-- Logs begin at Wed 2022-11-02 10:58:01 UTC, end at Wed 2022-11-02 14:09:32 UTC. -- Nov 02 11:38:57.183595 n-d-855649-4 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 11:38:57.193406 n-d-855649-4 devstack@n-api.service[111650]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 11:38:57 2022] *** Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: nodename: n-d-855649-4 Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: machine: x86_64 Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: clock source: unix Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: pcre jit disabled Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: detected number of CPU cores: 4 Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: current working directory: / Nov 02 11:38:57.194239 n-d-855649-4 devstack@n-api.service[111650]: detected binary path: /usr/bin/uwsgi-core Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: your processes number limit is 47680 Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: your memory page size is 4096 bytes Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: detected max file descriptor number: 2048 Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: lock engine: pthread robust mutexes Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: thunder lock: enabled Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 11:38:57.195780 n-d-855649-4 devstack@n-api.service[111650]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 11:38:57.235378 n-d-855649-4 devstack@n-api.service[111650]: Python main interpreter initialized at 0x559e090479c0 Nov 02 11:38:57.235378 n-d-855649-4 devstack@n-api.service[111650]: python threads support enabled Nov 02 11:38:57.235378 n-d-855649-4 devstack@n-api.service[111650]: your server socket listen backlog is limited to 100 connections Nov 02 11:38:57.235378 n-d-855649-4 devstack@n-api.service[111650]: your mercy for graceful operations on workers is 90 seconds Nov 02 11:38:57.235870 n-d-855649-4 devstack@n-api.service[111650]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 11:38:57.235870 n-d-855649-4 devstack@n-api.service[111650]: *** Operational MODE: preforking *** Nov 02 11:38:57.236138 n-d-855649-4 devstack@n-api.service[111650]: *** uWSGI is running in multiple interpreter mode *** Nov 02 11:38:57.236138 n-d-855649-4 devstack@n-api.service[111650]: spawned uWSGI master process (pid: 111650) Nov 02 11:38:57.236359 n-d-855649-4 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 11:38:57.238042 n-d-855649-4 devstack@n-api.service[111650]: spawned uWSGI worker 1 (pid: 111651, cores: 1) Nov 02 11:38:57.238042 n-d-855649-4 devstack@n-api.service[111650]: spawned uWSGI worker 2 (pid: 111652, cores: 1) Nov 02 11:38:57.238042 n-d-855649-4 devstack@n-api.service[111650]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 11:38:57.898965 n-d-855649-4 devstack@n-api.service[111652]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 11:38:57.918297 n-d-855649-4 devstack@n-api.service[111651]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 11:38:58.974920 n-d-855649-4 devstack@n-api.service[111652]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:38:58.974920 n-d-855649-4 devstack@n-api.service[111652]: from cryptography.utils import int_from_bytes Nov 02 11:38:58.975630 n-d-855649-4 devstack@n-api.service[111652]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:38:58.975630 n-d-855649-4 devstack@n-api.service[111652]: from cryptography.utils import int_from_bytes Nov 02 11:38:58.977995 n-d-855649-4 devstack@n-api.service[111651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:38:58.977995 n-d-855649-4 devstack@n-api.service[111651]: from cryptography.utils import int_from_bytes Nov 02 11:38:58.978678 n-d-855649-4 devstack@n-api.service[111651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:38:58.978678 n-d-855649-4 devstack@n-api.service[111651]: from cryptography.utils import int_from_bytes Nov 02 11:39:01.493151 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 11:39:01.493705 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 11:39:01.493941 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 11:39:01.494305 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 11:39:01.494563 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 11:39:01.495525 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.495854 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.496173 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.496494 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.496822 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.497134 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.497456 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.497773 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.498102 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.498361 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.498679 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.499026 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855649-4 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.499351 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.499660 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.499801 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 11:39:01.500160 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.500240 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 11:39:01.500332 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.500569 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.500688 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 11:39:01.500891 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.501005 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 11:39:01.501176 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 11:39:01.501286 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.501568 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.501681 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.501902 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502122 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502227 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502431 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502525 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502743 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.502896 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503088 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503253 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503410 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503556 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503717 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.503880 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504086 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504205 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504352 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504455 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504677 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504778 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.504993 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505087 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855649-4 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505391 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855649-4 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505476 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505898 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505991 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.505991 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506118 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506490 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506600 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506600 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.506930 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507060 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507268 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507376 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507637 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507777 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.507962 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508095 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508274 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508406 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508601 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508822 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.508921 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509175 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509267 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509497 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509581 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509813 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.509907 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510119 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510202 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510453 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510535 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510776 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.510890 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511100 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511200 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511406 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511504 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855649-4 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511657 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511806 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.511966 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512125 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512288 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512443 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512611 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512859 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.512943 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513173 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513266 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513426 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513511 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513747 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.513840 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514073 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514201 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514384 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514491 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514695 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.514800 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515026 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515125 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515340 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515437 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515651 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515757 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.515959 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516062 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516265 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516366 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516573 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516676 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516892 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.516987 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517196 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517290 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517505 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517601 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517759 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.517868 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518071 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518175 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518394 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518502 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518725 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.518867 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519064 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519152 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519319 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519419 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519573 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519717 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.519897 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520024 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520220 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520335 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520532 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520657 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520844 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.520966 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521157 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521275 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521470 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521582 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521784 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.521905 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522096 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522242 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522409 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522546 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522720 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.522812 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523068 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523156 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523392 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523476 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523713 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.523810 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524023 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524125 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524332 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524429 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524641 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524809 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.524949 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525036 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525256 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525343 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525565 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525665 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525873 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.525959 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526208 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526308 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526518 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526617 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526867 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.526958 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527208 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527295 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527519 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527619 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527829 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.527917 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528136 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528223 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528459 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528546 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528778 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.528867 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529042 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529130 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529348 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529435 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529660 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529756 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.529968 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530072 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530287 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530372 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530592 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530778 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.530901 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531127 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531232 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531438 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531523 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531751 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.531844 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532066 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532162 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532381 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532466 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532694 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.532779 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533008 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533107 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533317 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533408 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533625 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533716 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.533938 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534033 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534245 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534375 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534553 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534639 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534862 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.534956 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535192 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535286 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535499 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535585 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535805 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.535893 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536112 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536207 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536419 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536504 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536719 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.536806 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537037 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537133 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537347 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537431 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537655 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537740 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.537964 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538050 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538270 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538355 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538591 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538676 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.538910 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.539025 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.539251 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.539353 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.539575 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.539661 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.539882 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.539968 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.540196 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.540289 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.540518 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.540604 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.540829 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.540914 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.541140 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.541234 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.541449 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.541534 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.542290 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.542387 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.542601 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.542697 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.542912 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.543017 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.543249 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.543335 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.543561 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.543656 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.543865 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.544013 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.544187 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.544272 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.544503 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.544589 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.544813 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.544897 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.545124 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.545211 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.545433 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.545521 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.545748 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.545838 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:39:01.546078 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.546163 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.546402 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.546489 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.546715 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.546801 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547083 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547258 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547422 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547515 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547736 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.547823 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548063 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548150 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548378 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548464 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548690 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.548774 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549003 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549097 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549316 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549406 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549627 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549727 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.549943 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550043 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550308 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550400 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550581 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550677 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.550895 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551052 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551245 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551385 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551558 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551691 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.551870 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552011 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552181 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552317 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552491 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552629 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552786 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.552925 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553126 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553259 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553438 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553574 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553758 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.553895 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554076 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554208 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554390 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554523 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554707 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.554798 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555053 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555161 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555371 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555467 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555681 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555767 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.555984 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556069 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556289 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556392 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556593 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556679 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556904 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.556990 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.557206 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.557337 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558096 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558187 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558425 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558511 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558732 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.558836 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559072 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559161 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559393 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559533 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559705 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.559847 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560015 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560147 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560324 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560458 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560630 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560777 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.560942 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561254 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561410 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561560 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561705 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.561867 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562003 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562177 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562309 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562483 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562646 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562778 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.562911 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563113 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563247 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563422 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563559 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563728 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.563877 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564021 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564158 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564301 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564442 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564627 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564760 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.564934 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565073 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565251 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565393 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565569 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565718 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.565881 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566026 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566192 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566327 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566506 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566638 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566821 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.566967 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567169 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567310 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567499 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567636 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567818 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.567964 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568122 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568260 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568433 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568519 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568738 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.568826 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569043 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569127 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569344 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569473 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569654 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569756 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.569961 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570055 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570267 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570353 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570571 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570661 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570873 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.570958 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571201 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571290 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571513 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571609 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571823 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.571909 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572127 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572221 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572431 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572524 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572734 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.572826 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573107 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573257 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573414 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573575 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573755 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.573908 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574091 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574239 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574411 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574563 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574735 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.574874 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575076 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575215 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575403 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575527 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575714 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.575837 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576031 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576147 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576344 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576462 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576658 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576773 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.576981 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577077 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577296 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577384 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577619 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577704 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.577932 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578019 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578255 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578341 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578567 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578652 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578873 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.578958 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579208 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579294 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579520 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579614 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579860 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.579943 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580169 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580254 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580500 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580593 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580824 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.580910 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581138 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581232 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581456 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581550 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581768 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.581855 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582081 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582166 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582395 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582490 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582706 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.582790 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583041 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583129 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583362 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583460 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583685 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583771 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.583997 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584082 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584322 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584414 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584628 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584712 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.584950 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585035 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585257 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585344 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585578 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585662 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585887 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.585970 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586209 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586296 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586524 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586607 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586838 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.586922 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587195 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587283 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587510 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587604 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587823 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.587918 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588136 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588222 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588444 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588550 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588779 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.588878 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589093 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589180 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589412 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589497 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589728 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.589881 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590042 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590173 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590346 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590483 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590665 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.590812 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591023 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591161 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591297 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591433 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591590 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591728 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.591893 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592038 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592216 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592353 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592526 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592656 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592838 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.592971 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593161 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593297 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593464 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593618 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.593889 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594077 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594211 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594388 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594522 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594692 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.594824 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595014 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595163 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595327 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595458 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595641 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595773 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.595964 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596111 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596253 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596387 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596570 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596707 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.596877 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597021 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597187 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597317 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597498 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597640 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597804 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.597949 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598110 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598241 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598427 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598563 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598739 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.598882 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599077 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599177 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599392 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599478 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599702 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.599790 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600012 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600106 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600317 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600409 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600638 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600723 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.600948 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601040 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601254 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601339 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601565 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601650 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601868 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.601956 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.602179 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.602275 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.602498 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.602586 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.602808 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.603359 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.603457 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.603698 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.603787 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.604016 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.604102 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.604867 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.604959 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605196 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605334 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605552 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605702 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605849 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.605986 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606118 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606259 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606423 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606566 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606740 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.606874 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607079 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607244 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607406 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607515 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607681 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607768 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.607992 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608088 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608298 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608394 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608604 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608690 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608910 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.608997 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609215 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609302 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609518 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609602 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609820 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.609946 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.610124 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.610428 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.610511 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.610743 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.610838 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611074 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611167 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611389 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611474 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611695 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.611819 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612020 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612147 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612333 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612484 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612639 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612820 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.612946 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613141 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613251 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613454 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613596 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613770 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.613903 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614370 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614506 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614643 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614798 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.614938 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615090 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615246 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615381 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615521 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615689 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.615823 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616004 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616137 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616312 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616444 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616622 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616764 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.616931 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617111 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617241 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617386 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617530 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617668 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617838 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.617985 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618150 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618288 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618455 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618609 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618756 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.618899 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619099 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619243 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619381 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619523 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619661 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.619847 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.620588 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.620738 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.620907 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621045 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621200 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621346 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621507 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621648 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621822 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.621974 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622132 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622273 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622439 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622577 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622753 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.622890 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623079 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623226 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623400 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623534 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623705 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.623837 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624010 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624143 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624314 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624447 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624626 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624760 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.624936 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625091 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625229 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625374 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625550 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625686 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.625866 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626022 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626155 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626287 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626462 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626602 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626770 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.626912 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627105 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627254 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627393 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627529 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627686 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.627833 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628009 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628142 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628325 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628463 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628628 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628761 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.628937 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629077 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629239 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629374 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629547 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629694 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629851 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.629988 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630160 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630305 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630521 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630655 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630792 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.630934 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631098 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631240 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631386 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631522 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631659 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631795 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.631952 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632098 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632262 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632349 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632567 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632664 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632872 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.632973 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633175 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633261 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633510 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633595 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633814 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.633907 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634118 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634210 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634434 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634520 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634763 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.634859 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635107 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635198 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635441 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635543 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635756 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.635850 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636063 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636148 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636372 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636459 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636680 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636768 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.636990 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637082 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637294 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637378 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637596 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637683 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637901 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.637986 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638207 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638292 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638513 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638600 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638823 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.638964 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639168 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639253 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639479 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639567 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639795 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.639882 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640097 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640196 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640409 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640495 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640722 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.640809 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641031 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641158 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641341 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641471 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641655 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641823 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.641963 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642104 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642277 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642418 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642591 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642733 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.642903 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643076 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643240 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643389 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643549 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643710 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.643860 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644027 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644170 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644345 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644475 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644653 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644798 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.644959 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645106 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645286 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645409 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645603 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645709 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.645919 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646006 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646246 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646333 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646575 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646672 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.646904 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647035 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647239 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647351 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647554 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647661 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647871 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.647964 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648184 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648277 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648497 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648584 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648813 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.648899 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649127 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649217 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649443 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649531 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649764 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.649859 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650168 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650396 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650484 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650708 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.650793 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.651564 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.651676 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.651876 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.651968 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652181 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652329 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652506 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652601 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652811 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.652905 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653116 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653202 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653419 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653513 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653722 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.653807 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654036 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654119 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654340 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654434 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654759 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.654845 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655102 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655208 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655411 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655504 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655722 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.655819 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656040 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656134 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656354 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656450 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656676 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656771 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.656999 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657086 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657310 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657398 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657650 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657735 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.657968 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658054 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658281 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658372 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658607 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658693 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.658932 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659072 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659266 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659353 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659580 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659665 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.659888 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660052 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660202 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660298 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660515 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660610 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660822 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.660917 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661141 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661235 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661449 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661542 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661775 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.661866 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662160 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662259 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662484 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662573 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662792 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.662877 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663125 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663308 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663434 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663625 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663748 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.663940 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664036 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664270 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664367 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664599 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664685 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.664927 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665020 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665235 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665320 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665546 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665630 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665858 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.665964 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.666163 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.666250 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.666473 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.666559 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.667355 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.667465 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.667667 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.667752 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.667974 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668059 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668298 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668385 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668621 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668707 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.668937 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669022 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669240 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669333 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669564 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669650 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669873 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.669980 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670179 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670302 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670484 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670628 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670787 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.670957 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671158 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671290 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671449 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671599 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671772 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.671915 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672103 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672224 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672432 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672520 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672743 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.672843 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673079 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673166 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673401 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673487 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673723 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.673818 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674036 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674122 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674341 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674426 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674650 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674750 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.674956 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675064 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675280 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675368 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675592 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675680 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675897 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.675983 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676204 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676290 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676516 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676605 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676825 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.676912 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677130 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677216 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677434 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677522 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677737 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.677824 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678044 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678128 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678353 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678440 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678673 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678758 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.678997 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679099 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679306 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679393 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679612 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679697 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.679915 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680010 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680261 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680347 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680567 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680653 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680896 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.680992 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681206 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681303 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681518 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681605 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681833 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.681926 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682149 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682254 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682493 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682580 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682811 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.682898 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683150 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683239 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683460 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683545 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683773 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.683861 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684081 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684167 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684498 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684597 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684687 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684768 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.684993 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685080 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685300 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685521 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685619 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685852 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.685982 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686170 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686257 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686489 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686577 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686801 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.686888 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687140 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687231 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687447 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687534 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687756 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.687854 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688068 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688171 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688378 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688474 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688687 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.688774 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689016 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689110 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689334 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689420 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689657 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689750 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.689978 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690074 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690304 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690391 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690619 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690711 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.690942 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691081 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691276 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691367 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691587 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691673 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691906 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.691995 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.692225 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.692311 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.692539 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.692665 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.692857 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693064 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693172 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693399 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693494 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693716 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.693812 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694030 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694131 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694347 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694434 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694663 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.694968 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695084 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695302 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695391 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695615 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695702 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.695925 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696010 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696236 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696332 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696566 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696711 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696882 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.696968 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697195 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697291 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697508 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697595 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697824 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.697929 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.698168 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.698366 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.698488 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.698684 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.698808 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699044 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699195 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699371 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699504 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699697 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.699812 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700012 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700175 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700329 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700441 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700655 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700762 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.700961 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701079 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701266 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701393 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701577 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701706 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.701885 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702024 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702191 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702338 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702509 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702651 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702818 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.702949 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703147 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703308 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703468 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703626 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703779 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.703954 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.704294 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.704381 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.704617 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.704704 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.704933 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705022 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705251 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705344 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705574 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705667 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.705903 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706094 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706226 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706419 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706543 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706755 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.706848 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707109 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707201 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707439 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707525 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707750 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.707836 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708055 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708149 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708361 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708461 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708674 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.708760 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.709602 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.709709 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.709709 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.709859 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.709946 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710025 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710101 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710177 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710291 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710382 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710461 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710586 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710751 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.710901 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711076 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711271 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711400 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711596 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711731 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.711994 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712127 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712300 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712436 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712603 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712752 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.712916 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.713085 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.713219 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.713418 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714049 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714297 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714394 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714613 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714701 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.714944 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715068 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715283 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715371 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715596 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715685 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.715917 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716004 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716221 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716305 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716530 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716618 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716845 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.716951 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717152 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717247 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717465 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717559 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717774 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.717869 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718084 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718186 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718390 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718483 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718721 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.718816 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719062 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719284 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719373 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719623 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719708 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.719944 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720029 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720269 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720354 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720576 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720661 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720885 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.720971 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721188 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721275 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721493 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721578 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721798 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.721895 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722129 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722232 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722420 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722506 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722730 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.722830 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723068 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723221 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723368 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723517 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723663 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723809 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.723973 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724116 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724282 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724428 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724593 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724732 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.724902 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725037 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725210 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725366 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725511 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725647 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725810 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.725948 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726118 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726217 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726441 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726584 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726780 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.726943 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.727126 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.727393 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.727509 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.727700 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.727804 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728023 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728362 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728601 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728725 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728910 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.728995 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.729774 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.729874 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730086 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730181 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730404 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730497 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730733 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.730820 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.731072 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.731162 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.731380 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.731466 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.731695 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732012 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732132 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732328 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732414 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732643 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732730 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.732957 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733044 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733275 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733375 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733588 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733673 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733902 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.733989 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734214 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734299 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734523 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734622 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734836 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.734920 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735173 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735260 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735495 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735597 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735837 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.735928 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736158 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736250 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736470 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736562 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736778 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.736870 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737084 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737181 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737395 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737481 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737703 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.737787 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738013 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738100 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738322 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738422 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738632 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738734 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.738944 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739061 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739273 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739360 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739579 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739665 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.739886 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740190 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740302 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740499 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740599 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740805 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.740906 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741105 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741209 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741408 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741515 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741713 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.741875 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742008 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742131 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742317 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742450 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742613 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742778 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.742915 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743131 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743257 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743472 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743596 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743821 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.743921 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744121 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744210 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744453 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744539 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744785 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.744876 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745096 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745181 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745408 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745499 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745720 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.745833 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746039 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746131 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746347 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746462 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746654 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.746963 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747100 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747304 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747419 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747610 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747713 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.747921 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748007 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748229 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748325 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748540 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748624 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748848 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.748932 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749155 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749248 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749461 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749547 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749777 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.749918 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750196 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750393 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750493 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750700 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.750797 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751038 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751150 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751349 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751437 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751656 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.751963 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752065 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752286 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752375 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752573 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752660 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752894 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.752988 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753209 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753297 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753522 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753633 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753830 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.753917 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754140 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754302 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754461 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754560 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754770 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.754856 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755109 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755201 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755430 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755543 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755747 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.755836 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756060 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756153 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756395 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756532 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756709 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.756870 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757010 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757146 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757309 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757443 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757626 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757728 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.757945 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.758048 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.758258 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.758349 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.758665 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.758764 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759374 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759468 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759561 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759642 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759642 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759780 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.759857 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 11:39:01.760011 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.760179 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.760532 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.760848 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.761185 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.761502 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.761818 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.762133 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.762448 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.762767 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.763112 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.763429 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.763749 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.764072 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.764392 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.764725 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.765055 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.765371 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.765704 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.766038 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.766388 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.766705 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.767080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.767428 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.767732 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.768049 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.768359 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:39:01.768605 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 11:39:01.912517 n-d-855649-4 devstack@n-api.service[111652]: INFO dbcounter [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Registered counter for database nova_api Nov 02 11:39:01.920810 n-d-855649-4 devstack@n-api.service[111651]: INFO dbcounter [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Registered counter for database nova_api Nov 02 11:39:01.933752 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_db.sqlalchemy.engines [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:01.940554 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writer thread running {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:01.942886 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:01.950010 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:01.997741 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.context [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=111652) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 11:39:02.001629 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:02.002103 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:02.003738 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:02.004463 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:02.004907 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:02.006901 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:02.007800 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.context [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=111651) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 11:39:02.008932 n-d-855649-4 devstack@n-api.service[111652]: INFO dbcounter [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Registered counter for database nova_cell0 Nov 02 11:39:02.012316 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:02.012790 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:02.013658 n-d-855649-4 devstack@n-api.service[111652]: INFO dbcounter [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Registered counter for database nova_cell1 Nov 02 11:39:02.014519 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:02.015275 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:39:02.015725 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:39:02.017985 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_concurrency.lockutils [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:39:02.020002 n-d-855649-4 devstack@n-api.service[111651]: INFO dbcounter [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Registered counter for database nova_cell0 Nov 02 11:39:02.021350 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_db.sqlalchemy.engines [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.023719 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_db.sqlalchemy.engines [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.024304 n-d-855649-4 devstack@n-api.service[111651]: INFO dbcounter [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Registered counter for database nova_cell1 Nov 02 11:39:02.028466 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writer thread running {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.031378 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.031832 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writer thread running {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.033428 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.041152 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.041498 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.175905 n-d-855649-4 devstack@n-api.service[111652]: INFO dbcounter [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Registered counter for database nova_cell0 Nov 02 11:39:02.186151 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_db.sqlalchemy.engines [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.186434 n-d-855649-4 devstack@n-api.service[111651]: INFO dbcounter [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Registered counter for database nova_cell0 Nov 02 11:39:02.191272 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writer thread running {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.195600 n-d-855649-4 devstack@n-api.service[111651]: DEBUG oslo_db.sqlalchemy.engines [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:39:02.200741 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writer thread running {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:39:02.660526 n-d-855649-4 devstack@n-api.service[111652]: WARNING keystonemiddleware.auth_token [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:39:02.668004 n-d-855649-4 devstack@n-api.service[111652]: WARNING keystonemiddleware.auth_token [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:39:02.685705 n-d-855649-4 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:39:02.693073 n-d-855649-4 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:39:03.010164 n-d-855649-4 devstack@n-api.service[111652]: WARNING keystonemiddleware.auth_token [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:39:03.016164 n-d-855649-4 devstack@n-api.service[111652]: WARNING keystonemiddleware.auth_token [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:39:03.022234 n-d-855649-4 devstack@n-api.service[111652]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e090479c0 pid: 111652 (default app) Nov 02 11:39:03.024361 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:39:03.025565 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Nov 02 11:39:03.026002 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Wed Nov 2 11:39:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:39:03.036865 n-d-855649-4 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:39:03.043487 n-d-855649-4 devstack@n-api.service[111651]: WARNING keystonemiddleware.auth_token [None req-7285512a-d281-4d20-b0c0-3d3e7927aa85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:39:03.048799 n-d-855649-4 devstack@n-api.service[111651]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559e090479c0 pid: 111651 (default app) Nov 02 11:40:28.988148 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:28.989765 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Nov 02 11:40:28.990149 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:29.001905 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:29.002910 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell0:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:29.004082 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell1:SELECT=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:29.006297 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:29.871299 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-817272ec-012a-4f3f-b3ee-0413af8d110f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:29.904468 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-817272ec-012a-4f3f-b3ee-0413af8d110f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907598 Nov 02 11:40:29.905213 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 11:40:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:32.592491 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:32.593505 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-87d13aee-7a90-4998-a922-fe88a8618b56 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 02 11:40:32.594063 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:40:33.043240 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-df4dd880-26e6-4353-beb4-430a34947ec1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:33.307218 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-df4dd880-26e6-4353-beb4-430a34947ec1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.706587 Nov 02 11:40:33.307784 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:40:33.322398 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_api:SELECT=3 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:33.323310 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_cell0:SELECT=3 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:33.324921 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_cell1:SELECT=3 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:33.325868 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:40:33.531858 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-6bbcdd4b-52a1-4dde-bddd-38086cac3bdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:33.685741 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-6bbcdd4b-52a1-4dde-bddd-38086cac3bdf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.368546 Nov 02 11:40:33.686326 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Wed Nov 2 11:40:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:36.366061 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-df4dd880-26e6-4353-beb4-430a34947ec1 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:36.367274 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-df4dd880-26e6-4353-beb4-430a34947ec1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Nov 02 11:40:36.368797 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:37.181252 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-a100b103-5c8b-4174-9823-2a7d9bb21c82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:37.338765 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-a100b103-5c8b-4174-9823-2a7d9bb21c82 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.962032 Nov 02 11:40:37.351836 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-dc8a270f-d7bf-4b54-a26c-3c0d7ea72820 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:37.357353 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:40:37.482486 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-dc8a270f-d7bf-4b54-a26c-3c0d7ea72820 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134296 Nov 02 11:40:37.503884 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Wed Nov 2 11:40:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:40:40.542845 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-a100b103-5c8b-4174-9823-2a7d9bb21c82 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:40.544846 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-a100b103-5c8b-4174-9823-2a7d9bb21c82 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003158 Nov 02 11:40:40.551799 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:40.986913 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-8d7798ea-84a9-48ce-a809-f046e9bd50f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:41.066333 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-8d7798ea-84a9-48ce-a809-f046e9bd50f4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512977 Nov 02 11:40:41.074017 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:40:41.079716 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-8ccab4aa-1846-493a-92db-17a18cdede61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:41.172220 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-8ccab4aa-1846-493a-92db-17a18cdede61 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095907 Nov 02 11:40:41.183544 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Wed Nov 2 11:40:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:43.878860 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-8d7798ea-84a9-48ce-a809-f046e9bd50f4 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:43.880514 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-8d7798ea-84a9-48ce-a809-f046e9bd50f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Nov 02 11:40:43.881126 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:44.406348 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-f749bda4-8985-4234-a888-f5b2237b4564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "ram": 2048, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:44.491209 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-f749bda4-8985-4234-a888-f5b2237b4564 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.594351 Nov 02 11:40:44.491209 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:40:44.502363 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-497a6659-a63b-42bb-9190-a80b2c7042fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:44.588315 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-497a6659-a63b-42bb-9190-a80b2c7042fe admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089615 Nov 02 11:40:44.591303 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Wed Nov 2 11:40:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:40:47.466156 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-f749bda4-8985-4234-a888-f5b2237b4564 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:47.467218 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-f749bda4-8985-4234-a888-f5b2237b4564 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 02 11:40:47.467802 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:47.963968 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:48.044723 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.570548 Nov 02 11:40:48.059228 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-ae1b648f-be05-4880-b253-3dd250ecbb5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:48.063863 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:40:48.156901 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-ae1b648f-be05-4880-b253-3dd250ecbb5b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102229 Nov 02 11:40:48.168768 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Wed Nov 2 11:40:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:50.939080 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:50.940048 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 02 11:40:50.940464 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:51.463026 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-9d9ff7c1-fe16-4e6d-8b44-9fab2a66f7b9 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:51.491929 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-9d9ff7c1-fe16-4e6d-8b44-9fab2a66f7b9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.545051 Nov 02 11:40:51.492497 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 11:40:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:40:54.675800 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:54.676922 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2120a9ff-bb82-48a9-a74e-ec40934f9488 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Nov 02 11:40:54.677344 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:55.203242 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-240159aa-bca3-4d52-af35-dedb9449d8cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "ram": 512, "vcpus": 1, "name": "m1.tiny"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:55.329281 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-240159aa-bca3-4d52-af35-dedb9449d8cc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.645206 Nov 02 11:40:55.330106 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:40:55.344564 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-a096fc64-0b22-4370-ac6a-3e79da52d058 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:55.464865 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-a096fc64-0b22-4370-ac6a-3e79da52d058 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123745 Nov 02 11:40:55.465431 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Wed Nov 2 11:40:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:40:58.302961 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-240159aa-bca3-4d52-af35-dedb9449d8cc admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:40:58.304008 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-240159aa-bca3-4d52-af35-dedb9449d8cc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 02 11:40:58.304410 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:40:58.763898 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-9ac689a8-42b4-46a9-bdf1-9ae1b320c0cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:58.836946 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-9ac689a8-42b4-46a9-bdf1-9ae1b320c0cf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525779 Nov 02 11:40:58.837629 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:40:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:40:58.849668 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-34d5db86-9f8f-4024-bf0b-9f25d27daa38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:40:58.933604 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-34d5db86-9f8f-4024-bf0b-9f25d27daa38 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087023 Nov 02 11:40:58.934365 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Wed Nov 2 11:40:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:01.693632 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-9ac689a8-42b4-46a9-bdf1-9ae1b320c0cf admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:01.694682 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-9ac689a8-42b4-46a9-bdf1-9ae1b320c0cf admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Nov 02 11:41:01.695121 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:41:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:02.060035 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-35558220-bc31-4b75-a96c-b767b1bae57b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium", "id": "3", "ram": 4096}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:02.400665 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-35558220-bc31-4b75-a96c-b767b1bae57b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.698825 Nov 02 11:41:02.401284 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:41:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:41:02.413699 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-4476674a-517d-4187-a9c4-229ea748b73e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:02.418465 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:02.555086 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-4476674a-517d-4187-a9c4-229ea748b73e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145066 Nov 02 11:41:02.555681 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Wed Nov 2 11:41:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:05.251002 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-35558220-bc31-4b75-a96c-b767b1bae57b admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:05.252240 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-35558220-bc31-4b75-a96c-b767b1bae57b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 02 11:41:05.252830 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:05.717966 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-3a1bd60d-fc1d-4505-9cb3-ee18425271f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "vcpus": 4, "name": "m1.large", "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:05.798628 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-3a1bd60d-fc1d-4505-9cb3-ee18425271f8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539402 Nov 02 11:41:05.799546 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:41:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:05.812041 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-e18af348-1272-4ab2-9c23-3b2a74efe568 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:05.824765 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:05.906779 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-e18af348-1272-4ab2-9c23-3b2a74efe568 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098982 Nov 02 11:41:05.907814 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Wed Nov 2 11:41:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:08.548278 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-3a1bd60d-fc1d-4505-9cb3-ee18425271f8 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:08.550056 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-3a1bd60d-fc1d-4505-9cb3-ee18425271f8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002325 Nov 02 11:41:08.550492 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:09.005030 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "swap": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:09.095119 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.538148 Nov 02 11:41:09.095895 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Wed Nov 2 11:41:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:09.108535 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-3398af55-1a8b-4f15-8d6b-6d6d30df04e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:09.209806 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-3398af55-1a8b-4f15-8d6b-6d6d30df04e1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105419 Nov 02 11:41:09.210421 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Wed Nov 2 11:41:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:41:30.765173 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:30.766188 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 02 11:41:30.766590 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:30.777637 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:31.161678 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-228892d3-62cd-4e15-8f27-d5f64ad1232f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:31.180041 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-228892d3-62cd-4e15-8f27-d5f64ad1232f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406999 Nov 02 11:41:31.180601 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 11:41:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:41:32.488670 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:32.489783 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-96885ef4-af06-4652-adde-444fcd9b2f54 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Nov 02 11:41:32.490180 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:33.023389 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e6a774fc-9765-4b81-971c-8d6b11f74d54 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:33.029638 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-e6a774fc-9765-4b81-971c-8d6b11f74d54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e6a774fc-9765-4b81-971c-8d6b11f74d54 admin admin] Request method failure captured: Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Accept: application/json Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Connection: keep-alive Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Content-Length: 0 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Host: 10.222.0.48 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: Openstack-System-Scope: None Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: User-Agent: python-novaclient Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjYlds56gX2TaZUpPRztXCuSPl99eYICn8PRG0uI3lLtfZQRrq2kz2IKl66dPx14gKoLpelh5teMm7U-Do4s0NrUSsINHk8225UAS5zZb3rtnctqTgBglIImu_XK57TOtZDXP0i30H_qkfxh91N6R2ml-pcg8Tu4nkTYexubDFvJluo1k Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Id: None Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Name: None Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Is-Admin-Project: True Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Id: default Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Name: admin Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Role: reader,member,admin Nov 02 11:41:33.032910 n-d-855649-4 devstack@n-api.service[111651]: X-Roles: reader,member,admin Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant: admin Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Name: admin Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-User: admin Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Id: default Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Name: Default Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: X-User-Name: admin Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: method: > Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: exception: Flavor 42 could not be found. Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: action_args: {'id': '42'} Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:33.034405 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:33.036368 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.037579 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-e6a774fc-9765-4b81-971c-8d6b11f74d54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:33.038601 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-e6a774fc-9765-4b81-971c-8d6b11f74d54 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.401764 Nov 02 11:41:33.038601 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Nov 2 11:41:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:41:33.044209 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-f861d9df-829b-4300-8117-aabee74911ba admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:33.048520 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:41:33.079092 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-f861d9df-829b-4300-8117-aabee74911ba admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.038103 Nov 02 11:41:33.080170 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:33.098757 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-0a2efe72-bd72-4739-b785-38e315eb87fb admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:33.130222 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-0a2efe72-bd72-4739-b785-38e315eb87fb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.039451 Nov 02 11:41:33.130794 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:33.141761 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-0f61be71-8d0b-4464-ac2d-dbaaaf0043fe admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:33.147330 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.wsgi [None req-0f61be71-8d0b-4464-ac2d-dbaaaf0043fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-0f61be71-8d0b-4464-ac2d-dbaaaf0043fe admin admin] Request method failure captured: Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Accept: application/json Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Accept-Encoding: gzip, deflate Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Connection: keep-alive Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Content-Length: 0 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Host: 10.222.0.48 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: Openstack-System-Scope: None Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: User-Agent: python-novaclient Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Auth-Token: gAAAAABjYlds56gX2TaZUpPRztXCuSPl99eYICn8PRG0uI3lLtfZQRrq2kz2IKl66dPx14gKoLpelh5teMm7U-Do4s0NrUSsINHk8225UAS5zZb3rtnctqTgBglIImu_XK57TOtZDXP0i30H_qkfxh91N6R2ml-pcg8Tu4nkTYexubDFvJluo1k Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Id: None Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Name: None Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Identity-Status: Confirmed Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Is-Admin-Project: True Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Id: default Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Name: Default Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Name: admin Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Role: reader,member,admin Nov 02 11:41:33.150659 n-d-855649-4 devstack@n-api.service[111652]: X-Roles: reader,member,admin Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant: admin Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Name: admin Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-User: admin Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Id: default Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Name: Default Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: X-User-Name: admin Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: method: > Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: exception: Flavor 42 could not be found. Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: action_args: {'id': '42'} Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:33.152191 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:33.153166 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:33.154567 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-0f61be71-8d0b-4464-ac2d-dbaaaf0043fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:33.155861 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-0f61be71-8d0b-4464-ac2d-dbaaaf0043fe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015574 Nov 02 11:41:33.155861 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Nov 2 11:41:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:41:34.371286 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-0a2efe72-bd72-4739-b785-38e315eb87fb admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.372328 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-0a2efe72-bd72-4739-b785-38e315eb87fb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 02 11:41:34.372732 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:34.916401 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-6d540447-dc29-46f9-9eb5-6e3b1f34ab61 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.921951 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.wsgi [None req-6d540447-dc29-46f9-9eb5-6e3b1f34ab61 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-6d540447-dc29-46f9-9eb5-6e3b1f34ab61 admin admin] Request method failure captured: Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Accept: application/json Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Accept-Encoding: gzip, deflate Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Connection: keep-alive Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Content-Length: 0 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Host: 10.222.0.48 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: Openstack-System-Scope: None Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: User-Agent: python-novaclient Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Auth-Token: gAAAAABjYldu-vdegqn-Ei_Uw3w9LD1WVLFWLdYjGIHukAv6WAwcC5DAqJbD-OIQKkyaSUa4XBV8Vqr7d6bc15YhXD4wNEgpc7Ha1_HIFb_gdQKh1lY7uhjqyaglPB0cbkioj8Bm9PdybSEMASzPfitBKf8khZvARRNP04qW2LsMqGtJBLW45z0 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Id: None Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Name: None Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Identity-Status: Confirmed Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Is-Admin-Project: True Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Id: default Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Name: Default Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Name: admin Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Role: reader,member,admin Nov 02 11:41:34.923487 n-d-855649-4 devstack@n-api.service[111652]: X-Roles: reader,member,admin Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant: admin Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Name: admin Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-User: admin Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Id: default Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Name: Default Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: X-User-Name: admin Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: method: > Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: exception: Flavor 84 could not be found. Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: action_args: {'id': '84'} Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:34.924862 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:34.926719 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.927823 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-6d540447-dc29-46f9-9eb5-6e3b1f34ab61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:34.928800 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-6d540447-dc29-46f9-9eb5-6e3b1f34ab61 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.411917 Nov 02 11:41:34.928800 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 11:41:34.934550 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-481d8a58-5ce9-4783-af53-551db71ce62d admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.949528 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-481d8a58-5ce9-4783-af53-551db71ce62d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018546 Nov 02 11:41:34.950128 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:34.960108 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-5ca9c757-3b79-4347-830a-498363544612 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.976543 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-5ca9c757-3b79-4347-830a-498363544612 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020089 Nov 02 11:41:34.977386 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:34.987683 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-c8f9d2cb-7808-4324-8e6d-e45405f7a23b admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:34.992744 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-c8f9d2cb-7808-4324-8e6d-e45405f7a23b admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-c8f9d2cb-7808-4324-8e6d-e45405f7a23b admin admin] Request method failure captured: Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Accept: application/json Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Connection: keep-alive Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Content-Length: 0 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Host: 10.222.0.48 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: Openstack-System-Scope: None Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: User-Agent: python-novaclient Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjYldu-vdegqn-Ei_Uw3w9LD1WVLFWLdYjGIHukAv6WAwcC5DAqJbD-OIQKkyaSUa4XBV8Vqr7d6bc15YhXD4wNEgpc7Ha1_HIFb_gdQKh1lY7uhjqyaglPB0cbkioj8Bm9PdybSEMASzPfitBKf8khZvARRNP04qW2LsMqGtJBLW45z0 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Id: None Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Name: None Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Is-Admin-Project: True Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Id: default Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Name: admin Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Role: reader,member,admin Nov 02 11:41:34.994239 n-d-855649-4 devstack@n-api.service[111651]: X-Roles: reader,member,admin Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant: admin Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Name: admin Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-User: admin Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Id: default Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Name: Default Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: X-User-Name: admin Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: method: > Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: exception: Flavor 84 could not be found. Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: action_args: {'id': '84'} Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:34.995743 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:34.996693 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:34.997947 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-c8f9d2cb-7808-4324-8e6d-e45405f7a23b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:34.999281 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-c8f9d2cb-7808-4324-8e6d-e45405f7a23b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011628 Nov 02 11:41:34.999281 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Wed Nov 2 11:41:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:41:36.203421 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-5ca9c757-3b79-4347-830a-498363544612 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:36.204431 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-5ca9c757-3b79-4347-830a-498363544612 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 02 11:41:36.204826 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:36.730868 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-a7ad289e-28ab-4878-890e-fbb147fa5067 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:36.736869 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.wsgi [None req-a7ad289e-28ab-4878-890e-fbb147fa5067 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-a7ad289e-28ab-4878-890e-fbb147fa5067 admin admin] Request method failure captured: Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Accept: application/json Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Accept-Encoding: gzip, deflate Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Connection: keep-alive Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Content-Length: 0 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Host: 10.222.0.48 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: Openstack-System-Scope: None Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: User-Agent: python-novaclient Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Auth-Token: gAAAAABjYldwmbqOGxIEIlr2wyL7k4SC0Qio1tFy2ZK_KSneCzvrx2QS6ylAehY7jiCGQj7crs8EPwAkeYiqj3yXJg5TtK3v2_kB6pVKC0MMGwHALO-CeP3DMMjvPQwwgGcHQXkYoiLMhR8NqzbdQkzhs_zde1Zl5epQ6ofy-WnZ6wjoN3B68yw Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Id: None Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Domain-Name: None Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Identity-Status: Confirmed Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Is-Admin-Project: True Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Id: default Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Domain-Name: Default Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Project-Name: admin Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Role: reader,member,admin Nov 02 11:41:36.738436 n-d-855649-4 devstack@n-api.service[111651]: X-Roles: reader,member,admin Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant: admin Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-Tenant-Name: admin Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-User: admin Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Id: default Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-User-Domain-Name: Default Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: X-User-Name: admin Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: method: > Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: exception: Flavor 451 could not be found. Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: action_args: {'id': '451'} Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:36.740246 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:36.741135 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.742187 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-a7ad289e-28ab-4878-890e-fbb147fa5067 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:36.743233 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-a7ad289e-28ab-4878-890e-fbb147fa5067 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399014 Nov 02 11:41:36.743233 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:41:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:41:36.750152 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-3b7a5ee0-0ce0-48de-90dc-12b5534c1afc admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:36.765141 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-3b7a5ee0-0ce0-48de-90dc-12b5534c1afc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018526 Nov 02 11:41:36.765692 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:36.775680 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:36.790717 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018698 Nov 02 11:41:36.791831 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Wed Nov 2 11:41:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:41:36.801388 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-e8b99046-3838-4e09-8a96-653b5db2d554 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:36.806446 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.wsgi [None req-e8b99046-3838-4e09-8a96-653b5db2d554 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-e8b99046-3838-4e09-8a96-653b5db2d554 admin admin] Request method failure captured: Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Accept: application/json Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Accept-Encoding: gzip, deflate Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Connection: keep-alive Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Content-Length: 0 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Host: 10.222.0.48 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Openstack-Api-Version: compute 2.92 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: Openstack-System-Scope: None Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: User-Agent: python-novaclient Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Auth-Token: gAAAAABjYldwmbqOGxIEIlr2wyL7k4SC0Qio1tFy2ZK_KSneCzvrx2QS6ylAehY7jiCGQj7crs8EPwAkeYiqj3yXJg5TtK3v2_kB6pVKC0MMGwHALO-CeP3DMMjvPQwwgGcHQXkYoiLMhR8NqzbdQkzhs_zde1Zl5epQ6ofy-WnZ6wjoN3B68yw Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Id: None Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Domain-Name: None Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Identity-Status: Confirmed Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Is-Admin-Project: True Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Id: default Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Domain-Name: Default Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Project-Name: admin Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Role: reader,member,admin Nov 02 11:41:36.808609 n-d-855649-4 devstack@n-api.service[111652]: X-Roles: reader,member,admin Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4336a731744541749b41de2fe9211968", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4336a731744541749b41de2fe9211968"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4336a731744541749b41de2fe9211968"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant: admin Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Id: 4336a731744541749b41de2fe9211968 Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-Tenant-Name: admin Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-User: admin Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Id: default Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-User-Domain-Name: Default Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-User-Id: bb5174fdea1e4c9d91030428c5bf57a5 Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: X-User-Name: admin Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: method: > Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: exception: Flavor 451 could not be found. Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: action_args: {'id': '451'} Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:41:36.810211 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:36.811260 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: ERROR nova.api.openstack.wsgi Nov 02 11:41:36.812592 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-e8b99046-3838-4e09-8a96-653b5db2d554 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:41:36.813801 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-e8b99046-3838-4e09-8a96-653b5db2d554 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012279 Nov 02 11:41:36.813801 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:41:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 11:41:38.015451 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:38.016464 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Nov 02 11:41:38.016856 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:38.562849 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-3e8c0374-1165-4327-95d1-61627a0443c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:38.686454 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-3e8c0374-1165-4327-95d1-61627a0443c3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.528911 Nov 02 11:41:38.686928 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Nov 2 11:41:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:39.938569 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:39.939604 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 02 11:41:39.940003 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:40.468718 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-3d542c4d-b36c-4fb6-a5f2-0b923fd0bb5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:40.625575 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-3d542c4d-b36c-4fb6-a5f2-0b923fd0bb5c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.542499 Nov 02 11:41:40.632098 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Nov 2 11:41:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:41.843460 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:41.844508 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 02 11:41:41.844908 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:42.387989 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-c6b740ef-f00d-4705-89c8-1b56979f28ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:42.475657 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-c6b740ef-f00d-4705-89c8-1b56979f28ea admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.492839 Nov 02 11:41:42.476122 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Nov 2 11:41:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:43.682853 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:43.683900 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Nov 02 11:41:43.684306 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:44.213691 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-96549633-0523-42b2-bd4d-6590056d0bfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:41:44.310281 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-96549633-0523-42b2-bd4d-6590056d0bfa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.486676 Nov 02 11:41:44.310842 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Wed Nov 2 11:41:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:41:45.526691 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:45.527746 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 02 11:41:45.528143 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:41:46.051391 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-4d061e51-67b4-43ec-a54d-8d15c7686d90 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:41:46.073253 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-4d061e51-67b4-43ec-a54d-8d15c7686d90 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400348 Nov 02 11:41:46.073803 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Wed Nov 2 11:41:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:42:43.939676 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:43.940729 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-b6504b6a-f04c-4226-adff-05a4bbb06556 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Nov 02 11:42:43.941133 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Wed Nov 2 11:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:42:43.952070 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:42:44.338117 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-f12fc27c-6e7a-4c2d-9f91-b47d7f1ec9a4 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:44.360407 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-f12fc27c-6e7a-4c2d-9f91-b47d7f1ec9a4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413427 Nov 02 11:42:44.360937 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 11:42:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:42:44.383458 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=14 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:42:44.387270 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-8392f021-eea6-4fce-bf19-d5b3fe7eb526 admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:44.394535 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-8392f021-eea6-4fce-bf19-d5b3fe7eb526 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012513 Nov 02 11:42:44.397427 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Wed Nov 2 11:42:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:44.407116 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-e614048d-c49a-45b5-9c00-cdda267eedd6 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:44.414332 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-e614048d-c49a-45b5-9c00-cdda267eedd6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010798 Nov 02 11:42:44.414842 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Wed Nov 2 11:42:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:44.427108 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:44.435220 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011885 Nov 02 11:42:44.435823 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Wed Nov 2 11:42:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:42:44.447506 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-f8625016-43be-40cc-8511-f4116d4069bb admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:42:44.454641 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-f8625016-43be-40cc-8511-f4116d4069bb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010720 Nov 02 11:42:44.455676 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Wed Nov 2 11:42:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:48:34.320817 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:34.321859 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Nov 02 11:48:34.322255 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:48:34.463290 n-d-855649-4 devstack@n-api.service[111652]: DEBUG dbcounter [-] [111652] Writing DB stats nova_api:SELECT=6 {{(pid=111652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:48:34.606400 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:34.611504 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.611973 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.612393 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.613094 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:34.613535 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:34.613941 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:34.652669 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-46efa590-e63a-439b-9be2-d33b9a263d14 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.190545 Nov 02 11:48:34.653221 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:48:34 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:48:35.723277 n-d-855649-4 devstack@n-api.service[111651]: DEBUG nova.api.openstack.wsgi [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] Calling method '>' {{(pid=111651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:35.724280 n-d-855649-4 devstack@n-api.service[111651]: INFO nova.api.openstack.requestlog [None req-2c3bd73b-ac4e-42e0-854e-f0d04b48b22f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 02 11:48:35.724678 n-d-855649-4 devstack@n-api.service[111651]: [pid: 111651|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Wed Nov 2 11:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:48:35.914905 n-d-855649-4 devstack@n-api.service[111652]: DEBUG nova.api.openstack.wsgi [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Calling method '>' {{(pid=111652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:48:35.918489 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:35.918991 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:35.919421 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:35.920301 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:48:35.920744 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:48:35.921167 n-d-855649-4 devstack@n-api.service[111652]: DEBUG oslo_concurrency.lockutils [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:48:35.944361 n-d-855649-4 devstack@n-api.service[111652]: INFO nova.api.openstack.requestlog [None req-13737939-84d2-45c5-b454-ac5edceff82e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079750 Nov 02 11:48:35.944831 n-d-855649-4 devstack@n-api.service[111652]: [pid: 111652|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:48:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:49:22.717465 n-d-855649-4 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 11:49:22.718076 n-d-855649-4 devstack@n-api.service[111650]: Wed Nov 2 11:49:22 2022 - graceful shutdown triggered... Nov 02 11:49:22.718866 n-d-855649-4 devstack@n-api.service[111651]: Gracefully killing worker 1 (pid: 111651)... Nov 02 11:49:22.719379 n-d-855649-4 devstack@n-api.service[111652]: Gracefully killing worker 2 (pid: 111652)... Nov 02 11:49:22.843337 n-d-855649-4 devstack@n-api.service[111651]: DEBUG dbcounter [-] [111651] Writing DB stats nova_api:SELECT=4 {{(pid=111651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:49:23.719091 n-d-855649-4 devstack@n-api.service[111650]: worker 1 buried after 1 seconds Nov 02 11:49:23.719626 n-d-855649-4 devstack@n-api.service[111650]: worker 2 buried after 1 seconds Nov 02 11:49:23.719626 n-d-855649-4 devstack@n-api.service[111650]: goodbye to uWSGI. Nov 02 11:49:23.720662 n-d-855649-4 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 11:49:23.721255 n-d-855649-4 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 11:49:23.723967 n-d-855649-4 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 11:49:23.742944 n-d-855649-4 devstack@n-api.service[127550]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 11:49:23 2022] *** Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: nodename: n-d-855649-4 Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: machine: x86_64 Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: clock source: unix Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: pcre jit disabled Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: detected number of CPU cores: 4 Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: current working directory: / Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: detected binary path: /usr/bin/uwsgi-core Nov 02 11:49:23.762351 n-d-855649-4 devstack@n-api.service[127550]: your processes number limit is 47680 Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: your memory page size is 4096 bytes Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: detected max file descriptor number: 2048 Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: lock engine: pthread robust mutexes Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: thunder lock: enabled Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 11:49:23.763255 n-d-855649-4 devstack@n-api.service[127550]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 11:49:23.803049 n-d-855649-4 devstack@n-api.service[127550]: Python main interpreter initialized at 0x55e026ed99c0 Nov 02 11:49:23.803049 n-d-855649-4 devstack@n-api.service[127550]: python threads support enabled Nov 02 11:49:23.803049 n-d-855649-4 devstack@n-api.service[127550]: your server socket listen backlog is limited to 100 connections Nov 02 11:49:23.803049 n-d-855649-4 devstack@n-api.service[127550]: your mercy for graceful operations on workers is 90 seconds Nov 02 11:49:23.803474 n-d-855649-4 devstack@n-api.service[127550]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 11:49:23.803474 n-d-855649-4 devstack@n-api.service[127550]: *** Operational MODE: preforking *** Nov 02 11:49:23.803746 n-d-855649-4 devstack@n-api.service[127550]: *** uWSGI is running in multiple interpreter mode *** Nov 02 11:49:23.803746 n-d-855649-4 devstack@n-api.service[127550]: spawned uWSGI master process (pid: 127550) Nov 02 11:49:23.803972 n-d-855649-4 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 11:49:23.804544 n-d-855649-4 devstack@n-api.service[127550]: spawned uWSGI worker 1 (pid: 127567, cores: 1) Nov 02 11:49:23.806816 n-d-855649-4 devstack@n-api.service[127550]: spawned uWSGI worker 2 (pid: 127568, cores: 1) Nov 02 11:49:23.806816 n-d-855649-4 devstack@n-api.service[127550]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 11:49:24.467975 n-d-855649-4 devstack@n-api.service[127567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 11:49:24.469264 n-d-855649-4 devstack@n-api.service[127568]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 11:49:25.715120 n-d-855649-4 devstack@n-api.service[127567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:49:25.715120 n-d-855649-4 devstack@n-api.service[127567]: from cryptography.utils import int_from_bytes Nov 02 11:49:25.715750 n-d-855649-4 devstack@n-api.service[127567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:49:25.715750 n-d-855649-4 devstack@n-api.service[127567]: from cryptography.utils import int_from_bytes Nov 02 11:49:25.728886 n-d-855649-4 devstack@n-api.service[127568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:49:25.728886 n-d-855649-4 devstack@n-api.service[127568]: from cryptography.utils import int_from_bytes Nov 02 11:49:25.729413 n-d-855649-4 devstack@n-api.service[127568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 11:49:25.729413 n-d-855649-4 devstack@n-api.service[127568]: from cryptography.utils import int_from_bytes Nov 02 11:49:28.165766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 11:49:28.166454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 11:49:28.166577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 11:49:28.166920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 11:49:28.167204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 11:49:28.167600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.167935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.168265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.168590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.168931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.169248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.169577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.169956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.170341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.170612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.170996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 11:49:28.171390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.171481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 11:49:28.171563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855649-4 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.171644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.171842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 11:49:28.171956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.172195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 11:49:28.172298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.172459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 11:49:28.172607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.172858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.173861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.174964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.175886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-855649-4 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.176869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.177813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855649-4 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.178765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.179853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.180839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.181830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.182763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-855649-4 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.183953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.184857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.185088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.185188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.185421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.185530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.185696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.186317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.186497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.186595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.186828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.186924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.187920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.188896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.189962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.190938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.191938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.192925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.193869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.194906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.195890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.196888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.197961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.198170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.198267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.198489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.198625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.198798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.199917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.200936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.201073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.201210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.201534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.202272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.202419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.202611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.202757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.202896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.203972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.204986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.205995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.206861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.207932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.208875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.209792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.210962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.211927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.212883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.212972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.213195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.213283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.213507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.213616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.213825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.213915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.214138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.214227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.214453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.214556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.214766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.214854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.215103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.215197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.215414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.215517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.215741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.215837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.216068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.216156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.216385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.216475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.216701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.216799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.217033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.217146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.217362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 11:49:28.217461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.217695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.217785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.218022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.218122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.218603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.218707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.218925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.219953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.220938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.221998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.222970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.223992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.224975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.225932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.226921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.227920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.228894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.229849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.230803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.231795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.232801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.233977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.234932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.235915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.236960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.237924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.238880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.239868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.240838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.241850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.242963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.243934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.244968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.245923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.246898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.247871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.248091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.248188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.248941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.249998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.250940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.251967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.252884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.253855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.254855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.255843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.256804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.257993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.258948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.259931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.260916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.261966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.262946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.263897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.264668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.264767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.264987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.265942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.266998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.267976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.268920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.269880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.270812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.271788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.272741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.273921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.274958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.275947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.276904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.277852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.278076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.278330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.278432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.278678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.278847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.279915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.280972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.281979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.282910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.283130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.283394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.283557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.283726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.283816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.284979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.285928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.286025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.286241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.286330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.286572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.286690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.290396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.290563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.290682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.290793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.290915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.291959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.292958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.293893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.294874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.295663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.295783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.295899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.296917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.297959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.298923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.299901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.300909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.301715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.302892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.303939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.304874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.305792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.306961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.307955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.308902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.309941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.310165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.310260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.310477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.310578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.310845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.311546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.311695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.311793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.312959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.313990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.314230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.314318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.314560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.314660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.314893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.315966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.316930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.317886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.318822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.319814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.320771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.321945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.322042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.322265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.322589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.322689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.322909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.323924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.324985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.325966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.326952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.327200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.327296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.327515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.327603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.327847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.328887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.329871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.330852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.331958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.332917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.333870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.334846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.335817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.336854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.337903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.338877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.339860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.340806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.341789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.342969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.343140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.343590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.343719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.343898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.344882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.345986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.346937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.347951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.348916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.349902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.350866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.351836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.352988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.353940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.354900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.355956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.356975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.357184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.357291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.357504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.357603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.358354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.358454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.358681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.358815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.359963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.360918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.361861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.362908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.363866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.364821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.365794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.366778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.367930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.368905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.369972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.370921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.371911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.372867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.373108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.373205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.373977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.374126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.374324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.374420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.374649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.374742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.375983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.376961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.377943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.378898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.379894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.380858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.381097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.381298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.381402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.381623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.381944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.382939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.383936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.384885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.385967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.386896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.387131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.387354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.387466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.387715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.387809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.388772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.389962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.390906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.391974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.392936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.393868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.394881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.395987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.396983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.397985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.398915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.399840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.400827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.401970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.402226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.402327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.402576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.402675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.402901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.403971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.404991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.405967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.406953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.407922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.408870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.409823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.410833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.411890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.412795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.413973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.414953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.415925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.416957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.417915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.418856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.419820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.420027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.420119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.420857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.420968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.421913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.422880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.423847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.424832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.425969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.426911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.427997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.428970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.429946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.430950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.431956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.432895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.433877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.434860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.435113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.435347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.435495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.435636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.435812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.436456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.436602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.436744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.436931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.437882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.438016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.438204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.438345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.438496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 11:49:28.438640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.438840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.439186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.439516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.439844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.440182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.440521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.440844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.441187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.441526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.441881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.442205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.442562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.442902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.443255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.443579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.443896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 11:49:28.444151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 11:49:28.502488 n-d-855649-4 devstack@n-api.service[127568]: INFO dbcounter [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Registered counter for database nova_api Nov 02 11:49:28.507894 n-d-855649-4 devstack@n-api.service[127567]: INFO dbcounter [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Registered counter for database nova_api Nov 02 11:49:28.522927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.527924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.530578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.535110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.587201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.context [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127568) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 11:49:28.591276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.context [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127567) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 11:49:28.591403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.591807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.594269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.595017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.595484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.596116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.596596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.597548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.598212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.598934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:49:28.599411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:49:28.599635 n-d-855649-4 devstack@n-api.service[127568]: INFO dbcounter [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Registered counter for database nova_cell0 Nov 02 11:49:28.601468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:49:28.603543 n-d-855649-4 devstack@n-api.service[127567]: INFO dbcounter [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Registered counter for database nova_cell0 Nov 02 11:49:28.603712 n-d-855649-4 devstack@n-api.service[127568]: INFO dbcounter [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Registered counter for database nova_cell1 Nov 02 11:49:28.607598 n-d-855649-4 devstack@n-api.service[127567]: INFO dbcounter [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Registered counter for database nova_cell1 Nov 02 11:49:28.610806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.612600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.615451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.617639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.618694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.620833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.622264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.625514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.768489 n-d-855649-4 devstack@n-api.service[127568]: INFO dbcounter [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Registered counter for database nova_cell0 Nov 02 11:49:28.772611 n-d-855649-4 devstack@n-api.service[127567]: INFO dbcounter [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Registered counter for database nova_cell0 Nov 02 11:49:28.775326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_db.sqlalchemy.engines [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.783034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 11:49:28.783220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writer thread running {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:28.787865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writer thread running {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 11:49:29.123067 n-d-855649-4 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:49:29.130493 n-d-855649-4 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:49:29.137563 n-d-855649-4 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:49:29.145523 n-d-855649-4 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:49:29.481248 n-d-855649-4 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:49:29.487886 n-d-855649-4 devstack@n-api.service[127567]: WARNING keystonemiddleware.auth_token [None req-b1a1d19f-bab2-4185-b28c-8d6b106e4f43 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:49:29.493216 n-d-855649-4 devstack@n-api.service[127567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e026ed99c0 pid: 127567 (default app) Nov 02 11:49:29.509767 n-d-855649-4 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 11:49:29.515809 n-d-855649-4 devstack@n-api.service[127568]: WARNING keystonemiddleware.auth_token [None req-27a09d8e-9c00-469c-8f83-19a1816f9d50 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 11:49:29.521104 n-d-855649-4 devstack@n-api.service[127568]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e026ed99c0 pid: 127568 (default app) Nov 02 11:50:14.503805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:14.504665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:14.505645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:14.506364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:15.773494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:15.774837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:15.775756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:15.777083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:15.922611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '.version_select at 0x7ff1b9264a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:15.929379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127567) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 11:50:15.930122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:15.930605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:15.931072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:15.956201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:15.956692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:15.957136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:15.971142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:15.971627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:15.972575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:15.978947 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b0fd7c7-f4b6-45b2-bec8-c577b74510fa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.484585 Nov 02 11:50:15.989915 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 11:50:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:16.319461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d69b847d-cf66-45ed-9a42-0b8e2222165a tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-897806041", "id": 1898676238, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:16.457310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d69b847d-cf66-45ed-9a42-0b8e2222165a tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.476219 Nov 02 11:50:16.458021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2/2] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:50:15 2022] POST /compute/v2.1/flavors => generated 448 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:16.631403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:16.636191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.636876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.637647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.639200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.642684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.642684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.686145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cc3b443-6c0b-44f7-b896-5ffa4a0d21d4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.226991 Nov 02 11:50:16.686747 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3/3] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:50:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:16.691378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb5e4487-91ca-4c32-a500-3abab6595560 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1772988770", "name": "tempest-test_aggregate-1091337507"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:16.714269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-fb5e4487-91ca-4c32-a500-3abab6595560 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid 077773ae-85e4-4a32-bbbc-8cc413024f3d for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:50:16.803475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:16.805216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.805750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.806093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.806874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:16.807312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:16.807737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:16.849257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41958fab-0f1f-4d29-a1bd-2e6aa4185dbd tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.084876 Nov 02 11:50:16.849833 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1/4] 10.222.0.48 () {58 vars in 1164 bytes} [Wed Nov 2 11:50:15 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 11:50:16.869437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb5e4487-91ca-4c32-a500-3abab6595560 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.181227 Nov 02 11:50:16.870058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4/5] 10.222.0.48 () {60 vars in 1165 bytes} [Wed Nov 2 11:50:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:17.098070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a44fa750-8237-4787-bdd2-d419abe529a8 tempest-AZAdminNegativeTestJSON-1850140405 tempest-AZAdminNegativeTestJSON-1850140405-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.099677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a44fa750-8237-4787-bdd2-d419abe529a8 tempest-AZAdminNegativeTestJSON-1850140405 tempest-AZAdminNegativeTestJSON-1850140405-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '84473de648434237a863eb8aa8d577a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd185a2f69ac04013b1296e136670f12d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a44fa750-8237-4787-bdd2-d419abe529a8 tempest-AZAdminNegativeTestJSON-1850140405 tempest-AZAdminNegativeTestJSON-1850140405-project] Request method failure captured: Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0bopHW7kufpMirXrAYBDN_a_yjxke_wqxAeis0R9hxgw-HTsfgENwd967IU7qopzro2INklpT-wDG-8jzGWplDvOclpoIQHrpnG2hPU2481hDx4hC7ClBrYKUMxKMWmPVfjWgeYbRv-ge8bp2cN76BrcjKAseorUeYnL6v2dPiZc Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d185a2f69ac04013b1296e136670f12d Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1850140405 Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:17.103213 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d185a2f69ac04013b1296e136670f12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d185a2f69ac04013b1296e136670f12d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d185a2f69ac04013b1296e136670f12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d185a2f69ac04013b1296e136670f12d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AZAdminNegativeTestJSON-1850140405 Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d185a2f69ac04013b1296e136670f12d Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1850140405 Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AZAdminNegativeTestJSON-1850140405-project Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 84473de648434237a863eb8aa8d577a6 Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AZAdminNegativeTestJSON-1850140405-project Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 11:50:17.104467 n-d-855649-4 devstack@n-api.service[127568]: action_args: {} Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:17.105169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:17.106230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a44fa750-8237-4787-bdd2-d419abe529a8 tempest-AZAdminNegativeTestJSON-1850140405 tempest-AZAdminNegativeTestJSON-1850140405-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:17.107775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a44fa750-8237-4787-bdd2-d419abe529a8 tempest-AZAdminNegativeTestJSON-1850140405 tempest-AZAdminNegativeTestJSON-1850140405-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.253913 Nov 02 11:50:17.107775 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2/6] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:50:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:17.123857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Calling method '.version_select at 0x7ff1b905ce50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.128002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.128593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.129144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.157823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.158417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.158907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.173070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.173558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.174151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.180930 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c91c39be-8b93-4818-acc2-1bbc199df53d tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.309734 Nov 02 11:50:17.181503 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 5/7] 10.222.0.48 () {60 vars in 1208 bytes} [Wed Nov 2 11:50:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:50:17.186681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.188425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.189083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.189522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.190302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.190700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.191164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.221434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30c6ee77-03cb-4774-87ad-5fec3446a0fa tempest-AZAdminV2TestJSON-722299077 tempest-AZAdminV2TestJSON-722299077-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.038767 Nov 02 11:50:17.222235 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 6/8] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:50:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:17.230614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83507376-4e7b-4b25-960c-593f6f9079ee tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.246958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83507376-4e7b-4b25-960c-593f6f9079ee tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.023318 Nov 02 11:50:17.248252 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 7/9] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:50:17 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:17.333649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b1c6104-6121-4649-903e-9fd4eebcb996 tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:17.358816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b1c6104-6121-4649-903e-9fd4eebcb996 tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] 10.222.0.48 "GET /compute/v2.1/flavors/1898676238" status: 200 len: 448 microversion: 2.55 time: 0.252439 Nov 02 11:50:17.359464 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3/10] 10.222.0.48 () {60 vars in 1199 bytes} [Wed Nov 2 11:50:17 2022] GET /compute/v2.1/flavors/1898676238 => generated 448 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:17.364067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81e294b0-d6e5-4d49-8a80-db4bd8e974aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:17.400233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e294b0-d6e5-4d49-8a80-db4bd8e974aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:17.400715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e294b0-d6e5-4d49-8a80-db4bd8e974aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:17.401153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81e294b0-d6e5-4d49-8a80-db4bd8e974aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:17.765283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70bdf74f-1dc8-4afa-b415-eb04e75e1a11 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-724615447", "id": 1733557093, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:17.851353 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70bdf74f-1dc8-4afa-b415-eb04e75e1a11 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.601891 Nov 02 11:50:17.852105 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 8/11] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:17 2022] POST /compute/v2.1/flavors => generated 438 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:17.864831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8632877c-7f02-4ff7-9a44-d115850eff53 tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b9629f70>, body: {"flavor": {"description": "new"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:17.971820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8632877c-7f02-4ff7-9a44-d115850eff53 tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1898676238" status: 200 len: 449 microversion: 2.55 time: 0.118239 Nov 02 11:50:17.981329 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 9/12] 10.222.0.48 () {62 vars in 1219 bytes} [Wed Nov 2 11:50:17 2022] PUT /compute/v2.1/flavors/1898676238 => generated 449 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:17.981329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-509c9a48-63c3-4f2e-a18f-bc0c4fc85b44 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:18.497626 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81e294b0-d6e5-4d49-8a80-db4bd8e974aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.136805 Nov 02 11:50:18.498534 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 4/13] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:18.504752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9be3ffa1-f55f-4b66-bb97-7c3a90e54d2a tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:18.543006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-509c9a48-63c3-4f2e-a18f-bc0c4fc85b44 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1733557093/action" status: 200 len: 97 microversion: 2.1 time: 0.569243 Nov 02 11:50:18.543673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 10/14] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:17 2022] POST /compute/v2.1/flavors/1733557093/action => generated 97 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:18.549188 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9be3ffa1-f55f-4b66-bb97-7c3a90e54d2a tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.048898 Nov 02 11:50:18.552070 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 5/15] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:18 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:50:18.559902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b2f832d-40cb-4160-8412-c28475d5812b tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:18.618427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d80b503-d1c1-4de4-a75d-fb7fab4449b4 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-78399546", "id": 1666878597, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:18.754002 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5b2f832d-40cb-4160-8412-c28475d5812b tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. Nov 02 11:50:18.761294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d80b503-d1c1-4de4-a75d-fb7fab4449b4 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.216352 Nov 02 11:50:18.761905 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 11/16] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:18 2022] POST /compute/v2.1/flavors => generated 429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:18.767133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2d5f337-43d8-4f4d-aaf8-7570c841d1a0 tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b2f832d-40cb-4160-8412-c28475d5812b tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Request method failure captured: Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/1733557093/action HTTP/1.1 Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 67 Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3yzJnWkPKffpa-1Z7N9UFl82R4WzOebn3z27MRoZGES_hp8nMIiMoqb_f260WoPH8ATxrEJvjtcnk0SuPORGQa1Xt2nmSdiDKqs6948DWm124mAOcKf50dERq5p92-uiJo1caU2HoKfyNHciF8ffeNosOVwwR69QhoR3EJsI8DFY Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:18.767525 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ccafb9e8da745358c7c8cecaaa7762f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8ac14e435a414ca59f409fefc55fa797 Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} Nov 02 11:50:18.772371 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1733557093', 'body': {'addTenantAccess': {'tenant': '75294689126b43d19fb1c48a15932f87'}}} Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:50:18.773068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-75294689126b43d19fb1c48a15932f87' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 11:50:18.774216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 11:50:18.775345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:50:18.776352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-75294689126b43d19fb1c48a15932f87' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 11, 50, 18, 683879), 'updated_at': None, 'flavor_id': 16, 'project_id': '75294689126b43d19fb1c48a15932f87'}] Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:18.777344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:18.778381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:18.780138 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:18.781235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. Nov 02 11:50:18.781235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:18.781235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b2f832d-40cb-4160-8412-c28475d5812b tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 75294689126b43d19fb1c48a15932f87 combination. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:18.781235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b2f832d-40cb-4160-8412-c28475d5812b tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1733557093/action" status: 409 len: 152 microversion: 2.1 time: 0.216167 Nov 02 11:50:18.781235 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 6/17] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:18 2022] POST /compute/v2.1/flavors/1733557093/action => generated 152 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:50:18.798162 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2d5f337-43d8-4f4d-aaf8-7570c841d1a0 tempest-FlavorsV255TestJSON-1831719513 tempest-FlavorsV255TestJSON-1831719513-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.035210 Nov 02 11:50:18.798741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 12/18] 10.222.0.48 () {60 vars in 1166 bytes} [Wed Nov 2 11:50:18 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:50:18.803127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-274d8c15-88d5-4423-9a72-9fdcaa9d886b tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3b94de403342492d814b0a3713b2eeae"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:19.151989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-482765252", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "availability_zone": "tempest-test_az-1772988770"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:19.181008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:19.181505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:19.183517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:19.183517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:19.183517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:19.183932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:19.757012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-274d8c15-88d5-4423-9a72-9fdcaa9d886b tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1666878597/action" status: 200 len: 97 microversion: 2.1 time: 0.957148 Nov 02 11:50:19.764376 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 13/19] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:18 2022] POST /compute/v2.1/flavors/1666878597/action => generated 97 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:19.769165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e4f5e8f-9945-4be7-88b1-eb905575d492 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:19.844288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:20.077056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e4f5e8f-9945-4be7-88b1-eb905575d492 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1733557093/action" status: 200 len: 21 microversion: 2.1 time: 0.311318 Nov 02 11:50:20.077685 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 14/20] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:19 2022] POST /compute/v2.1/flavors/1733557093/action => generated 21 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:20.082156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42597621-c07a-4a55-a3f6-8c7d3018152d tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.187407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:20.187834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:20.188304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:20.188742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:20.189168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:20.204365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:20.204886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:20.205323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:20.206120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:20.209583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:20.209583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:20.209778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42597621-c07a-4a55-a3f6-8c7d3018152d tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1898676238" status: 202 len: 0 microversion: 2.55 time: 0.130250 Nov 02 11:50:20.210528 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 15/21] 10.222.0.48 () {60 vars in 1202 bytes} [Wed Nov 2 11:50:20 2022] DELETE /compute/v2.1/flavors/1898676238 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:50:20.242180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Getting quotas for project d274e2d85d22423ab6bc2ec03916973f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:20.251717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Getting quotas for user ed579e0d4c704e9284d93f5f592c3ccb and project d274e2d85d22423ab6bc2ec03916973f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:20.266414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:50:20.269377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:50:20.464142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1cc1e1a-357f-488e-829a-b283db98832b tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.693113 Nov 02 11:50:20.477520 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 7/22] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:50:20.482323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-463f3ed2-3856-457a-8954-3bf86ff57811 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.489224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a953c86-f8de-45a3-966c-c7eb5958713d tempest-FlavorsAccessTestJSON-572613605 tempest-FlavorsAccessTestJSON-572613605-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.517381 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a953c86-f8de-45a3-966c-c7eb5958713d tempest-FlavorsAccessTestJSON-572613605 tempest-FlavorsAccessTestJSON-572613605-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.305350 Nov 02 11:50:20.590031 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 16/23] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:20 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:20.590031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d0772a7-bbcf-4408-97d0-771cd0336bf3 tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.590031 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d0772a7-bbcf-4408-97d0-771cd0336bf3 tempest-FlavorsV255TestJSON-1938972815 tempest-FlavorsV255TestJSON-1938972815-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.032238 Nov 02 11:50:20.590031 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 17/24] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:20 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:50:20.590031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ebbfdc-3c98-42d0-aab7-2389cea5c048 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:20.593727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03ebbfdc-3c98-42d0-aab7-2389cea5c048 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:20.681139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-463f3ed2-3856-457a-8954-3bf86ff57811 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1733557093" status: 202 len: 0 microversion: 2.1 time: 0.204180 Nov 02 11:50:20.682221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 8/25] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:20 2022] DELETE /compute/v2.1/flavors/1733557093 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:20.687412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fa32f06-44fc-42d9-8818-5932f4f72e11 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3b94de403342492d814b0a3713b2eeae"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:21.181154 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fa32f06-44fc-42d9-8818-5932f4f72e11 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1666878597/action" status: 200 len: 21 microversion: 2.1 time: 0.497758 Nov 02 11:50:21.190906 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 9/26] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:20 2022] POST /compute/v2.1/flavors/1666878597/action => generated 21 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:21.190906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae6755ed-5cc7-4cec-af98-e52b32a2de01 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.224209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae6755ed-5cc7-4cec-af98-e52b32a2de01 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038542 Nov 02 11:50:21.225212 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 10/27] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:21.239586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3963c2d3-c764-4410-b83a-2f3ed935570c tempest-FlavorsAccessTestJSON-572613605 tempest-FlavorsAccessTestJSON-572613605-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.256306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3963c2d3-c764-4410-b83a-2f3ed935570c tempest-FlavorsAccessTestJSON-572613605 tempest-FlavorsAccessTestJSON-572613605-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028140 Nov 02 11:50:21.272971 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 11/28] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:21.275827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03ebbfdc-3c98-42d0-aab7-2389cea5c048 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:21.276469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c44286f6-1cbf-4c67-a371-ab8c4e0693ca tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-422525973", "id": 1899057941, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:21.293179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03ebbfdc-3c98-42d0-aab7-2389cea5c048 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1242 microversion: 2.1 time: 0.740026 Nov 02 11:50:21.294544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 18/29] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:20 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1242 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:21.300460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bcdf5ec1-1291-46b7-95a4-a190db39989c tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.377970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c44286f6-1cbf-4c67-a371-ab8c4e0693ca tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.105897 Nov 02 11:50:21.377970 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 12/30] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:21 2022] POST /compute/v2.1/flavors => generated 437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:21.389454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19c77988-12a4-4300-a1f5-8169e1d59e55 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.398049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-19c77988-12a4-4300-a1f5-8169e1d59e55 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19c77988-12a4-4300-a1f5-8169e1d59e55 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Request method failure captured: Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/flavors/1899057941/os-flavor-access HTTP/1.1 Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3yzJnWkPKffpa-1Z7N9UFl82R4WzOebn3z27MRoZGES_hp8nMIiMoqb_f260WoPH8ATxrEJvjtcnk0SuPORGQa1Xt2nmSdiDKqs6948DWm124mAOcKf50dERq5p92-uiJo1caU2HoKfyNHciF8ffeNosOVwwR69QhoR3EJsI8DFY Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:21.399507 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ccafb9e8da745358c7c8cecaaa7762f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8ac14e435a414ca59f409fefc55fa797 Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: exception: Access list not available for public flavors. Nov 02 11:50:21.400652 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'flavor_id': '1899057941'} Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 11:50:21.401354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:21.402884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19c77988-12a4-4300-a1f5-8169e1d59e55 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:21.402884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19c77988-12a4-4300-a1f5-8169e1d59e55 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1899057941/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015237 Nov 02 11:50:21.403775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bcdf5ec1-1291-46b7-95a4-a190db39989c tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1666878597" status: 202 len: 0 microversion: 2.1 time: 0.107258 Nov 02 11:50:21.404925 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 19/31] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:21 2022] DELETE /compute/v2.1/flavors/1666878597 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:21.412489 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 13/32] 10.222.0.48 () {58 vars in 1209 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/1899057941/os-flavor-access => generated 91 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:50:21.416516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7fbbcc35-b427-46a9-8ed1-3d9ac3289802 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.422709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2de57ffd-b332-45c8-8416-4aaf24ff479c tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.454642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2de57ffd-b332-45c8-8416-4aaf24ff479c tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5418 microversion: 2.1 time: 0.042453 Nov 02 11:50:21.455306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 20/33] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/detail => generated 5418 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:21.478331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05041cb3-cdb0-4aef-adfb-59ea6e55ac44 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-710012898", "id": 1702605611, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:21.548789 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7fbbcc35-b427-46a9-8ed1-3d9ac3289802 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1899057941" status: 202 len: 0 microversion: 2.1 time: 0.136575 Nov 02 11:50:21.549637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 14/34] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:21 2022] DELETE /compute/v2.1/flavors/1899057941 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:21.556768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05041cb3-cdb0-4aef-adfb-59ea6e55ac44 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.081900 Nov 02 11:50:21.569280 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 21/35] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:21 2022] POST /compute/v2.1/flavors => generated 430 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:21.569643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25434414-052f-45b9-b294-3d11494ddbd1 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.581125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6fa45ec-9d9a-4259-8fb7-242271b2afc0 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.582673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25434414-052f-45b9-b294-3d11494ddbd1 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028042 Nov 02 11:50:21.583608 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 15/36] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:21.595857 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6fa45ec-9d9a-4259-8fb7-242271b2afc0 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1702605611/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018903 Nov 02 11:50:21.601691 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 22/37] 10.222.0.48 () {58 vars in 1209 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/1702605611/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:21.609718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37b6f2c4-443c-4235-a012-52570efbc111 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-80548596", "id": 1073093355, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:21.618737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fddd8f50-508a-4f20-b73e-68ee9778f986 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.634049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:21.742450 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37b6f2c4-443c-4235-a012-52570efbc111 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.136752 Nov 02 11:50:21.743007 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 23/38] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:21 2022] POST /compute/v2.1/flavors => generated 437 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:21.768120 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fddd8f50-508a-4f20-b73e-68ee9778f986 tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1702605611" status: 202 len: 0 microversion: 2.1 time: 0.163372 Nov 02 11:50:21.769739 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 16/39] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:21 2022] DELETE /compute/v2.1/flavors/1702605611 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:21.782058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac1436d7-96f8-4400-87dc-d4993857736f tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:21.826462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac1436d7-96f8-4400-87dc-d4993857736f tempest-FlavorsAccessTestJSON-38445725 tempest-FlavorsAccessTestJSON-38445725-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051049 Nov 02 11:50:21.826944 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 17/40] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:22.029405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a710e404-397b-4e5a-b891-ebc224af452e tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:22.032590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a710e404-397b-4e5a-b891-ebc224af452e tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c0e51eabcb5e4963810d2249fad70ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75294689126b43d19fb1c48a15932f87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a710e404-397b-4e5a-b891-ebc224af452e tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Request method failure captured: Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/flavors/1073093355/action HTTP/1.1 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 67 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll0CSEADurtDXK5mZGT2p7I-7oqZK3IlefNjrSSx_rqknU1Cbf1Qvam7APCR1wbf5sTjOy0Zzc287nZOb__T3uAzsTy--Vt9LnZLIVGxi_kTpZW3LlnOtIoGb7tQi2Iv8lfujxWSXa_s5Y6XYQmgSDkRn2m2YEnHiuiTCDyix3jO3c Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 75294689126b43d19fb1c48a15932f87 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:22.036242 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75294689126b43d19fb1c48a15932f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_75294689126b43d19fb1c48a15932f87", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/75294689126b43d19fb1c48a15932f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75294689126b43d19fb1c48a15932f87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 75294689126b43d19fb1c48a15932f87 Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsAccessNegativeTestJSON-2075824336-project Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c0e51eabcb5e4963810d2249fad70ec5 Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336-project Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} Nov 02 11:50:22.037589 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1073093355', 'body': {'addTenantAccess': {'tenant': '75294689126b43d19fb1c48a15932f87'}}} Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:22.038284 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 11:50:22.039351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:22.040511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a710e404-397b-4e5a-b891-ebc224af452e tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:22.040511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a710e404-397b-4e5a-b891-ebc224af452e tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] 10.222.0.48 "POST /compute/v2.1/flavors/1073093355/action" status: 403 len: 130 microversion: 2.1 time: 0.286295 Nov 02 11:50:22.040511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 24/41] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:21 2022] POST /compute/v2.1/flavors/1073093355/action => generated 130 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:50:22.046363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-542d7b82-087f-4f0b-bbd4-d83f7c7979e8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:22.156932 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-542d7b82-087f-4f0b-bbd4-d83f7c7979e8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1073093355" status: 202 len: 0 microversion: 2.1 time: 0.114323 Nov 02 11:50:22.157541 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 18/42] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:22 2022] DELETE /compute/v2.1/flavors/1073093355 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:22.165519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01f981c1-6be9-45a9-bf1b-b3d3f90c298f tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:22.185453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01f981c1-6be9-45a9-bf1b-b3d3f90c298f tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023048 Nov 02 11:50:22.186010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 25/43] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:22.207997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee7df8d8-5353-411c-a159-63581c4674ff tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1769039751", "id": 1745029952, "os-flavor-access:is_public": "False"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:22.316445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12b942be-d2ca-4390-9c28-67513338bb9c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:22.317189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12b942be-d2ca-4390-9c28-67513338bb9c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:22.341270 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee7df8d8-5353-411c-a159-63581c4674ff tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.136929 Nov 02 11:50:22.343251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 19/44] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:22 2022] POST /compute/v2.1/flavors => generated 439 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:22.363111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75ce17b3-4ec4-4c12-8479-fd62ddc84924 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:22.381005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12b942be-d2ca-4390-9c28-67513338bb9c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:22.387922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12b942be-d2ca-4390-9c28-67513338bb9c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1242 microversion: 2.1 time: 0.075264 Nov 02 11:50:22.388492 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 26/45] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:22 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:23.072720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8,nova_api:DELETE=13 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:23.077476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75ce17b3-4ec4-4c12-8479-fd62ddc84924 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1745029952/action" status: 200 len: 97 microversion: 2.1 time: 0.719188 Nov 02 11:50:23.083252 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 20/46] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:22 2022] POST /compute/v2.1/flavors/1745029952/action => generated 97 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:23.089385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200268e3-17ee-4a89-aaae-98be40dc2ac0 tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:23.093091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-200268e3-17ee-4a89-aaae-98be40dc2ac0 tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c0e51eabcb5e4963810d2249fad70ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75294689126b43d19fb1c48a15932f87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200268e3-17ee-4a89-aaae-98be40dc2ac0 tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Request method failure captured: Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/flavors/1745029952/action HTTP/1.1 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 70 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll0CSEADurtDXK5mZGT2p7I-7oqZK3IlefNjrSSx_rqknU1Cbf1Qvam7APCR1wbf5sTjOy0Zzc287nZOb__T3uAzsTy--Vt9LnZLIVGxi_kTpZW3LlnOtIoGb7tQi2Iv8lfujxWSXa_s5Y6XYQmgSDkRn2m2YEnHiuiTCDyix3jO3c Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 75294689126b43d19fb1c48a15932f87 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:23.094963 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75294689126b43d19fb1c48a15932f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_75294689126b43d19fb1c48a15932f87", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/75294689126b43d19fb1c48a15932f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75294689126b43d19fb1c48a15932f87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 75294689126b43d19fb1c48a15932f87 Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336 Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsAccessNegativeTestJSON-2075824336-project Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c0e51eabcb5e4963810d2249fad70ec5 Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2075824336-project Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: {"removeTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} Nov 02 11:50:23.096023 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1745029952', 'body': {'removeTenantAccess': {'tenant': '75294689126b43d19fb1c48a15932f87'}}} Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can( Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:23.096832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 11:50:23.098547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:23.099646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200268e3-17ee-4a89-aaae-98be40dc2ac0 tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:23.099646 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-200268e3-17ee-4a89-aaae-98be40dc2ac0 tempest-FlavorsAccessNegativeTestJSON-2075824336 tempest-FlavorsAccessNegativeTestJSON-2075824336-project] 10.222.0.48 "POST /compute/v2.1/flavors/1745029952/action" status: 403 len: 133 microversion: 2.1 time: 0.011410 Nov 02 11:50:23.099646 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 27/47] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:23 2022] POST /compute/v2.1/flavors/1745029952/action => generated 133 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:23.104716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0c7995f-776e-4f7a-8e60-cda79f02edba tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "75294689126b43d19fb1c48a15932f87"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:23.411875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:23.412612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:23.420298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:23.420788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:23.421226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:23.421929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:23.422384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:23.422810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:23.565463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:23.588048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-505cd27d-6931-4672-8aa3-d79ba8bfbe4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1290 microversion: 2.1 time: 0.175588 Nov 02 11:50:23.589579 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 28/48] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:23 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1290 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:23.823431 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0c7995f-776e-4f7a-8e60-cda79f02edba tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1745029952/action" status: 200 len: 21 microversion: 2.1 time: 0.721771 Nov 02 11:50:23.825974 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 21/49] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:23 2022] POST /compute/v2.1/flavors/1745029952/action => generated 21 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:50:23.837899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-351483e4-4976-4c9a-a2ae-ab53fd1b1680 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:23.952572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-351483e4-4976-4c9a-a2ae-ab53fd1b1680 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1745029952" status: 202 len: 0 microversion: 2.1 time: 0.120614 Nov 02 11:50:23.953432 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 29/50] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:23 2022] DELETE /compute/v2.1/flavors/1745029952 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:23.962390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bef90aa9-6947-452c-bcc6-2993fe564417 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:23.987317 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bef90aa9-6947-452c-bcc6-2993fe564417 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029405 Nov 02 11:50:23.988804 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 22/51] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:24.008062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a75bb46-b619-4e9d-96ab-231f3b384820 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1111961847", "id": 1705603385, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:24.104393 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a75bb46-b619-4e9d-96ab-231f3b384820 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.100137 Nov 02 11:50:24.110076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 30/52] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:24 2022] POST /compute/v2.1/flavors => generated 439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:24.120145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7530fa1-6dc3-4f97-8a10-0ecbdac13ea8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b805eef4f8e49c4b3d232d8bf18e00c"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:24.628053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:24.628809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:24.634996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.635603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.636194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.637108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:24.637716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:24.638171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:24.715553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:24.724728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c6f6ba0-b6a9-4ae2-bd75-7081bef403fd tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1296 microversion: 2.1 time: 0.100996 Nov 02 11:50:24.725372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 31/53] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:24 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:24.775895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b7530fa1-6dc3-4f97-8a10-0ecbdac13ea8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] HTTP exception thrown: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7530fa1-6dc3-4f97-8a10-0ecbdac13ea8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Request method failure captured: Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/1705603385/action HTTP/1.1 Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 70 Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3yzJnWkPKffpa-1Z7N9UFl82R4WzOebn3z27MRoZGES_hp8nMIiMoqb_f260WoPH8ATxrEJvjtcnk0SuPORGQa1Xt2nmSdiDKqs6948DWm124mAOcKf50dERq5p92-uiJo1caU2HoKfyNHciF8ffeNosOVwwR69QhoR3EJsI8DFY Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:24.783402 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ccafb9e8da745358c7c8cecaaa7762f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ccafb9e8da745358c7c8cecaaa7762f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0ccafb9e8da745358c7c8cecaaa7762f Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658 Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8ac14e435a414ca59f409fefc55fa797 Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: {"removeTenantAccess": {"tenant": "2b805eef4f8e49c4b3d232d8bf18e00c"}} Nov 02 11:50:24.784795 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1705603385', 'body': {'removeTenantAccess': {'tenant': '2b805eef4f8e49c4b3d232d8bf18e00c'}}} Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 11:50:24.785523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:24.786678 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7530fa1-6dc3-4f97-8a10-0ecbdac13ea8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Returning 404 to user: Flavor access not found for 22 / 2b805eef4f8e49c4b3d232d8bf18e00c combination. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7530fa1-6dc3-4f97-8a10-0ecbdac13ea8 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1705603385/action" status: 404 len: 124 microversion: 2.1 time: 0.670373 Nov 02 11:50:24.792294 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 23/54] 10.222.0.48 () {60 vars in 1200 bytes} [Wed Nov 2 11:50:24 2022] POST /compute/v2.1/flavors/1705603385/action => generated 124 bytes in 673 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:50:24.800453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e50a87b-d396-4efc-b726-3d29b91fc6e5 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:24.891492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e50a87b-d396-4efc-b726-3d29b91fc6e5 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1705603385" status: 202 len: 0 microversion: 2.1 time: 0.095055 Nov 02 11:50:24.892354 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 32/55] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:50:24 2022] DELETE /compute/v2.1/flavors/1705603385 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:50:24.901119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-644cc481-fe3b-4ebd-b214-cbdb64ae63f6 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:24.924629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-644cc481-fe3b-4ebd-b214-cbdb64ae63f6 tempest-FlavorsAccessNegativeTestJSON-1225961658 tempest-FlavorsAccessNegativeTestJSON-1225961658-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027437 Nov 02 11:50:24.925700 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 24/56] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:25.630506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ae9ee44-8d90-48cb-9164-961f4c7132f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Calling method '.version_select at 0x7ff1b8651af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:25.632831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ae9ee44-8d90-48cb-9164-961f4c7132f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '9ef6e6cac1c5412991b7024e6ab69c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62143b67ae09439ab518668a2c26320e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ae9ee44-8d90-48cb-9164-961f4c7132f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Request method failure captured: Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll-zg_QZKlTKToJ5nw14ET86aMNJETAHK79WL5Ytl9q6GCAuEf7Tidq4JzxmgvsU8gX_8pZVuP0KXxLrOUis_pg-awzED5Qrnw8ffS2_AOjc112YpFsLqcD0eADtIs6FVcApThTL_hi1jIMshTYA7gOWLXhlZlsiI5glzQ4xHz86nU Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:25.634733 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62143b67ae09439ab518668a2c26320e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62143b67ae09439ab518668a2c26320e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9ef6e6cac1c5412991b7024e6ab69c37 Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 11:50:25.635913 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:25.636604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 11:50:25.638056 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.640629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ae9ee44-8d90-48cb-9164-961f4c7132f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:25.640629 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ae9ee44-8d90-48cb-9164-961f4c7132f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.423020 Nov 02 11:50:25.640629 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 33/57] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:25.646265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61d469fd-fb5f-41b5-8fb1-07b2bfbd6ade tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Calling method '.version_select at 0x7ff1b846cd30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:25.648287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61d469fd-fb5f-41b5-8fb1-07b2bfbd6ade tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '9ef6e6cac1c5412991b7024e6ab69c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62143b67ae09439ab518668a2c26320e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61d469fd-fb5f-41b5-8fb1-07b2bfbd6ade tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Request method failure captured: Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll-zg_QZKlTKToJ5nw14ET86aMNJETAHK79WL5Ytl9q6GCAuEf7Tidq4JzxmgvsU8gX_8pZVuP0KXxLrOUis_pg-awzED5Qrnw8ffS2_AOjc112YpFsLqcD0eADtIs6FVcApThTL_hi1jIMshTYA7gOWLXhlZlsiI5glzQ4xHz86nU Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:25.650397 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62143b67ae09439ab518668a2c26320e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62143b67ae09439ab518668a2c26320e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9ef6e6cac1c5412991b7024e6ab69c37 Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: action_args: {} Nov 02 11:50:25.651632 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:25.652463 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 11:50:25.654384 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.655483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61d469fd-fb5f-41b5-8fb1-07b2bfbd6ade tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:25.655483 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61d469fd-fb5f-41b5-8fb1-07b2bfbd6ade tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009496 Nov 02 11:50:25.655483 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 25/58] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:25.664055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee41ce7d-adaf-446e-92e6-d8c1fd2633f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Calling method '.version_select at 0x7ff1b86919d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:25.666090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee41ce7d-adaf-446e-92e6-d8c1fd2633f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '9ef6e6cac1c5412991b7024e6ab69c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62143b67ae09439ab518668a2c26320e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee41ce7d-adaf-446e-92e6-d8c1fd2633f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Request method failure captured: Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll-zg_QZKlTKToJ5nw14ET86aMNJETAHK79WL5Ytl9q6GCAuEf7Tidq4JzxmgvsU8gX_8pZVuP0KXxLrOUis_pg-awzED5Qrnw8ffS2_AOjc112YpFsLqcD0eADtIs6FVcApThTL_hi1jIMshTYA7gOWLXhlZlsiI5glzQ4xHz86nU Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:25.668586 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62143b67ae09439ab518668a2c26320e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62143b67ae09439ab518668a2c26320e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9ef6e6cac1c5412991b7024e6ab69c37 Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 11:50:25.670026 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:25.670811 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 11:50:25.685959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:25.686961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee41ce7d-adaf-446e-92e6-d8c1fd2633f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:25.686961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee41ce7d-adaf-446e-92e6-d8c1fd2633f9 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010283 Nov 02 11:50:25.686961 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 34/59] 10.222.0.48 () {58 vars in 1179 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:25.753377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:25.754006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:25.760917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:25.761731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:25.762539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:25.763936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:25.764396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:25.765268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:25.950767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:25.958844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.210814 Nov 02 11:50:25.971210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 35/60] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:25.971210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:25.971210 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42cd0a4f-2da9-4251-b7e7-7cc13b9598cb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001051 Nov 02 11:50:25.971210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 36/61] 10.222.0.48 () {56 vars in 886 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 11:50:26.181404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Calling method '.version_select at 0x7ff1b846a280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.190550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127568) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 11:50:26.194161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.197032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.198208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.229260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.230508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.232161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.248197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.248817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.249361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.258416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bb79982-ee7d-4cf1-8eb7-83a341aac18f tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.567078 Nov 02 11:50:26.259773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 26/62] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:26.274358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebd914ee-5bd1-4655-8bf8-b0732e10b5a0 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Calling method '.version_select at 0x7ff1b8651ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.276624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebd914ee-5bd1-4655-8bf8-b0732e10b5a0 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '9ef6e6cac1c5412991b7024e6ab69c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62143b67ae09439ab518668a2c26320e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebd914ee-5bd1-4655-8bf8-b0732e10b5a0 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Request method failure captured: Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll-zg_QZKlTKToJ5nw14ET86aMNJETAHK79WL5Ytl9q6GCAuEf7Tidq4JzxmgvsU8gX_8pZVuP0KXxLrOUis_pg-awzED5Qrnw8ffS2_AOjc112YpFsLqcD0eADtIs6FVcApThTL_hi1jIMshTYA7gOWLXhlZlsiI5glzQ4xHz86nU Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:26.279160 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62143b67ae09439ab518668a2c26320e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62143b67ae09439ab518668a2c26320e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9ef6e6cac1c5412991b7024e6ab69c37 Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1'} Nov 02 11:50:26.280341 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:26.280998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 11:50:26.281886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.282698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebd914ee-5bd1-4655-8bf8-b0732e10b5a0 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:26.282698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebd914ee-5bd1-4655-8bf8-b0732e10b5a0 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.013155 Nov 02 11:50:26.289991 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 37/63] 10.222.0.48 () {58 vars in 1173 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:26.295613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a78fe88d-47aa-4caa-a44c-4628dc76f29b tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Calling method '.version_select at 0x7ff1b84ce3a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.298069 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a78fe88d-47aa-4caa-a44c-4628dc76f29b tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] HTTP exception thrown: Hypervisor with ID '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' could not be found. Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a78fe88d-47aa-4caa-a44c-4628dc76f29b tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Request method failure captured: Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c/uptime HTTP/1.1 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmBKHmNpepX4Lanqqc8MLgW9zwfAi2gY4FyNlHOO47P8MJ0hGkP9psKiNhjAAwFFLbCvB21LwGlFKBNdWeQj9aotoxeE5B1O9xCZce2EONvzqrzu2wATpv1HL0n8mKPusU0RVlSLzIN-4sEBX4GSGMrcE5gEsfVP_6CbOtscSU6BGA Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7903ad7eff574f5393ac4319b9798830 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:26.310701 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7903ad7eff574f5393ac4319b9798830", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7903ad7eff574f5393ac4319b9798830 Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 10d867dbfc334223ad9eaabc888fdb69 Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: exception: Hypervisor with ID '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' could not be found. Nov 02 11:50:26.312367 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c'} Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 11:50:26.313180 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' could not be found. Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.314683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' could not be found. Nov 02 11:50:26.316085 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.317533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a78fe88d-47aa-4caa-a44c-4628dc76f29b tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Returning 404 to user: Hypervisor with ID '53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c' could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:26.318396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a78fe88d-47aa-4caa-a44c-4628dc76f29b tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029636 Nov 02 11:50:26.327976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Calling method '.version_select at 0x7ff1b8691af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.329753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.330235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.330706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.331397 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 27/64] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/os-hypervisors/53c4d1d2-fd3c-4179-a3b3-970ff8d2dd8c/uptime => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:26.365539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.366203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.367390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.384972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.385844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:26.386565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:26.394327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-498aaa37-efb9-48fd-b99f-5acad7719d3c tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070040 Nov 02 11:50:26.409564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3a53ed5-1524-4bda-80be-d8c771b76659 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Calling method '.version_select at 0x7ff1b846c940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.412726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3a53ed5-1524-4bda-80be-d8c771b76659 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '9ef6e6cac1c5412991b7024e6ab69c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62143b67ae09439ab518668a2c26320e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:26.413608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 38/65] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3a53ed5-1524-4bda-80be-d8c771b76659 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Request method failure captured: Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll-zg_QZKlTKToJ5nw14ET86aMNJETAHK79WL5Ytl9q6GCAuEf7Tidq4JzxmgvsU8gX_8pZVuP0KXxLrOUis_pg-awzED5Qrnw8ffS2_AOjc112YpFsLqcD0eADtIs6FVcApThTL_hi1jIMshTYA7gOWLXhlZlsiI5glzQ4xHz86nU Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:26.416604 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_62143b67ae09439ab518668a2c26320e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/62143b67ae09439ab518668a2c26320e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/62143b67ae09439ab518668a2c26320e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 62143b67ae09439ab518668a2c26320e Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-426280924 Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9ef6e6cac1c5412991b7024e6ab69c37 Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-426280924-project Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1'} Nov 02 11:50:26.418364 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:26.420407 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 11:50:26.422947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.431704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3a53ed5-1524-4bda-80be-d8c771b76659 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:26.431704 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3a53ed5-1524-4bda-80be-d8c771b76659 tempest-HypervisorAdminNegativeTestJSON-426280924 tempest-HypervisorAdminNegativeTestJSON-426280924-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020431 Nov 02 11:50:26.431704 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 28/66] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:26.444669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc0f114e-ecd3-45c7-be8b-2942752bf7e2 tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Calling method '.version_select at 0x7ff1b8651dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.457464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cc0f114e-ecd3-45c7-be8b-2942752bf7e2 tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] HTTP exception thrown: Hypervisor with ID '5b28f579-d18a-4b73-987e-d2a880afb7c1' could not be found. Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc0f114e-ecd3-45c7-be8b-2942752bf7e2 tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Request method failure captured: Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/5b28f579-d18a-4b73-987e-d2a880afb7c1 HTTP/1.1 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmBKHmNpepX4Lanqqc8MLgW9zwfAi2gY4FyNlHOO47P8MJ0hGkP9psKiNhjAAwFFLbCvB21LwGlFKBNdWeQj9aotoxeE5B1O9xCZce2EONvzqrzu2wATpv1HL0n8mKPusU0RVlSLzIN-4sEBX4GSGMrcE5gEsfVP_6CbOtscSU6BGA Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7903ad7eff574f5393ac4319b9798830 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:26.459966 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7903ad7eff574f5393ac4319b9798830", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7903ad7eff574f5393ac4319b9798830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7903ad7eff574f5393ac4319b9798830 Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774 Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 10d867dbfc334223ad9eaabc888fdb69 Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: exception: Hypervisor with ID '5b28f579-d18a-4b73-987e-d2a880afb7c1' could not be found. Nov 02 11:50:26.461227 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '5b28f579-d18a-4b73-987e-d2a880afb7c1'} Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '5b28f579-d18a-4b73-987e-d2a880afb7c1' Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 11:50:26.461831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:50:26.463020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '5b28f579-d18a-4b73-987e-d2a880afb7c1' could not be found. Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '5b28f579-d18a-4b73-987e-d2a880afb7c1' could not be found. Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:26.464595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc0f114e-ecd3-45c7-be8b-2942752bf7e2 tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] Returning 404 to user: Hypervisor with ID '5b28f579-d18a-4b73-987e-d2a880afb7c1' could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:26.471856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc0f114e-ecd3-45c7-be8b-2942752bf7e2 tempest-HypervisorAdminNegativeTestJSON-1643604774 tempest-HypervisorAdminNegativeTestJSON-1643604774-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/5b28f579-d18a-4b73-987e-d2a880afb7c1" status: 404 len: 123 microversion: 2.1 time: 0.039282 Nov 02 11:50:26.472606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 39/67] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/os-hypervisors/5b28f579-d18a-4b73-987e-d2a880afb7c1 => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:26.983821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:26.984685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:26.998348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:26.999890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:27.000859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:27.001980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:27.002504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:27.003193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:27.270605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:27.291185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92104f39-1963-4784-b253-306179c69355 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.312262 Nov 02 11:50:27.299915 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 29/68] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:26 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:28.314896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:28.319323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:28.319500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:28.346839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.347361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.347804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.348509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:28.354178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:28.354729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:28.545741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:28.555629 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8997ac5a-b232-4d44-9263-7533d9bcee3f tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.242785 Nov 02 11:50:28.556480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 40/69] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:28 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:29.598163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:29.604866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:29.614846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.615411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.615849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.616854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:29.617320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:29.617745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:29.859491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:29.868130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec354f2c-819e-46a3-8dac-e5c7a13adb0c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.290952 Nov 02 11:50:29.872293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 41/70] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:29 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:30.118285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422a8101-2746-4cee-b94f-3dd3ab8eed38", "tag": "b403f864-761c-48b3-92e0-919b276e8a3a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:30.148692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:30.150699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:30.150699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:30.180675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Creating event network-changed:b403f864-761c-48b3-92e0-919b276e8a3a for instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 on n-h1-855649-4 Nov 02 11:50:30.182001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:50:30.182401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d7f45ca3-a30b-4297-a507-36b3411fa8e7 req-9b886045-993f-4079-bd4d-326b3ec81ad6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:50:30.183630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:30.184313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:30.184750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:30.185504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:30.186004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:30.186423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:30.195451 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.rpcapi [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 11:50:30.196340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] Releasing lock "compute-rpcapi-router" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:50:30.229062 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ea55454-b5ca-40ab-80a7-6b211e580640 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.413044 Nov 02 11:50:30.229812 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 30/71] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:30.901882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:30.902714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:30.909511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:30.910117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:30.910629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:30.912102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:30.912788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:30.913298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:31.120056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:31.148192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d189f48d-a537-42b8-84c8-2d6534f6e592 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.234351 Nov 02 11:50:31.148192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 42/72] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:30 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:32.163850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:32.165219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:32.171485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:32.173639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:32.174139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:32.174770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:32.175696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:32.176334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:32.177117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:32.398606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:32.407810 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6598638f-09cf-4db1-8fbd-c319915e3fe8 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.247977 Nov 02 11:50:32.415707 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 31/73] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:32 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:32.501072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:32.741386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2426fa9a-ce2b-459b-b0bd-ca1cff298970 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Calling method '.version_select at 0x7ff1b8691c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.316918 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2426fa9a-ce2b-459b-b0bd-ca1cff298970 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 371 microversion: 2.1 time: 0.820346 Nov 02 11:50:33.324919 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 43/74] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 11:50:32 2022] GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 371 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:33.344580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b85b0310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:33.405919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b83df940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.407817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.408301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.409050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.428325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.428821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.429263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.443149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.443766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.444337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.453371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7562106-fc1a-4c95-9da5-ec91830124e5 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.229431 Nov 02 11:50:33.453974 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 32/75] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:33.477148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.478042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:33.484646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.493593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.493593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.493593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.493593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.493952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.666272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:33.684513 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cce12c1a-fbcb-46fc-a5bf-763f3d0d4b4e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.229487 Nov 02 11:50:33.691282 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 33/76] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:33.696388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b8386310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.698205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.698690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.699168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.713775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.714426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.714959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.725493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.725957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.726397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.732993 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-923218b0-6691-43a5-bd02-024d35bf930d tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.040272 Nov 02 11:50:33.733693 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 34/77] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:33.750624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b843c8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.752747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.753404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.753995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.768930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.769676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.770323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.781103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.781585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.782023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.787965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-feb40c1f-c4ef-406b-ac4c-2c8df2e08534 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041641 Nov 02 11:50:33.788555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 35/78] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:33.799579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b843c940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.801445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.801956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.802378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.825197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.826285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.826734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.833668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14482941-4492-4caa-8a81-50db44fc09d9 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.037965 Nov 02 11:50:33.834394 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 36/79] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:33.851559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a08e443-1a33-4abb-9aec-9e8bfbb582e6 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b843c670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.853678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a08e443-1a33-4abb-9aec-9e8bfbb582e6 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.854352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a08e443-1a33-4abb-9aec-9e8bfbb582e6 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.855424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a08e443-1a33-4abb-9aec-9e8bfbb582e6 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.882696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a08e443-1a33-4abb-9aec-9e8bfbb582e6 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.035257 Nov 02 11:50:33.883918 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 37/80] 10.222.0.48 () {58 vars in 1179 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:33.896901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b839f670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.898935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.899464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.899970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.915425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.915994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.916444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.928405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.928905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.929346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.936768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2472a7d4-1f6e-4799-8245-5d02c0807f31 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043602 Nov 02 11:50:33.991551 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 38/81] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:33.991551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b83305e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:33.991551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.991551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.991936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.991936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:33.991936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:33.991936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:33.992225 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57b7ac3e-bf4e-4bd5-a894-27d51f8e0e70 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.028404 Nov 02 11:50:33.992225 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 39/82] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:34.007460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b846cb80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:34.009257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.009737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.010317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.028735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.029236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.029670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.036559 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f08aa19c-5d02-4cff-8efd-af423574622e tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.032808 Nov 02 11:50:34.037518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 40/83] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:34 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:34.052081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Calling method '.version_select at 0x7ff1b839f5e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:34.053953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.054432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.054897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.077729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.077729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.077729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.084566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.085005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.085415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.551602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.552185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.552719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.553670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.554527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.555042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.706394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab3b0620-349a-479f-8ab8-7e2bae3c00bb tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 328 microversion: 2.1 time: 1.366413 Nov 02 11:50:34.719043 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 44/84] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:33 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 328 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:34.729481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:34.731194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:34.744430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.746936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.749860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.751394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:34.752131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:34.753893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:34.900817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:34.911006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbf8c024-3742-426c-813b-c5dda2d5ba33 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.202149 Nov 02 11:50:34.911794 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 45/85] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:34 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:35.292062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1654041672", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:35.365433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:35.552481 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d66a52dd-dbeb-4c38-80e8-331fb240e9b3 tempest-HypervisorAdminTestJSON-703953230 tempest-HypervisorAdminTestJSON-703953230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.504014 Nov 02 11:50:35.561684 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 41/86] 10.222.0.48 () {58 vars in 1173 bytes} [Wed Nov 2 11:50:34 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:35.578860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:35.579428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:35.579786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:35.580194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:35.580600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:35.594075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:35.594769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:35.595233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:35.595964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:35.596418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:35.596936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:35.619633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:35.625329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for user d79988ca3c1e467eb64779c2d9e7902b and project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:35.643098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.utils [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] cores quota exceeded for a92acab49be14c6faad479c2b6682589, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 11:50:35.644048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Request method failure captured: Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 145 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmEycGq3o2Q01rkZem79ysNLhvgFHZTKLykPKXDnXBAl8os2JDncqCRCMRnAaTOuSck9l4XvwPkxT5f_gPQD20W2AVABc9pYEaWWvig7mVi1aAvY688kULmdp2pLop7u6K2vbqHb7m36yN7T2Vudw-MK7T9Wz8nksrj2dmZ7K2b4bE Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:35.650794 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a92acab49be14c6faad479c2b6682589", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a92acab49be14c6faad479c2b6682589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d79988ca3c1e467eb64779c2d9e7902b Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1654041672", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} Nov 02 11:50:35.652214 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1654041672', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452'}}} Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 11:50:35.652883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:35.654823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.655973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6ec7882-c475-456c-a27c-a0181de02646 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.662327 Nov 02 11:50:35.657683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 46/87] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 664 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:35.663518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b82d2550>, body: {"quota_set": {"cores": 20}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:35.936095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:35.936707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:35.942626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:35.943152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:35.943591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:35.944400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:35.944894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:35.945317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:36.119669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:36.124465 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84291d51-66c7-4875-877e-b7bac8d419d0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.192914 Nov 02 11:50:36.125140 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 47/88] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:35 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:36.433273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:36.433756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:36.434186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:36.435212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:36.435670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:36.436090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:36.600419 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10ae62d8-1561-4732-aff4-e33de6ca47ef tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 329 microversion: 2.1 time: 0.941119 Nov 02 11:50:36.602261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 42/89] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:35 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 329 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:36.619382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20d4ff2e-bd17-4688-9415-7ebbb9a7c634 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Calling method '.version_select at 0x7ff1b83f3f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:37.029093 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20d4ff2e-bd17-4688-9415-7ebbb9a7c634 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 371 microversion: 2.1 time: 0.418046 Nov 02 11:50:37.029895 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 48/90] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 11:50:36 2022] GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:37.043626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8401040>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:37.219794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Calling method '.version_select at 0x7ff1b82ceee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:37.224073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.224554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.224986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.245004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.245483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.246779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.280386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.280386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.280386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.295560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.296315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.296826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.312267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.312836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.313347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.319718 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db826307-d6a5-402a-945e-214618db62f8 tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.416233 Nov 02 11:50:37.320365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 43/91] 10.222.0.48 () {60 vars in 1243 bytes} [Wed Nov 2 11:50:36 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:50:37.599571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f37048ba-8614-4cef-b323-12146bf4fe9d tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1598402115", "id": 1906060103, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:37.600822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.601580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.602230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.603404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.604669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.605359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.672494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f37048ba-8614-4cef-b323-12146bf4fe9d tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.350769 Nov 02 11:50:37.673048 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 44/92] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:50:37 2022] POST /compute/v2.1/flavors => generated 471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:37.677870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:37.678592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:37.685540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.686315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.686763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.687503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.687957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.688403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.700411 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d2b9b0b-2c02-4adb-825a-e9f6a3f46cc1 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 328 microversion: 2.1 time: 0.662435 Nov 02 11:50:37.701542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 49/93] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:37 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 328 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:37.709056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:37.719119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Calling method '.version_select at 0x7ff1b84109d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:37.724748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.725235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.725668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.741540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.742807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.743414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.779092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.779609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.780012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.789679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:37.791165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.791646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.792076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.809856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.810532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.810945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.819362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4c5b79d-3043-48fc-bdd3-f7e335f8a60b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.116595 Nov 02 11:50:37.827759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 50/94] 10.222.0.48 () {60 vars in 1222 bytes} [Wed Nov 2 11:50:37 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:37.832598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46ddf7d2-1668-4fad-aea1-b784c6fa08ab tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:37.871004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:37.880073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4d3a5da-26dd-4752-b1be-64c2b7a7656c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.205859 Nov 02 11:50:37.883404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 45/95] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:37 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:37.885286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Calling method '.version_select at 0x7ff1b82d21f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:37.889571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.890156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.890715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.914407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:37.914971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:37.915505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:37.922616 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-144cdd59-8076-4955-8ec1-59676cd1629b tempest-HypervisorAdminV253TestBase-1601087306 tempest-HypervisorAdminV253TestBase-1601087306-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/18f9dda8-282d-48d8-8f50-a29a96e08ac1" status: 200 len: 792 microversion: 2.53 time: 0.040788 Nov 02 11:50:37.923455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 46/96] 10.222.0.48 () {60 vars in 1298 bytes} [Wed Nov 2 11:50:37 2022] GET /compute/v2.1/os-hypervisors/18f9dda8-282d-48d8-8f50-a29a96e08ac1 => generated 792 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:37.928080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1969070405", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:37.980768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:38.113905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46ddf7d2-1668-4fad-aea1-b784c6fa08ab tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1906060103/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.292304 Nov 02 11:50:38.115184 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 51/97] 10.222.0.48 () {62 vars in 1265 bytes} [Wed Nov 2 11:50:37 2022] POST /compute/v2.1/flavors/1906060103/os-extra_specs => generated 62 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:38.128898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4223c81-30df-49bb-a56c-6d2e9393f2e9 tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:38.226195 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4223c81-30df-49bb-a56c-6d2e9393f2e9 tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1906060103" status: 202 len: 0 microversion: 2.86 time: 0.104417 Nov 02 11:50:38.227326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 52/98] 10.222.0.48 () {60 vars in 1202 bytes} [Wed Nov 2 11:50:38 2022] DELETE /compute/v2.1/flavors/1906060103 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:50:38.237783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64e99c97-c07f-442a-8adc-543c877acb93 tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:38.274773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64e99c97-c07f-442a-8adc-543c877acb93 tempest-FlavorMetadataValidation-954327301 tempest-FlavorMetadataValidation-954327301-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.042527 Nov 02 11:50:38.275735 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 53/99] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:50:38.327554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:38.327978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:38.328446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:38.328922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:38.329326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:38.338317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:38.338798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:38.339278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:38.339997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:38.340449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:38.341109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:38.359808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:38.363583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for user d79988ca3c1e467eb64779c2d9e7902b and project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:38.375072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.utils [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] instances quota exceeded for a92acab49be14c6faad479c2b6682589, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127568) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 11:50:38.375902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Request method failure captured: Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 145 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmEycGq3o2Q01rkZem79ysNLhvgFHZTKLykPKXDnXBAl8os2JDncqCRCMRnAaTOuSck9l4XvwPkxT5f_gPQD20W2AVABc9pYEaWWvig7mVi1aAvY688kULmdp2pLop7u6K2vbqHb7m36yN7T2Vudw-MK7T9Wz8nksrj2dmZ7K2b4bE Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:38.382048 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a92acab49be14c6faad479c2b6682589", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a92acab49be14c6faad479c2b6682589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d79988ca3c1e467eb64779c2d9e7902b Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1969070405", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} Nov 02 11:50:38.386071 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1969070405', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452'}}} Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 11:50:38.386824 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:38.388007 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.389243 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b70a92a4-3640-42d7-ad1e-ee703da30886 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.459007 Nov 02 11:50:38.390485 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 47/100] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:37 2022] POST /compute/v2.1/servers => generated 119 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:38.392325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8401d30>, body: {"quota_set": {"instances": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:38.902814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:38.903457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:38.905861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:38.910483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:38.910966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:38.911579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:38.912269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:38.912724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:38.913146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:39.073222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:39.084240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4902f64-a3ec-404a-9136-1ed0d67eabae tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.183880 Nov 02 11:50:39.085575 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 48/101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:38 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:39.136043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:39.137067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:39.147924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:39.147924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:39.147924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:39.147924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:39.322091 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc469981-7b27-49f4-a1f9-3d3323af7ba9 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 329 microversion: 2.1 time: 0.933157 Nov 02 11:50:39.323458 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 54/102] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:38 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 329 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:39.340557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a50f3b74-734e-43a6-983d-ad568954802e tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Calling method '.version_select at 0x7ff1b8116dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:39.571773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a50f3b74-734e-43a6-983d-ad568954802e tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 371 microversion: 2.1 time: 0.237235 Nov 02 11:50:39.579807 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 49/103] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 11:50:39 2022] GET /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:39.585721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b84189d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:39.711094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:39.711614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:39.712060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:39.713506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:39.713972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:39.714399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:39.883744 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-256ca146-7128-4655-ad7e-f7bb73064c02 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 325 microversion: 2.1 time: 0.302937 Nov 02 11:50:39.885402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 55/104] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:39 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:40.109239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:40.109888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:40.116754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.117403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.117861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.118546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.119038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.121642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.266365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:40.274836 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-612e679d-629f-4696-865b-7f37a51edd21 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.169842 Nov 02 11:50:40.275474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 50/105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:40 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:40.499152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1606335789", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:40.577582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:40.770946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:40.771428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:40.771902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:40.772334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:40.772744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:40.781865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.782339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.782774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.783530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:40.783981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:40.784403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:40.802583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:40.806348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Getting quotas for user d79988ca3c1e467eb64779c2d9e7902b and project a92acab49be14c6faad479c2b6682589. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:40.817566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.utils [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] ram quota exceeded for a92acab49be14c6faad479c2b6682589, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 11:50:40.818127 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Request method failure captured: Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 145 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmEycGq3o2Q01rkZem79ysNLhvgFHZTKLykPKXDnXBAl8os2JDncqCRCMRnAaTOuSck9l4XvwPkxT5f_gPQD20W2AVABc9pYEaWWvig7mVi1aAvY688kULmdp2pLop7u6K2vbqHb7m36yN7T2Vudw-MK7T9Wz8nksrj2dmZ7K2b4bE Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:40.820155 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a92acab49be14c6faad479c2b6682589", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a92acab49be14c6faad479c2b6682589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d79988ca3c1e467eb64779c2d9e7902b Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1606335789", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} Nov 02 11:50:40.821359 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1606335789', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452'}}} Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 11:50:40.822047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:40.822998 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.827714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0938b8b7-42a5-4706-b068-96f9b2c4b763 tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.327061 Nov 02 11:50:40.828960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 56/106] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:40.830475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8313040>, body: {"quota_set": {"ram": 51200}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:41.298387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:41.299652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:41.312845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.313340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.315175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.316303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.317476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.318443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.524404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.524924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.525305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.526029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:41.528874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:41.529347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:41.551455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:41.555240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:41.560867 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71f3d615-159b-435b-b768-ce14df1ed3bb tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.267225 Nov 02 11:50:41.561639 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 57/107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:41 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:41.713864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0ca361e-63d4-4eb2-85e9-bca7ea82be23 tempest-QuotasAdminNegativeTest-859946937 tempest-QuotasAdminNegativeTest-859946937-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 200 len: 329 microversion: 2.1 time: 0.887079 Nov 02 11:50:41.723930 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 51/108] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:40 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 329 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:41.729928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-676562be-80a4-41aa-8fbb-3f0f00a0905f tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Action: 'update', calling method: .version_select at 0x7ff1b8401ca0>, body: {"quota_set": {"ram": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:41.738309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-676562be-80a4-41aa-8fbb-3f0f00a0905f tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd79988ca3c1e467eb64779c2d9e7902b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92acab49be14c6faad479c2b6682589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-676562be-80a4-41aa-8fbb-3f0f00a0905f tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Request method failure captured: Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 HTTP/1.1 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 25 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmEycGq3o2Q01rkZem79ysNLhvgFHZTKLykPKXDnXBAl8os2JDncqCRCMRnAaTOuSck9l4XvwPkxT5f_gPQD20W2AVABc9pYEaWWvig7mVi1aAvY688kULmdp2pLop7u6K2vbqHb7m36yN7T2Vudw-MK7T9Wz8nksrj2dmZ7K2b4bE Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:41.741531 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a92acab49be14c6faad479c2b6682589", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a92acab49be14c6faad479c2b6682589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a92acab49be14c6faad479c2b6682589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a92acab49be14c6faad479c2b6682589 Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-103538090 Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d79988ca3c1e467eb64779c2d9e7902b Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-QuotasAdminNegativeTest-103538090-project Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: {"quota_set": {"ram": 0}} Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 11:50:41.742908 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'a92acab49be14c6faad479c2b6682589', 'body': {'quota_set': {'ram': 0}}} Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:41.743909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:41.745083 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-676562be-80a4-41aa-8fbb-3f0f00a0905f tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:41.746273 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-676562be-80a4-41aa-8fbb-3f0f00a0905f tempest-QuotasAdminNegativeTest-103538090 tempest-QuotasAdminNegativeTest-103538090-project] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589" status: 403 len: 116 microversion: 2.1 time: 0.019205 Nov 02 11:50:41.750818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 58/109] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:50:41 2022] PUT /compute/v2.1/os-quota-sets/a92acab49be14c6faad479c2b6682589 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:50:42.584536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:42.585173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:42.593125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:42.593634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:42.594071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:42.594769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:42.595260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:42.595683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:42.743526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:42.753432 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9438458b-7e29-4c7f-ae9d-092efb06e654 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.172826 Nov 02 11:50:42.754195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 52/110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:42 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:43.780865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:43.781505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:43.798224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.799319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.799913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.802003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.802432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.802873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.833956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Calling method '.version_select at 0x7ff1b8410ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:43.836453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.838008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.838759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.859987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.860958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.861915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.881414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.882069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.882688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.889011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc3746a2-f090-4074-a807-7da274413342 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.223445 Nov 02 11:50:43.889707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 59/111] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:43.942203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:43.951228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a7f1ebf-f251-420e-9654-fa9ee4e43472 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.177593 Nov 02 11:50:43.951875 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 53/112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:43 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:43.956350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Calling method '.version_select at 0x7ff1b810e8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:43.958242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.958719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.959191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.976786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:43.977273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:43.977742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:43.999285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.000047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.000640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.007137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97fac801-7c92-4c56-8587-9371658c1849 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-855649-4/servers" status: 200 len: 196 microversion: 2.1 time: 0.054303 Nov 02 11:50:44.007701 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 54/113] 10.222.0.48 () {58 vars in 1212 bytes} [Wed Nov 2 11:50:43 2022] GET /compute/v2.1/os-hypervisors/n-h1-855649-4/servers => generated 196 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:44.020974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Calling method '.version_select at 0x7ff1b8116af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:44.022901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.023520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.024293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.038294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.038777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.039232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.050030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.050503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.050935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.056965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73fe8390-847a-46b0-8ce7-2ceff3673c92 tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040752 Nov 02 11:50:44.057558 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 55/114] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:50:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:44.069100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Calling method '.version_select at 0x7ff1b82ceca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:44.070842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.071346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.071949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.084007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.084670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.085144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.091519 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-361d520e-2bef-4d66-9e96-463e9b71138a tempest-HypervisorAdminUnderV252Test-1886304426 tempest-HypervisorAdminUnderV252Test-1886304426-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-855649-4/search" status: 200 len: 104 microversion: 2.1 time: 0.026592 Nov 02 11:50:44.092383 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 56/115] 10.222.0.48 () {58 vars in 1209 bytes} [Wed Nov 2 11:50:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-855649-4/search => generated 104 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:44.331465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422a8101-2746-4cee-b94f-3dd3ab8eed38", "name": "network-vif-plugged", "status": "completed", "tag": "b403f864-761c-48b3-92e0-919b276e8a3a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:44.344346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.344815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.345245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.365656 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Creating event network-vif-plugged:b403f864-761c-48b3-92e0-919b276e8a3a for instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 on n-h1-855649-4 Nov 02 11:50:44.366177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 11:50:44.366562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5082ec4b-786a-4201-acb4-3a1893116ba8 req-a67a84c2-d996-4b10-aa2f-b6d8ae782d35 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 11:50:44.367629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.368128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.368599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.369304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.369742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.370152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.379149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.compute.rpcapi [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 11:50:44.379959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] Releasing lock "compute-rpcapi-router" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 11:50:44.395077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be651536-1f4a-4785-b9b9-aa687184a0de None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.504032 Nov 02 11:50:44.395676 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 60/116] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:44.984081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:44.984655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:44.991675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.992177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.992631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:44.993512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:44.994120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:44.994714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:45.277527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:45.289049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adb9b533-66a8-4831-ba53-268c6b0f6c9e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.308925 Nov 02 11:50:45.300741 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 57/117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:44 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:45.577034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2021937371", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:45.640518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:45.931697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:45.932107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:45.932574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:45.932973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:45.933378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:45.942592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:45.943100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:45.943534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:45.944253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:45.944700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:45.945123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:45.965249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:45.969687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:45.987617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:50:45.991112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:50:46.119728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54696950-65e1-4450-8164-edd5a1323a65 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701350 Nov 02 11:50:46.121914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 61/118] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:50:46.134272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63e30a0c-5f23-4ebf-aba7-9475eaca61ce tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.134902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63e30a0c-5f23-4ebf-aba7-9475eaca61ce tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:46.228451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Calling method '.version_select at 0x7ff1b8122700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.233414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.234099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.234716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.235670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.236298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.236869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.243249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63e30a0c-5f23-4ebf-aba7-9475eaca61ce tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.252090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=15 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:46.253133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63e30a0c-5f23-4ebf-aba7-9475eaca61ce tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1217 microversion: 2.1 time: 0.125058 Nov 02 11:50:46.254308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 62/119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:46.286116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61f98073-e9d5-4bf2-a56a-dd7ce19207b5 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.378643 Nov 02 11:50:46.287019 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 58/120] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 11:50:45 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:46.317566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.318471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:46.327178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.332771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.332771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.332771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:46.332771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:46.333196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:46.646136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b8b089-8ca4-4e75-87b6-9de478b38066 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Calling method '.version_select at 0x7ff1b863c550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.647820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11b8b089-8ca4-4e75-87b6-9de478b38066 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b8b089-8ca4-4e75-87b6-9de478b38066 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:46.650349 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 11:50:46.651493 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.652191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 11:50:46.653183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.658441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b8b089-8ca4-4e75-87b6-9de478b38066 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.658441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11b8b089-8ca4-4e75-87b6-9de478b38066 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.357229 Nov 02 11:50:46.658441 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 63/121] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:46.666452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b32c9155-5912-4187-851b-812f2df39f4f tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Calling method '.version_select at 0x7ff1b83f3a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.670147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b32c9155-5912-4187-851b-812f2df39f4f tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b32c9155-5912-4187-851b-812f2df39f4f tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/n-d-855649-4/reboot HTTP/1.1 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:46.672269 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'n-d-855649-4'} Nov 02 11:50:46.673687 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.674562 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 11:50:46.675757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.676746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b32c9155-5912-4187-851b-812f2df39f4f tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.676746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b32c9155-5912-4187-851b-812f2df39f4f tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-855649-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015693 Nov 02 11:50:46.676746 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 64/122] 10.222.0.48 () {58 vars in 1188 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/n-d-855649-4/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:46.691082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23d07f4b-73e6-4a11-bb04-3733dc20e982 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Calling method '.version_select at 0x7ff1b8418550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.696286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.704266 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-062f485a-80b2-4615-a689-3b6c580d6799 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1338 microversion: 2.1 time: 0.391799 Nov 02 11:50:46.709175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-23d07f4b-73e6-4a11-bb04-3733dc20e982 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.710440 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 59/123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23d07f4b-73e6-4a11-bb04-3733dc20e982 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.712617 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Nov 02 11:50:46.713985 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:46.714785 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 11:50:46.716345 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23d07f4b-73e6-4a11-bb04-3733dc20e982 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23d07f4b-73e6-4a11-bb04-3733dc20e982 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.028373 Nov 02 11:50:46.717689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 65/124] 10.222.0.48 () {58 vars in 1212 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:50:46.728237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaaa2803-b5a1-4884-b77d-9fb6e71bc490 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Calling method '.version_select at 0x7ff1b8122d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.730088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eaaa2803-b5a1-4884-b77d-9fb6e71bc490 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaaa2803-b5a1-4884-b77d-9fb6e71bc490 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hosts/n-d-855649-4 HTTP/1.1 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:46.732708 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-d-855649-4'} Nov 02 11:50:46.734004 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.734826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 11:50:46.736052 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.737174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaaa2803-b5a1-4884-b77d-9fb6e71bc490 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.737174 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eaaa2803-b5a1-4884-b77d-9fb6e71bc490 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-855649-4" status: 403 len: 109 microversion: 2.1 time: 0.009766 Nov 02 11:50:46.737174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 60/125] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/n-d-855649-4 => generated 109 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:50:46.743039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b58fa7f9-84a2-4ec4-b1b9-54c580838483 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Calling method '.version_select at 0x7ff1b8410e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.750746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b58fa7f9-84a2-4ec4-b1b9-54c580838483 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b58fa7f9-84a2-4ec4-b1b9-54c580838483 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.752296 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Nov 02 11:50:46.754617 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.755645 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.756585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.757453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b58fa7f9-84a2-4ec4-b1b9-54c580838483 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.757453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b58fa7f9-84a2-4ec4-b1b9-54c580838483 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014390 Nov 02 11:50:46.758831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 66/126] 10.222.0.48 () {58 vars in 1191 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:50:46.764752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75bd3396-1abf-401a-940f-1acd62e0ff73 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Calling method '.version_select at 0x7ff1b824d430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.766646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75bd3396-1abf-401a-940f-1acd62e0ff73 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75bd3396-1abf-401a-940f-1acd62e0ff73 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hosts/n-d-855649-4/shutdown HTTP/1.1 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:46.768246 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-d-855649-4'} Nov 02 11:50:46.769355 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.770005 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 11:50:46.782731 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.783859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75bd3396-1abf-401a-940f-1acd62e0ff73 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.783859 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75bd3396-1abf-401a-940f-1acd62e0ff73 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-855649-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009679 Nov 02 11:50:46.783859 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 61/127] 10.222.0.48 () {58 vars in 1194 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/n-d-855649-4/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:50:46.784034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-744a08f3-332d-4904-b180-04473f36e8ac tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Calling method '.version_select at 0x7ff1b85d1dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.786076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=2,nova_api:INSERT=7,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:46.791151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-744a08f3-332d-4904-b180-04473f36e8ac tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-744a08f3-332d-4904-b180-04473f36e8ac tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.792854 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Nov 02 11:50:46.794355 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:46.795086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 11:50:46.796312 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-744a08f3-332d-4904-b180-04473f36e8ac tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-744a08f3-332d-4904-b180-04473f36e8ac tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.018689 Nov 02 11:50:46.797467 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:50:46.804589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81b4009e-b93b-4f91-8010-a712979c0708 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Calling method '.version_select at 0x7ff1b8313040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.806352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81b4009e-b93b-4f91-8010-a712979c0708 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81b4009e-b93b-4f91-8010-a712979c0708 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hosts/n-d-855649-4/startup HTTP/1.1 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:46.808066 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-d-855649-4'} Nov 02 11:50:46.812552 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.813651 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 11:50:46.814753 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.815638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81b4009e-b93b-4f91-8010-a712979c0708 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.815638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81b4009e-b93b-4f91-8010-a712979c0708 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-855649-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.009848 Nov 02 11:50:46.815638 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 62/129] 10.222.0.48 () {58 vars in 1191 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/n-d-855649-4/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:46.820411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87d54afc-775d-4011-8b56-be1e267ae139 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Calling method '.version_select at 0x7ff1b8418af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:46.831453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-87d54afc-775d-4011-8b56-be1e267ae139 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87d54afc-775d-4011-8b56-be1e267ae139 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.833501 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'nonexistent_hostname'} Nov 02 11:50:46.834592 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:46.835332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 11:50:46.836273 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87d54afc-775d-4011-8b56-be1e267ae139 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87d54afc-775d-4011-8b56-be1e267ae139 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018171 Nov 02 11:50:46.837217 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 68/130] 10.222.0.48 () {58 vars in 1215 bytes} [Wed Nov 2 11:50:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:50:46.845063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db647891-70a9-449d-a4b9-5972b36b0ead tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8122670>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db647891-70a9-449d-a4b9-5972b36b0ead tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/n-d-855649-4 HTTP/1.1 Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 51 Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:46.859389 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.860560 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-d-855649-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance: Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.861200 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.863077 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db647891-70a9-449d-a4b9-5972b36b0ead tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db647891-70a9-449d-a4b9-5972b36b0ead tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-855649-4" status: 400 len: 199 microversion: 2.1 time: 0.019911 Nov 02 11:50:46.870132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 63/131] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:46 2022] PUT /compute/v2.1/os-hosts/n-d-855649-4 => generated 199 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:50:46.875753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6d3ec83-11c3-48d6-9bce-cf9fd704d024 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8418160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6d3ec83-11c3-48d6-9bce-cf9fd704d024 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-hosts/n-d-855649-4 HTTP/1.1 Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 51 Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.881009 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.882197 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'n-d-855649-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.883219 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.884637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6d3ec83-11c3-48d6-9bce-cf9fd704d024 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6d3ec83-11c3-48d6-9bce-cf9fd704d024 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-855649-4" status: 400 len: 189 microversion: 2.1 time: 0.012063 Nov 02 11:50:46.885606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 69/132] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:46 2022] PUT /compute/v2.1/os-hosts/n-d-855649-4 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:50:46.893727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44a32180-0142-4555-866e-a7653ef75608 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Action: 'update', calling method: .version_select at 0x7ff1b810ee50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:46.898647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44a32180-0142-4555-866e-a7653ef75608 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '78fe04dfc3024eb4b4f7bf12393a0ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b11916c8264a51949b4cdd662fc9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44a32180-0142-4555-866e-a7653ef75608 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Request method failure captured: Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/n-d-855649-4 HTTP/1.1 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 50 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmUgQn9QwNamhgy3vROJPXHT7ZsDDK_VIAo5RfvvncasfAqfXBjhSOCZMsuKyCHPLy2hdaE7kC996hptiVvAnHrGSaS-oxgzX6PJkdITrpyIfnVupzGYRmgbyzPs78XVciUsGT0N6CALmSE7PoA8Fx5nByFV7tHUTi2YiNzKooyC_4 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:50:46.900747 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2b11916c8264a51949b4cdd662fc9a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2b11916c8264a51949b4cdd662fc9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f2b11916c8264a51949b4cdd662fc9a4 Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-695191181 Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 78fe04dfc3024eb4b4f7bf12393a0ef5 Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-695191181-project Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 11:50:46.902262 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-d-855649-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.903404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 11:50:46.904878 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.906342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44a32180-0142-4555-866e-a7653ef75608 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.906342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44a32180-0142-4555-866e-a7653ef75608 tempest-HostsAdminNegativeTestJSON-695191181 tempest-HostsAdminNegativeTestJSON-695191181-project] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-855649-4" status: 403 len: 111 microversion: 2.1 time: 0.013132 Nov 02 11:50:46.906342 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 64/133] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:46 2022] PUT /compute/v2.1/os-hosts/n-d-855649-4 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:46.912675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c318292-f883-4f6f-a74d-f2384c3cbe15 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b8410670>, body: {"status": null, "maintenance_mode": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c318292-f883-4f6f-a74d-f2384c3cbe15 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-hosts/n-d-855649-4 HTTP/1.1 Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 42 Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:50:46.916246 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: {"status": null, "maintenance_mode": null} Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 11:50:46.917519 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'n-d-855649-4', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi None Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.918248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.923468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c318292-f883-4f6f-a74d-f2384c3cbe15 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c318292-f883-4f6f-a74d-f2384c3cbe15 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-855649-4" status: 400 len: 127 microversion: 2.1 time: 0.008906 Nov 02 11:50:46.924440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 70/134] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:46 2022] PUT /compute/v2.1/os-hosts/n-d-855649-4 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:50:46.931565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b824d8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:46.935240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.hosts [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Enabling host nonexistent_hostname. Nov 02 11:50:46.945998 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Request method failure captured: Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 50 Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmVzSuPuoaglPvmdiWD0eXfR49U_yECWHMCieDCil14acPceLN6-5KJNFq2lE6Ol86JMKemZtuBJgftG8H6NMSFaF1tfnXB8iGOep0d2_x4-UuT0qDZ7U-tfykn10eP3oIaJlDEACfjwnFPaOA05_QhMg9wRoVS0nLDJ9O7bf467cs Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:46.949857 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a079865204834b2e9a13b993311c1bfe", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a079865204834b2e9a13b993311c1bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: a079865204834b2e9a13b993311c1bfe Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1277289892 Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e582703ad02c4b9a9274d8dbcb64a381 Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1277289892-project-admin Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.951960 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:50:46.952817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:46.953728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:46.955283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:46.956253 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-266632a0-05cf-4f7a-a4b7-275d00994802 tempest-HostsAdminNegativeTestJSON-1277289892 tempest-HostsAdminNegativeTestJSON-1277289892-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022295 Nov 02 11:50:46.956253 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 65/135] 10.222.0.48 () {60 vars in 1211 bytes} [Wed Nov 2 11:50:46 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:50:47.281796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10f9372e-d5db-4eb1-a917-05ef3f631fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:47.282410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10f9372e-d5db-4eb1-a917-05ef3f631fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:47.366915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10f9372e-d5db-4eb1-a917-05ef3f631fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:47.376579 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10f9372e-d5db-4eb1-a917-05ef3f631fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1217 microversion: 2.1 time: 0.099531 Nov 02 11:50:47.379043 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:47 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:47.729044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:47.729728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:47.737021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:47.737503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:47.738186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:47.738901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:47.739433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:47.740021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.058253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:48.092787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74c962b4-316f-4d0d-ab17-76bbf6a9eb46 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1487 microversion: 2.1 time: 0.367523 Nov 02 11:50:48.095260 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 66/137] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:47 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1487 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:48.133572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:48.136545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:48.163545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.163545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.163683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.168114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.171476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.171945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.406585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:48.406585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:48.433131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.437564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.437564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.437564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:48.438028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:48.438286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:48.657999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:48.669280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23017cdb-df55-4359-9a78-56eb51b70cc4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1221 microversion: 2.1 time: 0.273000 Nov 02 11:50:48.683711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 67/138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:48 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1221 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:49.079487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0f4c3e0-4328-46fc-80a7-c530cc0c32af tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1638 microversion: 2.1 time: 0.961942 Nov 02 11:50:49.098086 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:48 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1638 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:49.103295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:49.104386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:49.111601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.112274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.112871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.113739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.114353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.114933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.143314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:50:49.639525 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfbcc722-e9a9-40b6-b5a1-aa4419f36afc tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "DELETE /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 204 len: 0 microversion: 2.1 time: 0.538254 Nov 02 11:50:49.641823 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 68/140] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:50:49 2022] DELETE /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:50:49.650297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:49.650928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:49.664338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.665170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.666497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.668137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.668776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.669536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.698230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:49.699094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:49.709768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.712600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.713225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.720231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:49.720996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:49.721646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:49.879814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:49.884825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:49.895136 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b10470c-72a5-4c33-8fc9-c249e814bc43 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1277 microversion: 2.1 time: 0.201090 Nov 02 11:50:49.912031 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 69/141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:49 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:50.065009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:50.076453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45876076-5f2b-48ad-91e2-2b2163ce6879 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1493 microversion: 2.1 time: 0.428032 Nov 02 11:50:50.077409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 73/142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:49 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1493 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:50.924480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:50.925150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:50.937968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:50.939542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:50.940152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:50.942387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:50.943048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:50.955649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.394555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Calling method '.version_select at 0x7ff1b80c1ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.397521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.398466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.402360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.629693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.629693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.629693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.631404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.631404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a524d45-9d8b-495b-9eee-fe1c816c3646 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1275 microversion: 2.1 time: 0.556260 Nov 02 11:50:51.631404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 74/143] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:50 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1275 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:50:51.632369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.632369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.632369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.632858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.632858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:51.632858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.632858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.633583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.633583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.633758 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a38e987-8fa0-410c-bc60-f846c9e02589 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.666945 Nov 02 11:50:51.633845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.633845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.634011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 70/144] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:50:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:51.638866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Calling method '.version_select at 0x7ff1b8230790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:51.639745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.640376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.641022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.680892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:51.681866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:51.683638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:51.697418 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bee3ee0-3aec-4de4-a859-729ec7b8cee7 tempest-HypervisorAdminV228Test-553629759 tempest-HypervisorAdminV228Test-553629759-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.074657 Nov 02 11:50:51.712579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 71/145] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:50:51.824225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:51.833166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e1fcfb3-e69e-4dbc-8a72-a44bf9a2d852 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1493 microversion: 2.1 time: 0.352756 Nov 02 11:50:51.834045 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 75/146] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:51 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:52.634785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=24 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:52.646539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:52.647867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:52.680225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:52.680726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:52.681170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:52.681898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:52.682362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:52.682796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:52.859032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:52.859851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:52.875058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:52.875566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:52.877465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:52.879188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:52.880619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:52.881263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:52.982722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:53.003518 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eb88401-121e-4b76-b90c-77bc7883cc1e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1275 microversion: 2.1 time: 0.367430 Nov 02 11:50:53.003518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 72/147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:52 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:53.493778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:53.506098 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7376063b-f8ad-45ca-8c16-3cd95e0d5b4c tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1493 microversion: 2.1 time: 0.651721 Nov 02 11:50:53.512702 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 76/148] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:52 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1493 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:53.748757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422a8101-2746-4cee-b94f-3dd3ab8eed38", "name": "network-vif-deleted", "tag": "b403f864-761c-48b3-92e0-919b276e8a3a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:53.807128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:53.807821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:53.808420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:53.824422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] Creating event network-vif-deleted:b403f864-761c-48b3-92e0-919b276e8a3a for instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 on n-h1-855649-4 Nov 02 11:50:53.831993 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b8724d0c-5768-4f25-b20d-3baf9a489313 req-02de9bd3-2941-4cc4-a2fc-dfcc9992b404 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087526 Nov 02 11:50:53.835209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 73/149] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:54.028611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:54.032239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:54.039563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.041485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.042201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.047658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.048596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.049325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.550232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:54.552821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:54.582703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.583582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.584154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.587666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.591919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.591919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.689497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:54.693997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:54.696725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:54.697364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lazy-loading 'fault' on Instance uuid 422a8101-2746-4cee-b94f-3dd3ab8eed38 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:50:54.871648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed579e0d4c704e9284d93f5f592c3ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274e2d85d22423ab6bc2ec03916973f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:54.872752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:54.880731 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca5de332-e6e4-41ea-815e-eb5e1bc5865e tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 200 len: 1328 microversion: 2.1 time: 0.341665 Nov 02 11:50:54.881832 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 74/150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:54 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 1328 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:54.886427 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04233348-9694-499a-aace-be4066577031 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.862884 Nov 02 11:50:54.907605 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:54 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:55.219493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1849424984", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:55.321599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:50:55.890625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:50:55.892266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:50:55.892976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:50:55.894469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:50:55.895591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:50:55.910082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.911387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:55.911982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.912432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.914263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.914619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:55.914801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.917395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.922269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.923233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.924179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.925323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.926112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.926761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.944977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] HTTP exception thrown: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Request method failure captured: Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 HTTP/1.1 Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYllzw2ESbpLyeff6mn_RgUNc3rG6M9bPfaRwiPam0MFA0HjKU-uU2USorBjKbcEpG5Rh3NeFxyo0TYziTg3i-KQW3HSelkul6CtGar81m41GojGeI0qU_ii28hCBGZrES7hzBhKJmuDTbKK0P3wMZ5roRU5cpuBl-UyZECxahfczPIM Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:50:55.947547 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d274e2d85d22423ab6bc2ec03916973f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ed579e0d4c704e9284d93f5f592c3ccb Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:50:55.948950 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '422a8101-2746-4cee-b94f-3dd3ab8eed38'} Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:55.949621 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:50:55.951420 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:50:55.953921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Getting quotas for project 714025ac7d854ab58a3b4e464b9aee75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:50:55.954903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Returning 404 to user: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:55.956113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2f54c63-8eb5-40a9-8e27-aa552ea8fcd0 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 404 len: 111 microversion: 2.1 time: 0.049755 Nov 02 11:50:55.956427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Getting quotas for user e0a0f072abfd447c9fc6fe2628a23da7 and project 714025ac7d854ab58a3b4e464b9aee75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:50:55.957567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 78/152] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:55 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:50:55.962711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:55.964662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:55.967440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:55.971289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:50:55.973992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:50:55.975748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.976448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.977077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:55.977994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:55.978640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:55.979288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:56.113545 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79c11895-4a44-4dc9-a6ed-4aa5ad90e513 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059628 Nov 02 11:50:56.121340 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 75/153] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:50:56.124727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fe1bcaa-5048-44eb-8529-03c165ca7f4f tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:56.146885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe1bcaa-5048-44eb-8529-03c165ca7f4f tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:56.147460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe1bcaa-5048-44eb-8529-03c165ca7f4f tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:56.147901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe1bcaa-5048-44eb-8529-03c165ca7f4f tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:56.361357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:56.372883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c49288e-6765-4ca8-943c-05e2c5d1f33f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.412332 Nov 02 11:50:56.374279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 79/154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:55 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:56.380452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13d0e6db-66fe-4f03-be73-d3137e02a8c5 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:56.382308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13d0e6db-66fe-4f03-be73-d3137e02a8c5 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:56.541376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13d0e6db-66fe-4f03-be73-d3137e02a8c5 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:56.556586 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13d0e6db-66fe-4f03-be73-d3137e02a8c5 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1219 microversion: 2.1 time: 0.179652 Nov 02 11:50:56.559039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 80/155] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:56 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:56.582893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:50:56.596553 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fe1bcaa-5048-44eb-8529-03c165ca7f4f tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.478792 Nov 02 11:50:56.597452 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 76/156] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:56.610643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a57100c2-8501-4f7f-a495-4de80bad6d7d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:57.037025 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a57100c2-8501-4f7f-a495-4de80bad6d7d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.425084 Nov 02 11:50:57.037025 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 81/157] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:56 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:50:57.050286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a99bedf3-f1ad-497b-a698-dba507f9adde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1746837501"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:57.067103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-a99bedf3-f1ad-497b-a698-dba507f9adde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid c1e13043-7e95-466d-8169-6c812e13bcf0 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:50:57.209688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a99bedf3-f1ad-497b-a698-dba507f9adde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.160952 Nov 02 11:50:57.211337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 77/158] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:50:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:57.225004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95646c5a-af79-4445-b4ee-1d70822252dd tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:57.260240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95646c5a-af79-4445-b4ee-1d70822252dd tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.261030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95646c5a-af79-4445-b4ee-1d70822252dd tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.261640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95646c5a-af79-4445-b4ee-1d70822252dd tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:57.401405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:57.405121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:57.412487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.413068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.418119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:57.419556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.420191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.420654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:57.878435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:57.889325 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-beac4eb0-f74e-4b0f-b5c6-e0dceaed9c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.492734 Nov 02 11:50:57.890088 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 78/159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:57 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:57.905173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:57.906113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:57.917050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.919697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.921683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:57.922719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:57.923469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:57.924315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:58.027349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:58.037623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be452adc-e3bb-449e-be00-c0cae8a67dee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1223 microversion: 2.1 time: 0.145724 Nov 02 11:50:58.043051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:57 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:58.487717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95646c5a-af79-4445-b4ee-1d70822252dd tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 1.267298 Nov 02 11:50:58.506726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 82/161] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:58.506893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:58.526042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:58.526446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:58.526880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:58.618873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-855649-4. Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 39 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:50:58.625090 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: {"add_host": {"host": "n-h1-855649-4"}} Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:50:58.626317 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate 2 already has host n-h1-855649-4. Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-855649-4'}}} Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:50:58.627190 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-855649-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 11:50:58.628268 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 11:50:58.630946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:50:58.634059 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-855649-4-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 11, 50, 58, 550804), 'updated_at': None, 'host': 'n-h1-855649-4', 'aggregate_id': 2}] Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:58.636037 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-855649-4. Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.639846 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-855649-4. Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:50:58.643934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:50:58.648388 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-855649-4. Nov 02 11:50:58.648388 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:50:58.648388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-855649-4. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:50:58.656545 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec47b641-ed42-4c4f-9f7f-1805a5df9f74 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.158186 Nov 02 11:50:58.667931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b73e0cd8-2a36-44fa-b890-4bd1def1472d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:58.672072 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 80/162] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:58 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 11:50:58.684411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b73e0cd8-2a36-44fa-b890-4bd1def1472d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:58.685108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b73e0cd8-2a36-44fa-b890-4bd1def1472d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:58.686667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b73e0cd8-2a36-44fa-b890-4bd1def1472d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:58.917649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:58.918525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:58.932139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:58.946920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:58.947725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:58.949024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:58.950511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:58.951918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:59.108962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b73e0cd8-2a36-44fa-b890-4bd1def1472d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.445637 Nov 02 11:50:59.109950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 83/163] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:58 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:59.117022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:59.117417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:50:59.133548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:59.134023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:59.134472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:59.135240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:59.135697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:59.136124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:50:59.280046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:59.290768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2a349b8-cc02-4af7-a06e-7595b8a22d9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.378031 Nov 02 11:50:59.292249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:50:59.318895 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:58 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:59.329619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca473934-cb2a-4a87-b551-9b28408b4b8a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1271 microversion: 2.1 time: 0.218186 Nov 02 11:50:59.331370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 84/165] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:50:59 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:50:59.347601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a3f94bf-74ff-44c0-bba7-2640926b7ec4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:50:59.552096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a3f94bf-74ff-44c0-bba7-2640926b7ec4 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.229454 Nov 02 11:50:59.552748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:50:59 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:50:59.569206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96c2a6db-6bb3-423d-8c70-a56c36c3fd05 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165284990"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:59.575836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-96c2a6db-6bb3-423d-8c70-a56c36c3fd05 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 0cacf1a9-79b8-4b7d-bbaf-03d94b32642e for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:50:59.608917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c28210d5-56f5-4533-9b63-b9df32cb41e5 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-650904818"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:59.613306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-c28210d5-56f5-4533-9b63-b9df32cb41e5 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid 7fe66435-b0a1-4874-9469-f9817a62011e for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:50:59.742132 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96c2a6db-6bb3-423d-8c70-a56c36c3fd05 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.182085 Nov 02 11:50:59.752269 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 85/167] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:50:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:50:59.762162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c28210d5-56f5-4533-9b63-b9df32cb41e5 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.158422 Nov 02 11:50:59.763965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 83/168] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:50:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:50:59.781086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4b8d73f-01d6-4bfd-834e-0e19a7d29398 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:50:59.810579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4b8d73f-01d6-4bfd-834e-0e19a7d29398 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:50:59.816782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4b8d73f-01d6-4bfd-834e-0e19a7d29398 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:50:59.819849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4b8d73f-01d6-4bfd-834e-0e19a7d29398 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.190487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3956f5fb-b664-4f37-8e09-e6bf3d3dd75f tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:00.194052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3956f5fb-b664-4f37-8e09-e6bf3d3dd75f tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3956f5fb-b664-4f37-8e09-e6bf3d3dd75f tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 39 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:00.198622 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: {"add_host": {"host": "n-h1-855649-4"}} Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:00.200006 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-855649-4'}}} Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:00.200899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 11:51:00.201899 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.208829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3956f5fb-b664-4f37-8e09-e6bf3d3dd75f tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:00.211993 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3956f5fb-b664-4f37-8e09-e6bf3d3dd75f tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.457465 Nov 02 11:51:00.220515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 86/169] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:00.237521 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4b8d73f-01d6-4bfd-834e-0e19a7d29398 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.462697 Nov 02 11:51:00.239616 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 84/170] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:50:59 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:00.243658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33d52fd7-cb94-4b08-bae4-20db156c319a tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.350777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] Calling method '.version_select at 0x7ff1b80c18b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.388321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33d52fd7-cb94-4b08-bae4-20db156c319a tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.166481 Nov 02 11:51:00.394203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 87/171] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:00 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:00.402493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc48cb4c-35fe-4c60-a021-0d93b8ade0e1 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.413968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc48cb4c-35fe-4c60-a021-0d93b8ade0e1 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/4" status: 200 len: 241 microversion: 2.1 time: 0.016410 Nov 02 11:51:00.419361 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 88/172] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 11:51:00 2022] GET /compute/v2.1/os-aggregates/4 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:00.422279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.422903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:00.429874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.430633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.431252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.432235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.432850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.433486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.664614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69a43599-9043-448b-93e3-6f81bd55a0b9 could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:51:00.665504 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] HTTP exception thrown: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] Request method failure captured: Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-floating-ips/69a43599-9043-448b-93e3-6f81bd55a0b9 HTTP/1.1 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmk_8p2g93K6fej9KaqLnwoEjR_XVgeKxNf3E8wb2Lccz6P57m4QBVl23myn_RnmuL3jXdehpMTv1fb5_EXmRyJ9pkeCHFyeLcsPzxhoBiGuJdmv2jTOwSPOdIN5iy0CFgIyv4kZZazMwgzJXbIibSP2Dsbw3TjjR7m6TOSMPzFwUI Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: bbb72e91fa8c4fe1a160c22c81d25eb7 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1901793078 Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:00.678792 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbb72e91fa8c4fe1a160c22c81d25eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bbb72e91fa8c4fe1a160c22c81d25eb7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bbb72e91fa8c4fe1a160c22c81d25eb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbb72e91fa8c4fe1a160c22c81d25eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1901793078 Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: bbb72e91fa8c4fe1a160c22c81d25eb7 Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1901793078 Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 553365d491af48568964b641c51c4753 Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9 Nov 02 11:51:00.680102 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '69a43599-9043-448b-93e3-6f81bd55a0b9'} Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:00.680766 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69a43599-9043-448b-93e3-6f81bd55a0b9 could not be found Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf0f1751-872d-451f-bf31-3a54d9e2429a'] Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9. Nov 02 11:51:00.681781 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9 Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:00.682788 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:00.686706 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:00.686706 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9 Nov 02 11:51:00.686706 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:00.687305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] Returning 404 to user: Floating IP not found for ID 69a43599-9043-448b-93e3-6f81bd55a0b9 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:00.688357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e07d67c7-7a25-4cff-9fb9-f24588bd91f1 tempest-FloatingIPDetailsNegativeTestJSON-1901793078 tempest-FloatingIPDetailsNegativeTestJSON-1901793078-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/69a43599-9043-448b-93e3-6f81bd55a0b9" status: 404 len: 111 microversion: 2.1 time: 0.445073 Nov 02 11:51:00.689262 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 11:51:00 2022] GET /compute/v2.1/os-floating-ips/69a43599-9043-448b-93e3-6f81bd55a0b9 => generated 111 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:00.696220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:00.697287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:00.723475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.731815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.731815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:00.731815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:00.731815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:00.732259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.010449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:01.020253 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16233459-069e-4d3e-a717-6b3b5b8a7126 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1277 microversion: 2.1 time: 0.329609 Nov 02 11:51:01.020895 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:00 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:01.025706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e11bcee-7ee5-4a44-91b0-c38d8d9fa704 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1468563029"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.029733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-2e11bcee-7ee5-4a44-91b0-c38d8d9fa704 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid a21e836d-87e1-4850-941b-9ddcad8a416b for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:01.131411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e11bcee-7ee5-4a44-91b0-c38d8d9fa704 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108948 Nov 02 11:51:01.132068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 87/175] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:01.139705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afeb54e9-96a0-4134-b77b-1b3aecd0a93c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.176165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afeb54e9-96a0-4134-b77b-1b3aecd0a93c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.176655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afeb54e9-96a0-4134-b77b-1b3aecd0a93c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.177098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afeb54e9-96a0-4134-b77b-1b3aecd0a93c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.390346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:01.409791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4fb3a480-ecfd-47aa-ad83-69dc4eceb781 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.988924 Nov 02 11:51:01.411126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 89/176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:00 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:01.416052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f01c5e-3ef8-4f56-affe-03b6962a8975", "tag": "666857f3-8f5d-4ca6-9913-a1a58f8a4974"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.443824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.445279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.447540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.486876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] Creating event network-changed:666857f3-8f5d-4ca6-9913-a1a58f8a4974 for instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 on n-h2-855649-4 Nov 02 11:51:01.492276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-496a51e7-901b-45d7-8889-da972e87f9ab req-ef832726-924c-4d9d-86c7-b86ee66c1e98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079716 Nov 02 11:51:01.500546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 90/177] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:01.513122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-674767367"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.534078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.534883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.535651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.545196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:01.545990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:01.546633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:01.560730 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-674767367 could not be found. Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 57 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:51:01.565062 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: {"add_host": {"host": "tempest-nonexist_host-674767367"}} Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:01.566405 n-d-855649-4 devstack@n-api.service[127567]: exception: Compute host tempest-nonexist_host-674767367 could not be found. Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-674767367'}}} Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-674767367' is not mapped to any cell Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.567383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 11:51:01.568646 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-674767367 could not be found. Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-674767367 could not be found. Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.569877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-674767367 could not be found. Nov 02 11:51:01.571191 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.576218 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afeb54e9-96a0-4134-b77b-1b3aecd0a93c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.440521 Nov 02 11:51:01.576218 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 88/178] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:01.576374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-674767367 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:01.577317 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-110051dd-de9e-4672-802b-d89044b2dcde tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.075366 Nov 02 11:51:01.578812 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 91/179] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:01.585780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4461ca0f-339e-44e0-8b0b-7652117a1a2e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:01.608324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4ce7cde-266d-4ec7-9899-f7e59e1a75f3 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:01.732922 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4461ca0f-339e-44e0-8b0b-7652117a1a2e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.150640 Nov 02 11:51:01.733538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 89/180] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:01.733897 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4ce7cde-266d-4ec7-9899-f7e59e1a75f3 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.141262 Nov 02 11:51:01.734569 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 92/181] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:01.753889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fcaa951-c957-4a21-a6bc-0bf7a0548604 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fcaa951-c957-4a21-a6bc-0bf7a0548604 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 283 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:51:01.761219 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.762819 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:51:01.763508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:01.764232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.765300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.766337 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:51:01.766337 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:51:01.766337 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:51:01.766337 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.767584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fcaa951-c957-4a21-a6bc-0bf7a0548604 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:01.768663 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fcaa951-c957-4a21-a6bc-0bf7a0548604 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.028285 Nov 02 11:51:01.776587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 93/182] 10.222.0.48 () {60 vars in 1165 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:01.784571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05c94d4c-3ad0-42b8-a1b7-b5604b4a9eee tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1544893216"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.791623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-05c94d4c-3ad0-42b8-a1b7-b5604b4a9eee tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid 4f3f8fdf-a3cf-4049-ab2a-ec1b825faa0b for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:01.947679 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05c94d4c-3ad0-42b8-a1b7-b5604b4a9eee tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.164554 Nov 02 11:51:01.948425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 94/183] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:01.961092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ee2a8f4-ddcb-4167-9141-913a5ca20705 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.972801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7cf97c1-342e-4658-98a5-3a2ada313300 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Action: 'create', calling method: .version_select at 0x7ff1b3fc6430>, body: {"keypair": {"name": "tempest-keypair-1112070398", "type": "ssh", "user_id": "760f5757027947fcb0a9958bda458b7f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQxMY/gaV94O0RCvYCnK++UZAXma0ExI0BJttesGAYrXJEC5OZakZwNAebGOIFUUWvuHG/hI89fsDpxaxQ/o2MkV82N3/g7EkH3PAe9XmqAtI5fqvgtjSdt/XcFIw3koA=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ee2a8f4-ddcb-4167-9141-913a5ca20705 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 27 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:51:01.972965 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: {"aggregate": {"name": ""}} Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:01.974367 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:01.975119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:51:01.976605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:01.977990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ee2a8f4-ddcb-4167-9141-913a5ca20705 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:01.977990 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ee2a8f4-ddcb-4167-9141-913a5ca20705 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019964 Nov 02 11:51:01.977990 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 95/184] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:01.988640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7199fa5-61d5-4f27-b047-369827aab294 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.013524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7199fa5-61d5-4f27-b047-369827aab294 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.014233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7199fa5-61d5-4f27-b047-369827aab294 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.014692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7199fa5-61d5-4f27-b047-369827aab294 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.036391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f7cf97c1-342e-4658-98a5-3a2ada313300 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:02.049882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f7cf97c1-342e-4658-98a5-3a2ada313300 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for user 28dc5fce3db246af924a32da6fbd9b07 and project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:02.206812 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7cf97c1-342e-4658-98a5-3a2ada313300 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.470568 Nov 02 11:51:02.210455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 90/185] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 472 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:51:02.223528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3cd1c77-2528-4379-adb8-2a7d45433e45 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1862755572"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.228065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3cd1c77-2528-4379-adb8-2a7d45433e45 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3cd1c77-2528-4379-adb8-2a7d45433e45 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 60 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:02.233801 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: {"aggregate": {"name": "tempest-test_aggregate-1862755572"}} Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:02.240222 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1862755572'}}} Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:02.241028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:02.242115 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 11:51:02.243351 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.243351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3cd1c77-2528-4379-adb8-2a7d45433e45 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:02.243351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3cd1c77-2528-4379-adb8-2a7d45433e45 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.029193 Nov 02 11:51:02.247616 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 91/186] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:02 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:02.256703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:02.257758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:02.268127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.269092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.269749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.270668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.271352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.273236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.545696 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7199fa5-61d5-4f27-b047-369827aab294 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.564986 Nov 02 11:51:02.545696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 96/187] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:01 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:02.549741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6f9e6b1-b6e8-4a99-b5e2-7f30aca267a1 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Action: 'create', calling method: .version_select at 0x7ff1b8347d30>, body: {"keypair": {"name": "tempest-keypair-1078141912", "type": "ssh", "user_id": "760f5757027947fcb0a9958bda458b7f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHYtoMr6r4/0heTWiYXuQiueIUNWS4hf5vEvJ/1KFKf6yXQGf97Ib2SJnEWxQ9fFWZwHJmDFcCp4TcbIj5LafPs8OPskFKa7JX0QvlQq7EpO9UJWHFemFy1ghlQRZCdyQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.575812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a6f9e6b1-b6e8-4a99-b5e2-7f30aca267a1 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:02.585024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a6f9e6b1-b6e8-4a99-b5e2-7f30aca267a1 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for user 28dc5fce3db246af924a32da6fbd9b07 and project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:02.633269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:02.648583 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa476535-8ddd-46c0-b6c2-76d5ad1f41ee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.396296 Nov 02 11:51:02.649432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 92/188] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:02 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:02.661102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8dd9259-6b6c-4611-ba1a-26cb6098ff45 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1546728412"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.671851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-c8dd9259-6b6c-4611-ba1a-26cb6098ff45 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 803e1ad2-20de-41d5-bb4a-985359f8625b for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:02.698325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6f9e6b1-b6e8-4a99-b5e2-7f30aca267a1 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.153121 Nov 02 11:51:02.700883 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 97/189] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:51:02.708024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:02.708994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:02.717685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.718672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.720012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.721461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.722110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.723237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:02.775312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8dd9259-6b6c-4611-ba1a-26cb6098ff45 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.123268 Nov 02 11:51:02.777331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 93/190] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:02.790188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97442f03-459b-47c2-acb8-f8675a74aa78 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:02.803602 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97442f03-459b-47c2-acb8-f8675a74aa78 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 459 microversion: 2.1 time: 0.024722 Nov 02 11:51:02.812051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:51:02 2022] GET /compute/v2.1/os-aggregates => generated 459 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:02.817082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e629385-48ca-437b-b716-bd23a735e2a8 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Calling method '.version_select at 0x7ff1b3fc6670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:02.828034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e629385-48ca-437b-b716-bd23a735e2a8 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1112070398?user_id=760f5757027947fcb0a9958bda458b7f" status: 200 len: 512 microversion: 2.10 time: 0.014538 Nov 02 11:51:02.828936 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 95/192] 10.222.0.48 () {60 vars in 1340 bytes} [Wed Nov 2 11:51:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1112070398?user_id=760f5757027947fcb0a9958bda458b7f => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:02.842851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1546728412"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.846659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid b8d2d0cc-6eda-4d10-a5a5-482815563cb6 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:02.858633 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1546728412 already exists. Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 60 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:02.861212 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: {"aggregate": {"name": "tempest-test_aggregate-1546728412"}} Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:02.870592 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate tempest-test_aggregate-1546728412 already exists. Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1546728412'}}} Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 11:51:02.871331 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1546728412 already exists. Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:02.872946 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1546728412 already exists. Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1546728412 already exists. Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1546728412 already exists. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:02.873981 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa2c88fd-2275-44ba-a3fb-e28b2aea0911 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.033528 Nov 02 11:51:02.874732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 96/193] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:02 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:02.879959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c570077-aca5-4c8e-bc64-82cdbe910781 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:02.891799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c570077-aca5-4c8e-bc64-82cdbe910781 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:02.892686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c570077-aca5-4c8e-bc64-82cdbe910781 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:02.893365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c570077-aca5-4c8e-bc64-82cdbe910781 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:03.055489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:03.071442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3648c460-8752-4b5b-a478-a869753ffbb3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.370138 Nov 02 11:51:03.073384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 98/194] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:02 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:03.080571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b03fbaaa-1ef5-42e6-adf8-86f132ddf19a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Action: 'create', calling method: .version_select at 0x7ff1b90e4dc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1663885840", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInZXsyChrc0csAqHafiD+Bb1vR8K6JHTelcJbfG0xglwXpcusPDWMyksCxeA/FbW95pAnl43EWxv06oLyfDkx4OgzT9hngZMkmsIot5AmYGH4w1GTqdWZrA9MxD5SwQ7Q=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:03.096793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:03.103536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=65 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:03.104760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b03fbaaa-1ef5-42e6-adf8-86f132ddf19a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:03.120460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b03fbaaa-1ef5-42e6-adf8-86f132ddf19a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Getting quotas for user 28dc5fce3db246af924a32da6fbd9b07 and project 11538914f9e1416aac174ed485b743ad. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:03.244301 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b03fbaaa-1ef5-42e6-adf8-86f132ddf19a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.169443 Nov 02 11:51:03.248608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 99/195] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 11:51:03 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:51:03.259251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7245df1-ef8e-4a9c-9592-b5c3dae3dd29 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.260692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c570077-aca5-4c8e-bc64-82cdbe910781 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.395376 Nov 02 11:51:03.262661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 97/196] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:02 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:03.271951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef3c055a-8755-4af7-8d01-acedf16d9d12 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Calling method '.version_select at 0x7ff1b8122d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.285210 n-d-855649-4 devstack@n-api.service[127568]: WARNING oslo_db.sqlalchemy.utils [None req-ef3c055a-8755-4af7-8d01-acedf16d9d12 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 11:51:03.309119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef3c055a-8755-4af7-8d01-acedf16d9d12 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs?user_id=760f5757027947fcb0a9958bda458b7f" status: 200 len: 726 microversion: 2.10 time: 0.043493 Nov 02 11:51:03.309119 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 98/197] 10.222.0.48 () {60 vars in 1259 bytes} [Wed Nov 2 11:51:03 2022] GET /compute/v2.1/os-keypairs?user_id=760f5757027947fcb0a9958bda458b7f => generated 726 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:03.325060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ef48776-28c4-4c94-965e-ca62985c50f5 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.368151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7245df1-ef8e-4a9c-9592-b5c3dae3dd29 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.117729 Nov 02 11:51:03.372764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:03 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:03.379169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06b447dc-1bf0-4e7a-98c4-166b50997723 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Calling method '.version_select at 0x7ff1b8347940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.473142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ef48776-28c4-4c94-965e-ca62985c50f5 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.152395 Nov 02 11:51:03.485775 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:03 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:03.495793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06b447dc-1bf0-4e7a-98c4-166b50997723 tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1663885840" status: 204 len: 0 microversion: 2.10 time: 0.119591 Nov 02 11:51:03.497090 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 101/200] 10.222.0.48 () {60 vars in 1325 bytes} [Wed Nov 2 11:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1663885840 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:51:03.506789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f88068aa-8e84-4dac-bb73-46b955a87a25 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1060910112"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:03.513428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d0364ae-618e-410d-a9af-75acf012186e tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1219706555"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:03.518305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-f88068aa-8e84-4dac-bb73-46b955a87a25 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid 0cb3d4df-6fb5-4b82-87f6-c9d6ad437b89 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:03.522304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-9d0364ae-618e-410d-a9af-75acf012186e tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 7ce01f90-54c9-42d8-ad6f-b3342a5d5afe for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:03.648933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f88068aa-8e84-4dac-bb73-46b955a87a25 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.149183 Nov 02 11:51:03.648933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 102/201] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:03.661530 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d0364ae-618e-410d-a9af-75acf012186e tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.174204 Nov 02 11:51:03.668219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 100/202] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:03.672725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c1915c-2147-4873-83fd-5ba245187d8d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:03.674113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6fade70-bc46-4c0f-8171-38cbd10fec7d tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Calling method '.version_select at 0x7ff1b824e5e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.689493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:03.695190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c1915c-2147-4873-83fd-5ba245187d8d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:03.695724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c1915c-2147-4873-83fd-5ba245187d8d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:03.696199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c1915c-2147-4873-83fd-5ba245187d8d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:03.768169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6fade70-bc46-4c0f-8171-38cbd10fec7d tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078141912?user_id=760f5757027947fcb0a9958bda458b7f" status: 204 len: 0 microversion: 2.10 time: 0.110204 Nov 02 11:51:03.779293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 103/203] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078141912?user_id=760f5757027947fcb0a9958bda458b7f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:51:03.808374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:03.813251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:03.832701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:03.833557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:03.834893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:03.842645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:03.843381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:03.843963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.134027 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84c1915c-2147-4873-83fd-5ba245187d8d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.470540 Nov 02 11:51:04.134776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 101/204] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:04.139810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-733b37f3-30e5-493b-85d4-b7ccf807edd3 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.141429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-733b37f3-30e5-493b-85d4-b7ccf807edd3 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-733b37f3-30e5-493b-85d4-b7ccf807edd3 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/9 HTTP/1.1 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:04.143325 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 11:51:04.144476 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '9'} Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:04.145123 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 11:51:04.146101 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.148338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-733b37f3-30e5-493b-85d4-b7ccf807edd3 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:04.149394 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-733b37f3-30e5-493b-85d4-b7ccf807edd3 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 403 len: 116 microversion: 2.1 time: 0.013341 Nov 02 11:51:04.150125 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 102/205] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:04.156002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31d3113b-5058-4df0-aba9-83cd7195bf3a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] Calling method '.version_select at 0x7ff1b80c1790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.269398 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31d3113b-5058-4df0-aba9-83cd7195bf3a tempest-KeyPairsV210TestJSON-1444037564 tempest-KeyPairsV210TestJSON-1444037564-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112070398?user_id=760f5757027947fcb0a9958bda458b7f" status: 204 len: 0 microversion: 2.10 time: 0.117929 Nov 02 11:51:04.273041 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 103/206] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112070398?user_id=760f5757027947fcb0a9958bda458b7f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:51:04.273766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:04.282397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.283515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:04.290924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3013e6a0-45aa-4885-90cc-7b054a6ea298 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.501776 Nov 02 11:51:04.299186 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 104/207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:03 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:04.305551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a0814e9-c9f8-4cc6-87f6-5f76fc70f806 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:04.305789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.306455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.307110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.307981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.308617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.309228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.326880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a0814e9-c9f8-4cc6-87f6-5f76fc70f806 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.329668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a0814e9-c9f8-4cc6-87f6-5f76fc70f806 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.330183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a0814e9-c9f8-4cc6-87f6-5f76fc70f806 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.355602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:04.692338 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a0814e9-c9f8-4cc6-87f6-5f76fc70f806 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.397351 Nov 02 11:51:04.693539 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 105/208] 10.222.0.48 () {60 vars in 1191 bytes} [Wed Nov 2 11:51:04 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:04.700290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-402cfbc2-cb81-4d7c-9680-1cfb7e05cf7c tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.795814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:04.805063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa1be72e-6abc-4c18-ba7a-a937cdbeac90 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.530218 Nov 02 11:51:04.805928 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 104/209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:04 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:04.834962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-402cfbc2-cb81-4d7c-9680-1cfb7e05cf7c tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.140324 Nov 02 11:51:04.835573 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:04.838310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153f71f0-b8d7-42d5-931c-fb0157936853", "tag": "b343fc19-07f8-4b93-bf76-9e82f48f3c47"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:04.849496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3dc8ad32-74f1-45a2-b6e4-50f62cee43ff tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.886301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:04.887126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:04.887722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:04.911306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] Creating event network-changed:b343fc19-07f8-4b93-bf76-9e82f48f3c47 for instance 153f71f0-b8d7-42d5-931c-fb0157936853 on n-h1-855649-4 Nov 02 11:51:04.924044 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-06ea8d85-a979-4546-8f0c-0901df422b02 req-5f2ed159-dea6-4d6d-9806-7a13ddecc9c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101300 Nov 02 11:51:04.926538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 105/211] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:04.934480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c06532d-24ff-4b60-a6b3-42a9813ef87f tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:04.962437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3dc8ad32-74f1-45a2-b6e4-50f62cee43ff tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.122585 Nov 02 11:51:04.970468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:04 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:04.975303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7b5c586-4f0a-438c-b471-f0ae28eb220a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1006141769"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:04.976092 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3c06532d-24ff-4b60-a6b3-42a9813ef87f tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c06532d-24ff-4b60-a6b3-42a9813ef87f tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:04.982238 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate -1 could not be found. Nov 02 11:51:04.983804 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '-1'} Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:04.984589 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.985853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 11:51:04.987170 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:04.987571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-f7b5c586-4f0a-438c-b471-f0ae28eb220a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid 1a1565ff-5428-48ef-8174-4c088f2b7fbf for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:04.997358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c06532d-24ff-4b60-a6b3-42a9813ef87f tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:05.001784 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c06532d-24ff-4b60-a6b3-42a9813ef87f tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.072920 Nov 02 11:51:05.002672 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:04 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:05.014094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcc1d118-613d-40e1-95aa-4972d5783a5a tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1231562270"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:05.023691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-bcc1d118-613d-40e1-95aa-4972d5783a5a tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 52457da2-9676-4cc7-8ea5-67b4c431799f for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:05.102999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7b5c586-4f0a-438c-b471-f0ae28eb220a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.123561 Nov 02 11:51:05.105302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 108/214] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:05.113481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-012312b5-0857-4189-8db4-c0cc63b2f365 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1250217743"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:05.117459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-012312b5-0857-4189-8db4-c0cc63b2f365 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Generated uuid d2841c2d-c25d-4c02-b5d5-eb45aa0bec05 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:05.132466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcc1d118-613d-40e1-95aa-4972d5783a5a tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.122776 Nov 02 11:51:05.134130 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 107/215] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:05.139946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d0bee7d-4092-4c9d-a386-a8b6fa8be44c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.265933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-012312b5-0857-4189-8db4-c0cc63b2f365 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.158689 Nov 02 11:51:05.267139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d0bee7d-4092-4c9d-a386-a8b6fa8be44c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.128925 Nov 02 11:51:05.267969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 108/216] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:05 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:05.270628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 109/217] 10.222.0.48 () {62 vars in 1205 bytes} [Wed Nov 2 11:51:05 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:05.284865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff284d0e-cf7d-4a86-a204-1c12f090b57c tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.287242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc842268-4507-4c08-98fb-9c3c4891f06a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.292539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff284d0e-cf7d-4a86-a204-1c12f090b57c tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff284d0e-cf7d-4a86-a204-1c12f090b57c tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:05.298334 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 11:51:05.299543 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '11'} Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:05.300629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 11:51:05.301640 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.306921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff284d0e-cf7d-4a86-a204-1c12f090b57c tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:05.311286 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff284d0e-cf7d-4a86-a204-1c12f090b57c tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates/11" status: 403 len: 114 microversion: 2.1 time: 0.041367 Nov 02 11:51:05.319078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 109/218] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/os-aggregates/11 => generated 114 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:05.319217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cc842268-4507-4c08-98fb-9c3c4891f06a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc842268-4507-4c08-98fb-9c3c4891f06a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Request method failure captured: Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-aggregates/10 HTTP/1.1 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYll2bXod5MxA6fBfoAPe45TA4kvlR1RZ0YxXHPF22ORxjhBN4zxIf7BuOnSG4oyDD8BUMSQsPLqKvYAZzR-N4AJuc_2j3FCqqKh98qNh-Al9UTiprWwFbHT5PsgYM3FQgh6qlzPS_qRESY1rXUqG3_kTIO4M5-dvSth_WFu3GjgKCus Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:51:05.321504 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39519d10d15c48e7927733f2e8202409", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39519d10d15c48e7927733f2e8202409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f1b56b68a74744f29b6a2f8af526fe53 Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: exception: Aggregate 10 could not be found. Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '10'} Nov 02 11:51:05.322762 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.323678 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Nov 02 11:51:05.325309 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.336089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc842268-4507-4c08-98fb-9c3c4891f06a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:05.338648 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc842268-4507-4c08-98fb-9c3c4891f06a tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.066191 Nov 02 11:51:05.339669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd07eb51-54f6-4418-9e50-bdd86c65f9b0 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1548378408"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:05.342178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 110/219] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/os-aggregates/10 => generated 78 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:05.358052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.359394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:05.376339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:05.377188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:05.377846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:05.379628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:05.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:05.380913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:05.620028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd07eb51-54f6-4418-9e50-bdd86c65f9b0 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.302709 Nov 02 11:51:05.629643 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 110/220] 10.222.0.48 () {62 vars in 1213 bytes} [Wed Nov 2 11:51:05 2022] PUT /compute/v2.1/os-aggregates/12 => generated 300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:05.635694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6022e343-b647-4363-a588-d9a2587f1aa6 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.760443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6022e343-b647-4363-a588-d9a2587f1aa6 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.129332 Nov 02 11:51:05.762951 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 111/221] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:05 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:05.790502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f573079-4b45-40c5-871a-d3d92389049e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.844558 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5f573079-4b45-40c5-871a-d3d92389049e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] HTTP exception thrown: Aggregate 10 could not be found. Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f573079-4b45-40c5-871a-d3d92389049e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Request method failure captured: Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/10 HTTP/1.1 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll2bXod5MxA6fBfoAPe45TA4kvlR1RZ0YxXHPF22ORxjhBN4zxIf7BuOnSG4oyDD8BUMSQsPLqKvYAZzR-N4AJuc_2j3FCqqKh98qNh-Al9UTiprWwFbHT5PsgYM3FQgh6qlzPS_qRESY1rXUqG3_kTIO4M5-dvSth_WFu3GjgKCus Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:05.850461 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39519d10d15c48e7927733f2e8202409", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39519d10d15c48e7927733f2e8202409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f1b56b68a74744f29b6a2f8af526fe53 Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate 10 could not be found. Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '10'} Nov 02 11:51:05.851747 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:05.852419 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 10 could not be found. Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 10 could not be found. Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.853387 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 10 could not be found. Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f573079-4b45-40c5-871a-d3d92389049e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Returning 404 to user: Aggregate 10 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:05.854551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f573079-4b45-40c5-871a-d3d92389049e tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 404 len: 78 microversion: 2.1 time: 0.088382 Nov 02 11:51:05.861328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:05 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 78 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:05.884323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5582c23-bd04-42b1-9fc0-b61cf211397e tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.906568 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5582c23-bd04-42b1-9fc0-b61cf211397e tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 300 microversion: 2.41 time: 0.033509 Nov 02 11:51:05.907957 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 113/223] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/os-aggregates/12 => generated 300 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:05.912919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-773abc5e-d093-46b1-9d5e-2ac2e046b65d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.920850 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-773abc5e-d093-46b1-9d5e-2ac2e046b65d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-773abc5e-d093-46b1-9d5e-2ac2e046b65d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:05.922743 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate -1 could not be found. Nov 02 11:51:05.923917 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '-1'} Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.924541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 11:51:05.925557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:05.929046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-773abc5e-d093-46b1-9d5e-2ac2e046b65d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:05.930132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-773abc5e-d093-46b1-9d5e-2ac2e046b65d tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021049 Nov 02 11:51:05.930876 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 114/224] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:05.936974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:05.938603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:05.941578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:05.947961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:05.948974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:05.949631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:05.961957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:05.962760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:05.963549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:05.964175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:05.987349 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f418edc2-d056-4e12-8868-d683c193172b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.637744 Nov 02 11:51:05.988525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 111/225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:05.998104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a07223b-a112-42ed-b830-6fac6553e551 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-671409953", "name": "tempest-test_aggregate-1583192824"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:06.040332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-5a07223b-a112-42ed-b830-6fac6553e551 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid b4bfb415-bacb-4596-be23-372eb5ae9c01 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:06.181972 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a07223b-a112-42ed-b830-6fac6553e551 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.191743 Nov 02 11:51:06.189421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 112/226] 10.222.0.48 () {60 vars in 1165 bytes} [Wed Nov 2 11:51:05 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:06.201591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c1df96a-fd4e-46b3-8db1-e62f4439c76a tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:06.233373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1df96a-fd4e-46b3-8db1-e62f4439c76a tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:06.233882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1df96a-fd4e-46b3-8db1-e62f4439c76a tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:06.234319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1df96a-fd4e-46b3-8db1-e62f4439c76a tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:06.362773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:06.379933 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc550183-bf94-4c7b-8401-d3f9c3f99e52 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.447657 Nov 02 11:51:06.381041 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:05 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:06.397688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d50823ad-1695-4937-9266-b9711517d139 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.399691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d50823ad-1695-4937-9266-b9711517d139 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d50823ad-1695-4937-9266-b9711517d139 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:06.402063 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 11:51:06.403794 n-d-855649-4 devstack@n-api.service[127568]: action_args: {} Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:06.404462 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 11:51:06.405434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.408069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d50823ad-1695-4937-9266-b9711517d139 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:06.409371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d50823ad-1695-4937-9266-b9711517d139 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026932 Nov 02 11:51:06.416514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 116/228] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:51:06 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:06.431901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d94b26b-8ffb-4fb5-946c-3ff071f4e374 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.562630 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d94b26b-8ffb-4fb5-946c-3ff071f4e374 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.143834 Nov 02 11:51:06.566476 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 117/229] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:06.574075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f05b5e31-69a3-4091-bbae-c3010fec0937 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.600084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f05b5e31-69a3-4091-bbae-c3010fec0937 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f05b5e31-69a3-4091-bbae-c3010fec0937 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Request method failure captured: Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll2bXod5MxA6fBfoAPe45TA4kvlR1RZ0YxXHPF22ORxjhBN4zxIf7BuOnSG4oyDD8BUMSQsPLqKvYAZzR-N4AJuc_2j3FCqqKh98qNh-Al9UTiprWwFbHT5PsgYM3FQgh6qlzPS_qRESY1rXUqG3_kTIO4M5-dvSth_WFu3GjgKCus Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:06.601664 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39519d10d15c48e7927733f2e8202409", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39519d10d15c48e7927733f2e8202409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f1b56b68a74744f29b6a2f8af526fe53 Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate 13 could not be found. Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '13'} Nov 02 11:51:06.603073 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.603928 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Nov 02 11:51:06.605159 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.607132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f05b5e31-69a3-4091-bbae-c3010fec0937 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:06.607132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f05b5e31-69a3-4091-bbae-c3010fec0937 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.035524 Nov 02 11:51:06.610328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 118/230] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:06 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:06.622716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e68d96c0-b678-47d9-9af3-1f53cd13056c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.661319 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e68d96c0-b678-47d9-9af3-1f53cd13056c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e68d96c0-b678-47d9-9af3-1f53cd13056c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Request method failure captured: Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll2bXod5MxA6fBfoAPe45TA4kvlR1RZ0YxXHPF22ORxjhBN4zxIf7BuOnSG4oyDD8BUMSQsPLqKvYAZzR-N4AJuc_2j3FCqqKh98qNh-Al9UTiprWwFbHT5PsgYM3FQgh6qlzPS_qRESY1rXUqG3_kTIO4M5-dvSth_WFu3GjgKCus Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:06.669315 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39519d10d15c48e7927733f2e8202409", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39519d10d15c48e7927733f2e8202409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39519d10d15c48e7927733f2e8202409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 39519d10d15c48e7927733f2e8202409 Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-725619572 Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f1b56b68a74744f29b6a2f8af526fe53 Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-725619572-project-admin Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: exception: Aggregate 13 could not be found. Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '13'} Nov 02 11:51:06.670739 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:06.671642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:06.673074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e68d96c0-b678-47d9-9af3-1f53cd13056c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:06.674416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e68d96c0-b678-47d9-9af3-1f53cd13056c tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.059238 Nov 02 11:51:06.679305 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 119/231] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:06.698456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7168fee7-20d2-414f-b6df-baf72518b313 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-958104459"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:06.702633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-7168fee7-20d2-414f-b6df-baf72518b313 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid c11e2cbc-5cc4-4e2c-98fe-e08bae1c5408 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:06.755981 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c1df96a-fd4e-46b3-8db1-e62f4439c76a tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.565068 Nov 02 11:51:06.762829 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 113/232] 10.222.0.48 () {62 vars in 1235 bytes} [Wed Nov 2 11:51:06 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:06.770138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03bfa65d-7eb2-414a-8d9a-af77239f8032 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:06.819183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03bfa65d-7eb2-414a-8d9a-af77239f8032 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:06.822062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03bfa65d-7eb2-414a-8d9a-af77239f8032 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:06.822932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03bfa65d-7eb2-414a-8d9a-af77239f8032 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:06.850797 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7168fee7-20d2-414f-b6df-baf72518b313 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.170296 Nov 02 11:51:06.851796 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 120/233] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:06.866346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cac04a1-a316-4bdc-83cf-1a8436a4653b tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:06.877172 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cac04a1-a316-4bdc-83cf-1a8436a4653b tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.016471 Nov 02 11:51:06.879401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 121/234] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:06 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:06.906443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-baa7e70e-4e42-4039-beaf-68cb98ccc9cb tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:07.041585 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-baa7e70e-4e42-4039-beaf-68cb98ccc9cb tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.143872 Nov 02 11:51:07.045624 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 122/235] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 11:51:06 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:07.065006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.068222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:07.081701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.082971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.083715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.084595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.085207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.086062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.246012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03bfa65d-7eb2-414a-8d9a-af77239f8032 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 300 microversion: 2.41 time: 0.479559 Nov 02 11:51:07.258086 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 114/236] 10.222.0.48 () {62 vars in 1235 bytes} [Wed Nov 2 11:51:06 2022] POST /compute/v2.1/os-aggregates/12/action => generated 300 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:07.264259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91389152-ea0a-436d-b62e-3a24595c30aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.283939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91389152-ea0a-436d-b62e-3a24595c30aa tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.024191 Nov 02 11:51:07.294137 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 115/237] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:07 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:07.316026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43e91f60-ef06-40e0-ac54-8f0eaf9ea6a8 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.411441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:07.415780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:07.423003 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19f2c5dc-f04a-4959-973f-3118833b3c89 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.376015 Nov 02 11:51:07.428302 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 123/238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:07 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:07.452600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e42f9d8-ab3c-4462-94d7-e61a4ef082f7 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.515471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43e91f60-ef06-40e0-ac54-8f0eaf9ea6a8 tempest-AggregatesAdminTestV241-969816815 tempest-AggregatesAdminTestV241-969816815-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.219421 Nov 02 11:51:07.516171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 116/239] 10.222.0.48 () {60 vars in 1196 bytes} [Wed Nov 2 11:51:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:07.531194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:07.531814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:07.542842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.544323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.546130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.546882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.548513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.549122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:07.616413 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e42f9d8-ab3c-4462-94d7-e61a4ef082f7 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.173597 Nov 02 11:51:07.617308 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 124/240] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:07.629383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab1f984f-2b7d-49c7-8957-9e2f9b30c83b tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408491805"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:07.640378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-ab1f984f-2b7d-49c7-8957-9e2f9b30c83b tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 9e886fab-212a-43b8-8b88-08b79dd189d1 for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:07.823314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:07.834832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bce02c5-21a0-4631-bd7b-4fce813cdff7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.312954 Nov 02 11:51:07.849510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 117/241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:07 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:07.853304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab1f984f-2b7d-49c7-8957-9e2f9b30c83b tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.234618 Nov 02 11:51:07.854692 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 125/242] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:07.859728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a297872-c95c-49b0-afb9-a37ab14f81a9 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2040896863", "availability_zone": "tempest-test_az-1683931760"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:07.864087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-4a297872-c95c-49b0-afb9-a37ab14f81a9 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid f4c829bc-133d-45f4-9713-d899fb0bf5b5 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:07.877001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd2c5587-6a4e-4221-a123-76ddda51d3c5 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:07.892508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2c5587-6a4e-4221-a123-76ddda51d3c5 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:07.893318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2c5587-6a4e-4221-a123-76ddda51d3c5 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:07.893764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2c5587-6a4e-4221-a123-76ddda51d3c5 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.002138 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a297872-c95c-49b0-afb9-a37ab14f81a9 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.146790 Nov 02 11:51:08.003036 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 118/243] 10.222.0.48 () {60 vars in 1165 bytes} [Wed Nov 2 11:51:07 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:08.021404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cb1177c-4c4a-4257-9d0b-4f36cbb13fd4 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2040896863_new", "availability_zone": "tempest-test_az-1683931760_new"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:08.219254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:DELETE=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:08.328227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cb1177c-4c4a-4257-9d0b-4f36cbb13fd4 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.329690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cb1177c-4c4a-4257-9d0b-4f36cbb13fd4 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.330410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cb1177c-4c4a-4257-9d0b-4f36cbb13fd4 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.392279 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd2c5587-6a4e-4221-a123-76ddda51d3c5 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 242 microversion: 2.1 time: 0.526079 Nov 02 11:51:08.401535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 126/244] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 11:51:07 2022] POST /compute/v2.1/os-aggregates/15/action => generated 242 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:08.409654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a378384d-47e6-46a3-8fd2-bc6ca239bf79 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:08.415457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a378384d-47e6-46a3-8fd2-bc6ca239bf79 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9bfe4b4aa036427a9013cc9fe247a54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0578221b42f44678831a12aa60f19a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a378384d-47e6-46a3-8fd2-bc6ca239bf79 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Request method failure captured: Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 42 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll0EMdkS317cMQgTensNtNYpbaHG6qtew2iegDJGfMeuOJvEsc9088_KBS96yZYTCyBI2v8yOCGqE8U1XXhAaXZhsqWuWtsOQOUeBT7qA4Zp7dhNehYYB8BvkwILbAojH6edK1GmcbCK6S11TEK2uKms96ct6ym27PrBRi4VLbL8Us Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:08.419759 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0578221b42f44678831a12aa60f19a89", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0578221b42f44678831a12aa60f19a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0578221b42f44678831a12aa60f19a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0578221b42f44678831a12aa60f19a89 Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081 Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bfe4b4aa036427a9013cc9fe247a54b Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1043055081-project Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: {"remove_host": {"host": "n-h1-855649-4"}} Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:08.421575 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'n-h1-855649-4'}}} Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:08.422281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 11:51:08.423443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:08.429073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a378384d-47e6-46a3-8fd2-bc6ca239bf79 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:08.430891 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a378384d-47e6-46a3-8fd2-bc6ca239bf79 tempest-AggregatesAdminNegativeTestJSON-1043055081 tempest-AggregatesAdminNegativeTestJSON-1043055081-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.027504 Nov 02 11:51:08.443135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 127/245] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 11:51:08 2022] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:08.451441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c134b168-72d2-4fcd-bac7-a459baa4c4e7 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:08.472384 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cb1177c-4c4a-4257-9d0b-4f36cbb13fd4 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.460396 Nov 02 11:51:08.472937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 119/246] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 11:51:08 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:08.487939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:08.493668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:08.508905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.509403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.509882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.513929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c134b168-72d2-4fcd-bac7-a459baa4c4e7 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.521100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c134b168-72d2-4fcd-bac7-a459baa4c4e7 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.522284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.522909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c134b168-72d2-4fcd-bac7-a459baa4c4e7 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.523564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.526273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.856091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:08.865120 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80235c5a-b05f-4f9d-b236-ce3c8e65b996 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.390430 Nov 02 11:51:08.866409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 120/247] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:08 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:08.872356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0762358a-9dec-4a3f-9ba6-60cad1983acf tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:08.902080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0762358a-9dec-4a3f-9ba6-60cad1983acf tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 569 microversion: 2.1 time: 0.034264 Nov 02 11:51:08.904505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:51:08 2022] GET /compute/v2.1/os-aggregates => generated 569 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:08.915605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:08.919035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:08.938610 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c134b168-72d2-4fcd-bac7-a459baa4c4e7 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 227 microversion: 2.1 time: 0.493068 Nov 02 11:51:08.942340 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 128/249] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 11:51:08 2022] POST /compute/v2.1/os-aggregates/15/action => generated 227 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:08.958459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fab5c2cd-3ebe-4c7c-86ad-bfe9e813735d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:08.976759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.977895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.983989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:08.994739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:08.995960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:08.999581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.112428 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fab5c2cd-3ebe-4c7c-86ad-bfe9e813735d tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.168272 Nov 02 11:51:09.113436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 129/250] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:08 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:09.124200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61be2017-60f7-4a62-b927-3bdbbbdda710 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.151466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=13,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:09.219465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:09.228595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d878ccc8-a72a-418a-8975-5bff1cab5f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.322682 Nov 02 11:51:09.229451 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 122/251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:08 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:09.235145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af6a35da-4f9e-40b4-83ea-6e63ee5bacef tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1100238645"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:09.239524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-af6a35da-4f9e-40b4-83ea-6e63ee5bacef tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Generated uuid e86f9cca-a669-4e0b-9483-8bb8733c5c18 for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:09.252971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61be2017-60f7-4a62-b927-3bdbbbdda710 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.133833 Nov 02 11:51:09.253645 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 130/252] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:09 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:09.263705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20f357cd-cf0b-4928-9bf2-17f419b66ec1 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2082894984"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:09.269139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.aggregate [None req-20f357cd-cf0b-4928-9bf2-17f419b66ec1 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Generated uuid 0bdbbf4e-93fd-47f6-8073-290b4b1f992e for aggregate {{(pid=127568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 11:51:09.337487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af6a35da-4f9e-40b4-83ea-6e63ee5bacef tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105984 Nov 02 11:51:09.339105 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 123/253] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:09.357483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ef2c554-39e4-4789-893a-e4a90c6a5f27 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.362346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20f357cd-cf0b-4928-9bf2-17f419b66ec1 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.102119 Nov 02 11:51:09.364551 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 131/254] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 11:51:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:09.377001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:09.388441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ef2c554-39e4-4789-893a-e4a90c6a5f27 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.032413 Nov 02 11:51:09.390130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.390771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.392645 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 124/255] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:51:09 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:09.398475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.408314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.409144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.409789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.412350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80cf952d-91c0-4d53-9cae-304f758402c3 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.423754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.compute.aggregates [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 11:51:09.425055 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Request method failure captured: Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 42 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYll3mb2Jhu0apXv5wcaxBLkawG9NmEiu29XL-ICxN3VyW9VJNIzImMrcdI3OEe4iXm-UBZxG1HUYE_ld7u0rH4cU6tS_0BvhVgyPTdrP3qMoinPlocyVblagDTJnWEOJRLKo-P3XmitPtIqPZUz2YtJ5L5GHLqOjiM2G1c7q3ZMamnk Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:09.427474 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_172ede1569284bceb0a758091c350fc1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/172ede1569284bceb0a758091c350fc1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/172ede1569284bceb0a758091c350fc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 172ede1569284bceb0a758091c350fc1 Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-562093099 Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b9709938d8ba43f4b1c0dfc1a6da7574 Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: {"remove_host": {"host": "nonexist_host"}} Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:09.428655 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 11:51:09.429367 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 11:51:09.431641 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.432800 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 11:51:09.436417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.439180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:09.440301 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4ceac8a-5360-4a5f-a57c-e0f3ed85ebff tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.068064 Nov 02 11:51:09.447383 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 132/256] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 11:51:09 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:51:09.457604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b263d45-6136-4c4d-a104-136860d68f19 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.548512 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80cf952d-91c0-4d53-9cae-304f758402c3 tempest-AggregatesAdminTestJSON-725619572 tempest-AggregatesAdminTestJSON-725619572-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.146483 Nov 02 11:51:09.550824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 125/257] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:09 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:09.572458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.573441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:09.582842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.584252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.586167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.595012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.595443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b263d45-6136-4c4d-a104-136860d68f19 tempest-AggregatesAdminNegativeTestJSON-562093099 tempest-AggregatesAdminNegativeTestJSON-562093099-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.146856 Nov 02 11:51:09.600567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 133/258] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:09 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:09.603281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.605117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.628979 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] HTTP exception thrown: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Request method failure captured: Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 HTTP/1.1 Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYllzw2ESbpLyeff6mn_RgUNc3rG6M9bPfaRwiPam0MFA0HjKU-uU2USorBjKbcEpG5Rh3NeFxyo0TYziTg3i-KQW3HSelkul6CtGar81m41GojGeI0qU_ii28hCBGZrES7hzBhKJmuDTbKK0P3wMZ5roRU5cpuBl-UyZECxahfczPIM Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:09.631550 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d274e2d85d22423ab6bc2ec03916973f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ed579e0d4c704e9284d93f5f592c3ccb Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.632889 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '422a8101-2746-4cee-b94f-3dd3ab8eed38'} Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:09.633563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.634755 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.639742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Returning 404 to user: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:09.647611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca77b644-838c-427f-90fe-9330fc858319 tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "DELETE /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 404 len: 111 microversion: 2.1 time: 0.080819 Nov 02 11:51:09.647611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 126/259] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:51:09 2022] DELETE /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:09.653275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.654169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] [instance: 422a8101-2746-4cee-b94f-3dd3ab8eed38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:09.665479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.670633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.671431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.672360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.673001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.673806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.731570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] HTTP exception thrown: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Request method failure captured: Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 HTTP/1.1 Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYllzw2ESbpLyeff6mn_RgUNc3rG6M9bPfaRwiPam0MFA0HjKU-uU2USorBjKbcEpG5Rh3NeFxyo0TYziTg3i-KQW3HSelkul6CtGar81m41GojGeI0qU_ii28hCBGZrES7hzBhKJmuDTbKK0P3wMZ5roRU5cpuBl-UyZECxahfczPIM Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:09.741714 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d274e2d85d22423ab6bc2ec03916973f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d274e2d85d22423ab6bc2ec03916973f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d274e2d85d22423ab6bc2ec03916973f Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1805962985 Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ed579e0d4c704e9284d93f5f592c3ccb Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AggregatesAdminTestJSON-1805962985-project Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.742994 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '422a8101-2746-4cee-b94f-3dd3ab8eed38'} Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:09.743638 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. Nov 02 11:51:09.744659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:09.754340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] Returning 404 to user: Instance 422a8101-2746-4cee-b94f-3dd3ab8eed38 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:09.758679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3dff91f-030b-411c-aace-6580f27809af tempest-AggregatesAdminTestJSON-1805962985 tempest-AggregatesAdminTestJSON-1805962985-project] 10.222.0.48 "GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38" status: 404 len: 111 microversion: 2.1 time: 0.109505 Nov 02 11:51:09.760002 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 134/260] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:09 2022] GET /compute/v2.1/servers/422a8101-2746-4cee-b94f-3dd3ab8eed38 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:09.894276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:09.896389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:09.906408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.907024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.907670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:09.908544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:09.909938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:09.910523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:10.068185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:10.088093 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdbafd09-8218-4e6e-acf1-ce587df01fde tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.201674 Nov 02 11:51:10.094736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 127/261] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:09 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:10.253347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:10.254026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:10.265517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:10.265517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:10.265517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:10.265517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:10.278877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:10.281475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:10.527715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:10.538085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08063474-86ea-4cdd-9ea7-873dfe59afc6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.288642 Nov 02 11:51:10.552380 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 135/262] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:10 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:11.120233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:11.121534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:11.135198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:11.140126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:11.140126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:11.141040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:11.142286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:11.143784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:11.176913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f01c5e-3ef8-4f56-affe-03b6962a8975", "name": "network-vif-plugged", "status": "completed", "tag": "666857f3-8f5d-4ca6-9913-a1a58f8a4974"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:11.205814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:11.206393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:11.210527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:11.256972 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] Creating event network-vif-plugged:666857f3-8f5d-4ca6-9913-a1a58f8a4974 for instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 on n-h2-855649-4 Nov 02 11:51:11.281542 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2a3e0c32-a542-4f12-9954-c4229f2f4865 req-8d4bd98b-0b8f-4061-b609-7666f8f46ed2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109696 Nov 02 11:51:11.282697 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 136/263] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:11.545483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:11.563439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:11.564209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:11.592770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:11.593386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:11.593841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:11.594589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:11.599257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:11.600233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:11.615842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:11.629026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e36da1c-2a62-4161-a00e-933dcaf0c880 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.514998 Nov 02 11:51:11.635163 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 128/264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:11 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:11.906396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:11.916314 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a34d557-6e1c-41be-8b7c-8e602aca6994 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.358108 Nov 02 11:51:11.935894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 137/265] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:11 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:12.659656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:12.660342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:12.662389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:12.668972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.669693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.670209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:12.671057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.671935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.673212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:12.884320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:12.896637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ffd3dea-33bb-4f86-80b9-70a133bf64a1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.241520 Nov 02 11:51:12.898107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 138/266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:12 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:12.943757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:12.944393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:12.954055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1729453583", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "1e42d025-6f92-4be4-aebf-e40b0c181c05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:12.970366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.970859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.974882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:12.981125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:12.981125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:12.981125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:13.055555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] validate_networks() for [('1e42d025-6f92-4be4-aebf-e40b0c181c05', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:13.459994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:13.468746 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d44fd0d-0ab7-4079-bd1d-47197a29641b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1317 microversion: 2.1 time: 0.531370 Nov 02 11:51:13.469941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 139/267] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:12 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:13.474461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f71f0-b8d7-42d5-931c-fb0157936853", "name": "network-vif-plugged", "status": "completed", "tag": "b343fc19-07f8-4b93-bf76-9e82f48f3c47"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:13.493632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:13.494131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:13.494567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:13.515557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] Creating event network-vif-plugged:b343fc19-07f8-4b93-bf76-9e82f48f3c47 for instance 153f71f0-b8d7-42d5-931c-fb0157936853 on n-h1-855649-4 Nov 02 11:51:13.520642 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ae011c9f-8419-4eed-b6f6-316d9641d845 req-14550dbc-c2af-4c2f-8f20-7bbe968c6ba8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049679 Nov 02 11:51:13.525903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 140/268] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:13.934286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:13.937608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:13.949347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:13.949844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:13.950280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:13.951006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:13.955164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:13.955801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.047777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:14.144744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:14.158379 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bf3c2c0-c640-4b19-b54c-4f0c406295aa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1319 microversion: 2.1 time: 0.242005 Nov 02 11:51:14.172812 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 141/269] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:13 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:14.493548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:14.496970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:14.505135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.505732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.510012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.510012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.510012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.510012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.850883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:14.851336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:14.851889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:14.852226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:14.852635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:14.864180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:14.868393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.869827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.870252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.871889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:14.872487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:14.872984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:14.873209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-617d1b37-7570-4ba1-9375-d0a6cf6b4091 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1467 microversion: 2.1 time: 0.384494 Nov 02 11:51:14.875065 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 142/270] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:14 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1467 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:14.894374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:14.899795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for user 7827c83ee4674362bab55ca9c40d16fb and project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:14.912093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:14.914623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:15.123324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-866d647d-8e58-4052-98f6-ef0dbf2af83c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.783676 Nov 02 11:51:15.127260 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 129/271] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:51:15.523212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b0f20c5-a1ff-4d01-8e09-34991e15e280 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] Calling method '.version_select at 0x7ff1b3efae50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:15.584074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b0f20c5-a1ff-4d01-8e09-34991e15e280 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] 10.222.0.48 "GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043" status: 200 len: 784 microversion: 2.1 time: 0.708416 Nov 02 11:51:15.584638 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 143/272] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:51:14 2022] GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043 => generated 784 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:15.589733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:15.591425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:15.642491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:15.643141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:15.649861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.650672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.651121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:15.651622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.652789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.653472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.654105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.667435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:15.669523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:15.670666 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0011a58a-3b9c-4e07-a6ae-c268e1685dbe tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1262 microversion: 2.25 time: 0.084496 Nov 02 11:51:15.671431 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 144/273] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:15 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:15.682481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:15.683584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:15.692093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.696817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.696817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.696817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:15.696817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:15.697360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:15.953813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:15.962166 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0357927a-1dc1-46d1-ad47-b29d8c5f49f0 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1469 microversion: 2.1 time: 0.289683 Nov 02 11:51:15.963127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 145/274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:15 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:15.989236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b3ec294-6364-46e8-a5a0-06bc41630935 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] Calling method '.version_select at 0x7ff1b3ef1940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:16.080353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b3ec294-6364-46e8-a5a0-06bc41630935 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] 10.222.0.48 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.095765 Nov 02 11:51:16.081152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 146/275] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Nov 2 11:51:15 2022] GET /compute/v2.1/images => generated 445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:16.196026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f14d109-ba66-48d0-aea5-70a47a661c58 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1618 microversion: 2.1 time: 1.067490 Nov 02 11:51:16.199306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 130/276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:15 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1618 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:16.206272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cabcc0e6-b9c2-497c-b8b6-65d267ebcbd4 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] Calling method '.version_select at 0x7ff1b8284dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:16.263707 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cabcc0e6-b9c2-497c-b8b6-65d267ebcbd4 tempest-ListImagesTestJSON-223512280 tempest-ListImagesTestJSON-223512280-project] 10.222.0.48 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.062590 Nov 02 11:51:16.264277 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 131/277] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:51:16 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:16.269039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: .version_select at 0x7ff1b824ee50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1357345354", "policies": ["affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:16.295262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:16.300689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:16.485332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:16.489584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:16.504484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1882178922", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:16.507289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:16.516384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.517605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.517605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.517971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.522488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.522928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.525445 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1f8c0cd-43f4-41a8-888e-f1611d277ebd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.260111 Nov 02 11:51:16.539601 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 132/278] 10.222.0.48 () {60 vars in 1174 bytes} [Wed Nov 2 11:51:16 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:16.698512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:16.704192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:16.710971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.711886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.712529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.714663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:16.716610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:16.717674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:16.796013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:16.804123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:16.805773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:16.807056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a824a6fb-9570-4811-a4c9-938daad0ea91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1266 microversion: 2.25 time: 0.114489 Nov 02 11:51:16.807608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 133/279] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:16 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:51:16.913776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-657591225", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fdd2794a-ba1a-4b09-a3af-25231ab28d5f"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:16.970741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:17.200651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:17.200651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:17.200651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:17.200651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:17.200651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:17.230178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:17.231239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:17.231672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:17.232395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:17.232843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:17.233264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:17.251223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:17.255000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:17.266775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:17.269052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:17.560381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127567) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 11:51:17.566509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:17.590338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:17.596584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:17.677263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lazy-loading 'flavor' on Instance uuid 153f71f0-b8d7-42d5-931c-fb0157936853 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:17.703053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:17.707477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:17.723939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=b0d49d4e-ec74-43b4-90f2-ede599ec98ed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:17.754693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Going to try to live migrate instance to tempest-host-1882178922 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:51:17.765967 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] HTTP exception thrown: Compute host tempest-host-1882178922 could not be found. Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Request method failure captured: Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853/action HTTP/1.1 Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 107 Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlme-jjcXCBGBJ10SP_llDa9nijrRmkbHbRGFpPT7WvFDW6CH6a-dCQ5A59gAd1vCxsgYn8LmS20lUfTNVmIwvmjP3MwZGKCuuVUKQx0t-5Sx-XWdYjVnWPa1XfIameU_THna9YQ6ZLn4XaQn43v4uRLnIQ0jtXyUU9eMJHhUfl9urw Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: df59171785ea4d9f8df31aa7a460b6ef Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:51:17.771736 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_df59171785ea4d9f8df31aa7a460b6ef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: df59171785ea4d9f8df31aa7a460b6ef Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationNegativeTest-1768597809-project-admin Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a988ed4cef704012ab3575d02d03960a Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationNegativeTest-1768597809-project-admin Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: {"os-migrateLive": {"host": "tempest-host-1882178922", "block_migration": true, "disk_over_commit": false}} Nov 02 11:51:17.773179 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: exception: Compute host tempest-host-1882178922 could not be found. Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '153f71f0-b8d7-42d5-931c-fb0157936853', 'body': {'os-migrateLive': {'host': 'tempest-host-1882178922', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:51:17.774199 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1882178922 could not be found. Nov 02 11:51:17.775626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1882178922 could not be found. Nov 02 11:51:17.777747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1882178922 could not be found. Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:17.779597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Returning 400 to user: Compute host tempest-host-1882178922 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:17.782474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b00a48cc-41c2-477b-9031-de73957a657e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853/action" status: 400 len: 100 microversion: 2.1 time: 1.699155 Nov 02 11:51:17.783156 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 147/280] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Nov 2 11:51:16 2022] POST /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853/action => generated 100 bytes in 1701 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:17.960015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:17.964218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:18.000874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1039897337", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:18.068696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:18.084134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:18.088800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:18.149242 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52692d06-bed6-410b-b7e9-67fa99a7305a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.240097 Nov 02 11:51:18.159195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 134/281] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:18.185486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:18.187384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:18.207553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.211873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.212523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.213422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.216149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.216810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.426898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:18.427553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:18.428103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:18.428600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:18.429085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:18.465522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.467372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.468416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.469494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.471937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.472559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.528586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:18.538383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for user e305bf222f694954931ffb496f521eab and project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:18.567064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:18.567241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.573472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:18.578217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe9e908f-64a1-4f2c-86a8-2fd2b68a6edb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1469 microversion: 2.1 time: 0.417413 Nov 02 11:51:18.589076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 135/282] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:18 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:18.603746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:18.611795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:18.629773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.630285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.630864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.631484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.632309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.632895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.771989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.783074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.785769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.787881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d43566ae-b668-4eac-a673-0cbac968fcf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1332 microversion: 2.25 time: 0.197476 Nov 02 11:51:18.788752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 136/283] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:18 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1332 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:18.793963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:18.799888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:18.800930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Searching by: {'deleted': False, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:51:18.821075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.822034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.822962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.823991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:18.825269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:18.826007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:18.852256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a430070-cfbe-499b-a13c-8138dcf7a5fc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062231 Nov 02 11:51:18.852964 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 148/284] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:18.906951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1527722909", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:18.941478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:51:19.037856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:19.093651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc656276-ea33-4be7-907d-f5a71074dd51 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.303444 Nov 02 11:51:19.099174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 137/285] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:51:18 2022] GET /compute/v2.1/servers => generated 1002 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:19.467276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:19.467979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:19.468234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:19.468688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:19.469107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:19.483721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:19.484900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:19.485886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:19.488403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:19.489116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:19.490643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:19.525218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Getting quotas for project 714025ac7d854ab58a3b4e464b9aee75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:19.532640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Getting quotas for user e0a0f072abfd447c9fc6fe2628a23da7 and project 714025ac7d854ab58a3b4e464b9aee75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:19.560661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:19.567782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:19.622116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c783f436-0c79-432d-8a93-08382a12a328 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1703537560", "id": 291802297, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:19.803304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7c27ab4-d44f-41bd-b4d0-3035deb5b25d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942442 Nov 02 11:51:19.804339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c783f436-0c79-432d-8a93-08382a12a328 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.707571 Nov 02 11:51:19.806699 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 149/286] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:19.807227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 138/287] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:19 2022] POST /compute/v2.1/flavors => generated 427 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:19.817385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1622567145", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:19.818085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fdcc7f2-3e12-44ea-8fbc-8b8f4cfe9de5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:19.820572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fdcc7f2-3e12-44ea-8fbc-8b8f4cfe9de5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:19.933306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:19.983837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fdcc7f2-3e12-44ea-8fbc-8b8f4cfe9de5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:19.998352 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fdcc7f2-3e12-44ea-8fbc-8b8f4cfe9de5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1218 microversion: 2.1 time: 0.185651 Nov 02 11:51:19.999450 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 150/288] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:19 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:20.009453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:20.013288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:20.024788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.025273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.025821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.026550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.034995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.035615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.571781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:20.582379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:20.588015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:20.591901 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bd8e9e6-39dc-4c34-bdee-79599c159ced tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.591420 Nov 02 11:51:20.608538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 151/289] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:19 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:20.622579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6eaf8a9c-7b28-4880-b2ac-b47ee6aa549b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:20.636173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6eaf8a9c-7b28-4880-b2ac-b47ee6aa549b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:20.689297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:20.689816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:20.690178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:20.690837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:20.691561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:20.712298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.712961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.713401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.714136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:20.714583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:20.715372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:20.743765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:20.750205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for user e305bf222f694954931ffb496f521eab and project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:20.750698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6eaf8a9c-7b28-4880-b2ac-b47ee6aa549b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:20.759175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6eaf8a9c-7b28-4880-b2ac-b47ee6aa549b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1219 microversion: 2.1 time: 0.148466 Nov 02 11:51:20.760267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 152/290] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:20 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:20.765845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa44c4d5-fb92-407b-a751-d1a9867e6618 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:20.780063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:20.782252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:20.895327 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa44c4d5-fb92-407b-a751-d1a9867e6618 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/291802297" status: 202 len: 0 microversion: 2.1 time: 0.133374 Nov 02 11:51:20.895915 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 153/291] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:51:20 2022] DELETE /compute/v2.1/flavors/291802297 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:20.946814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6720b022-92b4-4060-b03d-11097899dbc0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135866 Nov 02 11:51:20.947669 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 139/292] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:21.209663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc2adf52-5220-433f-8d35-20e1400cf6c6 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b82840d0>, body: {"keypair": {"name": "tempest-keypair-976848020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV/Z4Dpd9FUJ49rrhFgU/i5y00NV9Rk81dcL4sjXwAG9dPvJ8Nxx1a45b1V2IKB36dICDKBJ6V08UBugx1b/kZXv764/FHmqvPW5ALppQJE0D8AW5DekU+Pg3M9hP7u1Q=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:21.252006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bc2adf52-5220-433f-8d35-20e1400cf6c6 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:21.258728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-bc2adf52-5220-433f-8d35-20e1400cf6c6 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:21.261010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-535144911", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:21.344968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:21.382577 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc2adf52-5220-433f-8d35-20e1400cf6c6 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.430010 Nov 02 11:51:21.383517 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 140/293] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:21.389187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-862ae338-f841-4ff8-9b97-e2e84e2506d6 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:21.413007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-862ae338-f841-4ff8-9b97-e2e84e2506d6 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027988 Nov 02 11:51:21.414131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 141/294] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:21.437426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f2b12a6-662d-4b32-8587-b1838720fc66 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:21.441218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f2b12a6-662d-4b32-8587-b1838720fc66 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:21.607859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f2b12a6-662d-4b32-8587-b1838720fc66 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:21.633660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f2b12a6-662d-4b32-8587-b1838720fc66 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1214 microversion: 2.1 time: 0.203885 Nov 02 11:51:21.637379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 142/295] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:21 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:21.642741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:21.643480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:21.669685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.670186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.670625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.671522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.671809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.673058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.783721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:21.794559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a141e1d-cdaa-4366-8065-55a7a9e5c3cc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1222 microversion: 2.1 time: 0.155598 Nov 02 11:51:21.811080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 143/296] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:21 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:21.812832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0dcd71e8-799c-4e67-9eef-b7b6cfa6dd84 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b814ba60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:21.820909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:21.836155 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0dcd71e8-799c-4e67-9eef-b7b6cfa6dd84 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-976848020" status: 200 len: 511 microversion: 2.2 time: 0.033838 Nov 02 11:51:21.843807 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 144/297] 10.222.0.48 () {60 vars in 1255 bytes} [Wed Nov 2 11:51:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-976848020 => generated 511 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:21.857196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1367f4c0-91cd-4e4b-ab94-88abc41b9046 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1062502998", "id": 1707516122, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:21.907338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:21.907768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:21.908418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:21.908759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:21.909173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:21.920840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.921324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.921788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.922522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:21.922991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:21.927217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:21.944759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Getting quotas for project 2c1ad7e075184db8a76c09803e8c9be9. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:21.948875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Getting quotas for user 3269cc02f13947cca91c49350fa8fcfe and project 2c1ad7e075184db8a76c09803e8c9be9. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:21.961122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:21.969887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:21.973682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:22.017112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1367f4c0-91cd-4e4b-ab94-88abc41b9046 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.171310 Nov 02 11:51:22.018127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 145/298] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:21 2022] POST /compute/v2.1/flavors => generated 417 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:22.023547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408f05d1-a900-4540-9036-a4133f010764", "tag": "07d1b73b-9b5c-41c5-8d81-328873c6d107"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:22.036774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.037515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.041185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.059060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] Creating event network-changed:07d1b73b-9b5c-41c5-8d81-328873c6d107 for instance 408f05d1-a900-4540-9036-a4133f010764 on n-h1-855649-4 Nov 02 11:51:22.065329 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-caf23176-a61e-4c77-9f90-39aced7b4742 req-f2fcc1b6-ccbd-45f1-ae2b-197368b7087b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045447 Nov 02 11:51:22.065942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 146/299] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:22.072632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.073564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.088451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.089062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.094942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.094942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.094942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.094942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.167178 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16c8050c-ed2d-42a5-ba4a-6d27e24da05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264919 Nov 02 11:51:22.170034 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 154/300] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:22.196751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.196751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.230792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.232403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.235714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.238336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.239067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.242162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.382105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.406897 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f56e732c-6d51-47e4-9207-f23cfc840e4f tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1215 microversion: 2.1 time: 0.234050 Nov 02 11:51:22.409595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 155/301] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.415606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef432f83-2ec4-46f3-996a-bcb8c4468354 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d17160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.475768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.475768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:22.482473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.484212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.485584 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10b117e8-46c9-46cd-acee-5e31e4034b26 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.418002 Nov 02 11:51:22.486398 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 147/302] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:22.491807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2724ebad-95e4-41d2-9c0b-512804df9926 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.514945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2724ebad-95e4-41d2-9c0b-512804df9926 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.026957 Nov 02 11:51:22.515643 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 148/303] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.520957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8a58cf1-fcd1-4410-8393-cdff57317bd7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.521647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8a58cf1-fcd1-4410-8393-cdff57317bd7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.578328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8a58cf1-fcd1-4410-8393-cdff57317bd7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.585444 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8a58cf1-fcd1-4410-8393-cdff57317bd7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1219 microversion: 2.1 time: 0.068579 Nov 02 11:51:22.586021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 149/304] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.590799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d93c015-1346-4b6a-9f01-3bfbeb0dd6da tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.717621 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef432f83-2ec4-46f3-996a-bcb8c4468354 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976848020" status: 204 len: 0 microversion: 2.2 time: 0.305784 Nov 02 11:51:22.728436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 156/305] 10.222.0.48 () {60 vars in 1258 bytes} [Wed Nov 2 11:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976848020 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:22.734223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.734849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.742279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.752370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.752370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.752370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.752370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.752713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.787493 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d93c015-1346-4b6a-9f01-3bfbeb0dd6da tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1707516122" status: 202 len: 0 microversion: 2.1 time: 0.195397 Nov 02 11:51:22.787493 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 150/306] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:51:22 2022] DELETE /compute/v2.1/flavors/1707516122 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:22.794799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a064672d-5dc0-4745-969b-0fe815cfe7f7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b8047d30>, body: {"keypair": {"name": "tempest-keypair-1436048635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExQESEKfwOPrKF0an6LN4T6Vo+MZuy8GrtsN84lURlmlFBItFn2gs2z1mAEVgIUYBgnkyVYDiScf4oe3txpsXQW2JizJ561PszeObeCm9WgEtJL3AA7aXMPyCCrI96pWw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:22.841760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a064672d-5dc0-4745-969b-0fe815cfe7f7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:22.851498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a064672d-5dc0-4745-969b-0fe815cfe7f7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:22.856821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:22.865311 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ace2ef7b-3cf2-41e4-9b91-4d7657263bd3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1218 microversion: 2.1 time: 0.135516 Nov 02 11:51:22.868940 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 157/307] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.880346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d11cc40-ef71-42e4-980e-1ece04ee9762 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.923422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d11cc40-ef71-42e4-980e-1ece04ee9762 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051157 Nov 02 11:51:22.924196 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 158/308] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:22.929467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:22.930578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:22.938218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.940670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.940670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:22.940670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:22.941324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:22.941774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.046900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.054965 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a064672d-5dc0-4745-969b-0fe815cfe7f7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.269332 Nov 02 11:51:23.065204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2823f0d-315f-4cff-88ec-772aad140ebc tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1214 microversion: 2.1 time: 0.130033 Nov 02 11:51:23.065469 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 151/309] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:23.069544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16d47147-6602-4554-b3cb-ae3b7e9ddfd4 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-247112399", "id": 1565660337, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:23.073091 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 159/310] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:22 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:23.082095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23eb0af1-d071-4139-8a51-b551a805694b tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d17790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.203648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23eb0af1-d071-4139-8a51-b551a805694b tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436048635" status: 204 len: 0 microversion: 2.2 time: 0.129081 Nov 02 11:51:23.210099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 160/311] 10.222.0.48 () {60 vars in 1261 bytes} [Wed Nov 2 11:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436048635 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:23.226041 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16d47147-6602-4554-b3cb-ae3b7e9ddfd4 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.150769 Nov 02 11:51:23.226041 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 152/312] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:23 2022] POST /compute/v2.1/flavors => generated 428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:23.226953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b16412bc-ce96-4f06-88e0-d8011b39e8a7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b3e6a700>, body: {"keypair": {"name": "tempest-keypair-2054926268", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:23.237981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe0ab6ca-776e-4fd2-b009-e0034fd64adc tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.251553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b16412bc-ce96-4f06-88e0-d8011b39e8a7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:23.259280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b16412bc-ce96-4f06-88e0-d8011b39e8a7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:23.445016 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe0ab6ca-776e-4fd2-b009-e0034fd64adc tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1565660337" status: 202 len: 0 microversion: 2.1 time: 0.211334 Nov 02 11:51:23.445604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b16412bc-ce96-4f06-88e0-d8011b39e8a7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.227402 Nov 02 11:51:23.446231 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 153/313] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:51:23 2022] DELETE /compute/v2.1/flavors/1565660337 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:23.447662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 161/314] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:23 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 230 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 11:51:23.452469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.454391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:23.462052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.462796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.463470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.464375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.465065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.465668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.469690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4eaae6a1-51ce-4d35-887d-b3db1d8165a4 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d31280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.538645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.546446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ece4365-f396-433f-9fc0-522273d6228c tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1215 microversion: 2.1 time: 0.098961 Nov 02 11:51:23.547036 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 154/315] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:23 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:23.551696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28e979e3-0a8e-4ae3-b6cb-b154f1753e3f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.576035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28e979e3-0a8e-4ae3-b6cb-b154f1753e3f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027888 Nov 02 11:51:23.576998 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:23.581972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.582657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:23.599908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.600694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.601412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.603086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:23.603425 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4eaae6a1-51ce-4d35-887d-b3db1d8165a4 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054926268" status: 204 len: 0 microversion: 2.2 time: 0.141060 Nov 02 11:51:23.604014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 162/317] 10.222.0.48 () {60 vars in 1261 bytes} [Wed Nov 2 11:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054926268 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:23.605834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:23.605834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:23.616624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5481533e-0f47-4dfb-a90d-aba4dc04c9b0 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-362621958", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:23.742090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5481533e-0f47-4dfb-a90d-aba4dc04c9b0 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.134801 Nov 02 11:51:23.750699 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 163/318] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:23 2022] POST /compute/v2.1/flavors => generated 506 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:23.751887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ad7d6d8-db12-4cd1-9245-76efb61af029 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:23.752587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ad7d6d8-db12-4cd1-9245-76efb61af029 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:23.854105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ad7d6d8-db12-4cd1-9245-76efb61af029 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.865942 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ad7d6d8-db12-4cd1-9245-76efb61af029 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1219 microversion: 2.1 time: 0.121891 Nov 02 11:51:23.880451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 164/319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:23 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:23.893825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a09102-b34c-43e5-818b-e505e4e5c5a5 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b3d06dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-191768313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMgCsQCxmeHBUejd+YWDAZtF7E9r0GoY4mHGvAEDM2ROkc6NqZv4rTta2UP+YZ8ySQ8FMR1bQsxqgHPMAivE5grx3jqE+IRX2z9kXvGu3IKzWwQpPSFujmmwnQ0ihhQTQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:23.915328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46a09102-b34c-43e5-818b-e505e4e5c5a5 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:23.923166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-46a09102-b34c-43e5-818b-e505e4e5c5a5 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:23.931305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.943121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.965101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:23.969743 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1174204-fabd-40a1-800f-49544fffc7e8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.388963 Nov 02 11:51:23.970769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 156/320] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:23 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:23.975831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0471b12b-8a3c-45b9-a37d-6ca6e1d56afb tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.035157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a09102-b34c-43e5-818b-e505e4e5c5a5 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.137279 Nov 02 11:51:24.035157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 165/321] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:24.035157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.035157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:24.039016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.039771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.040399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.041573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.042672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.046056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.078321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:24.110598 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0471b12b-8a3c-45b9-a37d-6ca6e1d56afb tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/b521de27-a113-47c0-81a8-0806093b3551" status: 202 len: 0 microversion: 2.1 time: 0.138282 Nov 02 11:51:24.112069 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 157/322] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:51:23 2022] DELETE /compute/v2.1/flavors/b521de27-a113-47c0-81a8-0806093b3551 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:24.120928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c7d3d46-13db-44f4-bd71-dc2867ee8bdf tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b811d0d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1773887613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmodatqmRFQ6wHm7u+N4TNKOLummIfUX02I6WWXlOTUoCDzi0j+ivLqdwfY1GMr54dqLYCcezf0fxWBj0FE2eQqDM6Ev0bfZz1LWTxQGZ7YLSkHNamlMXauhXyZcfFH8A=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:24.147748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1c7d3d46-13db-44f4-bd71-dc2867ee8bdf tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:24.153664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1c7d3d46-13db-44f4-bd71-dc2867ee8bdf tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:24.261259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:24.271380 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f694a31c-deb2-4f2f-b1c0-5ed05bf09b83 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1210 microversion: 2.1 time: 0.243489 Nov 02 11:51:24.277781 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 166/323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1210 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.277960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.291575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:24.304200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.307266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.307266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.307266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.307266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.307731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.416432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:24.431243 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8469ff9b-93d9-462f-ab30-3d63f9bd36ad tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1270 microversion: 2.1 time: 0.157356 Nov 02 11:51:24.436754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c7d3d46-13db-44f4-bd71-dc2867ee8bdf tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.323341 Nov 02 11:51:24.437569 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 158/324] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 325 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:24.444763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1931a41-409e-4a40-bf9e-41e0afbf66a0 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.447389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 167/325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.461645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4cb566b-71df-446f-b827-a0b1c4034c9e tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b3d311f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-973135932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmw4233G4W6axn4uWcWF+JCytR++tA8bn3PZ9qEOTm21tRnpvVjRgt7Vyyb1+JG4mduBcpdeDcEgymAJ8L4hiwPfs9i2dsfdKXgeXR7zYcCJYJVkhjXoEoawBtOWFHDBw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:24.505160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1931a41-409e-4a40-bf9e-41e0afbf66a0 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066226 Nov 02 11:51:24.509875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 159/326] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.512490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b4cb566b-71df-446f-b827-a0b1c4034c9e tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:24.523794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b4cb566b-71df-446f-b827-a0b1c4034c9e tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:24.531133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f83785b4-9bb2-4a2e-af32-15fe0caa0708 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-344097160", "id": "91a0a4e2-286e-46f1-a76d-733a071e826a", "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:24.632414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f83785b4-9bb2-4a2e-af32-15fe0caa0708 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.105905 Nov 02 11:51:24.633228 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 160/327] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:24 2022] POST /compute/v2.1/flavors => generated 506 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:24.641578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.641578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:24.664181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.665054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.665161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.665786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.666236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.666883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.688554 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4cb566b-71df-446f-b827-a0b1c4034c9e tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.234962 Nov 02 11:51:24.689159 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 168/328] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:24.695647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8ad5fd0-f617-4528-8434-dea43a88892c tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.794881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:24.809128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bc05c64-ecf7-4214-a175-c597795ae5fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1215 microversion: 2.1 time: 0.172972 Nov 02 11:51:24.823189 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 161/329] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.829081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-150b08be-ff04-44a6-a416-369a0c2fdd53 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b811d280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.835252 n-d-855649-4 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-150b08be-ff04-44a6-a416-369a0c2fdd53 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 11:51:24.836474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8ad5fd0-f617-4528-8434-dea43a88892c tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/91a0a4e2-286e-46f1-a76d-733a071e826a" status: 202 len: 0 microversion: 2.1 time: 0.145943 Nov 02 11:51:24.837535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 169/330] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:51:24 2022] DELETE /compute/v2.1/flavors/91a0a4e2-286e-46f1-a76d-733a071e826a => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:24.847270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-150b08be-ff04-44a6-a416-369a0c2fdd53 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.033275 Nov 02 11:51:24.851224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba3b9494-74f3-4a0d-9f95-579c3199de20 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.856222 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 162/331] 10.222.0.48 () {60 vars in 1177 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.877011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e46114d3-dde3-4aa3-a296-c3e7d0709a4f tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b8047430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.880121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba3b9494-74f3-4a0d-9f95-579c3199de20 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034015 Nov 02 11:51:24.899127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 170/332] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:24.905463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:24.906933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:24.913849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.914417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.914861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.915608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:24.916069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:24.916497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:24.968864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e46114d3-dde3-4aa3-a296-c3e7d0709a4f tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-973135932" status: 204 len: 0 microversion: 2.2 time: 0.111197 Nov 02 11:51:24.974140 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 163/333] 10.222.0.48 () {60 vars in 1318 bytes} [Wed Nov 2 11:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-973135932 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:24.983552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f752799-5898-454d-bdfa-6da47be8ad23 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1370397418", "id": 82796543, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:25.122102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.132891 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f752799-5898-454d-bdfa-6da47be8ad23 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.155420 Nov 02 11:51:25.139002 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 164/334] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:25.141935 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac0c566e-5528-41d7-aa09-4eef8e2a56e3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1215 microversion: 2.1 time: 0.236444 Nov 02 11:51:25.144513 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 171/335] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:24 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.156521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-505f440c-335f-465b-a282-cd9c932fbe49 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3f80ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.164138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.167083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.176193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.178053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.178689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.180003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.180690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.185158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.298679 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-505f440c-335f-465b-a282-cd9c932fbe49 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1773887613" status: 204 len: 0 microversion: 2.2 time: 0.157120 Nov 02 11:51:25.300050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 165/336] 10.222.0.48 () {60 vars in 1321 bytes} [Wed Nov 2 11:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1773887613 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:25.306572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc362487-c6b6-4e2e-bb82-ea86ee06a629 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.320309 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc362487-c6b6-4e2e-bb82-ea86ee06a629 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/82796543" status: 200 len: 408 microversion: 2.1 time: 0.019738 Nov 02 11:51:25.323094 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 166/337] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/flavors/82796543 => generated 408 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:25.330154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.331063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.373176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.381706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.384294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.391465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.393144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.393708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.395082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34807fde-6f3c-4025-9652-96a996950b1e tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.249348 Nov 02 11:51:25.395500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.411019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.411368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 172/338] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:25.411484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.411572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7a3c27-0c66-4600-906b-4318329210ac tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d303a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.484493 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e7a3c27-0c66-4600-906b-4318329210ac tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-191768313" status: 204 len: 0 microversion: 2.2 time: 0.087248 Nov 02 11:51:25.486088 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 173/339] 10.222.0.48 () {60 vars in 1318 bytes} [Wed Nov 2 11:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-191768313 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:25.570728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.603441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-009b9e9e-4733-4715-aa10-16798d75d190 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1210 microversion: 2.1 time: 0.277865 Nov 02 11:51:25.607072 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 167/340] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1210 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.624934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.632945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.651378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.652795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.653526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.654434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.654894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.656003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.737659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-917cd6bc-6a31-41e1-9982-f6270b053524 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.825333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-917cd6bc-6a31-41e1-9982-f6270b053524 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.337214 Nov 02 11:51:25.827113 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 174/341] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.832662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed7f656b-872e-49f0-9b1c-62d7f23802c7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b3d17af0>, body: {"keypair": {"name": "tempest-keypair-255557988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0bLPmO9218KS0jlZI1y2HRw5flSa4OVehhmptV2E5UqKLbzzLgtJu0iYBnk+HWgAIE6+WdKxw9HF7x83nBwqkrbJZ593Wrg6bLJd810rsWXLZpTgX4PI3J8bLBpl5Z7Q=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:25.861287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ed7f656b-872e-49f0-9b1c-62d7f23802c7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:25.866170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ed7f656b-872e-49f0-9b1c-62d7f23802c7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:25.869496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:25.879834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c0d3857-9fa5-4dbf-bcea-cd7687f136cf tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1276 microversion: 2.1 time: 0.271462 Nov 02 11:51:25.900284 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 168/342] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:25.904676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:25.905312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:25.918050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.921331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.923225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:25.924226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:25.924891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:25.925333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.031484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed7f656b-872e-49f0-9b1c-62d7f23802c7 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.202720 Nov 02 11:51:26.036082 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 175/343] 10.222.0.48 () {62 vars in 1199 bytes} [Wed Nov 2 11:51:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:26.043595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78702607-30b0-49eb-8cc8-0da7dad6a929 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.069406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:26.079749 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4178424d-0ce1-41d8-86ab-434588e672cc tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1271 microversion: 2.1 time: 0.189428 Nov 02 11:51:26.080929 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 169/344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:25 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:26.091109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-146633f5-ef90-4b87-a2c3-67fc05253837 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b82840d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.092510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:26.098562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-146633f5-ef90-4b87-a2c3-67fc05253837 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-255557988" status: 200 len: 512 microversion: 2.2 time: 0.015965 Nov 02 11:51:26.099898 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 170/345] 10.222.0.48 () {60 vars in 1255 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-255557988 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:26.115044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74988e56-bc9c-4223-ba46-44156a15fc90 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3fa1ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.122226 n-d-855649-4 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-74988e56-bc9c-4223-ba46-44156a15fc90 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 11:51:26.128976 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74988e56-bc9c-4223-ba46-44156a15fc90 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.020499 Nov 02 11:51:26.130181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 171/346] 10.222.0.48 () {60 vars in 1177 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:26.141257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78702607-30b0-49eb-8cc8-0da7dad6a929 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/82796543" status: 202 len: 0 microversion: 2.1 time: 0.107105 Nov 02 11:51:26.141884 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 176/347] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:26 2022] DELETE /compute/v2.1/flavors/82796543 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:26.147558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60f89cf5-02a7-4650-b4ed-c4dd1ec2f879 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b811de50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.151075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04a13c40-c51e-4cf1-8a60-e979ab10d085 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.188756 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04a13c40-c51e-4cf1-8a60-e979ab10d085 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042403 Nov 02 11:51:26.199815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 177/348] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:26.214641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.215350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:26.222616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.223169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.223618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.224607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.225248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.225834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.288037 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60f89cf5-02a7-4650-b4ed-c4dd1ec2f879 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-255557988" status: 204 len: 0 microversion: 2.2 time: 0.151161 Nov 02 11:51:26.299229 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 172/349] 10.222.0.48 () {60 vars in 1258 bytes} [Wed Nov 2 11:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-255557988 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:26.313012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66a2278d-08b6-47d4-87ae-88732b532c31 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-765300474", "id": 634393276, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:26.409493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:26.436145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:26.450536 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5338bcb-0d2d-4208-9c3b-2db0474ab20a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1279 microversion: 2.1 time: 0.246297 Nov 02 11:51:26.451540 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 178/350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:26.466358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66a2278d-08b6-47d4-87ae-88732b532c31 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.161461 Nov 02 11:51:26.474301 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 173/351] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:26 2022] POST /compute/v2.1/flavors => generated 426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:26.474689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Action: 'create', calling method: .version_select at 0x7ff1b3d30790>, body: {"keypair": {"name": "tempest-keypair-1131142732", "type": "x509"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:26.475744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:26.476522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:26.485010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.485010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.485010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.486076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:26.486680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:26.487012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:26.522193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:26.532259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:26.584856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.processutils [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpn6r4tgxk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpn6r4tgxk/temp.key -subj /CN=b235e0d63f3e49b48eb6df40707350e4 -extensions v3_req_client {{(pid=127568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 11:51:27.101813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.processutils [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpn6r4tgxk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpn6r4tgxk/temp.key -subj /CN=b235e0d63f3e49b48eb6df40707350e4 -extensions v3_req_client" returned: 0 in 0.514s {{(pid=127568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 11:51:27.104216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.processutils [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpn6r4tgxk/temp.key -password pass: {{(pid=127568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 11:51:27.165563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.processutils [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpn6r4tgxk/temp.key -password pass:" returned: 0 in 0.061s {{(pid=127568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 11:51:27.265028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.283705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.287901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.290851 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-577db966-76d6-4486-8c59-f8fb2b94c985 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.821663 Nov 02 11:51:27.293565 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 174/352] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:26 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:27.312167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87b49603-d72f-4b44-9a04-b3e5706bbc4f tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "634393276"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:27.324195 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-87b49603-d72f-4b44-9a04-b3e5706bbc4f tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] HTTP exception thrown: Flavor 634393276 could not be found. Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87b49603-d72f-4b44-9a04-b3e5706bbc4f tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Request method failure captured: Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 106 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlm0v8GjyFfmsaPZopBXC7__45YX6xC2lU-Vq0P7ITV7mpy7iFhbEWKlSHzqsuZDIui9-NulavVQ0S3ly1CAo_KSNm984Viab6NHYDb1dZRqXIbDZGZPbo0rt4FuYM3LRuNvJCOZ8AqeULI1ZcyiOhvqGjIRIDB4IxH-Bqz2Il6xTC4 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8aa6af40e62947ee9f476b479dac54b4 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsAdminTestJSON-344475820 Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:27.327358 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8aa6af40e62947ee9f476b479dac54b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8aa6af40e62947ee9f476b479dac54b4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8aa6af40e62947ee9f476b479dac54b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8aa6af40e62947ee9f476b479dac54b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsAdminTestJSON-344475820 Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8aa6af40e62947ee9f476b479dac54b4 Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-344475820 Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsAdminTestJSON-344475820-project Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 6a4cf82f12a345aeb1b514f467129eec Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsAdminTestJSON-344475820-project Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "test", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "634393276"}} Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:27.328855 n-d-855649-4 devstack@n-api.service[127567]: exception: Flavor 634393276 could not be found. Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '634393276'}}} Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 634393276 could not be found. Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:27.329747 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 634393276 could not be found. Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:27.331023 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:27.332544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:27.332544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:27.332544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:27.332544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 634393276 could not be found. Nov 02 11:51:27.332544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:27.334611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87b49603-d72f-4b44-9a04-b3e5706bbc4f tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Returning 400 to user: Flavor 634393276 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:27.335608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87b49603-d72f-4b44-9a04-b3e5706bbc4f tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.040853 Nov 02 11:51:27.343379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 175/353] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:27 2022] POST /compute/v2.1/servers => generated 80 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:51:27.345274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.345914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:27.353250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.353904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.354352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.355098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.356181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.356611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.416203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:27.422229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Getting quotas for user b235e0d63f3e49b48eb6df40707350e4 and project ef8a2ec79a4c4539a0a0da6dae5ca267. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:27.441228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03f3fceb-9d61-46f8-9a53-e7da906f1255 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.988545 Nov 02 11:51:27.443444 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 179/354] 10.222.0.48 () {62 vars in 1198 bytes} [Wed Nov 2 11:51:26 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 991 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:27.451150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.452114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:27.483640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.500049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.502100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8abacb23-a46f-4544-b58f-b88a52467656 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1274 microversion: 2.1 time: 0.164396 Nov 02 11:51:27.502840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.503632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 176/355] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.505485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.508523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.509199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.509850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.518386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.524910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:27.542852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.546949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.547716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.549620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.552277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.552890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.722847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.739720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4443c0d5-52f1-4309-9acb-8997e2a0825e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1276 microversion: 2.1 time: 0.294832 Nov 02 11:51:27.742284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 180/356] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.764583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.779307 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2ea7c27-8ff5-4f64-b581-4ddbf806eaea tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1277 microversion: 2.1 time: 0.268134 Nov 02 11:51:27.780261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca2cc44b-f430-4165-9c0c-d97e7e798a06 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.780623 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 177/357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.785350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1704050d-e683-4fb4-8350-4e806f6ce822 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b8047c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.804918 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1704050d-e683-4fb4-8350-4e806f6ce822 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1131142732" status: 200 len: 1534 microversion: 2.2 time: 0.023147 Nov 02 11:51:27.811777 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 178/358] 10.222.0.48 () {60 vars in 1258 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1131142732 => generated 1534 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.817086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.822083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:27.832821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.833646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.840452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.840452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:27.840452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:27.840452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:27.926166 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca2cc44b-f430-4165-9c0c-d97e7e798a06 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/634393276" status: 202 len: 0 microversion: 2.1 time: 0.180934 Nov 02 11:51:27.935277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 181/359] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:51:27 2022] DELETE /compute/v2.1/flavors/634393276 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:27.940168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:27.951407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b98aa19-d6e4-483c-a77c-ae75562c2298 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d30700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.954363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57862075-6a53-4cf2-8eda-5ef97a82dd47 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1277 microversion: 2.1 time: 0.136198 Nov 02 11:51:27.955462 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 179/360] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.960073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e42cd2b4-7625-481d-af56-5bcce6e91cf4 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:27.961061 n-d-855649-4 devstack@n-api.service[127568]: WARNING oslo_db.sqlalchemy.utils [None req-3b98aa19-d6e4-483c-a77c-ae75562c2298 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 11:51:27.975640 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b98aa19-d6e4-483c-a77c-ae75562c2298 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.037297 Nov 02 11:51:27.976927 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 182/361] 10.222.0.48 () {60 vars in 1177 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:27.994287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0381cc02-2165-4512-b578-919f136cf130 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] Calling method '.version_select at 0x7ff1b3d17b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.009213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e42cd2b4-7625-481d-af56-5bcce6e91cf4 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052524 Nov 02 11:51:28.010241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 180/362] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:28.037622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3848941-6352-455c-9a19-257c85878f92 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1157061680", "id": 180815928, "os-flavor-access:is_public": "False"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:28.073638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0381cc02-2165-4512-b578-919f136cf130 tempest-KeyPairsV22TestJSON-289830528 tempest-KeyPairsV22TestJSON-289830528-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131142732" status: 204 len: 0 microversion: 2.2 time: 0.089190 Nov 02 11:51:28.075187 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 183/363] 10.222.0.48 () {60 vars in 1261 bytes} [Wed Nov 2 11:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131142732 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:28.163426 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3848941-6352-455c-9a19-257c85878f92 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.129663 Nov 02 11:51:28.164403 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 181/364] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:28 2022] POST /compute/v2.1/flavors => generated 412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:28.177606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2d34076-6d3e-43e3-ba33-9721e7bb1d1f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-455898184", "id": 113072792, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:28.219713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408f05d1-a900-4540-9036-a4133f010764", "name": "network-vif-plugged", "status": "completed", "tag": "07d1b73b-9b5c-41c5-8d81-328873c6d107"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:28.241204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.243447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.244077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.267857 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] Creating event network-vif-plugged:07d1b73b-9b5c-41c5-8d81-328873c6d107 for instance 408f05d1-a900-4540-9036-a4133f010764 on n-h1-855649-4 Nov 02 11:51:28.274405 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-55fd7301-def5-499b-894a-9c4b1510cacb req-6de93b5f-bb63-4dbb-91d5-24e13b381ab0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058320 Nov 02 11:51:28.275748 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 182/365] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:28.285887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2d34076-6d3e-43e3-ba33-9721e7bb1d1f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.112590 Nov 02 11:51:28.286889 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 184/366] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:28 2022] POST /compute/v2.1/flavors => generated 410 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.305003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb06be0c-e8f2-4bdf-9a9e-6e7db9e65d13 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.318081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.319021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.330136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb06be0c-e8f2-4bdf-9a9e-6e7db9e65d13 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.033727 Nov 02 11:51:28.330607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.331309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.331945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.332839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.333480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.334069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.339175 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 183/367] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.349698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd85ea81-ffb1-4fd3-b564-cd8266fa004f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.362602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd85ea81-ffb1-4fd3-b564-cd8266fa004f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.018685 Nov 02 11:51:28.377654 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 184/368] 10.222.0.48 () {58 vars in 1177 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.379162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d3b4ed8-e79f-47f6-abdb-ba36f639fbc7 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.399838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d3b4ed8-e79f-47f6-abdb-ba36f639fbc7 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.025189 Nov 02 11:51:28.412131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 185/369] 10.222.0.48 () {58 vars in 1171 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.420820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-459bd606-8586-49d4-b091-ae3fe28b1699 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.434446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-459bd606-8586-49d4-b091-ae3fe28b1699 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.023049 Nov 02 11:51:28.436568 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 186/370] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:28.450242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02c8d0f9-4969-40fe-a35d-579f8e959514 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.494020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02c8d0f9-4969-40fe-a35d-579f8e959514 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.048315 Nov 02 11:51:28.495367 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 187/371] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:28.514944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09e64e6d-a6fe-45dd-8893-45bc824247f5 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.548276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09e64e6d-a6fe-45dd-8893-45bc824247f5 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.036563 Nov 02 11:51:28.566019 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 188/372] 10.222.0.48 () {58 vars in 1175 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:28.572409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.605927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.605927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.605927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.605927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.606551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.606551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.606551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.606923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:28.606923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:28.607208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:28.607208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0c882b0-392d-4fe2-89ab-1b03841439b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 0.290978 Nov 02 11:51:28.607208 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 185/373] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:51:28.613090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7068bc7a-b540-45e2-b4e0-df7b978a0a85 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.637761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7068bc7a-b540-45e2-b4e0-df7b978a0a85 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.028629 Nov 02 11:51:28.658896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 186/374] 10.222.0.48 () {58 vars in 1173 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:28.678197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30c70452-ed22-45be-a0a7-49728c70bf0f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.678414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:28.692297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a806455-98dc-49e8-b789-c2d5d633ccfe tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1272 microversion: 2.1 time: 0.124723 Nov 02 11:51:28.707021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 189/375] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:28.739567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30c70452-ed22-45be-a0a7-49728c70bf0f tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.050191 Nov 02 11:51:28.741325 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 187/376] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:28.746700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba8500df-cf0e-44b4-8fc1-5f2dc2a1edbb tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.769056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.769056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.783600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.783960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.784425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.785137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.786024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.786606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.851716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba8500df-cf0e-44b4-8fc1-5f2dc2a1edbb tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/113072792" status: 202 len: 0 microversion: 2.1 time: 0.108530 Nov 02 11:51:28.852388 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 190/377] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:51:28 2022] DELETE /compute/v2.1/flavors/113072792 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:28.863163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:28.864446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:28.883090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.883886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.884651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.886076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:28.889126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:28.889126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:28.987110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:29.004536 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-476181b2-622c-46cd-96d7-b3578d131b2a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1277 microversion: 2.1 time: 0.145238 Nov 02 11:51:29.009505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 191/378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.022471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3ce1593-fdb6-49c5-b4c1-16086dbc2521 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.041697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:29.059847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f2bfe85-fe1a-4aa9-be14-984acbcdc3d7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.293647 Nov 02 11:51:29.084415 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 188/379] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:28 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:29.094774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.095954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:29.100053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3ce1593-fdb6-49c5-b4c1-16086dbc2521 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089762 Nov 02 11:51:29.100755 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 192/380] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.123947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-389f348e-0672-443a-ae87-5b5e4273e947 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.128871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.132258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.132930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.134390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.136176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.140651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.245601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:29.248111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-389f348e-0672-443a-ae87-5b5e4273e947 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/180815928" status: 202 len: 0 microversion: 2.1 time: 0.130447 Nov 02 11:51:29.248864 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 193/381] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:51:29 2022] DELETE /compute/v2.1/flavors/180815928 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:51:29.259785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cf51e1d-a53b-48a9-a7da-22a178fab6d9 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.263240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd8a5763-5ae1-40df-b847-2468c726efac tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1277 microversion: 2.1 time: 0.174021 Nov 02 11:51:29.279547 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 189/382] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.283272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cf51e1d-a53b-48a9-a7da-22a178fab6d9 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028701 Nov 02 11:51:29.285690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 194/383] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.307562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44b254cb-e428-4212-9a3c-526ce91b2d6a tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1839862613", "id": 1016827978, "os-flavor-access:is_public": "False"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:29.441587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44b254cb-e428-4212-9a3c-526ce91b2d6a tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.137847 Nov 02 11:51:29.442493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 190/384] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:29 2022] POST /compute/v2.1/flavors => generated 415 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:29.455653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87961a0c-349f-483a-a318-4e1f0e3c2693 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.482505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87961a0c-349f-483a-a318-4e1f0e3c2693 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030464 Nov 02 11:51:29.483382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 195/385] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.501355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b564d36-255f-4f93-a501-692106b29a85 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.525237 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b564d36-255f-4f93-a501-692106b29a85 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027591 Nov 02 11:51:29.526665 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 191/386] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.546167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e908df02-7c4d-4d0d-b1ae-62a852a92793 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.609503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d49d4e-ec74-43b4-90f2-ede599ec98ed", "tag": "8c388c0b-d300-42a8-ae3f-e5600cbba056"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:29.633264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.634832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.636007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.665363 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] Creating event network-changed:8c388c0b-d300-42a8-ae3f-e5600cbba056 for instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed on n-h2-855649-4 Nov 02 11:51:29.678828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7f00a3c5-827f-46cd-9223-262c9e285568 req-91fc8db2-14e5-488f-817c-7b50d05a2ea1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071967 Nov 02 11:51:29.680808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e908df02-7c4d-4d0d-b1ae-62a852a92793 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1016827978" status: 202 len: 0 microversion: 2.1 time: 0.139940 Nov 02 11:51:29.683032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 196/387] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:51:29 2022] DELETE /compute/v2.1/flavors/1016827978 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:29.691120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.692250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:29.694032 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 192/388] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:29.711504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-769857d3-d2ae-4be8-afd4-bc9bd3e1192a tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.717697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.727633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.728286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.729207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.729829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.730466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.810952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-769857d3-d2ae-4be8-afd4-bc9bd3e1192a tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.096240 Nov 02 11:51:29.812930 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 193/389] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:29.839717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:29.840527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:29.875194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.879998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.879998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:29.879998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:29.879998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:29.880424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.263316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:30.274515 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8762f7d4-f007-4a1c-a361-b5fafe898024 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1272 microversion: 2.1 time: 0.453602 Nov 02 11:51:30.276456 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 194/390] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1272 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:30.300643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f737e0dc-f98e-42b1-96df-11cb29da1a88 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1413274593", "id": 812115700, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:30.381669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f737e0dc-f98e-42b1-96df-11cb29da1a88 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.103522 Nov 02 11:51:30.390180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 195/391] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:30.397873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:30.398656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:30.419153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.419153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.420300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.422037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.423287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.423954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.711657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:30.727707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:30.733970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:30.735432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:30.737166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca5d5422-387a-4d89-94f1-e70accacd05d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1362 microversion: 2.25 time: 1.053877 Nov 02 11:51:30.737743 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 197/392] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:29 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1362 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:30.760895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:30.771008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:30.773970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.776819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.778114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:30.780554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:30.781221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:30.782655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.325233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:31.340194 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24ea342d-3672-4603-9de7-41008d1c228b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.946651 Nov 02 11:51:31.364270 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 196/393] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:30 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.378336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.378336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:31.384564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.385365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.386192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.387166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.387822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.390057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.468162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:31.481477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e9ea8d5-ae67-4167-bb93-10457611545d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.737463 Nov 02 11:51:31.481477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 198/394] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:30 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.483606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5fd6425d-58b8-48e9-98c3-a57c071ecdf1 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.516273 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5fd6425d-58b8-48e9-98c3-a57c071ecdf1 tempest-FlavorsAdminTestJSON-344475820 tempest-FlavorsAdminTestJSON-344475820-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.037257 Nov 02 11:51:31.519639 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 199/395] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.525426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.525964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:31.526260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:31.541655 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64115fb3-033a-4472-bbbb-ae1c44f755cc tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1277 microversion: 2.1 time: 0.175815 Nov 02 11:51:31.551168 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 197/396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.551529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.551529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.551529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.551529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.552040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.552040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.552247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3597945f-ea27-4831-b9f1-a1a48341ac86 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.634730 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3597945f-ea27-4831-b9f1-a1a48341ac86 tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/812115700" status: 202 len: 0 microversion: 2.1 time: 0.090204 Nov 02 11:51:31.635313 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 198/397] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:51:31 2022] DELETE /compute/v2.1/flavors/812115700 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:31.653887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-245242b1-3950-4d4e-bf41-4455455f57ed tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.676332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-245242b1-3950-4d4e-bf41-4455455f57ed tempest-FlavorsAdminTestJSON-51851534 tempest-FlavorsAdminTestJSON-51851534-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026619 Nov 02 11:51:31.676935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.686141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:31.701330 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a44cf21d-c947-44e0-9c09-a8482580c36d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1272 microversion: 2.1 time: 0.179753 Nov 02 11:51:31.702219 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 200/399] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:31.765007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:31.770188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:31.782223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.782719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.791181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.796206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:31.796927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:31.798613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:31.932158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:32.055318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:32.077547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:32.083171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:32.089715 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30a567d3-8555-4d13-981e-76f09b8c84c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1558 microversion: 2.25 time: 0.325532 Nov 02 11:51:32.089715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 200/400] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:31 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1558 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:32.506578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:32.507303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:32.520180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.520978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.523683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.524752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.527569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.528223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.652570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:32.679734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.680274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.680726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.717471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] Creating event network-changed:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:51:32.732938 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cae1a282-d685-46c6-bfdf-1dd22384deca req-dca8e15b-f4c3-498a-a867-7fdb5afe8a22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394457 Nov 02 11:51:32.733876 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 201/401] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:32.744495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:32.747659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:32.762639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:32.766639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.766639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.766639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.766639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:32.772430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:32.772860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:32.823923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 408f05d1-a900-4540-9036-a4133f010764 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:32.922333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:32.974282 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a4c9e67-7ce9-41cc-83a6-88ab71e3a07e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 2051 microversion: 2.25 time: 0.862118 Nov 02 11:51:32.977471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 201/402] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:32 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 2051 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:32.994899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:32.995577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:33.007761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.008255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.011790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.015710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.016495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.017134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.033160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:33.050346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74f8fe27-9955-43ff-8e31-0d0da08e8efa tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.314908 Nov 02 11:51:33.051494 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 202/403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:32 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:33.067468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:33.068088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:33.080284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.080775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.081276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.081977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.082433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.082856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.526830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:33.551050 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5853e19-1d0f-425b-9348-7ee2ed7b8bc2 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.495980 Nov 02 11:51:33.559558 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 203/404] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:33 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:33.582370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:33.585200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:33.592495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:33.603537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b35949aa-cfd3-46da-b777-d135b18dd592 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.622125 Nov 02 11:51:33.615009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 202/405] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:32 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:33.615436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.615436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.615436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.615436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.615948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.615948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.616084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:33.616084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:33.638702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.639231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.639670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.640380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.640833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.641262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.890496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:33.898331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff77a743-49d4-44be-8c2b-20a2c7e1fae1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.335306 Nov 02 11:51:33.898924 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 204/406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:33 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:33.926921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 408f05d1-a900-4540-9036-a4133f010764 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:33.954902 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20289f55-64e3-4b7a-bd62-2d141d4badde tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 2051 microversion: 2.25 time: 0.348735 Nov 02 11:51:33.963025 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 203/407] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:33 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 2051 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:33.983077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:33.987396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.988298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.988850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:33.989766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:33.990333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:33.990887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.019934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed284b56-89c1-4892-a3e8-dcdab2d9cb00 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041035 Nov 02 11:51:34.034860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": "auto"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:34.041329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:34.041481 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 205/408] 10.222.0.48 () {60 vars in 1217 bytes} [Wed Nov 2 11:51:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:51:34.045988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.047516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.048192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.049184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.050022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.050730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.078340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:34.079970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:34.090812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.093024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.093024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.093024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.093808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.094769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.100083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:34.166971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=58 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:34.212881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'flavor' on Instance uuid 408f05d1-a900-4540-9036-a4133f010764 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:34.289510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 408f05d1-a900-4540-9036-a4133f010764] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:51:34.805573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:34.817260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-128f2f90-dcd0-458a-8531-8027f84a4420 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.740522 Nov 02 11:51:34.818115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 206/409] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:34 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:34.833587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748177eb-66a3-4981-b496-4838c6f2c4d7", "tag": "75a2eede-f2e5-4468-97b7-9f6981479c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:34.861819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.863888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.864499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.890564 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] Creating event network-changed:75a2eede-f2e5-4468-97b7-9f6981479c64 for instance 748177eb-66a3-4981-b496-4838c6f2c4d7 on n-h2-855649-4 Nov 02 11:51:34.922151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b5cb1718-b250-46bf-a345-5bc2bb1d05c3 req-d332595d-b44e-4b43-afda-e9b3d1f95210 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101738 Nov 02 11:51:34.923326 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 207/410] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:34.942570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:34.943317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:34.966165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.966915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.967536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:34.972659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:34.973407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:34.976921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:35.689532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:35.698093 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93e75944-28c6-4571-9be6-633cb4c0f5e1 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.761465 Nov 02 11:51:35.711474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 208/411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:34 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:35.725041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:35.725671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:35.733799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:35.734799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:35.735535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:35.736791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:35.737503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:35.738119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.201707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:36.212988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8923e945-c4ea-421c-b2c2-a7fd762afdec tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.499234 Nov 02 11:51:36.215803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 209/412] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:35 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:36.224629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:36.225513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:36.234319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.235959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.237970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.238838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.239555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.240935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.530856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:36.547532 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4eca9b90-d372-4c76-865b-27bb6730bbb7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.329772 Nov 02 11:51:36.548855 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 210/413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:36 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:36.557091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:36.560211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:36.567537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.568280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.568912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.569846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.570530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.571418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.791268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:36.804874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a74843d0-35ee-49a6-be1b-9b920136328a tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.254727 Nov 02 11:51:36.813402 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 211/414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:36 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:36.827814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08b657c2-6022-4936-9ada-ca14aeabc8ad", "tag": "07b1b0b9-dd3e-4878-9b9d-b52f1e90634e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:36.841633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.842419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.843086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.863637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] Creating event network-changed:07b1b0b9-dd3e-4878-9b9d-b52f1e90634e for instance 08b657c2-6022-4936-9ada-ca14aeabc8ad on n-h2-855649-4 Nov 02 11:51:36.870446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-39b6a2aa-1730-4dce-a3c9-ae9f9b4e307f req-f46aac04-529e-4011-b2ee-82cd2d919565 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055444 Nov 02 11:51:36.872321 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 212/415] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:36.880451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:36.883526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:36.892668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.893166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.893610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:36.894348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:36.894811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:36.895283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.138232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:37.146390 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f60a32d0-d560-4777-b2ef-075d0997a761 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.270689 Nov 02 11:51:37.161144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 213/416] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:36 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:37.169479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3688f7ee-995c-4670-9095-f9329a3c5f4f", "tag": "0e624303-98c8-4b21-a772-128fb77301e0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:37.186259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.186913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.187522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.200316 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] Creating event network-changed:0e624303-98c8-4b21-a772-128fb77301e0 for instance 3688f7ee-995c-4670-9095-f9329a3c5f4f on n-h1-855649-4 Nov 02 11:51:37.209238 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c9ab4107-ad79-44da-91ff-1a72b88d144c req-ab360d90-453e-449f-9d04-d054af70dd26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046621 Nov 02 11:51:37.211052 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 214/417] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:37.240815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:37.241753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:37.253387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.254113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.254752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.255671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.256268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.256839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.432289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=50 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:37.491767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:37.504327 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8245ab2-ba0d-4253-9e98-41ba9d71ce08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.269660 Nov 02 11:51:37.519461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 215/418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:37 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:37.574740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:37.575577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:37.583119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.583974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.584631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.585974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.586765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.587441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.788448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:37.797683 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f871ff95-d151-4691-b39b-68a1f3d4198d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.227807 Nov 02 11:51:37.816174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 216/419] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:37 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:37.837363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:37.840066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:37.884528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.886554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.888126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:37.889168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:37.891811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:37.893655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.752204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:38.767306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb8e5c6c-685f-4111-bb15-270fade0a655 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.933662 Nov 02 11:51:38.783556 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 217/420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:37 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:38.794419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:38.799011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:38.812887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.819683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.819683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:38.819683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:38.819683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:38.820063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.134085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:40.203968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96075583-56ed-40f8-a784-d322b048b330 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 1.393694 Nov 02 11:51:40.203968 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 218/421] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:38 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:40.209957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:40.210902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:40.218296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:40.219143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:40.219757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.220772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:40.221404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:40.221993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.733800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:40.746964 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26c30233-b35d-4367-8388-4c3a938c592a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.558866 Nov 02 11:51:40.747596 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 219/422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:40 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:40.752590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:40.753527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:40.760624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:40.762066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:40.762776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.763776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:40.764473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:40.765207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:40.940998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:40.950304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edfb03ab-629b-40b5-adbf-05a19b8ed01c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.201425 Nov 02 11:51:40.964301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 220/423] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:40 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:41.074449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0400b5cb-9b5e-4190-8b24-4032fea35ad2 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1607379700", "ram": 512, "vcpus": 1, "disk": 10, "id": 1463346701, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:41.159673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0400b5cb-9b5e-4190-8b24-4032fea35ad2 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.193737 Nov 02 11:51:41.172727 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 221/424] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:40 2022] POST /compute/v2.1/flavors => generated 416 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:41.178309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6d7b6a-9909-4289-b081-b99bedae13b0", "tag": "dba73a21-6615-4b50-998a-c929842502c2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:41.194054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.194054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.194054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.201607 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] Creating event network-changed:dba73a21-6615-4b50-998a-c929842502c2 for instance af6d7b6a-9909-4289-b081-b99bedae13b0 on n-h2-855649-4 Nov 02 11:51:41.207875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ab186d0d-e042-4e59-a41a-5fc6866ced6a req-1812d4d9-29b8-4a09-8759-112849e24415 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Nov 02 11:51:41.208737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 222/425] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:41.215228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:41.216481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:41.217315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6db08fc-aadb-4532-a788-db8efed04c9e tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764/action" status: 202 len: 0 microversion: 2.25 time: 7.186616 Nov 02 11:51:41.217944 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 204/426] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:51:34 2022] POST /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764/action => generated 0 bytes in 7188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:51:41.230487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d49d4e-ec74-43b4-90f2-ede599ec98ed", "name": "network-vif-plugged", "status": "completed", "tag": "8c388c0b-d300-42a8-ae3f-e5600cbba056"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:41.230654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.230654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.230654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.230654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.230953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.230953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.256776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.256776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.256776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.275622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] Creating event network-vif-plugged:8c388c0b-d300-42a8-ae3f-e5600cbba056 for instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed on n-h2-855649-4 Nov 02 11:51:41.287124 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-04755994-23e7-4f5f-9877-1988c4cd833d req-bf5be93e-7df0-4e1a-b551-52d22df8640d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067814 Nov 02 11:51:41.298385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 205/427] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:41.300242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09e07342-7c9c-468a-a6b3-c93d136521df tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:41.337702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:SAVEPOINT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:41.455484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.465937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a44c508b-dff1-49b6-92aa-da57eb54b7fe tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.255574 Nov 02 11:51:41.468564 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 223/428] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:41.482398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:41.483228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:41.503492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.506188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.506756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.508395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.508937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.509488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.530022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09e07342-7c9c-468a-a6b3-c93d136521df tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.238257 Nov 02 11:51:41.530678 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 206/429] 10.222.0.48 () {60 vars in 1224 bytes} [Wed Nov 2 11:51:41 2022] POST /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:41.537089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:41.538081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:41.546890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.547622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.548274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.549235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.550374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.551116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.802385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.814598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.819150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.822712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:41.822922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f90a7d9c-7274-4d52-8882-78b767d40eb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.290419 Nov 02 11:51:41.824250 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 207/430] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:41.831388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e845722-0920-4b9e-aed4-8339774ea628 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.358017 Nov 02 11:51:41.831964 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 224/431] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:41.841311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:41.843956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:41.857531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.860723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.860723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:41.860723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:41.862484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:41.863175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.011808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41917267-6edd-45bb-804f-79138029f15c tempest-FlavorsExtraSpecsTestJSON-1132518815 tempest-FlavorsExtraSpecsTestJSON-1132518815-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.021457 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41917267-6edd-45bb-804f-79138029f15c tempest-FlavorsExtraSpecsTestJSON-1132518815 tempest-FlavorsExtraSpecsTestJSON-1132518815-project] 10.222.0.48 "GET /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.195611 Nov 02 11:51:42.032173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:42.037308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 208/432] 10.222.0.48 () {58 vars in 1203 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.043230 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f088638e-1773-465a-be1c-b7f318192518 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.208616 Nov 02 11:51:42.063396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.063951 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 225/433] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:41 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:42.069037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d218188-3742-497a-b769-edcc6164c2bd tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:42.070120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:42.088588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.089717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.090251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.092228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.092715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.093400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.106885 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d218188-3742-497a-b769-edcc6164c2bd tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041575 Nov 02 11:51:42.112487 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 226/434] 10.222.0.48 () {60 vars in 1224 bytes} [Wed Nov 2 11:51:42 2022] POST /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.117988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a50ac0dd-0eba-4319-b88a-b6e7038eff5a tempest-FlavorsExtraSpecsTestJSON-1132518815 tempest-FlavorsExtraSpecsTestJSON-1132518815-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.128934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a50ac0dd-0eba-4319-b88a-b6e7038eff5a tempest-FlavorsExtraSpecsTestJSON-1132518815 tempest-FlavorsExtraSpecsTestJSON-1132518815-project] 10.222.0.48 "GET /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014857 Nov 02 11:51:42.139106 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 227/435] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes => generated 22 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.141449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1bf0a65-3987-4f18-a1d6-66b016862556 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:42.175493 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1bf0a65-3987-4f18-a1d6-66b016862556 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038178 Nov 02 11:51:42.177164 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 228/436] 10.222.0.48 () {60 vars in 1224 bytes} [Wed Nov 2 11:51:42 2022] POST /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.187940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8b2a731-6ef9-4318-bec8-dfc601bb21d8 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.197738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8b2a731-6ef9-4318-bec8-dfc601bb21d8 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014492 Nov 02 11:51:42.198452 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 229/437] 10.222.0.48 () {58 vars in 1203 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.213508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eceaabe7-db59-45bb-aee6-d28dcfbe0ed1 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:42.280875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:42.289313 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cab85e4f-b04f-4f27-8abb-f293db5b2747 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.252303 Nov 02 11:51:42.289902 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 209/438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:42.360494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eceaabe7-db59-45bb-aee6-d28dcfbe0ed1 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.154716 Nov 02 11:51:42.361255 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 230/439] 10.222.0.48 () {60 vars in 1265 bytes} [Wed Nov 2 11:51:42 2022] PUT /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes => generated 22 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.370539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe7d39fc-154e-4b1f-bdea-4a7a50e1286a tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.378766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe7d39fc-154e-4b1f-bdea-4a7a50e1286a tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011930 Nov 02 11:51:42.379391 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 210/440] 10.222.0.48 () {58 vars in 1203 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/flavors/1463346701/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.388949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1936181-d263-4dbe-bedb-dc585fc6fd40 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.493164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.493895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:42.502314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.502915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.503444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.504239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.504901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.505330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.510680 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1936181-d263-4dbe-bedb-dc585fc6fd40 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.125570 Nov 02 11:51:42.512337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 231/441] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 11:51:42 2022] DELETE /compute/v2.1/flavors/1463346701/os-extra_specs/hw:numa_nodes => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:42.520518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9265ac38-e989-44c4-ba9a-6b4613a1d04e tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.623926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:42.632105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9265ac38-e989-44c4-ba9a-6b4613a1d04e tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1463346701/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.109278 Nov 02 11:51:42.632105 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 232/442] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 11:51:42 2022] DELETE /compute/v2.1/flavors/1463346701/os-extra_specs/hw:cpu_policy => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 11:51:42.640170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3d1d1d9-4586-4844-a9a1-021db506cc6e tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.654271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3d1d1d9-4586-4844-a9a1-021db506cc6e tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1463346701/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022277 Nov 02 11:51:42.660603 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 233/443] 10.222.0.48 () {58 vars in 1203 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/flavors/1463346701/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:42.669281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:42.676067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68be0540-7153-4bd4-b71b-5a62e7c2f8f2 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.678029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f57e9b59-bbbe-4faa-a3e7-0837be50f81e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.188796 Nov 02 11:51:42.679287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 211/444] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:42.766511 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68be0540-7153-4bd4-b71b-5a62e7c2f8f2 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1463346701" status: 202 len: 0 microversion: 2.1 time: 0.099625 Nov 02 11:51:42.769602 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 234/445] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:51:42 2022] DELETE /compute/v2.1/flavors/1463346701 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:42.775962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df3daa23-1387-4c8a-9b82-64567087c048 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.799199 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df3daa23-1387-4c8a-9b82-64567087c048 tempest-FlavorsExtraSpecsTestJSON-1794942505 tempest-FlavorsExtraSpecsTestJSON-1794942505-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026841 Nov 02 11:51:42.800185 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 212/446] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:42.855192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.859128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:42.865219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:42.868627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:42.874038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.877643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.879431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.881338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.881834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.882272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.882992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.883461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.883891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.887589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:42.888110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:42.888556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:42.934540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:43.333430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.352003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.366140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.366648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ba743d9-6496-402b-becf-5f325ae233ef tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.510689 Nov 02 11:51:43.367360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 235/447] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:43.379676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:43.383521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:43.397753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.402701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.403332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.404610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.405098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.405536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.498854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.509302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3c47a6d-b6b0-438f-b451-51d3fec96e68 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.651988 Nov 02 11:51:43.513498 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 213/448] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:42 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:43.535932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:43.536932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:43.545981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.546791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.547509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.548457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.549124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.549751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.900342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.911300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-385b3c30-4c69-443a-81ea-cd3749ab7e7d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.537583 Nov 02 11:51:43.923144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 236/449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:43 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:43.931116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3688f7ee-995c-4670-9095-f9329a3c5f4f", "name": "network-vif-plugged", "status": "completed", "tag": "0e624303-98c8-4b21-a772-128fb77301e0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:43.942095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:43.943297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.943787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.944229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.956523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3d9cc04-f448-482d-b3d0-e1f33f9c78cc tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.430868 Nov 02 11:51:43.958346 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 214/450] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:43 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:43.970682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:43.974407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:43.977390 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] Creating event network-vif-plugged:0e624303-98c8-4b21-a772-128fb77301e0 for instance 3688f7ee-995c-4670-9095-f9329a3c5f4f on n-h1-855649-4 Nov 02 11:51:43.986776 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-41a531ae-41d3-4f48-9e6d-e71abf0e10aa req-29414a73-d70b-46e9-b408-90d002038da6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065470 Nov 02 11:51:43.988045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 237/451] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:43.989399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.993100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.993100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:43.993100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:43.993100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:43.993578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.273300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:44.284361 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e6afbf1-5ed4-4203-ab32-2db0d2cca28b tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.324790 Nov 02 11:51:44.291084 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 215/452] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:43 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:44.393822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:44.402694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:44.405663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:44.414962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.415937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.416599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.418413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.419332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.423552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.544242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:44.545363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:44.559367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.559367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.559367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:44.565670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:44.566474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:44.567309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.099635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.116334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.119973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.130787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4ff1427-b5c2-4bd7-a5fb-c2eee5c2952c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.733419 Nov 02 11:51:45.143152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 238/453] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:44 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:45.143152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:45.143152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:45.189787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.190868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.190868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.191606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.192071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.192548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.336388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.351222 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33ae0ae0-1d5a-4504-b86f-c5479b943355 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1319 microversion: 2.1 time: 0.812716 Nov 02 11:51:45.365468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 216/454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:44 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1319 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:45.387156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:45.388821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:45.404008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.404643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.405194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.406028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.406602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.407388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.465647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.476267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d49551f4-b206-4afe-84d1-603e5379df62 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.339864 Nov 02 11:51:45.520997 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 239/455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:45 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:45.538825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:45.540801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:45.572332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.574217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.574857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.576854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:45.578574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:45.579516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:45.819146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:45.847814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6dc71453-fd7a-492e-80a0-dec98ebd19fb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.480330 Nov 02 11:51:45.866016 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 217/456] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:45 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:46.006100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748177eb-66a3-4981-b496-4838c6f2c4d7", "name": "network-vif-plugged", "status": "completed", "tag": "75a2eede-f2e5-4468-97b7-9f6981479c64"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:46.022647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.023173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.023613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.054757 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] Creating event network-vif-plugged:75a2eede-f2e5-4468-97b7-9f6981479c64 for instance 748177eb-66a3-4981-b496-4838c6f2c4d7 on n-h2-855649-4 Nov 02 11:51:46.071107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-736871f0-c1cd-4f66-866d-43e8b57e1157 req-c64165bc-a627-42ee-8321-b0632c2eba0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068570 Nov 02 11:51:46.071724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 218/457] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:46.166106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:46.166827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:46.179995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.180494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.180934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.181655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.182118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.191626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.318682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.336535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e78fe9aa-ab9e-451a-9e08-c0a36a1e9052 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.814309 Nov 02 11:51:46.352685 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 240/458] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:45 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:46.403636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:46.404280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:46.417021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.418250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.418775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.419840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.420506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.421125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.765478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.775149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.792077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.792077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63606be7-9c55-4747-bf97-432ee42011cd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.629966 Nov 02 11:51:46.810349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:46.821737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3c1e5a8-51ce-4ea7-be0d-2bb87fa555f7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1469 microversion: 2.1 time: 0.428356 Nov 02 11:51:46.829064 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 219/459] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:46 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:46.829582 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 241/460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:46 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:46.834960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:46.835713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:46.844246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.845166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.857415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:46.858882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:46.859580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:46.860169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.167745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.168489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:47.178020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.179676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.179676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.180788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.181696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.182388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.188023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:47.199772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c853fb1-b619-48d6-a14c-52d0c8ec94d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.375738 Nov 02 11:51:47.200761 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 220/461] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:46 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:47.209906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.213774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:47.234374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.234374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.234374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.234374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.234997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.234997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.273651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:51:47.273994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:47.458055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:47.466354 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11442e62-a9cf-42d7-a5cf-6fc8808fdae2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.264444 Nov 02 11:51:47.466935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 221/462] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:47 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:47.699242 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43661253-ed57-48ac-81d6-43f52e199bcd tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 204 len: 0 microversion: 2.1 time: 0.850941 Nov 02 11:51:47.700367 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 242/463] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:51:46 2022] DELETE /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 0 bytes in 853 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:51:47.709885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.711517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:47.722477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.723300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.723443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-201568fb-3623-4cda-997a-2684c858a91e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.724029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.724836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.725538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.726999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.735394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-201568fb-3623-4cda-997a-2684c858a91e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.267252 Nov 02 11:51:47.755157 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 222/464] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:51:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:47.764092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:47.764092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:47.801771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.802271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.802719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:47.803485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:47.803951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:47.804379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.091862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.101627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.107284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0b402ad-2163-45e9-b9e7-4f827d0180ad tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.402874 Nov 02 11:51:48.109731 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 243/465] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:47 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:48.115263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8306c5e-e4ec-43e7-9462-31769f25487e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1475 microversion: 2.1 time: 0.355884 Nov 02 11:51:48.116019 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 223/466] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:47 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1475 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:48.120978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:48.121585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:48.152082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.162050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.164751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.165510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.166039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.166440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.435452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89fd474f-fa91-4a4b-9bca-23e6d2ab7cdb tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-703798212", "id": 1167073119, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:48.437019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.468520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.474044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.480665 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08bb338f-dfde-4675-b8ec-f92de8d55699 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.363786 Nov 02 11:51:48.487486 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 224/467] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:48 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:48.501561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:48.507119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:48.532969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.533267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.537611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.538738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.540105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.541948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.555153 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89fd474f-fa91-4a4b-9bca-23e6d2ab7cdb tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.443779 Nov 02 11:51:48.555755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 244/468] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:48 2022] POST /compute/v2.1/flavors => generated 424 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:48.570155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:48.570776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:48.594147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.594736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.596255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.596994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.598948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.599425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.795490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.807388 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2d99570-387a-4ee0-9669-92c0dbe8d479 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.318540 Nov 02 11:51:48.810451 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 225/469] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:48 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:48.822872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08716f1b-83e6-432c-ab88-50245755b865 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:48.832326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08716f1b-83e6-432c-ab88-50245755b865 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018600 Nov 02 11:51:48.833259 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 226/470] 10.222.0.48 () {58 vars in 1182 bytes} [Wed Nov 2 11:51:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:48.837004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:48.855509 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd1b9435-cad7-4de0-8050-468de438d607 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.292623 Nov 02 11:51:48.868195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 245/471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:48 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:48.881629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6d7b6a-9909-4289-b081-b99bedae13b0", "name": "network-vif-plugged", "status": "completed", "tag": "dba73a21-6615-4b50-998a-c929842502c2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:48.896646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:48.897120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:48.897929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:48.917249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] Creating event network-vif-plugged:dba73a21-6615-4b50-998a-c929842502c2 for instance af6d7b6a-9909-4289-b081-b99bedae13b0 on n-h2-855649-4 Nov 02 11:51:48.923906 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6d848eec-f6e8-4de9-a0c7-ab51a6d8caf0 req-3a88d591-19f8-45bd-885f-c7fb45da1b93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054217 Nov 02 11:51:48.925167 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 246/472] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:48.933958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b653d781-3815-4a7e-8635-1a1be22dbd90 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2064215353", "id": 874270517, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:49.046255 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b653d781-3815-4a7e-8635-1a1be22dbd90 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.115386 Nov 02 11:51:49.047885 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 247/473] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:48 2022] POST /compute/v2.1/flavors => generated 422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:49.060813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfa20a82-99ee-4d9e-8d87-ee7100766158 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:49.076888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfa20a82-99ee-4d9e-8d87-ee7100766158 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020341 Nov 02 11:51:49.077677 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 248/474] 10.222.0.48 () {58 vars in 1182 bytes} [Wed Nov 2 11:51:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 11:51:49.092316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9835f8e2-fcbe-4145-ae08-ce5f3ec33f7e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Action: 'create', calling method: .version_select at 0x7ff1b3c953a0>, body: {"keypair": {"name": "tempest-keypair-559412311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWAw+a1fsQBbtrYJ/1HRqagH4SPwB8aDKX1SkBnxB9oYGFtDMOY0oluw7Na61GG5bZBA11SH7T2tYSopupWPkBHGqEMrIbAFvIzc3KdvLb1pxEuoGVOqzlCEmL0SFZ3cQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:49.129589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9835f8e2-fcbe-4145-ae08-ce5f3ec33f7e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for project 314ce714ea624e9c9fcd3258be119e24. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:49.136634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9835f8e2-fcbe-4145-ae08-ce5f3ec33f7e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for user 764a434df778448f8cb76d1371b867f7 and project 314ce714ea624e9c9fcd3258be119e24. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:49.226423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f857f356-aa57-450e-8b7f-786db427fbea tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3df2ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1547637871", "description": "tempest-description-877050223"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:49.282092 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9835f8e2-fcbe-4145-ae08-ce5f3ec33f7e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195334 Nov 02 11:51:49.282701 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 249/475] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:51:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:49.288118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:49.290271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:49.311761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.312637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.313158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:49.316001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.322419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.322419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:49.889518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:49.897593 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33741f99-ac1d-403e-a402-075d1d4efa19 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.613660 Nov 02 11:51:49.901006 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 250/476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:49 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:49.914663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:49.915624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:49.922715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.923785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.925682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:49.926580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:49.927234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:49.927926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.006342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.017148 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4719aa7e-e60c-4c56-9fa8-b1ca55590bfe tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1433 microversion: 2.1 time: 0.111722 Nov 02 11:51:50.020964 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 251/477] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:49 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1433 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:50.030299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.035187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:50.057557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.060754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.060971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.061911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.063720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.064387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.175320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f857f356-aa57-450e-8b7f-786db427fbea tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.340395 Nov 02 11:51:50.176155 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 227/478] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:51:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:50.181922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.183394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:50.194476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.202720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.202720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.202720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.202720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.203110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.373499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.384606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.387939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.389134 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffa48fa4-fcc5-42a5-9e3f-7d2b00f8bd37 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.363316 Nov 02 11:51:50.389887 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 252/479] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:50.403267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.408230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:50.428867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.431157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.431157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.431157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.431157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.431489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.468193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.478850 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7879c8d1-e419-493b-9def-325e13e50c67 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.301233 Nov 02 11:51:50.482053 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 228/480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:50.628728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:50.640482 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6ea3c02-48eb-4335-9368-83e2aeb89c37 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.247880 Nov 02 11:51:50.655146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 253/481] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:50.655146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d396370-14d9-41e3-9253-c3584a8451d9 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3c95820>, body: {"security_group_rule": {"parent_group_id": "0dd8df7f-b4b2-4927-9737-8a65943361c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:50.697510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3e221f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.702527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.702706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.703736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.704594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.705157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.708831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.832582 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b008dcd-28db-42d8-9637-0f447122b407 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.349200 Nov 02 11:51:50.833800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 229/482] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:50.848189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3688f7ee-995c-4670-9095-f9329a3c5f4f", "name": "network-vif-deleted", "tag": "0e624303-98c8-4b21-a772-128fb77301e0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:50.861831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.862168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.862750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.880115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] Creating event network-vif-deleted:0e624303-98c8-4b21-a772-128fb77301e0 for instance 3688f7ee-995c-4670-9095-f9329a3c5f4f on n-h1-855649-4 Nov 02 11:51:50.890304 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4c44be13-01f9-47b7-8db5-692bd787e229 req-f06a3027-ae8b-40ff-88a0-fc71c8851923 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052047 Nov 02 11:51:50.890304 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 230/483] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:50.894733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3ecf4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.899254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.900100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.900887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.901903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.902968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.903731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.941797 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4acb316c-cad6-41ca-8839-7d2924e8b512 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.051779 Nov 02 11:51:50.950687 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 231/484] 10.222.0.48 () {58 vars in 1139 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:50.966100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:50.967953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:50.981157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.982264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.987807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:50.987807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:50.987807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:50.987807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.275427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.289191 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b2c3e55-5842-4fe7-a691-88b2e97bba2d tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.333373 Nov 02 11:51:51.308304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d396370-14d9-41e3-9253-c3584a8451d9 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.661194 Nov 02 11:51:51.308304 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 254/485] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:51.310463 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 232/486] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:50 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:51.310588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3c2d8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.316425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.317013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.317533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.318359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.318929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.319815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.331354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.332019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:51.338653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.339806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.340548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.341271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.342102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.342698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.349740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eaec3785-2630-496d-b9b0-a6cc9fd11342 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.043809 Nov 02 11:51:51.352763 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 255/487] 10.222.0.48 () {58 vars in 1145 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:51:51.365882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45e63384-4162-4f43-a39b-5e1921e9059a tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3d301f0>, body: {"security_group_rule": {"parent_group_id": "0dd8df7f-b4b2-4927-9737-8a65943361c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:51.382165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.382636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.383143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.383596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lazy-loading 'fault' on Instance uuid 3688f7ee-995c-4670-9095-f9329a3c5f4f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:51.443707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.454134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b14832a-8d20-4594-bd08-3263bf5cb47f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 200 len: 1309 microversion: 2.1 time: 0.140186 Nov 02 11:51:51.471313 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-45e63384-4162-4f43-a39b-5e1921e9059a tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 Nov 02 11:51:51.472286 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 233/488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45e63384-4162-4f43-a39b-5e1921e9059a tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 138 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:51.472762 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "0dd8df7f-b4b2-4927-9737-8a65943361c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:51:51.474148 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: exception: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0dd8df7f-b4b2-4927-9737-8a65943361c0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:51.476061 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:51.478417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45e63384-4162-4f43-a39b-5e1921e9059a tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: This rule already exists in group 0dd8df7f-b4b2-4927-9737-8a65943361c0 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:51.480940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45e63384-4162-4f43-a39b-5e1921e9059a tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.099254 Nov 02 11:51:51.480940 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 256/489] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:51.481383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3dd8b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.481383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.481383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.481383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.482413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.482573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.482573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.482573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.483007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:51.525985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.530137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.530736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.531648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.532111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d5a23b2-d88a-4330-9b75-2c88c9905523 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.070546 Nov 02 11:51:51.532224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.532565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.532754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 234/490] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:51.538304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf13a7b5-e6f3-4ae5-9041-874051a4c00e tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3ecfa60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.855771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.887389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.889380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:51.890613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba845aa2-fae8-414d-8e9f-a42dedc09e9b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.427264 Nov 02 11:51:51.891594 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 257/491] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:51.897780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:51.898695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:51.906681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.907557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.908232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.909065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:51.909751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:51.910257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:51.933485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:52.010464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf13a7b5-e6f3-4ae5-9041-874051a4c00e tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/13269abd-80e3-42ce-a7c3-0d5fbaaf42d3" status: 202 len: 0 microversion: 2.1 time: 0.476657 Nov 02 11:51:52.016936 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 235/492] 10.222.0.48 () {58 vars in 1287 bytes} [Wed Nov 2 11:51:51 2022] DELETE /compute/v2.1/os-security-group-rules/13269abd-80e3-42ce-a7c3-0d5fbaaf42d3 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:51:52.022050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3dd8dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.027595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.028493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.029270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.030307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.040726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.040726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.070868 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7754f53-aa91-42db-be05-467cccd9b3ac tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052463 Nov 02 11:51:52.072940 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 236/493] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:52.080148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:52.084035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.084948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:52.092945 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1b38223-4b8d-4374-adff-9329be2cc0c5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1318 microversion: 2.1 time: 0.199559 Nov 02 11:51:52.093894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 258/494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:51 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:52.094591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.095324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.095873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.099432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.100590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48bddf21-2a9d-4273-983e-c49d7c6aba15 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3bd69d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-374993680", "description": "tempest-description-1851495604"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:52.100952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.102801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.342214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:52.347099 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb16fefc-c0f1-4bc1-8438-bdd6e4f00322 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1314 microversion: 2.1 time: 0.270640 Nov 02 11:51:52.347758 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 237/495] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:52.366831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3dd81f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.376953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.376953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.376953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.376953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.377239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.377239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.416559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51f4f630-f698-4f54-987e-42637a57236c tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.055189 Nov 02 11:51:52.417822 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 238/496] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:52.426917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.427576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:52.434515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.434822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.435295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.435994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.436451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:52.436882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:52.958592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:52.968065 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48bddf21-2a9d-4273-983e-c49d7c6aba15 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.872282 Nov 02 11:51:52.971230 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 259/497] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:51:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:52.984073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ad4f645-ca6d-4670-933f-dac33b39d598 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.563847 Nov 02 11:51:52.984690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3bd6310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.985445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 239/498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:52.994627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:52.997006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:52.997921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:53.005026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.005929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.006524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.008078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.008725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.009614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.010237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.010727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.040112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:51:53.044467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.044972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f HTTP/1.1 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:53.045484 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:51:53.046965 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '3688f7ee-995c-4670-9095-f9329a3c5f4f'} Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:53.047937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:51:53.049286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.050473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:53.050556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.050642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6458e10-4c97-4960-807e-256394f55115 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 404 len: 111 microversion: 2.1 time: 0.060497 Nov 02 11:51:53.063392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 240/499] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:53.073955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:53.073955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:53.077906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.078402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.078887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.079675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.081060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.081485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.100391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d87707e-9b2c-4259-8bab-ce01d7118965 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h1-855649-4" status: 200 len: 598 microversion: 2.1 time: 0.127960 Nov 02 11:51:53.108350 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 260/500] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 11:51:52 2022] GET /compute/v2.1/os-hosts/n-h1-855649-4 => generated 598 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:53.118848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae8557d3-f4fd-46c6-a902-40c025e776e7 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3e6a040>, body: {"security_group_rule": {"parent_group_id": "5e5bb67b-5684-4340-8886-082155043883", "ip_protocol": "tcp", "from_port": 1299474674, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:53.270554 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ae8557d3-f4fd-46c6-a902-40c025e776e7 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Invalid port range 1299474674:22. Former value cannot be greater than the later Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae8557d3-f4fd-46c6-a902-40c025e776e7 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 146 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:53.272413 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "5e5bb67b-5684-4340-8886-082155043883", "ip_protocol": "tcp", "from_port": 1299474674, "to_port": 22}} Nov 02 11:51:53.273666 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid port range 1299474674:22. Former value cannot be greater than the later Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5e5bb67b-5684-4340-8886-082155043883', 'ip_protocol': 'tcp', 'from_port': 1299474674, 'to_port': 22}}} Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1299474674:22. Former value cannot be greater than the later Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.274338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1299474674:22. Former value cannot be greater than the later Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1299474674:22. Former value cannot be greater than the later Nov 02 11:51:53.283714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.285272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae8557d3-f4fd-46c6-a902-40c025e776e7 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: Invalid port range 1299474674:22. Former value cannot be greater than the later {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:53.285272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae8557d3-f4fd-46c6-a902-40c025e776e7 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.177100 Nov 02 11:51:53.288239 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 261/501] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:53 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:53.316996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Calling method '.version_select at 0x7ff1b3fff1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:53.344566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.345495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.346090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.388465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.388465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.388465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.455702 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d35c8bb-ce5a-454d-a3bc-6511cf704c23 tempest-HostsAdminTestJSON-334053750 tempest-HostsAdminTestJSON-334053750-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h2-855649-4" status: 200 len: 729 microversion: 2.1 time: 0.166076 Nov 02 11:51:53.468946 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 262/502] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 11:51:53 2022] GET /compute/v2.1/os-hosts/n-h2-855649-4 => generated 729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:53.474740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:53.475787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:53.485553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.486313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.486954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.489052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.490741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.491402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.616501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:53.629630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:53.631534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:53.632770 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec318957-c5fb-4529-b0b8-8059086287d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.568037 Nov 02 11:51:53.633897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 241/503] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:53 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:53.639734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1419485208", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:53.712917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:53.921586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:53.932363 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-397f199f-207f-4c4f-9e3e-a482abd86cde tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1468 microversion: 2.1 time: 0.461800 Nov 02 11:51:53.933841 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 263/504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:53 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:53.953965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67e6dcc6-547b-46fe-8683-e2dd974e3fae tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3cfb550>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1756463486", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:53.957079 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-67e6dcc6-547b-46fe-8683-e2dd974e3fae tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Security group id should be uuid Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67e6dcc6-547b-46fe-8683-e2dd974e3fae tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 131 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:53.958844 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1756463486", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:53.960315 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group id should be uuid Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1756463486', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:53.961058 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 11:51:53.962758 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:53.964900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67e6dcc6-547b-46fe-8683-e2dd974e3fae tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: Security group id should be uuid {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:53.966305 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67e6dcc6-547b-46fe-8683-e2dd974e3fae tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030061 Nov 02 11:51:53.971127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 264/505] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:53 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:51:53.978303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:53.978303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:53.988623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.990528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.991030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:53.991765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:53.993419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:53.994053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.136640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:54.137615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:54.138252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:54.138863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:54.139448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:54.151762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.152491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.152932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.153860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.154475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.155109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.186884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Getting quotas for project 2c1ad7e075184db8a76c09803e8c9be9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:54.194191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Getting quotas for user 3269cc02f13947cca91c49350fa8fcfe and project 2c1ad7e075184db8a76c09803e8c9be9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:54.209746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:54.213915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:54.252864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:54.261957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2506f30f-c89f-47b7-8698-ff84c83ef343 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1464 microversion: 2.1 time: 0.292426 Nov 02 11:51:54.267181 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 265/506] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:53 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:54.269069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-727992331", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "874270517", "adminPass": "***", "networks": [{"uuid": "5cde0e45-0df9-44f6-b8c8-0ce5ce45b2dc"}], "security_groups": [{"name": "tempest-securitygroup--1372021882"}], "key_name": "tempest-keypair-559412311", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:54.318097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:INSERT=4,nova_api:SELECT=93 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:54.461452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] validate_networks() for [('5cde0e45-0df9-44f6-b8c8-0ce5ce45b2dc', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:54.487302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aad73b53-b82f-4803-b99d-ae9ebbfdc05d tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851998 Nov 02 11:51:54.490061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 242/507] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:54.498450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:54.499117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:54.515800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.516308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.516753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.518994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:54.522208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:54.522934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:54.915013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:54.923087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d48240ae-7e28-4142-8bcf-ada6910fbc06 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1468 microversion: 2.1 time: 0.431916 Nov 02 11:51:54.923658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 243/508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:54 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1468 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:54.930366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7487dc22-ae4e-4b6c-9484-3a20c3921977 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3fa1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1308031997", "description": "tempest-description-1341116888"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:55.252622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:55.253656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:55.254409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:55.259425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:55.260235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:55.271912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.272656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.273274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.279158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.279158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.279158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.294450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for project 314ce714ea624e9c9fcd3258be119e24. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:55.299436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for user 764a434df778448f8cb76d1371b867f7 and project 314ce714ea624e9c9fcd3258be119e24. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:55.303091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:55.314775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:55.317347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:55.479004 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-403aff9b-3098-4e83-a850-f3b5de6bc398 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.215364 Nov 02 11:51:55.480371 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 266/509] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:51:55.485372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:55.485986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:55.493396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.494141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.494740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.496080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.496691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.498430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.633260 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7487dc22-ae4e-4b6c-9484-3a20c3921977 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.706587 Nov 02 11:51:55.634233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 244/510] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:51:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:55.652511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408f05d1-a900-4540-9036-a4133f010764", "name": "network-vif-unplugged", "status": "completed", "tag": "07d1b73b-9b5c-41c5-8d81-328873c6d107"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:55.669390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.670851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.671325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.673344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:55.698865 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fa7d082-f454-483f-a3d5-ec39549aadfb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.213697 Nov 02 11:51:55.699072 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] Creating event network-vif-unplugged:07d1b73b-9b5c-41c5-8d81-328873c6d107 for instance 408f05d1-a900-4540-9036-a4133f010764 on n-h1-855649-4 Nov 02 11:51:55.699229 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 267/511] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:55.704059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:55.713362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:55.720365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b361f5d8-f70a-4658-ab92-98a747ff049d req-6d8abe14-66c8-4068-a712-5417a24a7ea8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084765 Nov 02 11:51:55.725534 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 245/512] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:55.726312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.726813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.726918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:55.727273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.727884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:55.728049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.728647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.728922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.735127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.735397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.735933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.736738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.737261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.737753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.846902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:55.855442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc1e6020-568d-4c4b-b547-f2e15e0a6832 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1224 microversion: 2.1 time: 0.133130 Nov 02 11:51:55.856024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 246/513] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:55.862514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:55.863485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:55.877589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.878082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.878517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.879250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.879884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.880280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.940708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:55.949722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8868f7c8-10a0-4d09-896f-9291ef893699 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1314 microversion: 2.1 time: 0.252159 Nov 02 11:51:55.950653 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 268/514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:55.955595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b657c2-6022-4936-9ada-ca14aeabc8ad", "name": "network-vif-plugged", "status": "completed", "tag": "07b1b0b9-dd3e-4878-9b9d-b52f1e90634e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:55.966373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:55.966846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:55.967302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:55.979145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] Creating event network-vif-plugged:07b1b0b9-dd3e-4878-9b9d-b52f1e90634e for instance 08b657c2-6022-4936-9ada-ca14aeabc8ad on n-h2-855649-4 Nov 02 11:51:55.985369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-41d43c3a-3458-4268-b3f5-dba1da19ead3 req-81ab7628-f08e-4a9c-a61e-0ac9357064cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Nov 02 11:51:55.986549 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 269/515] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:55.992598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.000704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.015265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Searching by: {'reservation_id': 'r-ig1x51vw', 'deleted': False, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:51:56.023429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.024741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.026049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.028003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.028473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.029025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.080063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.090032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.092617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.097680 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-827019c2-f0b4-4345-984f-a048bcbc7c89 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.236973 Nov 02 11:51:56.097680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 247/516] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:56.110354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-888777b3-a0bb-452d-83b2-575c6cd5cc4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.114698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-888777b3-a0bb-452d-83b2-575c6cd5cc4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:56.184258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-888777b3-a0bb-452d-83b2-575c6cd5cc4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.200531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-888777b3-a0bb-452d-83b2-575c6cd5cc4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1261 microversion: 2.1 time: 0.104431 Nov 02 11:51:56.201124 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 248/517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:56 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:56.207684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-484962f9-fc04-4b12-a1cf-4c8e6fb983bc tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3e37550>, body: {"security_group_rule": {"parent_group_id": "ac246d47-21f4-4c08-a183-3f42fa9ad781", "ip_protocol": "tempest-999-716735064", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:56.220934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:51:56.261818 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-484962f9-fc04-4b12-a1cf-4c8e6fb983bc tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Invalid IP protocol tempest-999-716735064. Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-484962f9-fc04-4b12-a1cf-4c8e6fb983bc tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 156 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:56.264421 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "ac246d47-21f4-4c08-a183-3f42fa9ad781", "ip_protocol": "tempest-999-716735064", "from_port": 22, "to_port": 22}} Nov 02 11:51:56.265810 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid IP protocol tempest-999-716735064. Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ac246d47-21f4-4c08-a183-3f42fa9ad781', 'ip_protocol': 'tempest-999-716735064', 'from_port': 22, 'to_port': 22}}} Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-716735064. Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:56.266727 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-716735064. Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-716735064. Nov 02 11:51:56.268125 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:56.269376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-484962f9-fc04-4b12-a1cf-4c8e6fb983bc tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: Invalid IP protocol tempest-999-716735064. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:56.269376 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-484962f9-fc04-4b12-a1cf-4c8e6fb983bc tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.062017 Nov 02 11:51:56.271209 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 249/518] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:56 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:51:56.282631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93450f46-51a9-40fc-95db-02218a8d578f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3db4940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-42260174", "description": "tempest-description-502292233"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:56.381576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:56.388406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.388880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.389314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.576088 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7e14c9d-d073-4efc-89f2-e6a133a81fc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-ig1x51vw" status: 200 len: 2929 microversion: 2.1 time: 0.588136 Nov 02 11:51:56.577213 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 270/519] 10.222.0.48 () {58 vars in 1197 bytes} [Wed Nov 2 11:51:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ig1x51vw => generated 2929 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:56.601419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.627888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_groups [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Querying cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) for 2 instances {{(pid=127568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 11:51:56.628595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.629057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.629480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.659996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8878d967-6b6f-40e4-a817-04a881d68b6f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/fdd2794a-ba1a-4b09-a3af-25231ab28d5f" status: 200 len: 266 microversion: 2.1 time: 0.062596 Nov 02 11:51:56.663471 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 271/520] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:51:56 2022] GET /compute/v2.1/os-server-groups/fdd2794a-ba1a-4b09-a3af-25231ab28d5f => generated 266 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:56.672394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.673160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:56.683864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.684369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.684835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.685531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.685991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.686571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.799622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93450f46-51a9-40fc-95db-02218a8d578f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.521245 Nov 02 11:51:56.800279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 250/521] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:51:56 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:51:56.805040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:56.805643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:56.812927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.813415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.813848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.814550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:56.815019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:56.815448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:56.951873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b932bd1d-3681-4ac3-8c36-e9703a374997 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1619 microversion: 2.1 time: 0.283041 Nov 02 11:51:56.953533 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 272/522] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:56 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1619 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:56.960188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85af7395-079e-42c7-9f9d-196a7b442236 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3aba790>, body: {"security_group_rule": {"parent_group_id": "ebb32c21-74c0-439e-93fc-4daed84f429e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:57.049235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-85af7395-079e-42c7-9f9d-196a7b442236 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85af7395-079e-42c7-9f9d-196a7b442236 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 138 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:57.052293 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: {"security_group_rule": {"parent_group_id": "ebb32c21-74c0-439e-93fc-4daed84f429e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 11:51:57.053580 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ebb32c21-74c0-439e-93fc-4daed84f429e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:57.054522 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 11:51:57.055962 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:57.058236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85af7395-079e-42c7-9f9d-196a7b442236 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:57.058504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.059259 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85af7395-079e-42c7-9f9d-196a7b442236 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.104381 Nov 02 11:51:57.059922 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 273/523] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:56 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:57.063679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:57.065232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.065912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.068658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-748c92ac-86af-4a8e-99eb-a2dc83af2daf tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1319 microversion: 2.1 time: 0.267144 Nov 02 11:51:57.069257 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 251/524] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:56 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.084348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.084348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.084348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.085099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.085184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.085259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.085329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.085329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.085467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.085467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.085467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.085467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.085716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.085716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.247973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.258894 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94db4d68-58d9-443a-8a0b-c9aeb797b506 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1272 microversion: 2.1 time: 0.197492 Nov 02 11:51:57.274116 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 274/525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.280995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.282102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.305580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.306321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.307021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.307970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.308619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.310059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.336605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.346874 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9a9aa78-e99e-4221-80f2-5c878293f907 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1314 microversion: 2.1 time: 0.276369 Nov 02 11:51:57.352452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 252/526] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.366891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b1e4e47-4292-4a8b-aa06-bbbe0361573d tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3db4700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2121118507", "description": "tempest-description-900678739"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:57.460340 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f182f2bd-a7c3-46fd-93a0-7e9e7cb6cbb6 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1619 microversion: 2.1 time: 0.185065 Nov 02 11:51:57.460878 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 275/527] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1619 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.466855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.467508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.473354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.473827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.474357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.475083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.475538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.475963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.667423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.677286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.679780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.685771 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfbfaac6-9359-4881-85d4-9abeb50cfdb4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.219420 Nov 02 11:51:57.685771 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 276/528] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:51:57.690099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:57.691351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:57.697935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.698502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.699114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.699831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.700344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.700948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.781797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:57.789838 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99ef3a9f-fe6c-41c1-88d7-2ffddb3dd59a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1257 microversion: 2.1 time: 0.104272 Nov 02 11:51:57.790408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 277/529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:57 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1257 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:57.795788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: .version_select at 0x7ff1b3c2d820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1765806909", "policies": ["anti-affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:57.817518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:57.822153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:57.898370 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b1e4e47-4292-4a8b-aa06-bbbe0361573d tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.544408 Nov 02 11:51:57.898998 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 253/530] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:51:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:57.904723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408f05d1-a900-4540-9036-a4133f010764", "tag": "07d1b73b-9b5c-41c5-8d81-328873c6d107"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:57.914592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:57.915099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:57.915535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:57.928665 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] Creating event network-changed:07d1b73b-9b5c-41c5-8d81-328873c6d107 for instance 408f05d1-a900-4540-9036-a4133f010764 on n-h1-855649-4 Nov 02 11:51:57.935913 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c045f656-f4be-4843-98c5-10e0f0555982 req-b0012d4e-e024-426e-b982-c0414e5b3520 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 Nov 02 11:51:57.936668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 254/531] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:57.941875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d7dd357-8318-48b5-8e01-f7455d79f05c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3db4e50>, body: {"security_group_rule": {"parent_group_id": "d5591eeb-3593-46fa-b4a1-c2486a0f9b85", "ip_protocol": "tcp", "from_port": 22, "to_port": 844601176}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:58.006804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:58.027044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:58.048907 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7635dc50-b5f2-438b-9989-583d3ca966ef tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.256925 Nov 02 11:51:58.050195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 278/532] 10.222.0.48 () {60 vars in 1174 bytes} [Wed Nov 2 11:51:57 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:58.055226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-plugged", "status": "completed", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:58.067118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.067809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.068240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.080736 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] Creating event network-vif-plugged:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:51:58.086679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d2433492-1e91-43fd-831c-b74cac7eacdb req-a3ef1452-8f8e-4f45-b2ce-d584621828c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035176 Nov 02 11:51:58.088408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 279/533] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:51:58.099048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:58.099754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:58.116597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.118913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.118913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.118913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.118913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.119290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.176725 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6d7dd357-8318-48b5-8e01-f7455d79f05c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d7dd357-8318-48b5-8e01-f7455d79f05c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 145 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:58.178544 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "d5591eeb-3593-46fa-b4a1-c2486a0f9b85", "ip_protocol": "tcp", "from_port": 22, "to_port": 844601176}} Nov 02 11:51:58.182215 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd5591eeb-3593-46fa-b4a1-c2486a0f9b85', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 844601176}}} Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.183130 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 Nov 02 11:51:58.184172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.185200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d7dd357-8318-48b5-8e01-f7455d79f05c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 400 to user: Invalid port range 22:844601176. Valid TCP ports should be between 1-65535 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:58.185200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d7dd357-8318-48b5-8e01-f7455d79f05c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.242650 Nov 02 11:51:58.186351 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 255/534] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:57 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:51:58.192814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Action: 'create', calling method: .version_select at 0x7ff1b3df0430>, body: {"security_group_rule": {"parent_group_id": "b56a3135-9abc-4689-8ef8-eb6e8763c705", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:58.262061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:51:58.262670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Neutron security group b56a3135-9abc-4689-8ef8-eb6e8763c705 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 11:51:58.263525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.263525 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 138 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:51:58.268707 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: {"security_group_rule": {"parent_group_id": "b56a3135-9abc-4689-8ef8-eb6e8763c705", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 11:51:58.270183 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b56a3135-9abc-4689-8ef8-eb6e8763c705', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:51:58.270999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 11:51:58.272236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.273343 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 404 to user: Security group b56a3135-9abc-4689-8ef8-eb6e8763c705 does not exist Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-5dfb89e5-f33c-4718-b7b9-f35fd980246c'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:58.275042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76c7f42f-a9a3-4da9-88ed-fed5e7f57f79 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.082202 Nov 02 11:51:58.276229 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 256/535] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 11:51:58 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:58.280502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-523451782", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f9ed0205-d90d-4b2e-bddb-cafa38aa4506"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:58.369412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:51:58.501473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:58.508649 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-288efea2-5645-4347-9a21-108c69240158 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1469 microversion: 2.1 time: 0.413827 Nov 02 11:51:58.509243 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 280/536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:58 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:51:58.514643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3c958b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:58.584035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:51:58.584659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Neutron security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 not found {{(pid=127568) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 11:51:58.585210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] HTTP exception thrown: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.585210 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Request method failure captured: Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-group-rules/aa3278af-225e-41ba-b589-eedacb9b1d43 HTTP/1.1 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlnU7eaatTVXZTGETnoMl6WDJeeob02E6R0L0P4WhqPH0wkvX7EExMNOUDCr5t_-KoJok57bIVcpp5dxQJu6K-JkKYaVHeHl28mIhS9HiiLYxmhHXWq0WWHGreJ7ccnSW3v0Wig1KekE0VILdBn_Cppx4Orz8jW8l6ItYcoT5lnxfY4 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:51:58.587206 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d6245cb2cc924341adc394c1658f69a1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d6245cb2cc924341adc394c1658f69a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d6245cb2cc924341adc394c1658f69a1 Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868 Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 686f45e42a474dd9acc7cb5f6c42796b Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.588404 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'aa3278af-225e-41ba-b589-eedacb9b1d43'} Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.589156 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 11:51:58.598395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.600327 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Returning 404 to user: Security group rule aa3278af-225e-41ba-b589-eedacb9b1d43 does not exist Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-3f44f1f1-e092-4492-8fbc-818889e41ae4'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:51:58.602921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a403c7b3-7d12-40a7-a788-a3d45cd0f93f tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/aa3278af-225e-41ba-b589-eedacb9b1d43" status: 404 len: 199 microversion: 2.1 time: 0.078125 Nov 02 11:51:58.607088 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 281/537] 10.222.0.48 () {58 vars in 1287 bytes} [Wed Nov 2 11:51:58 2022] DELETE /compute/v2.1/os-security-group-rules/aa3278af-225e-41ba-b589-eedacb9b1d43 => generated 199 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:51:58.613861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:58.615625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:58.626904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.627830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.628280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.629025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.629488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.630131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.888808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:51:58.889391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:51:58.889987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:51:58.890795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:51:58.891506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:51:58.921067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.922024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.922474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.923497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:58.924060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:58.924552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:58.949440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:58.954156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:58.972102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 2 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:51:58.975098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:59.020178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:59.023908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:51:59.028659 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58294935-1e02-423e-aad0-914495ba83c7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.434691 Nov 02 11:51:59.039377 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 282/538] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:58 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:59.044940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:51:59.045561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:59.063894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:59.064398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:59.064841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:59.065556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:59.066022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:59.066453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:59.140949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:59.145527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:59.309716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:59.314690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:59.332331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=7cc717d3-9a5e-49f9-a01a-0cf651aa0170,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:51:59.581583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:51:59.589438 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fde800b7-a938-41ab-9b43-aae5d6e02a57 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1314 microversion: 2.1 time: 0.548832 Nov 02 11:51:59.590526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 283/539] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:51:59 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:51:59.595936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:51:59.611031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:51:59.611298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:59.613938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:59.614097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:59.614769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:59.615286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:59.616050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:51:59.616504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:51:59.616962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:51:59.650626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lazy-loading 'flavor' on Instance uuid 08b657c2-6022-4936-9ada-ca14aeabc8ad {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:51:59.770839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:51:59.774988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'server_group_members'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:51:59.810642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9950ba5a-e6ca-4d8f-89a0-8268490befd9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.539445 Nov 02 11:51:59.814378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 257/540] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:51:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1541 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:51:59.818634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-664d296e-b8ef-4180-a7eb-32eae421985c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3db4430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.081807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77db0eea-6e9f-4dc0-b419-65022f3e7c08 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad/action" status: 202 len: 0 microversion: 2.1 time: 0.489839 Nov 02 11:52:00.085284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 284/541] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:51:59 2022] POST /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:00.105445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.106155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:00.125431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.126209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.126808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.130316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.131107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.131797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.269680 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-664d296e-b8ef-4180-a7eb-32eae421985c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d5591eeb-3593-46fa-b4a1-c2486a0f9b85" status: 202 len: 0 microversion: 2.1 time: 0.457189 Nov 02 11:52:00.270404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 258/542] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:51:59 2022] DELETE /compute/v2.1/os-security-groups/d5591eeb-3593-46fa-b4a1-c2486a0f9b85 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:00.278013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.278810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:00.286951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.287860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.288528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.289500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.291498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.298195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.397541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.407191 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8b950ab-12f2-4730-819e-dbecf3a78580 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1319 microversion: 2.1 time: 0.135410 Nov 02 11:52:00.408051 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 259/543] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:00.413573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.421228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.423236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Searching by: {'deleted': False, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:00.441219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.441962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.442399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.443186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.443641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.444059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.457256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.485594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.500541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:00.500911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.503921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2fd1933-a16b-469e-a94f-701b53ed85c8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.418226 Nov 02 11:52:00.507277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 285/544] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:00.516378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.519224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:00.529870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.530613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.531297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.532282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.532884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.533456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.563980 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aac23dec-7779-42f4-9284-0ada35329fa4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.154338 Nov 02 11:52:00.564814 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 260/545] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:00.571706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.572448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:00.579550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.580047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.580494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.581802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.582850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.583434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.876855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.895215 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02693def-4121-4504-84d4-a733e074d333 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.386435 Nov 02 11:52:00.899604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 286/546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:00.901754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe", "tag": "dd862d74-3b60-4aaa-b6c9-159fb5df7155"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:00.911676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:00.912522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:00.913161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:00.922584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:00.932516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] Creating event network-changed:dd862d74-3b60-4aaa-b6c9-159fb5df7155 for instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe on n-h1-855649-4 Nov 02 11:52:00.936543 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58e5846c-2223-4165-9870-e45e7c43dea8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1477 microversion: 2.1 time: 0.369851 Nov 02 11:52:00.937837 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 261/547] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:00.938162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4d3d5608-7680-4683-a0ae-88aea197ae71 req-eaa6d798-1de5-4f49-a008-d9a9cde41abb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038953 Nov 02 11:52:00.939200 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 287/548] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:00.944739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c49f4436-4987-413f-8baa-9ab7fed846f0 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.945261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5badfce-9256-4acb-9097-38879842acbd tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3db4310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:00.945589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c49f4436-4987-413f-8baa-9ab7fed846f0 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:01.038515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c49f4436-4987-413f-8baa-9ab7fed846f0 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:01.048879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c49f4436-4987-413f-8baa-9ab7fed846f0 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1218 microversion: 2.1 time: 0.108258 Nov 02 11:52:01.050708 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 288/549] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:00 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:01.056232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:01.058895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:01.067242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.067802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.071370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.071370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.071370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.071370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.403411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:01.430509 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dca1225-3fe2-40b1-95e6-57e1e68c548b tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1464 microversion: 2.1 time: 0.378341 Nov 02 11:52:01.433417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 289/550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:01 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:01.439045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:01.440267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:01.448533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.449218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.449663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.451257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.451908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.452543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.749100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:01.760094 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4470c65f-b334-4e49-befe-5e1f949e1773 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.325270 Nov 02 11:52:01.761968 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 290/551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:01 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:01.767526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:01.768973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:01.776722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.777671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.778320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.779195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:01.779746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:01.780266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:01.793064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5badfce-9256-4acb-9097-38879842acbd tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ebb32c21-74c0-439e-93fc-4daed84f429e" status: 202 len: 0 microversion: 2.1 time: 0.852712 Nov 02 11:52:01.795396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 262/552] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:52:00 2022] DELETE /compute/v2.1/os-security-groups/ebb32c21-74c0-439e-93fc-4daed84f429e => generated 0 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:01.802859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-401058713", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "625bd2f4-c703-4210-9c7e-51e3549762ae"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:01.877946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:02.289866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:02.302508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:02.304366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:02.306086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a79f2e2a-4d7e-431e-9f3c-ca0d28482f30 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.542438 Nov 02 11:52:02.307056 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 291/553] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:01 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:02.312968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc57f3d8-c825-4343-b851-a5577eae7beb tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3d785e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:02.518032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:02.518451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:02.519055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:02.519375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:02.519790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:02.537682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.538465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.539282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:02.540186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.540805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.541392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:02.569261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:02.579529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:02.588042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Getting quotas for user e305bf222f694954931ffb496f521eab and project ed0b3eaeb61546c18a68bf076583582f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:02.600218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:02.602751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:02.818740 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f85d305c-932f-4fa0-b105-e969f1e027b7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021911 Nov 02 11:52:02.820384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 263/554] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:52:02.828341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:02.829430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:02.843345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.844096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.844689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:02.845737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:02.846398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:02.847749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.504962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:03.523798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88e9c667-3ab2-4009-af45-51a070faae00 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.693105 Nov 02 11:52:03.537493 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 264/555] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:02 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:03.548143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:03.548812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:03.555724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc57f3d8-c825-4343-b851-a5577eae7beb tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ac246d47-21f4-4c08-a183-3f42fa9ad781" status: 202 len: 0 microversion: 2.1 time: 1.246794 Nov 02 11:52:03.564588 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 292/556] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:52:02 2022] DELETE /compute/v2.1/os-security-groups/ac246d47-21f4-4c08-a183-3f42fa9ad781 => generated 0 bytes in 1257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:03.569894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.570403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.570846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.571604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.572069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.572506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.572646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:03.573620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:03.580297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.581095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.581699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.582601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.583255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.583850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.738143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:03.763137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6357c5ce-eb59-451c-b113-26930f1e3d3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1214 microversion: 2.1 time: 0.194122 Nov 02 11:52:03.770074 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 293/557] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:03 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:03.780004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:03.781961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:03.798705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.799236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.803287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:03.803287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:03.803287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:03.804125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.037070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.061308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeea17f5-2032-4168-b919-e7401cfe90e1 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1460 microversion: 2.1 time: 0.522608 Nov 02 11:52:04.061947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 265/558] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:03 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1460 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:04.079530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c7f8d40-4e44-40a8-a702-de197d381232 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:04.091855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c7f8d40-4e44-40a8-a702-de197d381232 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:04.189344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c7f8d40-4e44-40a8-a702-de197d381232 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.203066 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c7f8d40-4e44-40a8-a702-de197d381232 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1213 microversion: 2.1 time: 0.139895 Nov 02 11:52:04.203544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 266/559] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:04 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:04.208604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:04.215217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:04.228741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.229809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.230249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.230962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.231567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.232140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.287276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.300722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d756ac49-152a-4bb9-a5e0-83f0073e9c09 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.535367 Nov 02 11:52:04.301641 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 294/560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:03 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:04.320330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee3d7dff-4a9d-4b10-8c0d-d246cc367369 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3a60820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:04.704405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.716083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.718019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:04.720115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf886427-0c22-42ec-8de9-68d329ea22d8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.515257 Nov 02 11:52:04.721333 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 267/561] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:04 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:04.726494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322766fc-fbbc-426a-96e1-625a6e32ba38", "tag": "215399ea-d67f-4238-8e58-f7e9e3818128"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:04.746971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.748221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.748765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.761701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] Creating event network-changed:215399ea-d67f-4238-8e58-f7e9e3818128 for instance 322766fc-fbbc-426a-96e1-625a6e32ba38 on n-h1-855649-4 Nov 02 11:52:04.768405 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6fa0a664-f5b5-4fef-ab7a-87c43df5c31c req-04534b77-5adc-4e8a-8690-a3ac73286adc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045570 Nov 02 11:52:04.770204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 268/562] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:04.776778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:04.777508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:04.785730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.786221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.786654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:04.787542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:04.787995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:04.788723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.235460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee3d7dff-4a9d-4b10-8c0d-d246cc367369 tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/5e5bb67b-5684-4340-8886-082155043883" status: 202 len: 0 microversion: 2.1 time: 0.929544 Nov 02 11:52:05.240552 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 295/563] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:52:04 2022] DELETE /compute/v2.1/os-security-groups/5e5bb67b-5684-4340-8886-082155043883 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:05.248231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:05.248864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:05.273550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.274070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.274549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.276980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.312805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.312805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.736763 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48c48b2d-554a-4ec9-aa80-a606ebc6e78c tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1611 microversion: 2.1 time: 0.961893 Nov 02 11:52:05.750149 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 269/564] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:04 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1611 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:05.765839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:05.766504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:05.787824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.788321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.788760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.789471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.790123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.790560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.846750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:05.861242 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce4101c0-7999-42bf-8c9b-98f56f916a3e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.619439 Nov 02 11:52:05.863405 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 296/565] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:05 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:05.877563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:05.882403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:05.895388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.897805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.898799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.900658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:05.901291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:05.902804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:05.964080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:05.980817 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b4d5972-2253-4521-9dbb-d447b01aff03 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1288 microversion: 2.1 time: 0.223258 Nov 02 11:52:05.981463 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 270/566] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:05 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1288 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:06.006859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d0a0112-4244-40f7-a794-8ae5ca309e8c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] Calling method '.version_select at 0x7ff1b3c96700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:06.049354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:06.061791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-833742fb-eb90-4baa-b21d-ff86d82186d3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1265 microversion: 2.1 time: 0.195807 Nov 02 11:52:06.064148 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 297/567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:05 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:06.070187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:06.072275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:06.080647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.085718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.085718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:06.085718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.085718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.086118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:06.110854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:06.867345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:06.879338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc9159f1-24d5-4a89-b66c-521f29ff6811 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.812303 Nov 02 11:52:06.880726 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 298/568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:06 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:06.888470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:06.890420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:06.899603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.900390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.901144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:06.904259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:06.904259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:06.904259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.528701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d0a0112-4244-40f7-a794-8ae5ca309e8c tempest-SecurityGroupRulesNegativeTestJSON-1460899868 tempest-SecurityGroupRulesNegativeTestJSON-1460899868-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/0dd8df7f-b4b2-4927-9737-8a65943361c0" status: 202 len: 0 microversion: 2.1 time: 1.530666 Nov 02 11:52:07.533549 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 271/569] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:52:05 2022] DELETE /compute/v2.1/os-security-groups/0dd8df7f-b4b2-4927-9737-8a65943361c0 => generated 0 bytes in 1548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:07.536438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:07.540425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.540998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.542400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.543430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.543742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.544548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.555136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:07.575853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:07.576068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec213572-fc9e-4e62-9ad3-6dbd7f84cb8e tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044748 Nov 02 11:52:07.577938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:07.582369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f28eba70-37e3-416f-a65b-73ff90be0413 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.700037 Nov 02 11:52:07.584421 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 299/570] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:06 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:07.585593 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 272/571] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:52:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:07.591528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:07.592424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:07.592611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:07.593634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:07.600036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.600764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.601414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.602301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.602668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.603173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.603284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.603776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.604743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:07.606068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:07.607636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:07.608089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.168107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:08.187642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00bf4537-93c0-4b9b-9fbc-b8ad9d88a824 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.600167 Nov 02 11:52:08.190225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 273/572] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:07 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:08.199825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:08.201253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:08.215099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.220496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.221393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.223961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.225499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.227195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.483682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:08.509458 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-045e98e8-dcea-4250-a79b-081a23792a8a tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.921843 Nov 02 11:52:08.510570 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 300/573] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:07 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:08.527401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-855649-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:08.535559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:08.548900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.549705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.552111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.553041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.553672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.556208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.597302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:08.597524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:08.608879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6f2502b-ff8e-428a-9935-9166b25d0229 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1271 microversion: 2.1 time: 0.415513 Nov 02 11:52:08.609426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Lazy-loading 'flavor' on Instance uuid 08b657c2-6022-4936-9ada-ca14aeabc8ad {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:08.610185 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 274/574] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:08 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:08.615030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:08.615864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:08.622227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.622960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.623600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.624453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.625059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.625637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.635476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 08b657c2-6022-4936-9ada-ca14aeabc8ad while it is in vm_state suspended Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Request method failure captured: Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad/action HTTP/1.1 Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 97 Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlme-jjcXCBGBJ10SP_llDa9nijrRmkbHbRGFpPT7WvFDW6CH6a-dCQ5A59gAd1vCxsgYn8LmS20lUfTNVmIwvmjP3MwZGKCuuVUKQx0t-5Sx-XWdYjVnWPa1XfIameU_THna9YQ6ZLn4XaQn43v4uRLnIQ0jtXyUU9eMJHhUfl9urw Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: df59171785ea4d9f8df31aa7a460b6ef Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:52:08.638153 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_df59171785ea4d9f8df31aa7a460b6ef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/df59171785ea4d9f8df31aa7a460b6ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: df59171785ea4d9f8df31aa7a460b6ef Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1768597809 Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationNegativeTest-1768597809-project-admin Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a988ed4cef704012ab3575d02d03960a Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationNegativeTest-1768597809-project-admin Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: {"os-migrateLive": {"host": "n-h1-855649-4", "block_migration": true, "disk_over_commit": false}} Nov 02 11:52:08.639673 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'os-migrateLive' instance 08b657c2-6022-4936-9ada-ca14aeabc8ad while it is in vm_state suspended Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '08b657c2-6022-4936-9ada-ca14aeabc8ad', 'body': {'os-migrateLive': {'host': 'n-h1-855649-4', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 11:52:08.640504 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:08.642234 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 08b657c2-6022-4936-9ada-ca14aeabc8ad while it is in vm_state suspended Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 08b657c2-6022-4936-9ada-ca14aeabc8ad while it is in vm_state suspended Nov 02 11:52:08.652313 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:08.653258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 08b657c2-6022-4936-9ada-ca14aeabc8ad while it is in vm_state suspended {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:08.653258 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3beb1905-50b0-45c0-bc04-4a6a94e01887 tempest-LiveMigrationNegativeTest-1768597809 tempest-LiveMigrationNegativeTest-1768597809-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad/action" status: 409 len: 155 microversion: 2.1 time: 0.125255 Nov 02 11:52:08.653258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 301/575] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:08 2022] POST /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad/action => generated 155 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:52:08.653258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc717d3-9a5e-49f9-a01a-0cf651aa0170", "tag": "62877c90-8086-436b-9673-3a6df76d7a30"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:08.668694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:08.670842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.671395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.672229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.694000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] Creating event network-changed:62877c90-8086-436b-9673-3a6df76d7a30 for instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 on n-h1-855649-4 Nov 02 11:52:08.704327 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-11afdcd2-c5cd-4252-8557-14b6480933d8 req-f53dd2ee-ac85-40c9-a9c8-d9e0da5abfe7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061463 Nov 02 11:52:08.706796 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 302/576] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:08.716734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:08.717732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:08.726987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.727515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.728120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:08.729050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:08.729518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:08.730614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.191318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.228607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.233490 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7138cfd6-0a70-481d-ab60-8941113608c2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.608710 Nov 02 11:52:09.234502 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 275/577] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:08 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:09.241010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.255182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.256435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e26f06c-1e61-43b5-80fa-5c8415474df6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.547997 Nov 02 11:52:09.257002 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 303/578] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:08 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:09.258158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:09.260167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:09.268202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe", "name": "network-vif-plugged", "status": "completed", "tag": "dd862d74-3b60-4aaa-b6c9-159fb5df7155"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:09.272169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.272991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.274528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.279172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.279172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.279172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.309561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.310141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.313874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.324788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:09.339111 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] Creating event network-vif-plugged:dd862d74-3b60-4aaa-b6c9-159fb5df7155 for instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe on n-h1-855649-4 Nov 02 11:52:09.348164 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b91dfd40-d77c-47a4-80d4-ca166dabaa6e req-5517ee3b-92b6-4af1-b1ea-0c2a3f973787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089842 Nov 02 11:52:09.349365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 304/579] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:09.355630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:09.356635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:09.363408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.364349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.365068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.366231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.366881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.367515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.550218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:09.761446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:09.779482 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62bc66a2-ee92-4c8d-86f8-fa06dcac7e30 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.428196 Nov 02 11:52:09.791044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 305/580] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:09 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:09.797694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:09.799680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:09.807080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.808059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.808566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.809508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.809981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.810415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.827460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d48fda97-61b6-4c41-a92e-e1261fee9cf9 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "DELETE /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 204 len: 0 microversion: 2.1 time: 0.585960 Nov 02 11:52:09.833933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 276/581] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:09 2022] DELETE /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:09.843906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:09.846119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:09.853198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.854359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.855717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:09.856759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:09.860196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:09.860196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.191010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:10.202945 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a81d532d-3ac7-4f8b-965b-cbb5b5580e37 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.414360 Nov 02 11:52:10.208283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 306/582] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:09 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:10.233457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:10.235238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:10.243633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.250582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.251698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.252787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.253474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.254091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.402270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:10.422379 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07ebc3a6-6a26-4f8a-b8d8-4d93372c93f6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.585953 Nov 02 11:52:10.439726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 277/583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:09 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:10.445903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:10.451836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:10.453615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.454288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.454885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.455783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.456391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.457112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.917352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:10.935886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b8c6214-ea76-4b8b-bf80-d3068d4ce506 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1466 microversion: 2.1 time: 0.710402 Nov 02 11:52:10.936806 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 307/584] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:10 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1466 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:10.941997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:10.942823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:10.949994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.950794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.951486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:10.952385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:10.953005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:10.953595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.009054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:11.023544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-722ed46a-32a5-4e79-afc4-dcd91d0a252a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.579422 Nov 02 11:52:11.024514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 278/585] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:10 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:11.030926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8c071ad-704c-4f72-924c-ad51dcce93ea", "tag": "b5eafcf5-2cf8-4479-9419-8df955fec7cc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:11.042855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.043724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.044155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.047706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:11.063396 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] Creating event network-changed:b5eafcf5-2cf8-4479-9419-8df955fec7cc for instance f8c071ad-704c-4f72-924c-ad51dcce93ea on n-h2-855649-4 Nov 02 11:52:11.070563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f018b121-8df5-4bcf-9acc-e840d98ff2da req-847e7903-c046-4a73-bf34-24a5fa8e0932 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044183 Nov 02 11:52:11.072219 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 279/586] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:11.082819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:11.083588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:11.095968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.096697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.097344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.098072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.098536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.098968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.299379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:11.309581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:11.311106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:11.312709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53556838-c235-452a-aaef-c9e1bad7104c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.374442 Nov 02 11:52:11.313501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 308/587] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:10 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:11.318585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:11.321471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:11.335937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.336159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.339212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.344783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.347808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.348304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.368876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:11.378942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4e508c1-2b06-4471-a0de-6c29dcdb339d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.300368 Nov 02 11:52:11.379976 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 280/588] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:11 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:11.424860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322766fc-fbbc-426a-96e1-625a6e32ba38", "name": "network-vif-plugged", "status": "completed", "tag": "215399ea-d67f-4238-8e58-f7e9e3818128"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:11.436314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.437087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.437702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.451630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] Creating event network-vif-plugged:215399ea-d67f-4238-8e58-f7e9e3818128 for instance 322766fc-fbbc-426a-96e1-625a6e32ba38 on n-h1-855649-4 Nov 02 11:52:11.457674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-846e22a5-0ee4-4c6d-b2a2-8e42a9b0fe6e req-991f9567-8d86-4530-b4c2-5f59e19aadd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Nov 02 11:52:11.462920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 281/589] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:11.470721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:11.471891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:11.480257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.481933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.482395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:11.483184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:11.483655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:11.484180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.022593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:12.034663 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-511e5b8c-83d4-46cc-bbdf-c9be2683a7cb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.570071 Nov 02 11:52:12.040130 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 282/590] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:11 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:12.052656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:12.053607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:12.066811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.073486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.074054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.075105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.075696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.076287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.203635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:12.216870 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e473a1c-0774-4f71-900d-1d4dcf07515f tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1320 microversion: 2.1 time: 0.902118 Nov 02 11:52:12.222625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 309/591] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:11 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1320 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:12.226597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:12.227251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:12.236146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.236907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.237530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.238280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.238899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.239400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.766916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:12.780675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e028807-7de2-47f3-a827-87ffbf21ff26 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1466 microversion: 2.1 time: 0.739573 Nov 02 11:52:12.782802 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 283/592] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:12 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1466 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:12.796376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:12.800415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:12.808879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.822063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.822063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.822063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.822063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.823192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.850557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:12.859963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3be812ad-2f44-4cd9-b6ee-690172bfa386 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1387 microversion: 2.1 time: 0.637696 Nov 02 11:52:12.881288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 310/593] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:12 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1387 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:12.892992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:12.893627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:12.911912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.913024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.913746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:12.914924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:12.915680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:12.916348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.445140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:13.446388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:13.482419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:13.483256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9b29ab0-173e-4d55-a542-579d31ce276a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.600732 Nov 02 11:52:13.485945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 311/594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:12 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:13.494839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:13.501874 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac7341f0-86a9-4921-abe7-a063e7cc3422 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.712068 Nov 02 11:52:13.501874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 284/595] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:12 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:13.525651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:13.530679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:13.538353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:13.544581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:13.553382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.554440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.556273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.559702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.561442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.562653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.563608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.567527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.567761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:13.569143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:13.569801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:13.570390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.193527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=38 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:14.362932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:14.367897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:14.383337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-495d7864-773c-4441-bef5-3494197260d0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1470 microversion: 2.1 time: 0.885423 Nov 02 11:52:14.385030 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16d593b4-09e0-48ce-bc0b-99375248d718 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.893895 Nov 02 11:52:14.386508 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 312/596] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:13 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:14.389180 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 285/597] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:13 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1470 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:14.393705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:14.394555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:14.396823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:14.405380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:14.416369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.419046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.419836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.421227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.421930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.422521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.424524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.440541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.441404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.442401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.443144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.444406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.786411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:14.791290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:14.799677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9516b80-8516-4e23-b12c-00faba7eaa71 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1466 microversion: 2.1 time: 0.411284 Nov 02 11:52:14.800194 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a051c31-2c1c-440e-9d0e-75fb3590e1c0 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1587 microversion: 2.1 time: 0.409420 Nov 02 11:52:14.815042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 313/598] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:14 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:14.816126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 286/599] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:14 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1587 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:14.824037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:14.824037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:14.829265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:14.829265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:14.834023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.834447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.834587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.835249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.835429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.835973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.836534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.836817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.836943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:14.838026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:14.839272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:14.840772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.111338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:15.125158 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df85dbb4-2c2f-4c7d-94c3-c3e6604505e6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.307101 Nov 02 11:52:15.127095 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 287/600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:14 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:15.132449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:15.133380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:15.140235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.141274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.141920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.142788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.143290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.143773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.307560 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6cd41e9-bf0a-4cb9-b471-2c31772eddd9 tempest-DeleteServersAdminTestJSON-2060473865 tempest-DeleteServersAdminTestJSON-2060473865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.502400 Nov 02 11:52:15.309329 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 314/601] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:14 2022] POST /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:15.315887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:15.317326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:15.324466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.327446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.328328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.329369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.330082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.334033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.521463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:15.538499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:15.553656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:15.555076 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5b372ee-a98e-4aa7-9609-ea73302fc272 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1568 microversion: 2.25 time: 0.426639 Nov 02 11:52:15.574058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 288/602] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:15 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1568 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:15.579145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c81f15-7201-49b2-9081-a5ef032bc7cd", "tag": "d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:15.605837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.606316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.606738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.634038 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] Creating event network-changed:d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba for instance e4c81f15-7201-49b2-9081-a5ef032bc7cd on n-h2-855649-4 Nov 02 11:52:15.652884 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bd77492f-a7bf-4059-8eb9-fbad4633e3f7 req-e7a3c619-a9c4-42f1-b1d5-bbb52326fbe9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077353 Nov 02 11:52:15.653488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 289/603] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:15.659611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:15.660544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:15.678836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.679761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.680405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.682852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.684243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.684682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.714964 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b617d61-62e2-4820-ad34-3ce33e4caf03 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.403836 Nov 02 11:52:15.725115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 315/604] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:52:15 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38/os-interface => generated 285 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:15.730357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:15.731282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:15.741909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.746998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.747165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.747165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.751333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.752208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:15.752826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:15.754223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.759708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:15.760725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lazy-loading 'fault' on Instance uuid 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:17.452166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:17.466661 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa01a071-2f43-480e-a3e6-44b60e760b69 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1453 microversion: 2.1 time: 1.811631 Nov 02 11:52:17.474293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 290/605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:15 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1453 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:17.486395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:17.487624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:17.500518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:17.502634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:17.502634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:17.502634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:17.507251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:17.508189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:17.559917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:17.663799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:17.680509 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5019d650-46b4-48bf-8921-62fb726710a0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 1.951423 Nov 02 11:52:17.684928 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 316/606] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:15 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:17.713315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:17.720473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:17.733254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:17.736109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:17.736109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:17.736109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:17.736988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:17.738445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.615975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:18.627562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af8dc21d-f677-4a14-bdee-c0a217455eee tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1466 microversion: 2.1 time: 1.151195 Nov 02 11:52:18.633739 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 291/607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:17 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1466 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:18.642186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc717d3-9a5e-49f9-a01a-0cf651aa0170", "name": "network-vif-plugged", "status": "completed", "tag": "62877c90-8086-436b-9673-3a6df76d7a30"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:18.672597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.675860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.676711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.701795 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] Creating event network-vif-plugged:62877c90-8086-436b-9673-3a6df76d7a30 for instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 on n-h1-855649-4 Nov 02 11:52:18.707091 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-88ad0fac-37aa-47c4-b9d7-aa3f9ea3e224 req-189c7fda-a7b8-42a0-b2cf-08963636d8d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071716 Nov 02 11:52:18.709050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 292/608] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:18.718410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:18.727127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:18.751564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.753026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.755191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.765217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.766000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.766687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.859943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:18.877035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60d921ad-b9ac-4bc0-9d38-b29e7c6332e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 1.177403 Nov 02 11:52:18.878011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 317/609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:17 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:18.898906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:18.901388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:18.914851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.915505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.916033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.917776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:18.918416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:18.919226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:18.936869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:18.957846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:19.373461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-debc2a04-ce22-45dd-b6be-baf88aaa7f44 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 204 len: 0 microversion: 2.1 time: 0.491387 Nov 02 11:52:19.374412 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 318/610] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:18 2022] DELETE /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:19.383173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:19.384425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:19.395211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.396445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.397075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.398650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.399139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.399752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.941223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:19.951852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:19.953742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:19.955323 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e02a766d-bd6c-403d-8f8c-bc60006c5b81 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1558 microversion: 2.25 time: 1.244785 Nov 02 11:52:19.956126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 293/611] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:18 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1558 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:19.961710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:19.962668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:19.969747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.970673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.971631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:19.972553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:19.973425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:19.974159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.011545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.012369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.013032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.013688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lazy-loading 'fault' on Instance uuid 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:20.139444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:20.147882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5eb96863-1782-4828-850f-a9784799b6bd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.771848 Nov 02 11:52:20.148587 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 319/612] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:19 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:20.170494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.171155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:20.179809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.180316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.180750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.181469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.182502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.183173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.295829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:20.307980 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04c4dfd5-5e1a-476c-999e-db38cec9fe38 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1424 microversion: 2.1 time: 0.145848 Nov 02 11:52:20.312066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 320/613] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:20.313678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b657c2-6022-4936-9ada-ca14aeabc8ad", "name": "network-vif-deleted", "tag": "07b1b0b9-dd3e-4878-9b9d-b52f1e90634e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:20.325741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.326225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.326854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.340371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] Creating event network-vif-deleted:07b1b0b9-dd3e-4878-9b9d-b52f1e90634e for instance 08b657c2-6022-4936-9ada-ca14aeabc8ad on n-h2-855649-4 Nov 02 11:52:20.346289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9ca365ae-a24a-4b8d-97c0-4bb541c87438 req-b3c24fbf-9891-4001-bee9-6242eeede596 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036380 Nov 02 11:52:20.347139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 321/614] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:20.352622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.353324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:20.362020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.362755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.363221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.363946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.365376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.365997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.394993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:20.417213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b552c369-1921-48ba-a33d-ec276e49e65b tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1459 microversion: 2.1 time: 0.459144 Nov 02 11:52:20.418045 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 294/615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:19 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1459 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:20.423596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41332d00-654b-4298-8d55-5122eaae4c83 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '.version_select at 0x7ff1b3c2a430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.427387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41332d00-654b-4298-8d55-5122eaae4c83 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.428140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41332d00-654b-4298-8d55-5122eaae4c83 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.434064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41332d00-654b-4298-8d55-5122eaae4c83 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.446823 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41332d00-654b-4298-8d55-5122eaae4c83 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.027332 Nov 02 11:52:20.448040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 295/616] 10.222.0.48 () {60 vars in 1184 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:20.462689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.463464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:20.470023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.470644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.471214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.472004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.472552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.473088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.477444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:20.705719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:20.719535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70689312-c843-4a96-bff4-ba4f3eacf2e7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.370843 Nov 02 11:52:20.720686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 322/617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:20.755179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08b657c2-6022-4936-9ada-ca14aeabc8ad", "name": "network-vif-unplugged", "status": "completed", "tag": "07b1b0b9-dd3e-4878-9b9d-b52f1e90634e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:20.776700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.777170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.778830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.795307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 408f05d1-a900-4540-9036-a4133f010764 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:20.799543 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] Creating event network-vif-unplugged:07b1b0b9-dd3e-4878-9b9d-b52f1e90634e for instance 08b657c2-6022-4936-9ada-ca14aeabc8ad on n-h2-855649-4 Nov 02 11:52:20.814551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-dd8defe5-2b89-40dd-b295-81a4c2a4a14f req-78230324-7a09-4c20-83cc-e48ef26c88c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081317 Nov 02 11:52:20.818581 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 323/618] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:20.828716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e1fdb9b-1aba-48cc-8476-8a2b53a2beac tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 2051 microversion: 2.25 time: 0.369932 Nov 02 11:52:20.829642 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 296/619] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 2051 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:20.831368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:20.834214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:20.844879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.847295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.847295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.847295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:20.848103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:20.848761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:20.998656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-318136479", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "1e42d025-6f92-4be4-aebf-e40b0c181c05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:21.066842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] validate_networks() for [('1e42d025-6f92-4be4-aebf-e40b0c181c05', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:21.222529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.233261 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-671a3582-2946-42d2-9cc4-027f0afc54c9 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 200 len: 1587 microversion: 2.1 time: 0.410665 Nov 02 11:52:21.236058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 324/620] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:20 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 1587 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:21.249882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.251159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:21.265975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.268930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.270596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.271486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:21.271966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:21.272399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:21.967743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:21.979630 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4ed4368-b4a7-4291-9cd5-198f64d8a9b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.738534 Nov 02 11:52:21.981404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 325/621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:21 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:21.989940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:21.993108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:22.005821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.006434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.007045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.007837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.008405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.008888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.175629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:22.187902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc19e81e-db79-4005-a542-25a4a8c20c9e tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1424 microversion: 2.1 time: 0.205183 Nov 02 11:52:22.188824 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 326/622] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:21 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1424 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:22.194352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:22.195443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:22.205233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.205980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.206583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.210530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.210530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.210530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.253116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.254500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.255395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.257340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lazy-loading 'fault' on Instance uuid 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:22.639295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:22.639824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:22.642785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:22.642785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:22.642785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:22.653215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.654137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.655127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.656120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.656988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.657663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.658732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:22.679300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e62af22-ee22-480a-8c78-c8b210ee0a72 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1459 microversion: 2.1 time: 0.487678 Nov 02 11:52:22.681216 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 327/623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:22 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1459 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:22.693802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:22.694703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:22.709907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:22.714069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.715152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.715590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.716315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:22.716770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:22.717886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for user 7827c83ee4674362bab55ca9c40d16fb and project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:22.719516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:22.735402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:22.739133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:22.762055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:22.956410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:22.963897 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c337e7cc-d701-4c08-bf82-f9a502b66d62 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.969711 Nov 02 11:52:22.969627 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91d2dea7-ba3c-4547-bab7-7537d8aeb019 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.286163 Nov 02 11:52:22.971652 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 328/624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:22 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:22.974071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 297/625] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 11:52:23.003438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c071ad-704c-4f72-924c-ad51dcce93ea", "name": "network-vif-plugged", "status": "completed", "tag": "b5eafcf5-2cf8-4479-9419-8df955fec7cc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:23.004551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "322766fc-fbbc-426a-96e1-625a6e32ba38", "tag": "215399ea-d67f-4238-8e58-f7e9e3818128"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:23.046639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.047250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.047671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.052101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.052101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.052101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.090995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] Creating event network-changed:215399ea-d67f-4238-8e58-f7e9e3818128 for instance 322766fc-fbbc-426a-96e1-625a6e32ba38 on n-h1-855649-4 Nov 02 11:52:23.101416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] Creating event network-vif-plugged:b5eafcf5-2cf8-4479-9419-8df955fec7cc for instance f8c071ad-704c-4f72-924c-ad51dcce93ea on n-h2-855649-4 Nov 02 11:52:23.106634 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f3533b7b-9efd-4d74-826f-c9fc9637e50c req-5353d06c-08aa-476f-a1de-9a4635b57d47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132447 Nov 02 11:52:23.115891 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 329/626] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:23.126958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c171fd5c-bc8f-4d79-a430-89d4c9e94af7 req-c8945d6e-0032-4423-aa60-9b0d7c0bac69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146587 Nov 02 11:52:23.130475 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 298/627] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:23.143390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:23.145928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:23.148279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:23.149015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:23.172542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.178039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.180297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.183433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.186253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.187253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.295262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:23.309629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:23.309629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:23.320255 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a375b4aa-a00a-4605-8a9b-1f5f553c740f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1261 microversion: 2.25 time: 0.195016 Nov 02 11:52:23.333400 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 330/628] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:23 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:23.346495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:23.347209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:23.361770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.362266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.362711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.363460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.373833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.373833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.605096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:23.622419 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96600c95-f112-41fc-ab5e-82c6ee3b84e6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1424 microversion: 2.1 time: 0.280656 Nov 02 11:52:23.623785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 331/629] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:23 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1424 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:23.706702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:23.707361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:23.713826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.714851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.721139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.721139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.721139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.721139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.814703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:23.815635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:23.816308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:23.816968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lazy-loading 'fault' on Instance uuid 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:24.030254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3269cc02f13947cca91c49350fa8fcfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1ad7e075184db8a76c09803e8c9be9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.047776 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d16229d4-5433-4264-b98d-f6c6e7e23c6e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 200 len: 1310 microversion: 2.1 time: 0.341484 Nov 02 11:52:24.048531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 332/630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:23 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 1310 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:24.059910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.061116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.081098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.083275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.084476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.097594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.098059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.098512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.195886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.207732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-258b5abe-62e7-41b8-ba83-d51e395d7601 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 1.075779 Nov 02 11:52:24.211663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 299/631] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:23 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:24.348079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.349077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.725041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.740324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.758707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.765032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cedfc327-6bb8-4cb9-b8e7-e8aaee9e4ad9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1261 microversion: 2.25 time: 0.417792 Nov 02 11:52:24.767530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 300/632] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:24 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1261 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:24.778637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:24.781247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:24.803145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.806284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.806284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.806284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.806284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.810577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.884048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:24.891116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:24.891661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:24.892100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:24.895457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afe5b785-3abb-4222-b3e0-bb552bbc30ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1318 microversion: 2.1 time: 0.845427 Nov 02 11:52:24.897214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lazy-loading 'fault' on Instance uuid 08b657c2-6022-4936-9ada-ca14aeabc8ad {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:24.900552 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 333/633] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:24 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1318 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:24.998470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:25.007704 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0d409a4-dddc-42f5-a284-c889e0bf1f18 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 200 len: 1309 microversion: 2.1 time: 0.238943 Nov 02 11:52:25.011586 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 301/634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:24 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 1309 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:25.074477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.075246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.096811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.097417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.098333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.099516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.100364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.101069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.116185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe HTTP/1.1 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:52:25.118170 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.120709 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe'} Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:25.121900 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.124139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.132106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe", "name": "network-vif-deleted", "tag": "dd862d74-3b60-4aaa-b6c9-159fb5df7155"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:25.138177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:25.139582 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f14290b-5df4-40e9-9992-abb88249f4f8 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 404 len: 111 microversion: 2.1 time: 0.070993 Nov 02 11:52:25.142300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 334/635] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:25 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:25.155789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.156895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.157484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.158020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.158598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.170244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.175579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.176170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.177014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.177750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.179378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.184729 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] Creating event network-vif-deleted:dd862d74-3b60-4aaa-b6c9-159fb5df7155 for instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe on n-h1-855649-4 Nov 02 11:52:25.200523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-02e7dc4e-3e03-45d7-b6df-c1ff45f63cf7 req-86681136-d62a-4950-8f82-e13919e34f9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066701 Nov 02 11:52:25.202435 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 302/636] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:25.207856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe HTTP/1.1 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:52:25.209821 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.211150 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe'} Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:25.212097 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.213346 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.219497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:25.220611 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e79408b-ad08-4f99-b51a-49aec6da59b0 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 404 len: 111 microversion: 2.1 time: 0.071323 Nov 02 11:52:25.224785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 335/637] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:25 2022] DELETE /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:25.233609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.234394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.246846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.248542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.249351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.250634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.251422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.252213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.252737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.253172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.266593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.276766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.278650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.284071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.285073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.285701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.290602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe HTTP/1.1 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:25.293260 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.294778 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe'} Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:25.295633 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. Nov 02 11:52:25.297332 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.302033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:25.309873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-010ba71b-9f81-48a6-a11f-c88691d24ec3 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe" status: 404 len: 111 microversion: 2.1 time: 0.080794 Nov 02 11:52:25.311133 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 303/638] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:25 2022] GET /compute/v2.1/servers/0eb8bfe0-9ed2-4f3e-8aa6-07043139d3fe => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:25.326538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.327461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.344195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.347382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.348187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.349475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.353242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.354470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.411865 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f HTTP/1.1 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:25.414371 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.416470 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '3688f7ee-995c-4670-9095-f9329a3c5f4f'} Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:25.417271 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.418589 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.421986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:25.423096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3569355-9456-4deb-9e0e-be438c0e793e tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 404 len: 111 microversion: 2.1 time: 0.106217 Nov 02 11:52:25.427112 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 304/639] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:25 2022] DELETE /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:25.436155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.441502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] [instance: 3688f7ee-995c-4670-9095-f9329a3c5f4f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.444564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.445268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.446535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.447554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.448190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.448782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.465483 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] HTTP exception thrown: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Request method failure captured: Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f HTTP/1.1 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlm23Jv1VvD3HN8zz3yMDQzTnH_2gATjQN_j5qSOySxghpD83Fd4BE7wUjpQijgJOHOebw36HFhUviAIn2YVMNpfphtXlMcu-awXTTD3Lk3-UefMHJXsxYbc-vCLOTSBj9X2OxcmuB0zAZcAm_6MhVGDWcGFaEWioHCQhkgc4v5MffY Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:25.467425 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c1ad7e075184db8a76c09803e8c9be9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c1ad7e075184db8a76c09803e8c9be9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2c1ad7e075184db8a76c09803e8c9be9 Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-974536759 Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 3269cc02f13947cca91c49350fa8fcfe Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersAdminTestJSON-974536759-project Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.469039 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '3688f7ee-995c-4670-9095-f9329a3c5f4f'} Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:25.469937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. Nov 02 11:52:25.471481 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:25.473545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] Returning 404 to user: Instance 3688f7ee-995c-4670-9095-f9329a3c5f4f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:25.474577 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b7b6368-2e09-44e0-b271-74a916a403e7 tempest-DeleteServersAdminTestJSON-974536759 tempest-DeleteServersAdminTestJSON-974536759-project] 10.222.0.48 "GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f" status: 404 len: 111 microversion: 2.1 time: 0.045518 Nov 02 11:52:25.486677 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 305/640] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:25 2022] GET /compute/v2.1/servers/3688f7ee-995c-4670-9095-f9329a3c5f4f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:25.800771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:25.804213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:25.832171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.833108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.834275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:25.835095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:25.837001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:25.837840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.311664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:26.326122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:26.327617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:26.335402 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-552d83c2-87c8-4083-80cf-beff4ff230b5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1313 microversion: 2.25 time: 0.542189 Nov 02 11:52:26.344034 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 306/641] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:25 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:26.358682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:26.362016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:26.371304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.374698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.376829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.377931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.383543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.385157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.720131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:26.761051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d016c57-389e-42a9-b6a3-c2af7c337918 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 1.520560 Nov 02 11:52:26.762617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 336/642] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:25 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:26.769082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:26.770069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 08b657c2-6022-4936-9ada-ca14aeabc8ad] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:26.777392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.779053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.780749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.781817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.783183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.783879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.792604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:26.810766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] HTTP exception thrown: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Request method failure captured: Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad HTTP/1.1 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmd0X_xssakSwC7dBqJDTUN4BuEGISSiFzUijRntTcR2ODZweu82X4iuEkzqRZNixGkjLx8ps3XWv8Bmc2yxtwQcsNHJpuwTvtK1TT7dFLCl9_ALUN802wJhUwLnb0xs3KtAihPv09-LeO20gT7v-P7sTbQs2kD0WURxRRRc0DGg7w Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 714025ac7d854ab58a3b4e464b9aee75 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:52:26.826972 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_714025ac7d854ab58a3b4e464b9aee75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 714025ac7d854ab58a3b4e464b9aee75 Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationNegativeTest-1269578205-project Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e0a0f072abfd447c9fc6fe2628a23da7 Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationNegativeTest-1269578205-project Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. Nov 02 11:52:26.829730 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '08b657c2-6022-4936-9ada-ca14aeabc8ad'} Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:26.830667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. Nov 02 11:52:26.831861 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:26.832868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Returning 404 to user: Instance 08b657c2-6022-4936-9ada-ca14aeabc8ad could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:26.835329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8a74ec1-fd6b-44cd-b4f9-d21a0a95f3c7 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad" status: 404 len: 111 microversion: 2.1 time: 0.065209 Nov 02 11:52:26.836723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 337/643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:26 2022] GET /compute/v2.1/servers/08b657c2-6022-4936-9ada-ca14aeabc8ad => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:26.845743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:26.846640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:26.856323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.861645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.861645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.861645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:26.861645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:26.862042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:26.924916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:27.038426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.053514 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d702434f-28b3-4ccf-9ead-60ba47e5b4a8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1468 microversion: 2.1 time: 0.707932 Nov 02 11:52:27.055890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 307/644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:26 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1468 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:27.082304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:27.083301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:27.096822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.098904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.099634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.101781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.103862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.106936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.345315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9482c6aa-47fb-4170-bc42-257142d53f02 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "DELETE /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 204 len: 0 microversion: 2.1 time: 0.504320 Nov 02 11:52:27.346025 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 338/645] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:26 2022] DELETE /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:52:27.356705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:27.357890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:27.370439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.383266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.383788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.385024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.385599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.386142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.711982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.724654 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f13892e7-dd92-440e-a1fd-2c3f5e48a024 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1467 microversion: 2.1 time: 0.646057 Nov 02 11:52:27.727452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 308/646] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:27 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1467 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:27.734917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:27.740209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:27.747512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.748234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.748768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.749576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.750129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.750711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.814137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.822142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b96ae8b-1aa6-4589-8ae0-19e4b209deeb tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1475 microversion: 2.1 time: 0.471490 Nov 02 11:52:27.835499 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 339/647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:27 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:27.844124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:27.849768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.850874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Searching by: {'reservation_id': 'r-2y7kkoo3', 'deleted': False, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:27.857572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.858239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.858829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.859752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.860387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.860966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.897025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.906051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.907929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:27.909339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48751c7c-ce5f-42d1-bd07-6d5b77af77d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1319 microversion: 2.25 time: 0.180682 Nov 02 11:52:27.910433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 309/648] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:27 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:27.915193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:27.924340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:27.924340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.924340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.924340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.925542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:27.926216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:27.926839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:27.968940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:28.051829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:28.059823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.060477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.061027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:28.456698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:28.471233 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8350fff1-ec2e-4bf7-a445-7ef1ee7088ec tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.556412 Nov 02 11:52:28.471233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 310/649] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:27 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:28.487349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79d41f79-9cec-4658-b0d2-c754c4511e5b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-2y7kkoo3" status: 200 len: 2928 microversion: 2.1 time: 0.647712 Nov 02 11:52:28.488486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 340/650] 10.222.0.48 () {58 vars in 1197 bytes} [Wed Nov 2 11:52:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-2y7kkoo3 => generated 2928 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:28.516132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:28.552571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Querying cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) for 2 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 11:52:28.555866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.557345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.558917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:28.628437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db44b1c9-1989-42b2-b2cc-2e6b72340823 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/f9ed0205-d90d-4b2e-bddb-cafa38aa4506" status: 200 len: 271 microversion: 2.1 time: 0.116384 Nov 02 11:52:28.634489 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 311/651] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:52:28 2022] GET /compute/v2.1/os-server-groups/f9ed0205-d90d-4b2e-bddb-cafa38aa4506 => generated 271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:28.648607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:28.649395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:28.670622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.673729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.674499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:28.676342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.678475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.679055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:28.851062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:28.852319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:28.867923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.868638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.869165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:28.870232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:28.870703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:28.871217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.423923 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f912ff7-7efe-4575-af05-b325cc128db8 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1618 microversion: 2.1 time: 0.779656 Nov 02 11:52:29.428281 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 341/652] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:28 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1618 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:29.435610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:29.436453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:29.438762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:29.453930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.453930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.453930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.453930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.454332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.454332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.605718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:29.618065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-138624d9-a7f4-4a15-83e7-67e59b740a85 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1475 microversion: 2.1 time: 0.772052 Nov 02 11:52:29.619583 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 312/653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:28 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:29.624385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:29.625189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:29.632016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.632674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.633256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.634347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.635645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.636259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.899715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:29.922202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:29.927075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:29.929694 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73fc3061-6f44-40fe-997d-9072845da9f7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.499742 Nov 02 11:52:29.931337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 342/654] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:29 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:29.937123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:29.938482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:29.945495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.946301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.948893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:29.950191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:29.950813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:29.951744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:30.354695 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01625bdb-ac04-4574-8845-1bc0a9dc70f4 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1619 microversion: 2.1 time: 0.732831 Nov 02 11:52:30.382757 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 313/655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:29 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1619 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:30.405183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18db3627-ff2f-4019-99bb-df0825aa445c", "tag": "b5f6e97f-b902-4010-84d3-8c4f71e844d8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:30.452321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:30.453069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:30.456348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:30.499928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] Creating event network-changed:b5f6e97f-b902-4010-84d3-8c4f71e844d8 for instance 18db3627-ff2f-4019-99bb-df0825aa445c on n-h1-855649-4 Nov 02 11:52:30.530312 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-60ddb509-a269-4097-82c5-a8142f696476 req-b8db6135-b88a-4bca-a434-42e190465df4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146066 Nov 02 11:52:30.530938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 314/656] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:30.618154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-33772919", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "79f01c5e-3ef8-4f56-affe-03b6962a8975"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:30.622439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:30.634266 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d6d8fe7-63bc-45b1-8657-006a4b07c116 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.697643 Nov 02 11:52:30.637749 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 343/657] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:29 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:30.654076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:30.655108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:30.669123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:30.670361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:30.671196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:30.674548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:30.675339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:30.676020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:30.761743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:31.338911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:31.348586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8637bab2-9cfa-497c-b800-5ea73378f009 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1433 microversion: 2.1 time: 0.709561 Nov 02 11:52:31.349170 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 344/658] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:30 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1433 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:31.366672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:31.366672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:31.377092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:31.377581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:31.387739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:31.388791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:31.389266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:31.389696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:31.922109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:31.952816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:31.957887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:31.958438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:31.958756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:31.959254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:31.959441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:31.960013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:31.961675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a20bb799-182b-4054-a9fe-71ca69bc6e9a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.611294 Nov 02 11:52:31.970816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:31.973678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:31.973678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:31.973678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:31.973678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:31.974019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:31.976634 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 345/659] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:31 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:32.020029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:32.024621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:32.037135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:32.039921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:32.199162 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a7fee7a-1ae9-42b1-ab25-178fbaa16a72 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593389 Nov 02 11:52:32.200213 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 315/660] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:52:32.212708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c81f15-7201-49b2-9081-a5ef032bc7cd", "name": "network-vif-plugged", "status": "completed", "tag": "d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:32.249442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.249803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.250239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.267726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] Creating event network-vif-plugged:d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba for instance e4c81f15-7201-49b2-9081-a5ef032bc7cd on n-h2-855649-4 Nov 02 11:52:32.282600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ce077b4f-8790-4e93-a4b3-c15a7f0fdda5 req-46b54248-390f-4dda-9ee9-5cda2abfedcf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071662 Nov 02 11:52:32.282600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 316/661] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:32.290330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153f71f0-b8d7-42d5-931c-fb0157936853", "name": "network-vif-deleted", "tag": "b343fc19-07f8-4b93-bf76-9e82f48f3c47"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:32.321681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.323009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.328530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.355049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] Creating event network-vif-deleted:b343fc19-07f8-4b93-bf76-9e82f48f3c47 for instance 153f71f0-b8d7-42d5-931c-fb0157936853 on n-h1-855649-4 Nov 02 11:52:32.364811 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3b91deff-8f9f-46e7-b281-eadb120873f4 req-ea51f210-70b8-4148-893f-1d388b50f549 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082561 Nov 02 11:52:32.366007 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 317/662] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:32.378095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:32.379795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:32.390499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.392540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.394831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.395768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.396411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.399170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.495524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9a6f474-ad6f-4b4e-a792-3185ffe00b89 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Action: 'create', calling method: .version_select at 0x7ff1b3981c10>, body: {"keypair": {"name": "tempest-keypair-754306462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcYC3xagoJIdwOMLgNKkwqCDCIIRseZ5i4AbfVdw1/WpXq8wPVNBFRouuYzxpJeZFVHpR8U5pD1/rZTfCXUF9M1a5MooXyGz5PhscSehOcWaZO7TuSwC9gsFqxSDORsIw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:32.539428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f9a6f474-ad6f-4b4e-a792-3185ffe00b89 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:32.546283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f9a6f474-ad6f-4b4e-a792-3185ffe00b89 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for user 9adf6d939b944575a9320a21e331ce34 and project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:32.684289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9a6f474-ad6f-4b4e-a792-3185ffe00b89 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.706169 Nov 02 11:52:32.685443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 346/663] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:52:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:32.695648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d24af516-50dd-4fef-b675-ffbbf8350e20 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:32.696527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d24af516-50dd-4fef-b675-ffbbf8350e20 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:32.740193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:32.751663 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d10e7ee5-fd1f-480a-a03b-c22ed5861941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.384280 Nov 02 11:52:32.753762 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 318/664] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:32 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:32.764996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:32.766457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:32.780354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.781416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.784757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.785667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.795366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.796183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.871472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d24af516-50dd-4fef-b675-ffbbf8350e20 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:32.886667 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d24af516-50dd-4fef-b675-ffbbf8350e20 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1215 microversion: 2.1 time: 0.195115 Nov 02 11:52:32.887669 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 347/665] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:32 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:32.915556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:32.917112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:32.919151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:32.920605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lazy-loading 'fault' on Instance uuid 153f71f0-b8d7-42d5-931c-fb0157936853 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:32.989650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:32.991695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:33.003707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:33.004822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.005597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.008128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:33.021086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.021799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:33.021881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.021881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:33.023350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-785c80c1-6ee0-470a-8eb8-c08c540764a6 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1309 microversion: 2.1 time: 0.267383 Nov 02 11:52:33.025832 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 319/666] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:32 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:33.473833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:33.489669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:33.491518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:33.493014 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8360cbea-881f-401e-8100-f09b63780cf4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.507826 Nov 02 11:52:33.494064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 348/667] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:32 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:33.784327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:33.785290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:33.807110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.808499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.810748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:33.811635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.813748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.814302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:33.910053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:33.911037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:33.919926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.934163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.934163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:33.934163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:33.934163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:33.934842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.051611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.066130 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25ebb355-6334-4711-9c0e-331eb536dd71 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1219 microversion: 2.1 time: 0.159909 Nov 02 11:52:34.067368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 349/668] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:33 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:34.086461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:34.087545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:34.100779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:34.100779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:34.100779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.107161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:34.114766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:34.115366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.165206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.187700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:34.188195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:34.188637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.188786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-313deef0-4922-486c-b35c-aa7d16b4e36a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1313 microversion: 2.1 time: 0.411645 Nov 02 11:52:34.189101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lazy-loading 'fault' on Instance uuid 153f71f0-b8d7-42d5-931c-fb0157936853 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:34.189391 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 320/669] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:33 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:34.265696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0a0f072abfd447c9fc6fe2628a23da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714025ac7d854ab58a3b4e464b9aee75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.274106 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-434a1b1d-256a-4b51-8157-717530f34ab8 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 200 len: 1309 microversion: 2.1 time: 0.205408 Nov 02 11:52:34.274678 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 350/670] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:34 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:34.521324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:34.521945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:34.530633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:34.531222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:34.531663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.532772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:34.533237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:34.533666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:34.826819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.858241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.861065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:34.884098 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3682a270-16e4-42ec-a2dc-62840587e067 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.366534 Nov 02 11:52:34.895478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 321/671] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:34 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:35.090549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:35.091806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:35.104517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.108255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.109440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.111711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.116799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.116799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.219625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:35.220514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:35.233505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.234563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.235110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.235843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.236304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.236738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.264320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:35.279837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc97c08c-f019-4bc9-9923-56e776571d1d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1267 microversion: 2.1 time: 0.189637 Nov 02 11:52:35.281107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 351/672] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:35 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:35.450930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:35.480330 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-429b0d83-ef2d-4e36-9a9b-099b718ccc65 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1463 microversion: 2.1 time: 0.264555 Nov 02 11:52:35.481533 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 322/673] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:35 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:35.495827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:35.497297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] [instance: 153f71f0-b8d7-42d5-931c-fb0157936853] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:35.514115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.520197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.520197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.520197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.520197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.520841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.544658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] HTTP exception thrown: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Request method failure captured: Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 HTTP/1.1 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmd0X_xssakSwC7dBqJDTUN4BuEGISSiFzUijRntTcR2ODZweu82X4iuEkzqRZNixGkjLx8ps3XWv8Bmc2yxtwQcsNHJpuwTvtK1TT7dFLCl9_ALUN802wJhUwLnb0xs3KtAihPv09-LeO20gT7v-P7sTbQs2kD0WURxRRRc0DGg7w Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 714025ac7d854ab58a3b4e464b9aee75 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:35.546332 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_714025ac7d854ab58a3b4e464b9aee75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/714025ac7d854ab58a3b4e464b9aee75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 714025ac7d854ab58a3b4e464b9aee75 Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1269578205 Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationNegativeTest-1269578205-project Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e0a0f072abfd447c9fc6fe2628a23da7 Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationNegativeTest-1269578205-project Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. Nov 02 11:52:35.548055 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '153f71f0-b8d7-42d5-931c-fb0157936853'} Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:35.549428 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. Nov 02 11:52:35.554099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:35.560043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] Returning 404 to user: Instance 153f71f0-b8d7-42d5-931c-fb0157936853 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:35.560043 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3311159a-2c48-4db2-997f-03da477ed362 tempest-LiveMigrationNegativeTest-1269578205 tempest-LiveMigrationNegativeTest-1269578205-project] 10.222.0.48 "GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853" status: 404 len: 111 microversion: 2.1 time: 0.075572 Nov 02 11:52:35.572553 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 323/674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:35 2022] GET /compute/v2.1/servers/153f71f0-b8d7-42d5-931c-fb0157936853 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:35.613263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69b98cd1-b779-4818-b05a-9adac36999d2 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-465259844", "ram": 512, "vcpus": 1, "disk": 10, "id": 445442610, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:35.788717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69b98cd1-b779-4818-b05a-9adac36999d2 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.506456 Nov 02 11:52:35.793944 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 352/675] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:35 2022] POST /compute/v2.1/flavors => generated 412 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:35.847370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:35.854318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'deleted': False, 'project_id': 'a4243abde708404caf49d9a97b457eb4'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:35.863715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.864479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.865080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:35.866124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:35.867083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:35.867705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.029809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f71832d-bb54-4d5b-a043-c87716380ce0 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.039289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8f71832d-bb54-4d5b-a043-c87716380ce0 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] HTTP exception thrown: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.049067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99de9294-3cd9-4068-8ec8-ce20940eab59 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.479258 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f71832d-bb54-4d5b-a043-c87716380ce0 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Request method failure captured: Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYloBmjix171FmD95HFzUeWClTnFHIwagzWLDMTLm5kPmJUWXa7SCzcZ9608UfHoOdhhicQQ6sSCw3aFgDeI2qruoRMf60O1mPJKVokUnPr2sLIts56AbZ-8zgXPcpAJaqwigg1qawHLLRft1333rv3uxtdZLf1ZuAyFNQ4YSKud2Kiw Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:52:36.049536 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2189f9bb9ac9416bad874409d1578a25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7c7a2cd2ebd444848a8d6e6ce4f96847 Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:36.051050 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'flavor_id': '445442610', 'id': 'hw:cpu_thread_policy'} Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.051987 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.053466 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.053964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 324/676] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:52:35 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:36.054929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f71832d-bb54-4d5b-a043-c87716380ce0 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Returning 404 to user: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.059883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f71832d-bb54-4d5b-a043-c87716380ce0 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] 10.222.0.48 "GET /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.259649 Nov 02 11:52:36.060601 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 353/677] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:52:35 2022] GET /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:52:36.068317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.068943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:36.080887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a0281b4-0f84-440b-ad7c-111f70b54234 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.082714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.083130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.083684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.084286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.084782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.085829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.092234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a0281b4-0f84-440b-ad7c-111f70b54234 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7c7a2cd2ebd444848a8d6e6ce4f96847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2189f9bb9ac9416bad874409d1578a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a0281b4-0f84-440b-ad7c-111f70b54234 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Request method failure captured: Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/flavors/445442610/os-extra_specs HTTP/1.1 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 66 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYloBmjix171FmD95HFzUeWClTnFHIwagzWLDMTLm5kPmJUWXa7SCzcZ9608UfHoOdhhicQQ6sSCw3aFgDeI2qruoRMf60O1mPJKVokUnPr2sLIts56AbZ-8zgXPcpAJaqwigg1qawHLLRft1333rv3uxtdZLf1ZuAyFNQ4YSKud2Kiw Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:52:36.095497 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2189f9bb9ac9416bad874409d1578a25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7c7a2cd2ebd444848a8d6e6ce4f96847 Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 11:52:36.096813 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'flavor_id': '445442610', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:52:36.097693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 11:52:36.098887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.105280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a0281b4-0f84-440b-ad7c-111f70b54234 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.107097 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a0281b4-0f84-440b-ad7c-111f70b54234 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] 10.222.0.48 "POST /compute/v2.1/flavors/445442610/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.035345 Nov 02 11:52:36.111012 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 354/678] 10.222.0.48 () {60 vars in 1221 bytes} [Wed Nov 2 11:52:36 2022] POST /compute/v2.1/flavors/445442610/os-extra_specs => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:52:36.116729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.133084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'deleted': False} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:36.149160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.150457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.163743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.164798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.165461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.166602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.343918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.354064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.357113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.360737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-806c4c0f-0ab7-48f3-a488-c3769364737f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.310063 Nov 02 11:52:36.363630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 325/679] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:36 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:36.366781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-917752a8-cb8f-4ed3-8c07-94bc6931de4c tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.405453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:36.458189 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-917752a8-cb8f-4ed3-8c07-94bc6931de4c tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/445442610/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095058 Nov 02 11:52:36.459564 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 326/680] 10.222.0.48 () {60 vars in 1221 bytes} [Wed Nov 2 11:52:36 2022] POST /compute/v2.1/flavors/445442610/os-extra_specs => generated 66 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:36.472366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.474075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:36.490872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.491551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.491995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.492725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.498405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.499018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.569282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:36.583784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:36.584556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:36.641132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.652427 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8025c3fe-ecb2-4d67-b2d8-6290be186425 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1285 microversion: 2.1 time: 0.191568 Nov 02 11:52:36.653021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 327/681] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:36 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:36.667953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cb475d4-3ec9-48e6-aae9-3ed8854feb8a tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.670406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cb475d4-3ec9-48e6-aae9-3ed8854feb8a tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7c7a2cd2ebd444848a8d6e6ce4f96847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2189f9bb9ac9416bad874409d1578a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cb475d4-3ec9-48e6-aae9-3ed8854feb8a tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Request method failure captured: Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYloBmjix171FmD95HFzUeWClTnFHIwagzWLDMTLm5kPmJUWXa7SCzcZ9608UfHoOdhhicQQ6sSCw3aFgDeI2qruoRMf60O1mPJKVokUnPr2sLIts56AbZ-8zgXPcpAJaqwigg1qawHLLRft1333rv3uxtdZLf1ZuAyFNQ4YSKud2Kiw Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:36.676529 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2189f9bb9ac9416bad874409d1578a25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7c7a2cd2ebd444848a8d6e6ce4f96847 Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:36.678066 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'flavor_id': '445442610', 'id': 'hw:numa_nodes'} Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:52:36.678848 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.680229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cb475d4-3ec9-48e6-aae9-3ed8854feb8a tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.687413 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cb475d4-3ec9-48e6-aae9-3ed8854feb8a tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] 10.222.0.48 "DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.033263 Nov 02 11:52:36.690066 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 328/682] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 11:52:36 2022] DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:36.711797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72ce1292-ea35-4ae0-98de-226274770e9a tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.735657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=89,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:36.744466 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72ce1292-ea35-4ae0-98de-226274770e9a tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/445442610/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048673 Nov 02 11:52:36.745069 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 329/683] 10.222.0.48 () {60 vars in 1221 bytes} [Wed Nov 2 11:52:36 2022] POST /compute/v2.1/flavors/445442610/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:36.770498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4b7e5a6-abe4-4101-bdff-1a927366ff3d tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.781064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4b7e5a6-abe4-4101-bdff-1a927366ff3d tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7c7a2cd2ebd444848a8d6e6ce4f96847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2189f9bb9ac9416bad874409d1578a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4b7e5a6-abe4-4101-bdff-1a927366ff3d tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Request method failure captured: Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 22 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYloBmjix171FmD95HFzUeWClTnFHIwagzWLDMTLm5kPmJUWXa7SCzcZ9608UfHoOdhhicQQ6sSCw3aFgDeI2qruoRMf60O1mPJKVokUnPr2sLIts56AbZ-8zgXPcpAJaqwigg1qawHLLRft1333rv3uxtdZLf1ZuAyFNQ4YSKud2Kiw Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:52:36.784197 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2189f9bb9ac9416bad874409d1578a25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2189f9bb9ac9416bad874409d1578a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2189f9bb9ac9416bad874409d1578a25 Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7c7a2cd2ebd444848a8d6e6ce4f96847 Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: {"hw:numa_nodes": "1"} Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:36.785664 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'flavor_id': '445442610', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:52:36.786563 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 11:52:36.788101 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.794909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4b7e5a6-abe4-4101-bdff-1a927366ff3d tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.794909 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4b7e5a6-abe4-4101-bdff-1a927366ff3d tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803 tempest-FlavorsExtraSpecsNegativeTestJSON-1915369803-project] 10.222.0.48 "PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.033031 Nov 02 11:52:36.794909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 330/684] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:52:36 2022] PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:36.804362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c954d76-11fd-478c-984c-70e3f18abc7e tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:36.816581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2c954d76-11fd-478c-984c-70e3f18abc7e tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] HTTP exception thrown: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c954d76-11fd-478c-984c-70e3f18abc7e tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Request method failure captured: Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYloDHLGjengSF6QSGxya8q8xx9ncxsIrLA_Jy0TnM96Gi04ROShmaMSvr4RZHUTjMdNhcPyag1b1UCnApRABkAp6k3WmZ_h2VmAwVf-xmbKu1WkrvSDFsp4tQHc-Htfk40LAjSsv96kvDGKiRF8WzIRA5zxmAjavH0t8Z5KB4kh-5Lo Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:52:36.828111 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da10b71689b64d829e9657a732ffbe48", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0016d2a64b044c4b8bf9c20bc4c1eff8 Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:36.829765 n-d-855649-4 devstack@n-api.service[127567]: exception: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'flavor_id': '445442610', 'id': 'hw:cpu_thread_policy'} Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.830664 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c954d76-11fd-478c-984c-70e3f18abc7e tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Returning 404 to user: Flavor 445442610 has no extra specs with key hw:cpu_thread_policy. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c954d76-11fd-478c-984c-70e3f18abc7e tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.032628 Nov 02 11:52:36.837599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 331/685] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 11:52:36 2022] DELETE /compute/v2.1/flavors/445442610/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:52:36.840393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-041a4202-36c9-4ef9-88a2-0cd5a4290738 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.851171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-041a4202-36c9-4ef9-88a2-0cd5a4290738 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-041a4202-36c9-4ef9-88a2-0cd5a4290738 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Request method failure captured: Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 27 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYloDHLGjengSF6QSGxya8q8xx9ncxsIrLA_Jy0TnM96Gi04ROShmaMSvr4RZHUTjMdNhcPyag1b1UCnApRABkAp6k3WmZ_h2VmAwVf-xmbKu1WkrvSDFsp4tQHc-Htfk40LAjSsv96kvDGKiRF8WzIRA5zxmAjavH0t8Z5KB4kh-5Lo Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:52:36.852693 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da10b71689b64d829e9657a732ffbe48", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0016d2a64b044c4b8bf9c20bc4c1eff8 Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: {"hw:cpu_policy": "shared"} Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:36.854246 n-d-855649-4 devstack@n-api.service[127567]: exception: Request body and URI mismatch Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'flavor_id': '445442610', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.855304 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-041a4202-36c9-4ef9-88a2-0cd5a4290738 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.856667 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-041a4202-36c9-4ef9-88a2-0cd5a4290738 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.018929 Nov 02 11:52:36.859340 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 332/686] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:52:36 2022] PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:52:36.866332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e08eeb0-eb0f-470f-96ff-b5bac8277c99 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e08eeb0-eb0f-470f-96ff-b5bac8277c99 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Request method failure captured: Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 49 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYloDHLGjengSF6QSGxya8q8xx9ncxsIrLA_Jy0TnM96Gi04ROShmaMSvr4RZHUTjMdNhcPyag1b1UCnApRABkAp6k3WmZ_h2VmAwVf-xmbKu1WkrvSDFsp4tQHc-Htfk40LAjSsv96kvDGKiRF8WzIRA5zxmAjavH0t8Z5KB4kh-5Lo Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:52:36.877192 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da10b71689b64d829e9657a732ffbe48", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da10b71689b64d829e9657a732ffbe48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: da10b71689b64d829e9657a732ffbe48 Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0016d2a64b044c4b8bf9c20bc4c1eff8 Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 11:52:36.878739 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'flavor_id': '445442610', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance: Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 11:52:36.881298 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.883128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e08eeb0-eb0f-470f-96ff-b5bac8277c99 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e08eeb0-eb0f-470f-96ff-b5bac8277c99 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014771 Nov 02 11:52:36.890308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 333/687] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:52:36 2022] PUT /compute/v2.1/flavors/445442610/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:52:36.895255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-659b10f0-fec2-47d2-a17a-618aa7cd9ea1 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:37.021864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-659b10f0-fec2-47d2-a17a-618aa7cd9ea1 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/445442610" status: 202 len: 0 microversion: 2.1 time: 0.130882 Nov 02 11:52:37.022960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 334/688] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:52:36 2022] DELETE /compute/v2.1/flavors/445442610 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:52:37.031534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba051f3d-d671-4055-97dd-f7875158d009 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:37.061047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba051f3d-d671-4055-97dd-f7875158d009 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913 tempest-FlavorsExtraSpecsNegativeTestJSON-952047913-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.033043 Nov 02 11:52:37.062779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 335/689] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:52:37 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:37.403167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:37.404605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:37.425792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:37.428852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:37.430169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:37.434822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:37.435918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:37.437578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.063898 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e1d0d135-b037-47bc-952a-e712e1a2879b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19258 microversion: 2.1 time: 1.950500 Nov 02 11:52:38.065180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 355/690] 10.222.0.48 () {58 vars in 1171 bytes} [Wed Nov 2 11:52:36 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19258 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:38.070047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:38.070676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:38.086510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.089030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.101762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.102533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.115882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.116518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.137547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:38.165373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:38.189983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:38.193321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:38.202703 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f689976-a961-41e0-b1bc-31f9fba29c44 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.813951 Nov 02 11:52:38.203370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 336/691] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:37 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:38.209976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:38.247260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'deleted': False, 'project_id': 'a4243abde708404caf49d9a97b457eb4'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:38.252542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.253295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.254051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.254994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.260529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.261192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.355426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:38.373350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-795fed14-1655-47bf-b2be-3124e983478d tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?tenant_id=ed0b3eaeb61546c18a68bf076583582f" status: 200 len: 15 microversion: 2.1 time: 0.168877 Nov 02 11:52:38.375029 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 337/692] 10.222.0.48 () {58 vars in 1231 bytes} [Wed Nov 2 11:52:38 2022] GET /compute/v2.1/servers/detail?tenant_id=ed0b3eaeb61546c18a68bf076583582f => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:38.376015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ff291b4-4b38-4ad4-99be-d7f667aea605 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1273 microversion: 2.1 time: 0.309683 Nov 02 11:52:38.376942 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 356/693] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:38 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:38.399514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:38.408245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'tenant_id': 'ed0b3eaeb61546c18a68bf076583582f', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:38.424913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.425660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.426245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.433493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.434375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.435196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:38.508422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:38.687571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:38.688620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:38.689206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.232485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:39.233934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:39.253440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.257388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.282745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.289866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.293261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.293956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.401649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8b3491d-bb96-4313-a21f-c2e20041d0ea tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ed0b3eaeb61546c18a68bf076583582f" status: 200 len: 4827 microversion: 2.1 time: 1.005427 Nov 02 11:52:39.403509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 338/694] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 11:52:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ed0b3eaeb61546c18a68bf076583582f => generated 4827 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:39.415492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:39.415492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:39.423855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.423855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.423855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.423855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.424221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.424221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.817671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:39.834875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:39.835129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:39.839947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:39.842617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ee9199c-d4db-4e8d-956b-b0d59ff57654 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.614789 Nov 02 11:52:39.843823 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 357/695] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:39 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:39.847083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56b22f26-566b-4a7e-a443-c4fcc74d24b6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.443381 Nov 02 11:52:39.848230 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 339/696] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:39 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:39.855541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:39.865605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'tenant_id': 'a4243abde708404caf49d9a97b457eb4', 'deleted': False} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:39.873130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.873623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.874056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:39.875122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:39.876066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:39.885260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.020131 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a1fa906-4319-419f-9722-8d8de715d54a tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a4243abde708404caf49d9a97b457eb4" status: 200 len: 15 microversion: 2.1 time: 0.174989 Nov 02 11:52:40.021488 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 358/697] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 11:52:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a4243abde708404caf49d9a97b457eb4 => generated 15 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:40.046027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a52fc336-564e-4096-88eb-1c072a183392 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:40.053002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a52fc336-564e-4096-88eb-1c072a183392 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010702 Nov 02 11:52:40.054012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 340/698] 10.222.0.48 () {58 vars in 1189 bytes} [Wed Nov 2 11:52:40 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:40.084914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:40.089987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:40.119016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.122721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.123379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.124298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.127432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.129635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.492882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18db3627-ff2f-4019-99bb-df0825aa445c", "name": "network-vif-plugged", "status": "completed", "tag": "b5f6e97f-b902-4010-84d3-8c4f71e844d8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:40.534137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.542258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.542866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.552940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-777b618a-633a-4fbb-9efa-04154fe33a93 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 0 microversion: 2.1 time: 0.475441 Nov 02 11:52:40.554238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 359/699] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:40 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:40.565843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:40.574567 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] Creating event network-vif-plugged:b5f6e97f-b902-4010-84d3-8c4f71e844d8 for instance 18db3627-ff2f-4019-99bb-df0825aa445c on n-h1-855649-4 Nov 02 11:52:40.589773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bbf8aaff-5a41-4d51-80bf-07a4247537d4 req-95014705-33c2-432b-89bd-1c784c25fc77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099791 Nov 02 11:52:40.592075 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 341/700] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:40.594492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:40.606121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:40.619339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.619339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.619339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.628114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.628625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.629071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.854156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:40.873380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:40.875265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:40.892039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.896554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.900433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.905115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:40.905697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:40.906158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:40.993354 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-542f4d76-25f3-4a41-bab1-0219047b0f10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.433455 Nov 02 11:52:41.004532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 360/701] 10.222.0.48 () {58 vars in 1150 bytes} [Wed Nov 2 11:52:40 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:41.016311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:41.017213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:41.031456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.033697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.034349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.035900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.042938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.043786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.346863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:41.360690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:41.362706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:41.372108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5352181a-af62-4312-b4c0-16d9b4f8c969 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.498528 Nov 02 11:52:41.385421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 342/702] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:40 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:41.407867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:41.425270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:41.440488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.440999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.442268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.443496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.444035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.444621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.485310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:41.496886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-831b0cdb-b191-4397-953b-f477544aa3a9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.490854 Nov 02 11:52:41.497493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 361/703] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:41 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:41.505323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4d2599-dcde-4200-a78a-03abf1f8217f", "tag": "9f6b4a14-79ed-4102-929a-9ea8df15bcdc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:41.527859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:41.528475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:41.534874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:41.541248 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] Creating event network-changed:9f6b4a14-79ed-4102-929a-9ea8df15bcdc for instance cb4d2599-dcde-4200-a78a-03abf1f8217f on n-h1-855649-4 Nov 02 11:52:41.546448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c39ddc81-a9ca-43ba-800b-fab2c93206c7 req-1e373cfb-ccd8-4b9a-8da3-5e63eafebdc7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047785 Nov 02 11:52:41.547617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 362/704] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:42.259875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae763388-86d5-49e1-bb94-8ea1008d7a83 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 0 microversion: 2.1 time: 0.870841 Nov 02 11:52:42.261481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 343/705] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:41 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:42.271139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:42.272647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:42.282140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.282963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.283716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.284791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.286471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.287174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.400397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:42.401319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:42.411520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.414712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.418246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.421225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.423080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.423539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.656957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e82fbe8-936f-4a8e-95d3-da90918e3d38 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1615 microversion: 2.1 time: 0.391197 Nov 02 11:52:42.657563 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 363/706] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:42 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1615 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:42.662226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:42.684906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:42.687088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:42.690023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80f9f000-ed0d-4d77-a34f-38f657a3d5e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1361 microversion: 2.25 time: 0.293796 Nov 02 11:52:42.691421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 344/707] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:42 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:42.691823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:42.692491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:42.697910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:42.698920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:42.700374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.700863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.701304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.702079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.702712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.703333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.711142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.713074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.713074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:42.714655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:42.716073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:42.716585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.026535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:43.037214 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f2bb914-f73c-4536-abb4-489bf2d1c555 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1615 microversion: 2.1 time: 0.344192 Nov 02 11:52:43.044091 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 345/708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:42 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1615 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:43.055502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05148354-6589-410b-a687-746f31307821 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.377740 Nov 02 11:52:43.056640 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 364/709] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:42 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:43.062341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:43.077526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'host': 'n-h2-855649-4', 'deleted': False} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:43.082771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.083284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.084458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.085210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.085775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.086357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.221630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:52:43.260590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:43.308343 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6aa6f72-bba9-4243-a135-ff6cb61a7eec tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=n-h2-855649-4&all_tenants=1" status: 200 len: 2645 microversion: 2.1 time: 0.249617 Nov 02 11:52:43.319701 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 346/710] 10.222.0.48 () {58 vars in 1190 bytes} [Wed Nov 2 11:52:43 2022] GET /compute/v2.1/servers?host=n-h2-855649-4&all_tenants=1 => generated 2645 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:43.325211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:43.331893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:52:43.339484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.340330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.341189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.342358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.344117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.344848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.485572 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7946eb6a-42a4-4d87-bc8d-af3edcb35fc6 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.164792 Nov 02 11:52:43.486193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 365/711] 10.222.0.48 () {58 vars in 1196 bytes} [Wed Nov 2 11:52:43 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:52:43.499754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:43.502420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:43.513659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.514605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.515299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.516411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.517180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.518051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.721771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:43.722613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:43.744438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.745230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.745855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.746758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.747549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.747989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.886838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6223b5f-0879-4a28-b867-60957714bc08 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 0 microversion: 2.1 time: 0.388435 Nov 02 11:52:43.886838 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 347/712] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:43 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:52:43.947135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:43.960077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:43.961973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:43.964615 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6cbda29-a86d-4823-ad90-8c3d01f8be4c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1556 microversion: 2.25 time: 0.247188 Nov 02 11:52:43.966101 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 366/713] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:43 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1556 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:43.972865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:43.980060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:43.987190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.988448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.989449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:43.990368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:43.991135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:43.991572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.119217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:44.120330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:44.121053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:44.121698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:44.122348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:44.275874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-526e3069-a463-4557-a69c-4fb1ef9986cc tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] Calling method '.version_select at 0x7ff1b3c1b280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:44.380683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:44.398598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.405330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.405718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.406411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.406912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.411083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.458610 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7b916c9-b42f-4b73-aafb-1b3b53936944 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 1068 microversion: 2.1 time: 0.491027 Nov 02 11:52:44.459934 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 367/714] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:52:43 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 1068 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 11:52:44.467265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:44.468976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:44.477301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.479345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.480057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.481128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.481946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.482766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.686032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-526e3069-a463-4557-a69c-4fb1ef9986cc tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 6092 microversion: 2.1 time: 0.799918 Nov 02 11:52:44.687396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 348/715] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:52:43 2022] GET /compute/v2.1/os-networks => generated 6092 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:44.695409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:44.699071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:44.704796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.705614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.706208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.707387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:44.708000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:44.708638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:44.955776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:45.067302 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cd80648-070e-4bf2-b124-aa065251c67b tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 2048 microversion: 2.25 time: 0.606014 Nov 02 11:52:45.069166 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 368/716] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:44 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 2048 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:45.070515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:45.075252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.076276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:45.082372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e20697b-e34d-491c-b123-6fc9bd5e3640 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.392281 Nov 02 11:52:45.083008 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 349/717] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:44 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:45.099146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.099146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.099387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f81fbdc3-585d-4f4f-84af-0b723b6e1352 tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] Calling method '.version_select at 0x7ff1b3db4ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.099487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.109357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.110698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.111955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.312405 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f81fbdc3-585d-4f4f-84af-0b723b6e1352 tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks/673eecb1-78e5-4d1a-b3ef-8aece7cb5288" status: 200 len: 652 microversion: 2.1 time: 0.228316 Nov 02 11:52:45.313344 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 350/718] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/os-networks/673eecb1-78e5-4d1a-b3ef-8aece7cb5288 => generated 652 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:45.319478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.320131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:45.355042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.356052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.356512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.357270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.357729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.358162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.656709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:45.669615 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28973d98-d6b1-4b60-b5b9-9630e26cc017 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.599064 Nov 02 11:52:45.683617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 369/719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:45.698168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93cf14bb-64f2-4ebb-b604-af8b8125f577 tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] Calling method '.version_select at 0x7ff1b3d06d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.819535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:45.857940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc8d9634-663f-4111-ba43-cb55080ced36 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 2048 microversion: 2.25 time: 0.543418 Nov 02 11:52:45.858551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 351/720] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 2048 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:45.904868 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93cf14bb-64f2-4ebb-b604-af8b8125f577 tempest-NetworksTest-1845526925 tempest-NetworksTest-1845526925-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 6092 microversion: 2.1 time: 0.210896 Nov 02 11:52:45.906158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 370/721] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/os-networks => generated 6092 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:45.912434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:45.920827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.922579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.925037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:45.928184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:45.928923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:45.929606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.000177 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1699ea70-d42a-4865-a675-c2b422e0fc8a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.091711 Nov 02 11:52:46.005805 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 371/722] 10.222.0.48 () {60 vars in 1217 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:46.022739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:46.023352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:46.049280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.049784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.050223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.053970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.057514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.059878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.065702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:46.168332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a83263a1-2be9-4600-a786-543581c0a752 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] Calling method '.version_select at 0x7ff1b3e22040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:46.180036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:46.184550 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a83263a1-2be9-4600-a786-543581c0a752 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.323548 Nov 02 11:52:46.186321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 352/723] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:52:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:46.201142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:46.201992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:46.210770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.211632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.212815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.213800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.214700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.215173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.442845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:46.455637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34970c02-3b42-4f14-9a06-337c35e5465c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.267675 Nov 02 11:52:46.456249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 353/724] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:46 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:46.461979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00e69755-351c-40b8-a0d0-203c03be7256 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3e22040>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:46.544649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:46.614592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da2e8110-1840-49ad-8a49-51c79e99cf16 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c/action" status: 202 len: 0 microversion: 2.25 time: 0.592064 Nov 02 11:52:46.614592 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 372/725] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:52:46 2022] POST /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:46.622575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:46.623811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:46.632289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.635438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.636242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.637194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.637663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.638089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.807961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:46.824978 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06bd2b55-130a-401f-aa95-b7efddaa020c tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 2053 microversion: 2.25 time: 0.208777 Nov 02 11:52:46.825959 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 373/726] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:46 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 2053 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:46.844721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:46.850566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:46.852754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.854010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.854866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:46.855992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:46.856671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:46.857501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.105875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:47.115641 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-170011de-e209-4e90-934b-af42b944a941 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.288590 Nov 02 11:52:47.116767 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 374/727] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:46 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:47.486843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:47.487982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:47.495290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.495781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.496224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.496941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.497400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.497851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.745249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:47.754822 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbbd1d4d-5509-432d-ba2f-a45e60a02915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.273689 Nov 02 11:52:47.755871 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 375/728] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:47 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:47.874259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:47.875000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:47.891740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.895795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.895795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:47.895795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:47.895795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:47.896188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.098413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:48.127712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:SELECT=74,nova_api:DELETE=3,nova_api:UPDATE=10,nova_api:INSERT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:48.139719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-373374d6-3a23-4135-8ecc-aa0db978bdc9 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 2033 microversion: 2.25 time: 0.265740 Nov 02 11:52:48.139719 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 376/729] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:47 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 2033 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:52:48.149297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:48.152963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:48.164837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:48.166352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:48.167219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.171374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:48.171374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:48.171374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.381578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:48.393936 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9bbad84a-09cb-43ef-a0ee-6286c21b0816 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.251704 Nov 02 11:52:48.394677 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 377/730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:48 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:48.409283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": "auto"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:48.417828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:48.436975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:48.439329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:48.439329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.441053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:48.441604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:48.442301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:48.487128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00e69755-351c-40b8-a0d0-203c03be7256 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 2.028925 Nov 02 11:52:48.488255 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 354/731] 10.222.0.48 () {60 vars in 1206 bytes} [Wed Nov 2 11:52:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:48.496778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'flavor' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:52:48.505271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92f34f76-5020-4443-9bc5-c6b4a3e0d18a tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] Calling method '.version_select at 0x7ff1b3c1b280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:48.515504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:52:48.530911 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92f34f76-5020-4443-9bc5-c6b4a3e0d18a tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.033353 Nov 02 11:52:48.539393 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 355/732] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:52:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:48.553260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93b68c8d-805b-4715-b523-448e7dcc5a11 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3c64940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:50.530955 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93b68c8d-805b-4715-b523-448e7dcc5a11 tempest-QuotaClassesAdminTestJSON-1506906147 tempest-QuotaClassesAdminTestJSON-1506906147-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.987519 Nov 02 11:52:50.531967 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 356/733] 10.222.0.48 () {60 vars in 1206 bytes} [Wed Nov 2 11:52:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:50.547224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:50.548550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:50.556631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:50.561525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:50.561525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:50.561525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:50.561525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:50.561912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:50.734742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:50.747289 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4400b711-b424-4b44-a022-298e5a895361 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.204459 Nov 02 11:52:50.747955 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 357/734] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:50 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:50.752922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:50.753572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:50.761882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:50.762594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:50.762814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:50.763573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:50.764026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:50.765026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:50.934300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:50.943555 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0f173ab-46ca-4e0b-a1bd-73189e9d40a1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.194203 Nov 02 11:52:50.951182 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 358/735] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:50 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:50.951182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4d2599-dcde-4200-a78a-03abf1f8217f", "name": "network-vif-plugged", "status": "completed", "tag": "9f6b4a14-79ed-4102-929a-9ea8df15bcdc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:50.959351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:50.960109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:50.960535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:50.976303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] Creating event network-vif-plugged:9f6b4a14-79ed-4102-929a-9ea8df15bcdc for instance cb4d2599-dcde-4200-a78a-03abf1f8217f on n-h1-855649-4 Nov 02 11:52:50.982771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ce6c9453-9f1f-4511-90e5-c37a9707b2bb req-a4669a13-c512-4fd7-b584-4a28993cfb21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037245 Nov 02 11:52:50.983753 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 359/736] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:51.772274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:51.773244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:51.790931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:51.791467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:51.795115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:51.795853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:51.796335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:51.796766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:51.974798 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c8a74bd-59cb-4829-9a78-8f2ba904e8fa tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c/action" status: 202 len: 0 microversion: 2.25 time: 3.579069 Nov 02 11:52:51.976519 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 378/737] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:52:48 2022] POST /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c/action => generated 0 bytes in 3581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:51.983623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:51.984946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:51.994788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:51.995319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:51.995921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:51.997213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:51.997672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:51.998279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:52.012136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:52.022648 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d278c89-0ecd-42c7-b035-10a370785326 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1315 microversion: 2.1 time: 0.255507 Nov 02 11:52:52.023424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 360/738] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:51 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:52.028965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:52.029672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:52.036427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:52.037401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:52.038093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:52.039208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:52.039749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:52.040860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:52.263664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:52.280035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48418b22-7dea-4c3d-945c-b68cf6c43484 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.302239 Nov 02 11:52:52.282448 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 379/739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:51 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:52.314728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:52.326158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:52.329775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:52.329775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa7014d2-97ee-45c0-bb0b-419037b7541b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.304980 Nov 02 11:52:52.344148 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 361/740] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:52 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:53.047649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:53.048884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:53.052091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:53.065990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.068356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.071692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.072674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.073368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.074010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.313957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:53.315165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:53.317948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:53.325146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.331216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.331216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.343876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.345223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.348946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.408504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:53.419362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a3db1cc-1fe4-472a-9a16-0b4414ee1825 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1465 microversion: 2.1 time: 0.376379 Nov 02 11:52:53.422835 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 380/741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:53 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1465 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:53.425650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:53.426638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:53.434719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.435283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.435729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.436443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.437827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.438285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.732223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:53.747190 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea688fb1-36dd-4726-af89-7a255c01177c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.444944 Nov 02 11:52:53.760255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:53.766046 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 362/742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:53 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:53.772007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:53.772904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:53.773130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:53.778594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:53.785084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68aae391-834e-44c6-ac2e-9d3e57b3cabf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.363993 Nov 02 11:52:53.786165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.786556 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 381/743] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:53 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:53.787922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.788657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:53.791597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:53.792143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:53.794237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:54.088659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d662ff60-2fe0-42c0-9df4-7d8a35738a03 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1616 microversion: 2.1 time: 0.316790 Nov 02 11:52:54.089546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 363/744] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:53 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1616 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:54.295803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1377432318", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["79f01c5e-3ef8-4f56-affe-03b6962a8975"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:54.383577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:54.444151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6498111f-4422-4cb2-ba81-324cbe64a1a0 tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] Calling method '.version_select at 0x7ff1b3efaf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:54.463183 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6498111f-4422-4cb2-ba81-324cbe64a1a0 tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.255688 Nov 02 11:52:54.465099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 382/745] 10.222.0.48 () {60 vars in 1226 bytes} [Wed Nov 2 11:52:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:54.488172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1fb684dc-3a83-473a-abd8-7cf0a327bb33 tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3988f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:55.080050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:55.080731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:55.081362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:55.081823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:55.082621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:55.098864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.099028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.099820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.100384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.100905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.101342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.124761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:55.130219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:55.145731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:55.148918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:55.189031 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1fb684dc-3a83-473a-abd8-7cf0a327bb33 tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.711283 Nov 02 11:52:55.189031 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 383/746] 10.222.0.48 () {62 vars in 1247 bytes} [Wed Nov 2 11:52:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:55.193788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:55.194494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:55.201928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.202419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.202854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.203602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.204058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.204747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.292850 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-627a6131-0270-4239-9637-1dc56f66a0ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001869 Nov 02 11:52:55.305233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 364/747] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:52:55.311829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:55.314354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:55.321897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.322770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.323461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.324494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.325324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.326029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.595874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:55.605679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-251318e0-11c2-4278-a03f-7d7f93bc42dd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.416390 Nov 02 11:52:55.622694 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 384/748] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:55 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:55.622694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:55.622694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:55.635667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.636128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.641375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.642390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.642887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.643435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.706956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:52:55.712775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:55.735622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:55.739743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:55.743838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d91a50a8-8c85-4e0f-a2f7-993ce875d4ba tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.438521 Nov 02 11:52:55.743838 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 365/749] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:55 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:55.773469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-389198d2-7733-4bbf-82b0-be65d9c2b18d tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] Calling method '.version_select at 0x7ff1b81618b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:55.801353 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-389198d2-7733-4bbf-82b0-be65d9c2b18d tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.057993 Nov 02 11:52:55.818787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 366/750] 10.222.0.48 () {60 vars in 1226 bytes} [Wed Nov 2 11:52:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:55.818787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18db3627-ff2f-4019-99bb-df0825aa445c", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f6e97f-b902-4010-84d3-8c4f71e844d8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:55.827227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:55.827849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:55.828371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:55.841542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] Creating event network-vif-unplugged:b5f6e97f-b902-4010-84d3-8c4f71e844d8 for instance 18db3627-ff2f-4019-99bb-df0825aa445c on n-h1-855649-4 Nov 02 11:52:55.849279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-212bb9a6-09c9-41a8-8019-4e59c236faa5 req-3841638b-dae6-4d60-ae21-014f22dc794d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042696 Nov 02 11:52:55.851141 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 367/751] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:55.858484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e0beb05-03a6-4232-beeb-9f01b91fc39a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:55.859476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e0beb05-03a6-4232-beeb-9f01b91fc39a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:55.878623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:55.948303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:55.991015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e0beb05-03a6-4232-beeb-9f01b91fc39a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:56.004184 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e0beb05-03a6-4232-beeb-9f01b91fc39a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1217 microversion: 2.1 time: 0.150090 Nov 02 11:52:56.005847 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 368/752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:55 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:56.016888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-231eb7cc-47f6-4ac2-a87a-76eae6975d8c tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3c344c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:56.123513 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccdf24f6-a268-44fa-a1fd-0c98b582cb94 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 204 len: 0 microversion: 2.1 time: 0.508950 Nov 02 11:52:56.132946 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 385/753] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:52:55 2022] DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:52:56.324956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-572111777", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "1167073119", "adminPass": "***", "networks": [{"uuid": "5cde0e45-0df9-44f6-b8c8-0ce5ce45b2dc"}], "security_groups": [{"name": "tempest-securitygroup--1372021882"}], "key_name": "tempest-keypair-559412311", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:56.455025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] validate_networks() for [('5cde0e45-0df9-44f6-b8c8-0ce5ce45b2dc', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:52:56.880014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:52:56.880696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:52:56.880976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:52:56.881601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:52:56.882093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:52:56.892810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:56.893403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:56.893954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:56.894882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:56.895546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:56.896028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:56.916318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for project 314ce714ea624e9c9fcd3258be119e24. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:52:56.922502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Getting quotas for user 764a434df778448f8cb76d1371b867f7 and project 314ce714ea624e9c9fcd3258be119e24. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:52:56.936363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:52:56.939264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:52:57.136968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70bbbdae-1c56-4632-a7c8-ae48a6031079 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.817980 Nov 02 11:52:57.141182 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 386/754] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:52:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:52:57.147392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:57.148077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:57.156176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.156711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.157534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.158283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.158752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.159252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.242632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-231eb7cc-47f6-4ac2-a87a-76eae6975d8c tempest-QuotaClassesAdmin257Test-934767947 tempest-QuotaClassesAdmin257Test-934767947-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 1.229739 Nov 02 11:52:57.247824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 369/755] 10.222.0.48 () {62 vars in 1247 bytes} [Wed Nov 2 11:52:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:57.273169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:57.278755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:57.315855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.320195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.322240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.329320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.329907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.330359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.544324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.552817 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f19865fd-7ada-49c8-8441-365d4c2aef07 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1472 microversion: 2.1 time: 0.410326 Nov 02 11:52:57.555261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 387/756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:57 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:57.562483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:57.563362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:57.569326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.570010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.570597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.571824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.572290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.572717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.603768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.612354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.614099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.615483 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf359ee6-2007-4290-8435-dca2695136c2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.363257 Nov 02 11:52:57.616252 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 370/757] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:57 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:57.631501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25fb582f-1591-41f4-ab37-75de01cd5c79 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:57.632678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25fb582f-1591-41f4-ab37-75de01cd5c79 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:57.639757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=73,nova_api:UPDATE=21 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:57.677933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.696083 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f515ffc5-193d-4157-b924-e1234df6d118 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1221 microversion: 2.1 time: 0.137143 Nov 02 11:52:57.701923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 388/758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:57 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:57.717634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-25fb582f-1591-41f4-ab37-75de01cd5c79 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:57.733465 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25fb582f-1591-41f4-ab37-75de01cd5c79 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1263 microversion: 2.1 time: 0.115986 Nov 02 11:52:57.739420 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 371/759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:57 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1263 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:57.869272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18db3627-ff2f-4019-99bb-df0825aa445c", "tag": "b5f6e97f-b902-4010-84d3-8c4f71e844d8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:57.890781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:57.892090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:57.892609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:57.904960 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] Creating event network-changed:b5f6e97f-b902-4010-84d3-8c4f71e844d8 for instance 18db3627-ff2f-4019-99bb-df0825aa445c on n-h1-855649-4 Nov 02 11:52:57.910595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-53b1de20-fd3d-4d91-96f9-39387a63f1e4 req-a5d15f52-e900-4310-9c77-937491da0ffa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048972 Nov 02 11:52:57.914286 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 389/760] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:52:58.220357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3db4670>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:58.511245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.511245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.511245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.511245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.512055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.512055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.581002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:58.582006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:58.594851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.595915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.596794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.597703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.598805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.599454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.647591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-868318db-7f14-46cb-8b65-e01b3055b23c tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8" status: 200 len: 240 microversion: 2.36 time: 0.640929 Nov 02 11:52:58.650077 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 372/761] 10.222.0.48 () {62 vars in 1303 bytes} [Wed Nov 2 11:52:58 2022] PUT /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8 => generated 240 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:58.659601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:58.660222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:58.674250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.676454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.676454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.677582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:58.678926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:58.679580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:58.978239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:58.989456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-132d7564-34f7-43b5-89b7-15455d58beef tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.413817 Nov 02 11:52:59.003005 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 390/762] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:58 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:52:59.017695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Calling method '.version_select at 0x7ff1b3d17940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:59.059894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:59.072387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:59.077180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:59.080676 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98e7c259-6456-4f6e-9876-078aee2323e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.427392 Nov 02 11:52:59.081375 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 373/763] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:52:58 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:52:59.089319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:59.089937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:59.111676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.113058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.113753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.114819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.116542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.127668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.132809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:52:59.171145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.171959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.172572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.173372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.173873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.174378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.201073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57f15c7b-e238-406e-b6dd-259ce4d0fbe9 tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8/detail" status: 200 len: 672 microversion: 2.36 time: 0.209527 Nov 02 11:52:59.203545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 391/764] 10.222.0.48 () {60 vars in 1304 bytes} [Wed Nov 2 11:52:58 2022] GET /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8/detail => generated 672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:52:59.208815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:52:59.209880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:52:59.219390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.220107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.220760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.221779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.222302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.222836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.286375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:59.306729 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb2ea441-110a-42b2-a6ed-e15badf2c70d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1213 microversion: 2.1 time: 0.222070 Nov 02 11:52:59.307357 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 374/765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:59 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:59.323449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:52:59.348480 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-768ce922-e06a-4463-8c42-ccfc80c06577 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1259 microversion: 2.1 time: 0.142904 Nov 02 11:52:59.353920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 392/766] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:52:59 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:52:59.503586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b90765e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:59.582201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.582839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.583316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.584216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.584961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.585526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.679522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.680012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.680452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.682849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.683240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.685071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.729146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "322766fc-fbbc-426a-96e1-625a6e32ba38", "name": "network-vif-deleted", "tag": "215399ea-d67f-4238-8e58-f7e9e3818128"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:52:59.764556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:52:59.766015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:52:59.768832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:52:59.812359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] Creating event network-vif-deleted:215399ea-d67f-4238-8e58-f7e9e3818128 for instance 322766fc-fbbc-426a-96e1-625a6e32ba38 on n-h1-855649-4 Nov 02 11:52:59.819666 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-80f458a0-0d4b-4724-9fef-8cbdf7a5ad6b req-aba05549-54e6-4c0b-8146-4ef968cd407d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093213 Nov 02 11:52:59.823096 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 393/767] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:52:59.995690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2395766-70f9-488f-b245-eba6748caa4a tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8?user_id=f7d553e7001445e8a525ec6c122388ff" status: 200 len: 240 microversion: 2.36 time: 0.495915 Nov 02 11:52:59.999434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 375/768] 10.222.0.48 () {62 vars in 1384 bytes} [Wed Nov 2 11:52:59 2022] PUT /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8?user_id=f7d553e7001445e8a525ec6c122388ff => generated 240 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:00.009042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3642ffd-99ba-4da1-a2cb-4424d9def4ed tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] Calling method '.version_select at 0x7ff1b3981670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:00.016739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:00.019882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:00.029184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.031009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.033908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.033908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.033908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.033908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.278232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.288088 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-661f7a87-15aa-4955-96ec-59295ca2aed2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.277697 Nov 02 11:53:00.308227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 376/769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:00 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:00.313469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:00.314371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:00.321053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.321564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.322005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.323040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.323741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.324227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.357208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3642ffd-99ba-4da1-a2cb-4424d9def4ed tempest-QuotasAdminTestV236-1537886681 tempest-QuotasAdminTestV236-1537886681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8?user_id=f7d553e7001445e8a525ec6c122388ff" status: 200 len: 282 microversion: 2.36 time: 0.352843 Nov 02 11:53:00.358072 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 394/770] 10.222.0.48 () {60 vars in 1364 bytes} [Wed Nov 2 11:53:00 2022] GET /compute/v2.1/os-quota-sets/25847a1e3d404722a20c9c4ca03499c8?user_id=f7d553e7001445e8a525ec6c122388ff => generated 282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:00.365754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:00.373203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:00.382056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.382554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.383088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.386158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.386158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.386158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.530735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.543417 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-332f3897-3945-4cbc-9e14-49098472eab2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1269 microversion: 2.1 time: 0.182499 Nov 02 11:53:00.544005 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 395/771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:00 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:00.550932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:00.550932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:00.563676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.564474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.565925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.567643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:00.568369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:00.569405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:00.654242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.672022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.673552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.674780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7583ca16-43c4-4b27-a599-e360784aad19 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.365246 Nov 02 11:53:00.678424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 377/772] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:00 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:00.717751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:00.730090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-227564e1-ab4b-49d2-8d68-b0adcccd2ea6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1259 microversion: 2.1 time: 0.184725 Nov 02 11:53:00.731214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 396/773] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:00 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:01.316964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:01.317803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:01.325956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.326144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.326897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.327657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.328128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.328561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.496040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:01.527768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec3bef18-f915-4e64-b128-dc5950d93add tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.215307 Nov 02 11:53:01.529103 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 378/774] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:01 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:01.570529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:01.572349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:01.598476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.599220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.601163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.611489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.612357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.615711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.706706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:01.707455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:01.719470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.723945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.725954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.727451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.730752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.732952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.863389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:01.878096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6d7bad6-f074-4f5d-befe-83e49a41919b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1287 microversion: 2.1 time: 0.314956 Nov 02 11:53:01.880204 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 397/775] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:01 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1287 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:01.896876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:01.902130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:01.917220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.918214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.918874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:01.919973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:01.920596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:01.921239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:02.018821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:02.035261 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9375f936-0066-4473-8151-b3a86a2fbf07 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1315 microversion: 2.1 time: 0.150867 Nov 02 11:53:02.036360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 398/776] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:01 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:02.042667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-unplugged", "status": "completed", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:02.054870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:02.056531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:02.057299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:02.084813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:02.095449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:02.097162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:02.098621 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0357c621-ac04-4957-a53d-b0392ee951ca tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.397398 Nov 02 11:53:02.106161 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] Creating event network-vif-unplugged:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:53:02.109620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 379/777] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:01 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:02.117107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f123d7f7-1587-4406-8a51-8672e8dcd030 req-5ae23996-077f-4ed0-bdbf-18802dda23ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079133 Nov 02 11:53:02.119171 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 399/778] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:02.552611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:02.553535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:02.570325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:02.571615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:02.572424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:02.573905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:02.576245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:02.578380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:02.885973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:02.898444 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93255d59-23e7-457d-a22b-8c69330a0825 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.351164 Nov 02 11:53:02.915006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:02.915006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:02.917244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 380/779] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:02 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:02.924256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:02.929176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:02.932530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:02.933473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:02.933966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:02.934441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.218581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3c1b9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:03.357332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.357332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.357668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.358649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.359307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.360236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.489748 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f6a2e93-1868-4395-8bb3-83de1984aabe tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d" status: 200 len: 148 microversion: 2.57 time: 0.468861 Nov 02 11:53:03.494077 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 381/780] 10.222.0.48 () {62 vars in 1303 bytes} [Wed Nov 2 11:53:03 2022] PUT /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d => generated 148 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:53:03.506744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:03.506744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:03.511824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:03.514369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.514865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.515343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.516192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.516499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.516925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.529460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9c4b62a-4b23-4f35-bf22-bcf487b962d9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 0.628326 Nov 02 11:53:03.546247 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 400/781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:02 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:03.546247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:03.546247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:03.562082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.563500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.571826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.571826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.571826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.571826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:03.683307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:03.697363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b036a8ee-86cb-47e0-8d3d-c1e562ea3d56 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1321 microversion: 2.1 time: 0.199088 Nov 02 11:53:03.699679 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 382/782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:03 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:03.711696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Calling method '.version_select at 0x7ff1b3c64d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:03.940695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:03.955343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:03.957409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:03.960879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3239161b-01f6-4007-a378-229024cfedea tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.425948 Nov 02 11:53:03.964621 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 401/783] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:03 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:03.976688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:03.979552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:03.995400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:03.996249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:03.997055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.004384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.004384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.004384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.196856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.204901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.204901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.204901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.204901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.205866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.248527 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cc1e020-6595-40b2-8688-a4068e0c715d tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d/detail" status: 200 len: 463 microversion: 2.57 time: 0.547366 Nov 02 11:53:04.250306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 383/784] 10.222.0.48 () {60 vars in 1304 bytes} [Wed Nov 2 11:53:03 2022] GET /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d/detail => generated 463 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:04.429128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648e9260-1754-49ad-8222-b2a4f5e28247", "tag": "485eebf4-cf4a-4f27-b358-fecda0c6c23a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:04.443083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.443810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.444366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.472565 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] Creating event network-changed:485eebf4-cf4a-4f27-b358-fecda0c6c23a for instance 648e9260-1754-49ad-8222-b2a4f5e28247 on n-h1-855649-4 Nov 02 11:53:04.490703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:04.507430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c7a10682-e037-4755-a445-b77fa496fa62 req-68cdf30c-8bde-41e9-a52a-81c3a0da4efa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082322 Nov 02 11:53:04.509677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24da14c1-86d1-49e0-be36-1aada605cc9e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.538668 Nov 02 11:53:04.530419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 384/786] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:53:04.530560 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 402/786] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:03 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:04.556802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:04.557522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:04.565064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.569231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.569231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.569231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.569231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.569585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.691449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3a16550>, body: {"quota_set": {"ram": "2048"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:04.985530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.986127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.986452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:04.987763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:04.990593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:04.991599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.047749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=8,nova_api:INSERT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:05.104259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.105072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.105528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.106452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.108364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.110427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.496282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3adb1e21-818e-4753-a7af-806079c5629f tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d?user_id=b7bf242e06e54321809699fca68771a4" status: 200 len: 148 microversion: 2.57 time: 0.808766 Nov 02 11:53:05.507230 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 403/787] 10.222.0.48 () {62 vars in 1384 bytes} [Wed Nov 2 11:53:04 2022] PUT /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d?user_id=b7bf242e06e54321809699fca68771a4 => generated 148 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:05.514965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:05.515919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:05.529435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.530049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.530564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.531487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.531935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.532404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.701836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:05.714668 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4476f05-3de5-4200-be61-c3a77adbe3a6 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 1.164201 Nov 02 11:53:05.715280 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 385/788] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:04 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:05.723606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:05.724209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:05.731201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.731683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.732338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.733178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:05.733980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:05.734757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:05.744757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:05.755171 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-592fbf95-4cae-448d-902a-2f8db2e9d858 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1321 microversion: 2.1 time: 0.246478 Nov 02 11:53:05.756339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 404/789] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:05 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:05.777288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55040021-d5ff-410a-b601-9533cbdd1859 tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] Calling method '.version_select at 0x7ff1b80c1310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:06.433025 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55040021-d5ff-410a-b601-9533cbdd1859 tempest-QuotasAdminTestV257-956485360 tempest-QuotasAdminTestV257-956485360-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d?user_id=b7bf242e06e54321809699fca68771a4" status: 200 len: 190 microversion: 2.57 time: 0.661947 Nov 02 11:53:06.434660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 405/790] 10.222.0.48 () {60 vars in 1364 bytes} [Wed Nov 2 11:53:05 2022] GET /compute/v2.1/os-quota-sets/83acae1845b945fb9ea08a8633e4990d?user_id=b7bf242e06e54321809699fca68771a4 => generated 190 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:06.453032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:06.467887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:06.490180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:06.490623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:06.491100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:06.495586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:06.495586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:06.495586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:06.505796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:06.520415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:06.529980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:06.542171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-392c0f08-0ab2-4c11-a781-84776f72f249 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.820626 Nov 02 11:53:06.544405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 386/791] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:05 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:06.870190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1931762850", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:06.920692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:06.935214 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2512b6bb-87df-4862-82ad-97754c2e75a9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.496365 Nov 02 11:53:06.937387 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 406/792] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:06 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:06.945914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:06.947122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:06.972266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:06.986348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:06.986875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:06.987852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:06.988118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:06.988548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:07.004922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:53:07.392447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:07.395099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:07.403246 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a68c39ab-a0a4-4f52-8ecf-1e5be792b564 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 0.464632 Nov 02 11:53:07.424167 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 407/793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:06 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:07.440903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:07.443351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:07.466187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:07.468986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:07.476452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:07.476452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:07.476452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:07.477690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:07.837270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:07.837853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:07.840382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:07.840803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:07.841231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:07.848580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:07.853631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:07.854443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:07.855070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:07.856010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:07.856758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:07.857377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:07.877221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Getting quotas for project cfcdc9b8fd4f4c27b3e9bd3ba453df2b. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:07.882701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Getting quotas for user 57bdea337b67423490859b82924ba604 and project cfcdc9b8fd4f4c27b3e9bd3ba453df2b. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:07.897959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:07.901879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:08.049719 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb1d7c99-b364-4d08-96ea-13c359291230 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443417 Nov 02 11:53:08.050939 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 387/794] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:53:08.056365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:08.057157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:08.060614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:08.065275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.065971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.066568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.067496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.068104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.076185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.259820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.276033 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6f424af-f767-4076-b928-fef5cde9ffbb tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.847723 Nov 02 11:53:08.276652 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 408/795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:07 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:08.288158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:08.294952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:08.315482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.316012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.317554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.320238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.322378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.326771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.771064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.782750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.784495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.787052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2db434d-4104-4487-b667-0ffa752811a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.734971 Nov 02 11:53:08.790849 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 388/796] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:08 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:08.798752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-751f8c42-6fc4-4e8b-b650-5e1b60b4bc72 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:08.799531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-751f8c42-6fc4-4e8b-b650-5e1b60b4bc72 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:08.841429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.849437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9eafef19-b9ef-43c2-a00e-607dfbfe393f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.568673 Nov 02 11:53:08.852636 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 409/797] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:08 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:08.857462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-plugged", "status": "completed", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:08.894522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.899687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.900663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.929487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] Creating event network-vif-plugged:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:53:08.935144 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6691ddfa-af69-4bd9-a25c-e400f126d36c req-fc027e4c-536e-443d-b4b4-7316708247b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081029 Nov 02 11:53:08.936064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 410/798] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:08.941367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:08.942375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:08.954546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.955404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.957164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-751f8c42-6fc4-4e8b-b650-5e1b60b4bc72 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:08.958191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.963989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:08.963989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:08.963989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:08.989765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-751f8c42-6fc4-4e8b-b650-5e1b60b4bc72 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1223 microversion: 2.1 time: 0.197747 Nov 02 11:53:08.998414 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 389/799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:08 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1223 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:09.304351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:09.304969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:09.316823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.317551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.318160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:09.319073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.319687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.320275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:09.543296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:09.553693 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c5bc2f8-e6a1-489b-a0c7-84b049dee83f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 0.616216 Nov 02 11:53:09.556303 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 411/800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:08 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:09.819862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:09.821371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:09.829505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.832264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.833078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:09.834420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.835238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.835681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:09.838939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:09.852997 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d46aa983-6cf9-4f1e-a3eb-1ddfda5612b7 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.551285 Nov 02 11:53:09.854227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 390/801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:09 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:09.877275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:09.878360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:09.889246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.889754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.890195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:09.890917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:09.891404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:09.896053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.497372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.507096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.513222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.516093 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6d0dab1-d60d-4f52-971b-b958b3371ee6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1566 microversion: 2.25 time: 0.703004 Nov 02 11:53:10.519177 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 412/802] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:09 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1566 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:10.549625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:10.554436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:10.570009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.570502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.571090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.571765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.572225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.573691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.613237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.622208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8eb78bcc-2f26-4c4c-9ca0-fc9349c719b5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1478 microversion: 2.1 time: 0.748924 Nov 02 11:53:10.624476 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 391/803] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:09 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1478 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:10.629532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:10.634108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:10.636523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.637136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.637870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.638862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.639425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.639923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.663505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.681709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b14ad8c3-6c50-4e8a-931e-37ee2061adaf tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1227 microversion: 2.1 time: 0.161099 Nov 02 11:53:10.682961 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 413/804] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:10 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:10.696897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e12fdc4-11a1-4993-a2ae-623d8aca991d", "tag": "1498a22a-1827-4556-bb14-b4d1af271888"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:10.706857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.707383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.707821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.718970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] Creating event network-changed:1498a22a-1827-4556-bb14-b4d1af271888 for instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d on n-h1-855649-4 Nov 02 11:53:10.724413 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-45d4c2a9-4374-4f18-b7df-fda0cc33a238 req-30d60437-0c8f-40ba-b672-84f7c5478817 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039679 Nov 02 11:53:10.728812 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 414/805] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:10.874491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:10.889213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4a3a089-5c4a-4763-8bfd-3775744cf02c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 0.261603 Nov 02 11:53:10.901670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:10.901670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:10.907061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 392/806] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:10 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:10.919923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.920506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.921018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:10.921971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:10.922503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:10.923033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.046368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648e9260-1754-49ad-8222-b2a4f5e28247", "name": "network-vif-plugged", "status": "completed", "tag": "485eebf4-cf4a-4f27-b358-fecda0c6c23a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:11.060828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.061509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.062419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.075510 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] Creating event network-vif-plugged:485eebf4-cf4a-4f27-b358-fecda0c6c23a for instance 648e9260-1754-49ad-8222-b2a4f5e28247 on n-h1-855649-4 Nov 02 11:53:11.084012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-33e27bfe-773a-481c-8bba-07838ed2b92b req-d0ea0499-9771-4eda-b53d-627edc78d9d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040482 Nov 02 11:53:11.086827 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 393/807] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:53:11.318610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:11.331490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fe2b490-19f2-4f37-944d-66303ec0726b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.447393 Nov 02 11:53:11.352935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 415/808] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:10 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:11.548190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:11.548982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:11.563509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.564233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.564701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.565741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.566283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.566880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.790090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-31000286", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:11.811744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:11.847693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:11.849435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:11.850831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d12a4ff7-8f31-424f-95d2-53c82d431e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1541 microversion: 2.25 time: 0.307602 Nov 02 11:53:11.852968 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 416/809] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:11 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:11.859420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:11.860573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:11.866855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.867396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.868016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.868745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.869377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.869817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.885649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:11.886474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:11.887194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:11.887836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:11.889337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:11.902266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.903100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.903771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.904710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:11.905428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:11.906660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:11.930911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Getting quotas for project 71eb96678e854fa79fd541da1b5b2815. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:11.937454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Getting quotas for user 496980ce473d4c0abcc8ca47ee949ef7 and project 71eb96678e854fa79fd541da1b5b2815. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:11.954196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:11.957177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:12.036416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.044347 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3cd4b45-924a-413e-9bd8-73e307141701 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1464 microversion: 2.1 time: 0.189206 Nov 02 11:53:12.044984 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 417/810] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:11 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:12.049448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.050061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.057432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.057970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.058417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.059283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.063335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.063335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.122780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47b29fd4-e649-47b3-b4fd-a939003067a4 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.660170 Nov 02 11:53:12.125239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 394/811] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 11:53:12.130861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95a909b6-f8fd-4d26-a256-4701506f0942 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '.version_select at 0x7ff1b3c64c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.149277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a909b6-f8fd-4d26-a256-4701506f0942 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.151568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a909b6-f8fd-4d26-a256-4701506f0942 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.152933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a909b6-f8fd-4d26-a256-4701506f0942 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.153602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.164705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf1fab8e-d271-4b6d-aba2-984ee0eaac71 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1275 microversion: 2.1 time: 0.118582 Nov 02 11:53:12.167362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 418/812] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:12.172121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.173006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.173939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95a909b6-f8fd-4d26-a256-4701506f0942 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.047328 Nov 02 11:53:12.179455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.183607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.184444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.186124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.186735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.187381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.187562 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 395/813] 10.222.0.48 () {60 vars in 1184 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:12.199658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.200288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.216971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.217688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.218166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.218927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.219620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.220065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.428667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.438715 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fa0d5e8-a83d-4b5b-8020-43cfb055f8e4 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1317 microversion: 2.1 time: 0.270108 Nov 02 11:53:12.439359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 419/814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:12.444860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:12.448439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.460230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.462301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:12.468943 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-788d1141-de22-4894-98fb-b1e9b49be4f3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1464 microversion: 2.1 time: 0.279367 Nov 02 11:53:12.469516 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 396/815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:12.473901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.474643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.481269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.481992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.482652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.483924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.484459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.485048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.539198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.548133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.549699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.556642 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-403fd454-c3d3-4ef0-92da-02484a940d58 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "PUT /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1357 microversion: 2.75 time: 0.116172 Nov 02 11:53:12.558668 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 420/816] 10.222.0.48 () {62 vars in 1297 bytes} [Wed Nov 2 11:53:12 2022] PUT /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:12.573085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.573085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.573085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.573085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.573489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.573489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.573489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.573489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.706922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:12.722034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44379bda-e2c7-4a20-8281-3e28d0ed958a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 2033 microversion: 2.25 time: 0.250687 Nov 02 11:53:12.723034 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 397/817] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 2033 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:12.728261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:12.731128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.751263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.753000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.755984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.756753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:12.757221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:12.757650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:12.780024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.788555 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d4ac3c0-6b06-4d6c-8927-91c47dd8da2a tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.230114 Nov 02 11:53:12.790183 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 421/818] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:12.795161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:12.796190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:12.859245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:12.859693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:12.860147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:12.860565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:12.860982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:12.869186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.879403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.881088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:12.890535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a84473e-5206-4cac-afcd-d7dab1b50945 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1357 microversion: 2.75 time: 0.096690 Nov 02 11:53:12.890535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 422/819] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:12 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:12.893909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-317f75b9-e06e-48c0-849f-83829c973313 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: .version_select at 0x7ff1b362a700>, body: {"keypair": {"name": "tempest-keypair-659397333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ98mAhJX+PbZ5b2Q/xDsLyiaoDg/nUEu71IDqm9CP5BqD0CxtRROpcFOK8Tn9T7+sXfOLxc5kdVGK6nSMkprNbAyX4aQhm8vZ6HW2xFdsYg0esxSVAcfeEQDK84ckZRw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:12.911683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-317f75b9-e06e-48c0-849f-83829c973313 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for project 7b4127e1b3c0429690c7d1905258e750. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:12.917106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-317f75b9-e06e-48c0-849f-83829c973313 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for user 7827c83ee4674362bab55ca9c40d16fb and project 7b4127e1b3c0429690c7d1905258e750. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:13.022926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-317f75b9-e06e-48c0-849f-83829c973313 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.132574 Nov 02 11:53:13.024635 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 423/820] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 11:53:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 11:53:13.192039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.195496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.196683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.198565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.199092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.199533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.200251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.200717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.201208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.203561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.204054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.204494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.205334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.205953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.206592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.233413 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2106bb9-1c7b-40b1-b050-dd77747e02c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 1068 microversion: 2.1 time: 0.509007 Nov 02 11:53:13.234224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 398/821] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:53:12 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 1068 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 11:53:13.257301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.258217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.265209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.265958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.266949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.268133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.268816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.269456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.287246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:13.299563 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ffd579d-b082-44e2-8855-64cc1b2dd6d3 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1275 microversion: 2.1 time: 0.109570 Nov 02 11:53:13.311154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 424/822] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:13.440172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:13.448462 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8539ff81-27a0-45dd-bb17-b3c2fd4f8471 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.195527 Nov 02 11:53:13.449039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 399/823] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:13.463647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.464469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.470411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.470914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.471401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.472137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.472597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.473029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.611794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:13.620815 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a98e4b5-a815-4a72-9153-01bd6ae385ee tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1466 microversion: 2.1 time: 0.161221 Nov 02 11:53:13.621391 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 425/824] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:13.643226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.643836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.650357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.650838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.651302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.651995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.652445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.652866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.793272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7374fe45-a129-40f3-9f0d-d61547930126 tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1617 microversion: 2.1 time: 0.153838 Nov 02 11:53:13.793931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 400/825] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1617 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:13.813892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.814952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.827421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.827989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.828483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.829259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.829774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.830249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.916348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:13.916965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:13.925312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.934225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.934752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.936401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:13.938073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:13.938673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:13.995939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:14.005276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-896460ec-7898-4350-9524-682c9519a415 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.195476 Nov 02 11:53:14.006221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 426/826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:14.011904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-229303424", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "79f01c5e-3ef8-4f56-affe-03b6962a8975"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:14.084363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:53:14.143537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:14.154007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:14.156363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:14.182386 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdeef3f2-bc9e-49a1-8343-2d889db51716 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1361 microversion: 2.75 time: 0.269957 Nov 02 11:53:14.184034 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 401/827] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:13 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:14.372585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:14.373082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:14.373633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:14.374176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:14.374708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:14.381660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e66283f-d2c0-42de-88d5-fa8163a1ad42 tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] Action: 'create', calling method: .version_select at 0x7ff1b909c4c0>, body: {"security_group": {"name": "tempest-securitygroup-2097500772", "description": "tempest-description-2128287609"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:14.385602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.391099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.391099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.391099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.391099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.391452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.405742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:14.411526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Getting quotas for user a56e86810c96430a9db812bdeb895c42 and project e43d4aa3b5a443cab0e019f12fad6d0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:14.415572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:14.428662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:14.431473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:14.598637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4beb2f1-55fd-465d-baf2-f9cacc41e908 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590995 Nov 02 11:53:14.599813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 427/828] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:53:14.605665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:14.606473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:14.616013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.618001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.619753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.623184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.624955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.626452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.788229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:14.799562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78014b27-719f-469b-963b-5531f0083979 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1283 microversion: 2.1 time: 0.198392 Nov 02 11:53:14.800344 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 428/829] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:14 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:14.823137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:14.823887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:14.841488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.843366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.843852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.844547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:14.847157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:14.847608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:14.873218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:15.149057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.160838 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc97986b-80d0-4f48-b669-b2fea0f12876 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.348466 Nov 02 11:53:15.161774 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 429/830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:14 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:15.166749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28e65b52-21f8-42b2-9a9f-adc3d0376ca7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:15.167485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28e65b52-21f8-42b2-9a9f-adc3d0376ca7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:15.236053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28e65b52-21f8-42b2-9a9f-adc3d0376ca7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.245611 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28e65b52-21f8-42b2-9a9f-adc3d0376ca7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1216 microversion: 2.1 time: 0.082557 Nov 02 11:53:15.258151 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 430/831] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:15 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:15.265521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:15.266154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:15.274493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.275194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.275714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:15.276576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.277298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.278114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:15.560525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e66283f-d2c0-42de-88d5-fa8163a1ad42 tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.375245 Nov 02 11:53:15.561835 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 402/832] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:53:14 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:15.567278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:15.567981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:15.591543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.592069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.592507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:15.593217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.593669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.594089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:15.604247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.616215 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19dc0015-f9ac-4ed7-b1a5-49e2332857a1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.355183 Nov 02 11:53:15.618146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 431/833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:15 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:15.623295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3149ba45-2c28-4a61-82d8-2a9d85eb18a4 tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] Action: 'create', calling method: .version_select at 0x7ff1b82ceca0>, body: {"security_group": {"name": "tempest-securitygroup-1856432173", "description": "tempest-description-933811456"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:15.716258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.733774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.735549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:15.740815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6497953d-f2c7-4b7e-855d-cee61e3c0ac3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1409 microversion: 2.75 time: 0.177713 Nov 02 11:53:15.741415 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 403/834] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:15 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1409 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:15.825717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:15.826362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:15.832832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.833317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.833755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:15.834446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:15.834901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:15.835357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.132045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:16.150666 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2907e473-419c-4e08-8a26-94196c803080 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.329567 Nov 02 11:53:16.157713 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 404/835] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:15 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:16.190215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:16.192382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:16.201461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.202193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.202912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.203887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.204451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.205033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.345671 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3149ba45-2c28-4a61-82d8-2a9d85eb18a4 tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.726022 Nov 02 11:53:16.348411 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 432/836] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:53:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:16.356440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:16.359256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:16.371552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.372796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.373619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.375696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.376718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.377458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.402843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:16.415726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97aa6759-a39e-4e5e-a27f-916d8230b557 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.229749 Nov 02 11:53:16.417302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 405/837] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:16 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:16.498281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:16.503863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9848e5f4-828d-4d76-a621-484dde7b29fc tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] Action: 'create', calling method: .version_select at 0x7ff1b3e37ca0>, body: {"security_group": {"name": "tempest-securitygroup-194234288", "description": "tempest-description-692065272"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:16.513461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b9b36d2-147c-41d1-801a-653e61a5d47f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1220 microversion: 2.1 time: 0.163303 Nov 02 11:53:16.519514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 433/838] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:16 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:16.649812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:16.653346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:16.663872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.665315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.666623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.668471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.669648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.670558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.952789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:16.965588 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2afb487-416e-46ad-a1fe-27898b9d2a34 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.322840 Nov 02 11:53:16.966832 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 434/839] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:16 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:16.972793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:16.974618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:16.983319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.984431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.985260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:16.986278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:16.986923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:16.994294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.110307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:17.121536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:17.123674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:17.142668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57f27d8a-08fa-4faa-8916-59c7422d8adb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.174465 Nov 02 11:53:17.145116 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 435/840] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:16 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:17.183909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:17.184672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:17.195474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:17.200978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:17.201464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.202170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:17.202636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:17.205480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.385007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:17.393410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-723012ab-1b34-4cce-b790-8d3e4fa46644 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.215443 Nov 02 11:53:17.393998 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 436/841] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:17 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:17.398551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-307061764", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "1e42d025-6f92-4be4-aebf-e40b0c181c05"}], "security_groups": [{"name": "tempest-securitygroup--1510112354"}], "key_name": "tempest-keypair-659397333", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:17.468178 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9848e5f4-828d-4d76-a621-484dde7b29fc tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.049667 Nov 02 11:53:17.477947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 406/842] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:53:16 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:17.478155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:17.479090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:17.485471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:17.485994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:17.486540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.487263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:17.487726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:17.488156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.523552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] validate_networks() for [('1e42d025-6f92-4be4-aebf-e40b0c181c05', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:53:17.694421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:17.704826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9c18c7f-a4b5-4bec-ae46-7b24c8c89943 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.232839 Nov 02 11:53:17.705631 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 407/843] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:17 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:17.710327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd6af0e-6a91-485d-8485-bd3e1584b265", "tag": "eb2e2c5b-ba44-4661-b975-a7e938984621"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:17.720501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:17.721180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:17.721613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:17.734697 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] Creating event network-changed:eb2e2c5b-ba44-4661-b975-a7e938984621 for instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 on n-h1-855649-4 Nov 02 11:53:17.740216 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-56970f72-9257-424c-bbd8-62f9f636460d req-2728f0b6-55cb-4615-9b72-e94e0af0491f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033094 Nov 02 11:53:17.740875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 408/844] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:17.746900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f16bfe4-59e8-4cd0-85c9-840471fb6c36 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] Action: 'create', calling method: .version_select at 0x7ff1b3989dc0>, body: {"security_group": {"name": "tempest-securitygroup-686155334", "description": "tempest-description-1271228826"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:18.022117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:18.022745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:18.023492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:18.024635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:18.025175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:18.033559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=55,nova_cell0:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:18.036250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.036839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.037378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.038299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.038862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.039469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.058651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:18.065174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for user 7827c83ee4674362bab55ca9c40d16fb and project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:18.079064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:18.081394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:18.368996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c746163-c9f3-49e8-8ba9-27e7ae884238 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.973937 Nov 02 11:53:18.376673 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 437/845] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:53:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:53:18.376673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.376673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.382360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.382861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.383380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.384091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.384551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.384989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.415322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f16bfe4-59e8-4cd0-85c9-840471fb6c36 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.672327 Nov 02 11:53:18.416179 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 409/846] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 11:53:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:18.424552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.424552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.442544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.444686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.445328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.448712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.449201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.452359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.471824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.480781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea094c4f-6b62-4ce5-b1b9-23085c34bbc8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1276 microversion: 2.1 time: 0.109515 Nov 02 11:53:18.480781 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 438/847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:18.495383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.495383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.495383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.495383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.495736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.495736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.496106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.496462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.585030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.589486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.591199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.596269 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23b8f080-0aa0-44a9-bbe6-4dfc54326878 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.114350 Nov 02 11:53:18.611008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 439/848] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:18.611008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.611008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.628751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.638357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f70c1cdd-402c-4b2c-9d8a-f60ca8edee4e tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.221039 Nov 02 11:53:18.643314 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 410/849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:18.652992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.653537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.660074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.660580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.661829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.662864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.663342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.663790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.663966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.672206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.673669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.675196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d80bb5a3-197e-45e9-828b-75ed3418fefc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1284 microversion: 2.25 time: 0.076846 Nov 02 11:53:18.675762 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 440/850] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1284 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:18.684907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-116d4978-b08a-423b-ba1f-fe6b5ace777c tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] Calling method '.version_select at 0x7ff1b35cc670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.885817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:18.893983 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f77acff-a9e6-4069-8c70-bb289757e124 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.245736 Nov 02 11:53:18.894803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 411/851] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:18.899592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:18.900204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:18.906041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.907146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.907146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:18.907889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:18.908348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:18.908776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.368865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:19.378133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78f6ff5a-c83e-47fe-a52e-a270f2d4d2a2 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.482033 Nov 02 11:53:19.378993 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 412/852] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:19.384432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e12fdc4-11a1-4993-a2ae-623d8aca991d", "name": "network-vif-plugged", "status": "completed", "tag": "1498a22a-1827-4556-bb14-b4d1af271888"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:19.395317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.396076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.396769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.411744 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] Creating event network-vif-plugged:1498a22a-1827-4556-bb14-b4d1af271888 for instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d on n-h1-855649-4 Nov 02 11:53:19.422750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a33fe04e-4905-40da-ac95-adb7540f4856 req-46e2ffb0-f741-4b3b-a286-af10c52b2b4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042060 Nov 02 11:53:19.423686 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 413/853] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:19.507175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:19.509286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:19.516490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.517011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.517455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.518249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.518716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.519483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.614575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:19.626451 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72278fa8-9310-492a-aac9-4a650db82f3c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1276 microversion: 2.1 time: 0.124596 Nov 02 11:53:19.627492 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 414/854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:19 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:19.646611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:19.647349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:19.653646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.654233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.654749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.655613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.656187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.657202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.674085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:19.748020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:19.761610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:19.763089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:19.768565 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f38fe13-d72d-420e-b7a1-6022bd52bea7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.129703 Nov 02 11:53:19.769147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 415/855] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:19 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:19.790944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:19.790944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:19.796672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.797177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.797624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.798398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:19.798786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:19.799245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:19.995401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.005192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a07f9323-426c-42d2-a49e-68fe69b88fe1 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.220709 Nov 02 11:53:20.005876 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 416/856] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:19 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:20.028504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:20.031815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:20.036830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.037359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.037808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.038524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.039011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.039445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.120636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.133401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.134860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.136019 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e58e31f0-370e-4e3d-ae78-eb3d4bcd96ed tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1288 microversion: 2.25 time: 0.128911 Nov 02 11:53:20.137928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 417/857] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:20 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:20.141411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:20.142022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:20.148728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.149439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.150066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.150815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.151441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.152021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.340431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.349341 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b3dd68a-d77d-42c9-93e7-5088ca8585f7 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.211718 Nov 02 11:53:20.349954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 418/858] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:20 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:20.407459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:20.408126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:20.415700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.416195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.416635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.417337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.417798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.418227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.627745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.645083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10158f25-ad55-4071-89b5-91bfdb5d0c5c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.241200 Nov 02 11:53:20.645900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 419/859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:20 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:20.651360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:20.652714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:20.658884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.659440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.659882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.660588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.661044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.661473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.751237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.759854 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c971785-68ae-40e1-8e6e-f5c5fc8feab5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1276 microversion: 2.1 time: 0.112765 Nov 02 11:53:20.760465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 420/860] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:20 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:20.798878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:20.799541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:20.805635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.806136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.806564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.807349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:20.807809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:20.808236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:20.883961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.893057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.894590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:20.901096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b8fca9c-180d-423d-b7aa-992e397a3107 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.106159 Nov 02 11:53:20.901790 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 421/861] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:20 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:21.030924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.031946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:21.037752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.038243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.038728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.039497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.039948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.040371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.232620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.241654 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa2cb79a-af8d-485b-8d37-3c099e0f5d31 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1389 microversion: 2.1 time: 0.215845 Nov 02 11:53:21.255083 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 422/862] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1389 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:21.255083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.255484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:21.261982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.262570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.263031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.263750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.264222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.264655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.355697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.369058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.372927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.377474 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b64836b-b5e2-4508-8316-10373d45d3be tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1336 microversion: 2.25 time: 0.124034 Nov 02 11:53:21.377474 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 423/863] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:21.380343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.381232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:21.387699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.388186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.388825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.389531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.389982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.390401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.422003 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-116d4978-b08a-423b-ba1f-fe6b5ace777c tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12985 microversion: 2.1 time: 2.744525 Nov 02 11:53:21.424790 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 441/864] 10.222.0.48 () {58 vars in 1191 bytes} [Wed Nov 2 11:53:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12985 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:21.449893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d517758-018d-4465-abec-59246acaacac tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] Calling method '.version_select at 0x7ff1b3638c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.594716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.603367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3cc0083-409d-4c22-bc14-f46277e6db6a tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.227133 Nov 02 11:53:21.603946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 424/865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:21.670487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.671931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:21.678087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.678697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.679243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.680639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:21.681173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:21.681693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:21.700015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d517758-018d-4465-abec-59246acaacac tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.253148 Nov 02 11:53:21.700764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 442/866] 10.222.0.48 () {58 vars in 1191 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:21.715711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c9f6790-a072-42fa-b10e-414017d9ee16 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] Calling method '.version_select at 0x7ff1b3595670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:21.915880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:21.947460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=13 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:21.967758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:21.983161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06f952c4-b6aa-4c0d-a914-6eea70e99c2d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.316149 Nov 02 11:53:21.984628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 425/867] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:22.001170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.001914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.010222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.010222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.010850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.011659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.012433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.012871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.115775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.127376 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc5ce185-9721-4b57-9ecb-e07af7e7212b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1276 microversion: 2.1 time: 0.139948 Nov 02 11:53:22.142544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 426/868] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:21 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:22.147816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.149153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.155500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.156196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.156639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.157498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.157958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.158473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.228298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.238434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.242524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.243167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:22.244115 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c9f6790-a072-42fa-b10e-414017d9ee16 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3fd2a1ea-88a9-451e-b7b6-d87c0d1344bf" status: 202 len: 0 microversion: 2.1 time: 0.531980 Nov 02 11:53:22.244718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 443/869] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:53:21 2022] DELETE /compute/v2.1/os-security-groups/3fd2a1ea-88a9-451e-b7b6-d87c0d1344bf => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:53:22.249906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8130009a-0e3a-49d6-b69d-f4a224b29482 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.108758 Nov 02 11:53:22.251029 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 427/870] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:22 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:22.252770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4aae03f-5c65-43a7-af49-c2c49141db10 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] Calling method '.version_select at 0x7ff1b3595c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.276714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.277345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.303723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.304175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.307794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.308595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.309077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.309527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.550905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.564185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a156cea1-0f44-4ed7-ade3-bae65da97565 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1589 microversion: 2.1 time: 0.299684 Nov 02 11:53:22.579779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 428/871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:22 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1589 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:22.600477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.601258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.614461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.619392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.620115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.624835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.625605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.626256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.706270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.715430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.716866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:22.717969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb872b9b-8c8d-4c26-8baa-f272527a3ba8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1354 microversion: 2.25 time: 0.137079 Nov 02 11:53:22.718985 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 429/872] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:22 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:22.723978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.724128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.739364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.739985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.740504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.741450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.741988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.742938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.767151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4aae03f-5c65-43a7-af49-c2c49141db10 tempest-SecurityGroupsTestAdminJSON-914823929 tempest-SecurityGroupsTestAdminJSON-914823929-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/bacc313f-fb35-422f-a7b1-f4ca8600b473" status: 202 len: 0 microversion: 2.1 time: 0.516529 Nov 02 11:53:22.768698 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 444/873] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:53:22 2022] DELETE /compute/v2.1/os-security-groups/bacc313f-fb35-422f-a7b1-f4ca8600b473 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:53:22.777953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:22.778829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:22.789154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.790704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.791369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.792931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:22.793564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:22.794161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:22.861787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48c618ce-8ee7-4c5b-b6c8-480987812e5c tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141148 Nov 02 11:53:22.870360 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 430/874] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:53:22 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:22.874776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a227126-4611-404a-841d-46012d6702cb tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] Calling method '.version_select at 0x7ff1b399b1f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.078457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.087981 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42752170-c7ce-447d-970c-6d1189c8a8d8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.317848 Nov 02 11:53:23.089156 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 445/875] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:22 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:23.095043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.095849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:23.102745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.103622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.104211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.107710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.107710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.107710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.386944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.396103 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef15bdc1-6fbd-4af8-9837-e0e895f3aaa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.304966 Nov 02 11:53:23.396848 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 446/876] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:23 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:23.402859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.403717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:23.410292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.410865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.411398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.412269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.412938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.413538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.463780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a227126-4611-404a-841d-46012d6702cb tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/61c05f1a-5f9b-47b0-8a8f-dde7e4245630" status: 202 len: 0 microversion: 2.1 time: 0.599160 Nov 02 11:53:23.464419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 431/877] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:53:22 2022] DELETE /compute/v2.1/os-security-groups/61c05f1a-5f9b-47b0-8a8f-dde7e4245630 => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:53:23.470394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.471034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:23.495480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.495980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.496425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.497141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.497599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.498018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.647616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.658338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.667182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.685807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88486a66-0ba0-4444-a27d-174edcf752d9 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1415 microversion: 2.75 time: 0.210942 Nov 02 11:53:23.686542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 432/878] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:23 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1415 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:23.701993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72b1f6fc-118e-4054-acb7-59999635f13e tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] Calling method '.version_select at 0x7ff1b399b3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.725087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:23.738605 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b340944c-40b7-40d8-922d-a42f21086b08 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.340106 Nov 02 11:53:23.758617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 447/879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:23 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:23.764978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:23.767004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:23.791985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.791985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.791985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:23.791985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:23.792858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:23.792858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:24.119009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:24.127971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:24.129750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:24.131405 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d7cca9b-3836-49dc-8532-67bbaaea591c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.371305 Nov 02 11:53:24.132132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 448/880] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:23 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:24.157571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1219479967", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5016f7ec-e46f-43d9-bbf4-bc3c8fccc142"}], "security_groups": [{"name": "tempest-securitygroup--1478829584"}], "key_name": "tempest-keypair-754306462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9f160140-e21b-42af-9084-4c28f0ae5189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:24.372323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] validate_networks() for [('5016f7ec-e46f-43d9-bbf4-bc3c8fccc142', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:53:24.401592 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72b1f6fc-118e-4054-acb7-59999635f13e tempest-SecurityGroupsTestAdminJSON-1708449872 tempest-SecurityGroupsTestAdminJSON-1708449872-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d5270905-dab3-42da-86ed-5564422271b0" status: 202 len: 0 microversion: 2.1 time: 0.709781 Nov 02 11:53:24.402958 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 433/881] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:53:23 2022] DELETE /compute/v2.1/os-security-groups/d5270905-dab3-42da-86ed-5564422271b0 => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:53:24.427368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:24.428255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:24.462579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:24.464609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:24.467435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:24.470537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:24.471217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:24.477668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:24.517610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:24.838761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:24.848042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e866a84-9b8c-41bb-a272-ddfa234760e9 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.442892 Nov 02 11:53:24.861126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 434/882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:24 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:24.869557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:24.870437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:24.877849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:24.879127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:24.879780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:24.884849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:24.893291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:24.894482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.251325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:25.259886 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b749b8ec-275b-49e5-97f4-37096c08974d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.409954 Nov 02 11:53:25.267540 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 435/883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:24 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:25.273121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:25.278495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:25.297137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.297644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.298085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.303356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.305652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.306330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.438793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:25.445137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for user 9adf6d939b944575a9320a21e331ce34 and project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:25.449334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:25.469642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:25.472965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:25.476088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:25.479087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:25.479760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:25.480406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:25.481691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad281ac4-65c3-4b27-9b01-225c8db2b01f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1436 microversion: 2.75 time: 0.212467 Nov 02 11:53:25.483194 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 436/884] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:25 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1436 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:25.488390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:25.489255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:25.491775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:25.506930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.506930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.506930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.506930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.507330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.507330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.517339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.523958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.524611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.525436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.525907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.526338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.564292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:25.571401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Getting quotas for user 9adf6d939b944575a9320a21e331ce34 and project bcdaa2663aca442eb46cc53a7d2aee4f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:25.657570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:25.661307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f160140-e21b-42af-9084-4c28f0ae5189',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:25.810123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:25.818290 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c3b6495-39b7-48a8-862a-32d7f05aed32 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.333562 Nov 02 11:53:25.820049 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 437/885] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:25 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:25.845380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd6af0e-6a91-485d-8485-bd3e1584b265", "name": "network-vif-plugged", "status": "completed", "tag": "eb2e2c5b-ba44-4661-b975-a7e938984621"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:25.858463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.859231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.860169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.872048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] Creating event network-vif-plugged:eb2e2c5b-ba44-4661-b975-a7e938984621 for instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 on n-h1-855649-4 Nov 02 11:53:25.878131 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5e09e888-72e7-482f-a8c1-9b4404d51558 req-14a15170-a39a-4508-8ae6-eb96031c12d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043700 Nov 02 11:53:25.878855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 438/886] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:25.885644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:25.889916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:25.897734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.898283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.899329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:25.901771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:25.908070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:25.909839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.163484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be0ccb75-0b86-4f96-b37f-1a497250bca7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.013381 Nov 02 11:53:26.166180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 449/887] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:53:24 2022] POST /compute/v2.1/servers => generated 407 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:53:26.176556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:26.191015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:26.209287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.210015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.212248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.217102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.218064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.219747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.568453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:26.584626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:26.587159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:26.588678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a472d6c-42f1-4c82-80b6-52cbaf939a31 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.708149 Nov 02 11:53:26.589302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 439/888] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:25 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:26.594819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e12fdc4-11a1-4993-a2ae-623d8aca991d", "tag": "1498a22a-1827-4556-bb14-b4d1af271888"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:26.606851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.607631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.608072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.622919 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] Creating event network-changed:1498a22a-1827-4556-bb14-b4d1af271888 for instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d on n-h1-855649-4 Nov 02 11:53:26.627966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-042f5e40-0eb0-4107-ab16-d8518883ea33 req-2341f0f0-0ffa-4eaf-94c1-f8fa790a0ff3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037346 Nov 02 11:53:26.629021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 440/889] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:26.635302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:26.638338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:26.644634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.645125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.645730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.647241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.647882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.648707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.776357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:26.779331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:26.779854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:26.780274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:26.780695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:26.850687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:26.861604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2573d72-6c77-4bc2-bb21-5bdcb621c160 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1589 microversion: 2.1 time: 0.693825 Nov 02 11:53:26.875464 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 450/890] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:26 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1589 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:26.885107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:26.885869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:26.892105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.892683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.893341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:26.894049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:26.894658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:26.895139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.089813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.102479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.108454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.108959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.109504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.110224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.110684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.111175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.112506 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea69f37b-8a12-4072-b044-6e9025a70895 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.235513 Nov 02 11:53:27.113819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 451/891] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:26 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:27.120503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9821ea1-aa3e-4089-a23c-abb5073f6d9e", "tag": "eb76a1a4-12a5-4aa6-8153-52ab5cde950b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:27.131669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.132228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.134852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.145948 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] Creating event network-changed:eb76a1a4-12a5-4aa6-8153-52ab5cde950b for instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e on n-h2-855649-4 Nov 02 11:53:27.151926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-95f7db3b-d0be-400b-bc97-10cac2c38c3c req-480e90c2-4664-47fa-880b-f7e2bf83604a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036561 Nov 02 11:53:27.152863 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 452/892] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:27.158217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d301b07f-66d4-4ec1-94a8-8357d21a5e47 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:27.159151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d301b07f-66d4-4ec1-94a8-8357d21a5e47 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.214037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.228519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.229956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.236794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d2374d0-0ce8-4878-9258-10e3bce1200f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "POST /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe/action" status: 202 len: 1493 microversion: 2.75 time: 0.606200 Nov 02 11:53:27.237430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d301b07f-66d4-4ec1-94a8-8357d21a5e47 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.237588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 441/893] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:53:26 2022] POST /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe/action => generated 1493 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 11:53:27.245583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:27.246193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.246795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d301b07f-66d4-4ec1-94a8-8357d21a5e47 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1121 microversion: 2.1 time: 0.092684 Nov 02 11:53:27.247417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 453/894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:27 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1121 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:27.252140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:27.254717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.261654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:27.262597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.263177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.263773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.264515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.264709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.264998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.265168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.265421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.265608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.266316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.266771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.267225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.462524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.464831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.470616 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b19badc-f881-4729-aaf0-1125657d77c0 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.232177 Nov 02 11:53:27.471225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 442/895] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:27 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:27.473009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69a48203-0c89-4a68-90d2-64f14215aeed tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.224348 Nov 02 11:53:27.489160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:27.489792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.490900 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 454/896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:27 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:27.496479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.496973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.497415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.498141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.498589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.499048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.593387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.593387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.594003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.597526 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c697169-5670-4e9b-97a7-24830cc40abe tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.113275 Nov 02 11:53:27.598240 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 443/897] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:27 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:27.613827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:27.614635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:27.620813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.621401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.621924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.622797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:27.623195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:27.623622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:27.762599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.770731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.772203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:27.773312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f85d962b-dcae-4e46-bb7f-6a48186b1cb8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.163649 Nov 02 11:53:27.774521 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 455/898] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:27 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:28.137009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.137512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.144140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.144639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.145078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.145784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.146243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.146727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.269870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.270512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.277475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.277956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.278387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.279161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.279563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.279995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.284065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:28.288003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.296853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c062a0c1-8e15-4406-babb-241ee561a763 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.164452 Nov 02 11:53:28.314435 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 444/899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:28.343586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.352037 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d7826f1-f1b2-47fe-b62b-88eaabc8d681 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1171 microversion: 2.1 time: 0.085517 Nov 02 11:53:28.352619 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 456/900] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1171 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:28.498308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.498606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.498922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.499307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.505351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.505544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.505841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.505974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.506277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.506433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.507013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.507130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.507460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.507580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.507887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.507994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.719895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.728275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.731787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-417c6d9c-cc76-4b65-a09f-fb3c403851bb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.237062 Nov 02 11:53:28.732765 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 457/901] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:28.739228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.741327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a35ebb9f-d45d-497b-930b-3438e0a40342 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.244915 Nov 02 11:53:28.741487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.748259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.749065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.749508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.750481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.751005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.751447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.760721 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 445/902] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:28.766044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:28.777878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.778349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.779009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.793810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] Creating event network-changed:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h1-855649-4 Nov 02 11:53:28.800205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9806288b-6013-4dfc-a1d1-374b52e5eabf req-dbf937e2-b387-420a-96a5-79ad53b7d66b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038147 Nov 02 11:53:28.801426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 446/903] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:28.810171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:28.814061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:28.818018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.818511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.818947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.820176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:28.821264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:28.821858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:28.831439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.840384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.842254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:28.858527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-963982f7-be85-4960-8fe7-52374ecd6d8f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.124430 Nov 02 11:53:28.863935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 458/904] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:29.034608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.052667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.052667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.052667 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8b4e24b-c585-46a1-b331-fa6cbabac022 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.247868 Nov 02 11:53:29.053088 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 447/905] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:28 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:29.322548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:29.323776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:29.339921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.340334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.340779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.341994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.342163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.342468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.374365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:29.374969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:29.385692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.386961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.387416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.388281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.391519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.399524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.522750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.534093 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-879708ef-6557-448c-9468-8d75daea398e tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1163 microversion: 2.1 time: 0.163563 Nov 02 11:53:29.535529 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 448/906] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:29 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1163 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:29.654607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.666443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdcbaa6c-e509-4551-8d66-853c589e6873 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1323 microversion: 2.1 time: 0.349606 Nov 02 11:53:29.667057 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 459/907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:29 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:29.765323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:29.766392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:29.773193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.774207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-378849005", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:29.774712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.775072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.778171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.778171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.778171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.834279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:29.834676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:29.835352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:29.835792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:29.836784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:29.846051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.846542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.847001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.847890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.848223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.848655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.866816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Getting quotas for project 0a79df55f6bd4c42a4b44c9180370c53. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:29.872655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Getting quotas for user f502ff21451342df8c8ba71e6d893b97 and project 0a79df55f6bd4c42a4b44c9180370c53. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:29.887159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:29.889553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:29.919342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:29.927624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-313804db-ffec-4447-bd42-ad549a4e7bb6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.167763 Nov 02 11:53:29.928195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 460/908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:29 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:29.932584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:29.933178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:29.938695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.942682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.942682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:29.942682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:29.942682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:29.943077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.050569 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64cd03a6-379f-4417-9ac1-93f2d031d10f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.427250 Nov 02 11:53:30.054368 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 449/909] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:53:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:53:30.056046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.056719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.063539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.064116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.064622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.065416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.065926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.066445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.091004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.098042 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed8b236b-31fa-442b-9d26-4082ec19e7da tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.168274 Nov 02 11:53:30.098637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 461/910] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:29 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:30.123459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.124140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.165754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.174723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.176945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.184023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdc80834-dbfc-4506-b516-cbb106eae541 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.131339 Nov 02 11:53:30.184596 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 450/911] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:30.189391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.190214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.194757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.197807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.198462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.199086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.199958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.200618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.201192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.206078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.209267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.215360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-740bb3d5-e67d-4e01-a8cf-748c0f1ed326 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1452 microversion: 2.91 time: 0.109346 Nov 02 11:53:30.216341 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 462/912] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:30.220524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:30.343190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.350855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.353191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.354297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a62f9563-5bfe-44eb-83da-c79b697f7fce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.168611 Nov 02 11:53:30.354850 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 451/913] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:30.564357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.565714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.574028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.574764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.575730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.576989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.577798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.578477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.672879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.681372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-076ac746-f86b-4da4-afc3-1f1478a4ae93 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1227 microversion: 2.1 time: 0.121254 Nov 02 11:53:30.682140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 463/914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1227 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:30.690448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.691099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.698681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.699213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.699660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.700384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.700835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.701288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.917798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.925881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1591d15-297f-4e07-b455-05d9cb87738c tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1472 microversion: 2.1 time: 0.240020 Nov 02 11:53:30.926469 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 452/915] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:30.950351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.950840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.951832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:30.952451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:30.956961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.957388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.957822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.958248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.958511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.958729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.958961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.959195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.959402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.959881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:30.960361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:30.960816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:30.984970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Request method failure captured: Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265/diagnostics HTTP/1.1 Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlog7KHVFzYRyuAJlaiE4NkG2dzibRs6kfNNLTT1a-StygmdjlotvdTIP7t_5vFpslxmZJ0uUv4xtM1DDXfeOIetrl-9_8omPizL0I8MKVW1n_92aVt4mS9MCFDTz0ZXVtf0GdTSQxQDOtGLLBptwFSkyA4nfzzmcKbL19iGuFAkukc Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: cfcdc9b8fd4f4c27b3e9bd3ba453df2b Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:53:30.987512 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cfcdc9b8fd4f4c27b3e9bd3ba453df2b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: cfcdc9b8fd4f4c27b3e9bd3ba453df2b Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiagnosticsNegativeTest-252533907-project Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 57bdea337b67423490859b82924ba604 Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-252533907-project Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:53:30.989111 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '8cd6af0e-6a91-485d-8485-bd3e1584b265'} Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:53:30.989807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 11:53:30.991100 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:30.993593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:53:30.994830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef957b4d-0d7e-4154-8f69-49941bfbf9e8 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.048298 Nov 02 11:53:30.995979 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 464/916] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265/diagnostics => generated 117 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:53:31.010586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.030798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.030798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.030798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.030798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.031671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.031671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.031671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.064994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:53:31.248065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.256505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd603d7a-0412-4bb4-b0d2-ac6daf328db5 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.308339 Nov 02 11:53:31.257086 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 453/917] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:30 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:31.267824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.267824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.274258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.274894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.275447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.276235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.276787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.277784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.478072 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79984cb2-da8f-4953-8fe9-b48ece0a1e59 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 204 len: 0 microversion: 2.1 time: 0.474797 Nov 02 11:53:31.478794 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 465/918] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:31 2022] DELETE /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:53:31.486449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.489842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.494811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.495458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.496161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.496965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.497640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.498168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.569057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.578144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d01338e-17aa-4463-9473-3ece832e3cae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.319918 Nov 02 11:53:31.578826 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 454/919] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:31 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:31.600736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.601033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.602196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.609970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.610732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.610875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.611440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.612299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.612544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.613122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.613636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.618847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a00e4ad2-4f93-4e8d-aa8c-7654fdd77dad tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.138600 Nov 02 11:53:31.633847 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 466/920] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:31 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:31.644605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.645280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.652887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.653565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.654298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.655033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.655560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.655998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.762403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.771219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.772766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:31.778669 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab7e2bb8-0c38-4c21-a9a1-1e89b4ce524d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1456 microversion: 2.91 time: 0.185735 Nov 02 11:53:31.779566 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 455/921] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:31 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1456 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:31.802847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:31.802847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:31.802847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.809463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.809463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:31.809463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:31.809463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:31.809826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.103506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.115169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.118445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.119791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00030163-c029-4000-a128-7210ae8a67d4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.484785 Nov 02 11:53:32.120460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 467/922] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:31 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:32.125448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:32.126745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:32.134708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.135312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.135845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.136828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.137503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.138299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.164363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.180201 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5aa80ae-beb2-47d5-8670-360e90b97b1e tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1478 microversion: 2.1 time: 0.387220 Nov 02 11:53:32.181556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 456/923] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:31 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1478 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:32.290396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:32.300988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:32.316286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.318393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.319408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.320484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.321016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.321955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.486776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.492790 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-453c45c5-18c9-4eac-98f5-2e334f8c0ca5 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1305 microversion: 2.1 time: 0.370934 Nov 02 11:53:32.494248 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 468/924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:32 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1305 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:32.556665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.571221 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96ce3e0a-47c0-4298-8b05-8629ec024c45 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.294506 Nov 02 11:53:32.572666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 457/925] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:32 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:32.603791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:32.605127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:32.613195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.613999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.614662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.615608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.616361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.617445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.649888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:32.650786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:32.672641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.673527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.674219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.678594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.679241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.679844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.806825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.818780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.825187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.833514 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96a326db-b391-4424-9009-32564120e0cc tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.188731 Nov 02 11:53:32.849852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 458/926] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:32 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:32.868809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "name": "network-vif-plugged", "status": "completed", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:32.882152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:32.890265 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c8043ec-284b-4310-8b15-7d7f3a0a6531 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.291029 Nov 02 11:53:32.893131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.893615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.894097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.894887 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 469/927] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:32 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:32.901727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:32.902346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:32.909368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.912238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.912238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.912238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:32.912238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:32.912574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:32.928977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] Creating event network-vif-plugged:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h1-855649-4 Nov 02 11:53:32.936601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1195251c-955a-4a9b-ba85-94160e1d586a req-0feb12e2-5c15-49bc-8a81-e76521f0da8d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085362 Nov 02 11:53:32.937557 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 459/928] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:33.034831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.048199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.049631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.055623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d53aa9f5-17b5-41b7-aaad-1490a2f2e53a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1456 microversion: 2.91 time: 0.158948 Nov 02 11:53:33.056416 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 470/929] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:32 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:33.152036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:33.153185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:33.161741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:33.168043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:33.168043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:33.168043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:33.168043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:33.168940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:33.205471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:33.206473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:33.221895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:33.225560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:33.231034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:33.231034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:33.231034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:33.231034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:33.950052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.959950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01d571b6-30f1-4621-8c4d-f37222918f84 tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1478 microversion: 2.1 time: 0.758448 Nov 02 11:53:33.964431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.981506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.984041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:33.984297 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 471/930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:33 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1478 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:33.987665 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c80ce201-ace1-4741-a39d-25c2f9c9fab1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1410 microversion: 2.25 time: 0.840895 Nov 02 11:53:33.989318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:33.990997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:33.991714 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 460/931] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:33 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1410 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:34.010938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:34.011397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.012052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.012756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:34.013341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.015033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.015577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.016028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.021974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.022493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.022938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.023760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.024227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.024722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.041439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:34.396854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.405794 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e8e9e72-b5c2-49af-8ac3-3001d328dc06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1305 microversion: 2.1 time: 0.420370 Nov 02 11:53:34.422285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 472/932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:33 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1305 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:34.427551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:34.428337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:34.434096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.449258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.452248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.452941 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-953645b5-deab-451e-b07d-d9aef7884f5d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.458951 Nov 02 11:53:34.453093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.454763 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 461/933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:33 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:34.459184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.459801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.460268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.463351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:34.464919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:34.485366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.485366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.485747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.486553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.487207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.488117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.606528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.615987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.618025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.623689 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04416ce6-3212-4555-a26f-cd0e7827d4f8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.199913 Nov 02 11:53:34.650606 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 473/934] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:34 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:34.652969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:34.653753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:34.660934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.661699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.662321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.663302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.664550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.665138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.781617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.791094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.792665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.798284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-493dab2a-a195-4e80-af10-7b0eaf703c3c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1504 microversion: 2.91 time: 0.157261 Nov 02 11:53:34.799117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 474/935] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:34 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:34.813006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd6af0e-6a91-485d-8485-bd3e1584b265", "name": "network-vif-deleted", "tag": "eb2e2c5b-ba44-4661-b975-a7e938984621"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:34.838469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:34.838952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:34.839421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:34.861448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:34.870686 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] Creating event network-vif-deleted:eb2e2c5b-ba44-4661-b975-a7e938984621 for instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 on n-h1-855649-4 Nov 02 11:53:34.875337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e12e992-87b0-400c-8a7d-bb90aaba9204 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.417124 Nov 02 11:53:34.880188 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7ab68358-edcf-4d6c-b8f4-374bed08905f req-aff4dd20-a037-4a46-8bed-f2a01a2e739b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070736 Nov 02 11:53:34.882295 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 475/936] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:34.887059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 462/937] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:34 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:34.992964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:34.993858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.001592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.002185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.003012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.003532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.004165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.004672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.021397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.022093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.026757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:35.038293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.041718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.042465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.043461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.044165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.044759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.053324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.053930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.054537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.055639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lazy-loading 'fault' on Instance uuid 8cd6af0e-6a91-485d-8485-bd3e1584b265 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:35.163249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.173974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b75fe738-4dfd-4299-9fe1-69f5d567555b tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1313 microversion: 2.1 time: 0.190469 Nov 02 11:53:35.174736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 476/938] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:34 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:35.318325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.334951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.337610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.344820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a21365ac-737c-4ecd-9a53-25f04f914f20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1605 microversion: 2.25 time: 0.330140 Nov 02 11:53:35.347097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 463/939] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:35.376814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.377313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.383402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.384104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.384714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.385742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.386460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.387074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.428395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.429955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.442283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.443485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.444356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.445879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.446513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.447136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.529721 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fba01a9f-58cc-4755-b2bc-ef9840d9a2a7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.157590 Nov 02 11:53:35.530396 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 477/940] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:35.535367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9821ea1-aa3e-4089-a23c-abb5073f6d9e", "name": "network-vif-plugged", "status": "completed", "tag": "eb76a1a4-12a5-4aa6-8153-52ab5cde950b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:35.554403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=15 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:35.565298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.565967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.566560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.592454 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] Creating event network-vif-plugged:eb76a1a4-12a5-4aa6-8153-52ab5cde950b for instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e on n-h2-855649-4 Nov 02 11:53:35.603702 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-56e0f369-572d-4cf6-9cc0-e53db7297dfc req-55f7fa24-90bc-4ef3-b2f8-82de0fa0accd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071014 Nov 02 11:53:35.605607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 478/941] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:35.621861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.623873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.627615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.634623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.636123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.636937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.638374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.639119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b26e810-d868-4fda-ba11-2d7f011dcb77 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1305 microversion: 2.1 time: 0.213761 Nov 02 11:53:35.639239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.648792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 464/942] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:35.648985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.660318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.661251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.668139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.668734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.669517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.670261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.670733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.671181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.861179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.870267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.871885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:35.878011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c84d13b-9075-4a6b-834a-56db2f148350 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.223433 Nov 02 11:53:35.895618 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 465/943] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:35.904064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:35.904827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:35.918008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.918630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.919067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:35.919780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:35.920240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:35.921758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.001454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.015062 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-400eee3b-fc1d-40f1-ae74-da245eca880a tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.407839 Nov 02 11:53:36.024914 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 479/944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:36.024914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:36.024914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:36.031508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.032653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.035360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.035360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.035872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.036930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.040321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.051819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.060974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.079077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e44f9af1-b77d-4e0f-a6b0-248295a4d401 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1522 microversion: 2.91 time: 0.182117 Nov 02 11:53:36.097985 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 466/945] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:35 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:36.201805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:36.202492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:36.211421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.212176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.212688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.213746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.214275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.214778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.254739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.257699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.258286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.258816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.259375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lazy-loading 'fault' on Instance uuid 8cd6af0e-6a91-485d-8485-bd3e1584b265 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:36.264162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbb5f801-fbd9-4f43-8859-4f179c7273e2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.246252 Nov 02 11:53:36.265051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 480/946] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:36 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:36.312020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bdea337b67423490859b82924ba604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcdc9b8fd4f4c27b3e9bd3ba453df2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.319668 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09f79f83-8763-4b5a-a7ad-8bf9c71e47ab tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 200 len: 1313 microversion: 2.1 time: 0.122523 Nov 02 11:53:36.320403 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 467/947] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:36 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 1313 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:36.670359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:36.671239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:36.681176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.681676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.682111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.683004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.683551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.684188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.860406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:36.873257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-757868b6-fc4e-442b-89fb-e2f73524a4a2 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1305 microversion: 2.1 time: 0.209687 Nov 02 11:53:36.887510 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 481/948] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:36 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1305 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:36.897922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162a4c4e-b03e-4587-9e10-75ae1727d583", "tag": "720103ce-5339-4505-b619-52a0d9df27dc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:36.911455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:36.912065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:36.913118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.914134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.916778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.918885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.919403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.919867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.920569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.921022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.921444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.932967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] Creating event network-changed:720103ce-5339-4505-b619-52a0d9df27dc for instance 162a4c4e-b03e-4587-9e10-75ae1727d583 on n-h1-855649-4 Nov 02 11:53:36.938208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d3a21949-3eb8-470e-83f4-8c4b3cf3d1fe req-6956bd89-c073-42e1-9da8-38ddfb9abcdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045026 Nov 02 11:53:36.939364 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 468/949] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:36.947031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:36.958632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:36.959390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:36.965030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:36.965220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:36.974802 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] Creating event network-changed:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h1-855649-4 Nov 02 11:53:36.987287 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-125a396b-5163-48e8-8284-77891caebd7b req-fc8241d8-6a16-4b32-bc52-ef9bb36f52e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043947 Nov 02 11:53:36.997147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 469/950] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:37.009809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.020768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.022410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.028508 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a635589-0b36-464e-b679-5d20675476a8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.121707 Nov 02 11:53:37.029296 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 482/951] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:36 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:37.045204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:37.046431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:37.055150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.060236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.060236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.060236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.060236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.060551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.109968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:37.110663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:37.132528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.133035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.133484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.134203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.134668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.135166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.298399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.308072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.309534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.318047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97efdc1f-7ff0-4bf3-9117-ea2da28f3032 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1510 microversion: 2.91 time: 0.211923 Nov 02 11:53:37.323564 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 483/952] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:37 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:37.328513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:37.329149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:37.335179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.336232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.336769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.337487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.338214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.338715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.412416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.421305 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d27f872a-cf60-4026-864e-c2ace0fa86b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.381969 Nov 02 11:53:37.421957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 470/953] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:37 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:37.427717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:37.430060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] [instance: 8cd6af0e-6a91-485d-8485-bd3e1584b265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:37.436388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.437255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.437973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.438669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.439444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.440286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.458407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] HTTP exception thrown: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Request method failure captured: Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 HTTP/1.1 Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlog7KHVFzYRyuAJlaiE4NkG2dzibRs6kfNNLTT1a-StygmdjlotvdTIP7t_5vFpslxmZJ0uUv4xtM1DDXfeOIetrl-9_8omPizL0I8MKVW1n_92aVt4mS9MCFDTz0ZXVtf0GdTSQxQDOtGLLBptwFSkyA4nfzzmcKbL19iGuFAkukc Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: cfcdc9b8fd4f4c27b3e9bd3ba453df2b Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:53:37.460283 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cfcdc9b8fd4f4c27b3e9bd3ba453df2b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfcdc9b8fd4f4c27b3e9bd3ba453df2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: cfcdc9b8fd4f4c27b3e9bd3ba453df2b Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-252533907 Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerDiagnosticsNegativeTest-252533907-project Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 57bdea337b67423490859b82924ba604 Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-252533907-project Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. Nov 02 11:53:37.461649 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8cd6af0e-6a91-485d-8485-bd3e1584b265'} Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:53:37.462367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. Nov 02 11:53:37.464091 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:37.465178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] Returning 404 to user: Instance 8cd6af0e-6a91-485d-8485-bd3e1584b265 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:53:37.465178 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a1f010a-fc3b-4cf8-9cf1-4280ae42bede tempest-ServerDiagnosticsNegativeTest-252533907 tempest-ServerDiagnosticsNegativeTest-252533907-project] 10.222.0.48 "GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265" status: 404 len: 111 microversion: 2.1 time: 0.038424 Nov 02 11:53:37.465178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 471/954] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:37 2022] GET /compute/v2.1/servers/8cd6af0e-6a91-485d-8485-bd3e1584b265 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:53:37.519435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:37.527904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1371a112-87d6-42c2-883b-09f7d17681bb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1316 microversion: 2.1 time: 0.203317 Nov 02 11:53:37.528490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 484/955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:37 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:37.896744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:37.897870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:37.904780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.905438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.905874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:37.906618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:37.907104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:37.907550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.059437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.060241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.067778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.068393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.069096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.069889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.070467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.071037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.082403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.091123 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00cfab9d-2d06-45e0-98d3-8d8543112292 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1305 microversion: 2.1 time: 0.198015 Nov 02 11:53:38.092726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 472/956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:37 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1305 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:38.145015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.156123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.160704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.163128 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68570849-7052-4c22-aa1c-b95323ae94a7 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.108175 Nov 02 11:53:38.164326 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 485/957] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:38 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:38.367772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.369623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.377696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.377696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.378040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.378703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.379208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.379652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.446834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.447594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.458080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.458579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.459715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.460700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.461171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.461609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.469718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.480798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.480798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.485786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2941b5d8-e28e-45f8-9548-a7c193195981 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1510 microversion: 2.91 time: 0.134343 Nov 02 11:53:38.488803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 473/958] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:38 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1510 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:38.550746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.551770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.558554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.559084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.559533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.560234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.560695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.561126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.668194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.685669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d951ec47-379d-418d-9ec6-974c28d1d39e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.243589 Nov 02 11:53:38.687204 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 486/959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:38 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:38.730970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:38.743781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d65b2e3c-cf01-4ca9-aa17-4c9deb355769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1466 microversion: 2.1 time: 0.196634 Nov 02 11:53:38.745416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 474/960] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:38 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1466 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:38.767871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.768581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.775103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.775912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.776569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.777551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.778180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.778689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.940156 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3f1dc00-2305-4551-9e0e-22566e876cad tempest-ServersOnMultiNodesTest-66919472 tempest-ServersOnMultiNodesTest-66919472-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1617 microversion: 2.1 time: 0.176058 Nov 02 11:53:38.940727 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 487/961] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:38 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1617 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:38.965107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:38.965693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:38.971696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.972241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.972677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:38.973372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:38.973827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:38.974255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.001486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:53:39.120191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.120970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.128481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.128980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.129647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.130397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.130899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.131364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.265737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.274080 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93bc974a-9488-45e8-9c3c-d1f6a7bc30e1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.158739 Nov 02 11:53:39.274654 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 488/962] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:39.279114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.283590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.285424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.285912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.286355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.287079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.287540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.288155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.353290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.362087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.363620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.366430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:39.369218 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd06af5b-04a9-4751-9c6a-35ae94479013 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.093601 Nov 02 11:53:39.369788 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 489/963] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:39.514633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.515236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.521159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.521646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.522088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.522899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.524015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.524447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.531440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ebbbd15-9f05-4698-b419-baf8bcdb8e7b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 204 len: 0 microversion: 2.1 time: 0.570225 Nov 02 11:53:39.532118 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 475/964] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:38 2022] DELETE /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:53:39.540519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:39.540680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.541234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.551393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.551891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.552336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.553044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.553501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.553931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.599857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.611676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.613234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.619276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35968258-2ae4-4471-9e62-b64d62eb3c71 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1531 microversion: 2.91 time: 0.108488 Nov 02 11:53:39.627157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 490/965] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1531 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:39.705840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.714470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc2206e6-0d5d-4265-946b-bad77cd003de tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1472 microversion: 2.1 time: 0.178046 Nov 02 11:53:39.715341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 476/966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:39.720340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.721025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.728219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.728874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.729643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.730443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.731002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.731470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.857034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:39.881880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:39.884482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:39.891420 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78fc15bc-e858-4676-b02c-405c07042fa6 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.174822 Nov 02 11:53:39.892600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 477/967] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:39.920483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:39.921108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:39.928260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.929404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.929404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:39.929911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:39.930368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:39.930800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.047317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lazy-loading 'services' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:40.065000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e10f2696-07dd-4453-8f94-211c0906d8c1 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1936 microversion: 2.91 time: 0.420369 Nov 02 11:53:40.065596 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 491/968] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:39 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1936 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:40.093639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.094257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.101776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.102407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.102906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.103694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.104182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.104595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.221669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lazy-loading 'services' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:40.239348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1631044c-4ca0-4242-8cc2-0da733fd34a7 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1936 microversion: 2.91 time: 0.149360 Nov 02 11:53:40.239926 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 478/969] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1936 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:40.267372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.271288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.271789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.272210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.272944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.274023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.274451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.275752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=21 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:40.298277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.299141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.301665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a0544c8-0089-42e5-9abd-99f1c300d937 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.038353 Nov 02 11:53:40.302797 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 492/970] 10.222.0.48 () {60 vars in 1217 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:53:40.305458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.306018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.306539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.307335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.307865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.308389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.314159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:40.314751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.322080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.327768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.327768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.327768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.327768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.328148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.350894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lazy-loading 'flavor' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:40.460802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:40.469458 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd08bd1f-e582-4df1-b143-415fe1d1de86 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.175474 Nov 02 11:53:40.479396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 479/971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:40.490191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.490814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.497496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.497983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.498421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.499150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.499607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.500037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.567770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:40.577267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:40.578870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:40.584312 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a822c57-8ebe-4431-a748-c3b6c54cb50c tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.103829 Nov 02 11:53:40.584922 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 480/972] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:40.738169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.738948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.746178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.746666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.747160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.747854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.748298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.748904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.883058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:40.891693 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94867a1d-b437-473f-9bca-736cce665893 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1472 microversion: 2.1 time: 0.157341 Nov 02 11:53:40.892422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 481/973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:40.916027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:40.916650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:40.923072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.923552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.926802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.926802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:40.926802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:40.926802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:40.987501 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a412d5c0-8c65-4f5a-a99d-ecb0d2c9fe69 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action" status: 202 len: 0 microversion: 2.91 time: 0.676768 Nov 02 11:53:40.997322 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 493/974] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:53:40 2022] POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:53:41.006537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:41.007926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:41.015490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.015992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.016432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.024634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.024634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.024634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.084352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.093450 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8fd3381-cd64-4239-a3da-8958e0b1d3b1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.181846 Nov 02 11:53:41.094621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 482/975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:41.106231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.115236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.116692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.122905 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c77dd05-bd36-4094-b4a8-775022178588 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.123158 Nov 02 11:53:41.123523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 494/976] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:40 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:41.496514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:41.497219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:41.503769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.504325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.504829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.505649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.508888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.508888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.616448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:41.617530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:41.626317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.629716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.629716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.629716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.629716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.630231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.732361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.741913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.743908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.746902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:41.749164 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1ba5e9d-b61e-4281-879c-ea00c3d639cb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.137832 Nov 02 11:53:41.749920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 495/977] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:41 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:41.754752 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9624bb4-1543-45b1-bb30-280232ac5b19 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.262136 Nov 02 11:53:41.755527 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 483/978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:41 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:41.916590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:41.917219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:41.924330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.924819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.925328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:41.926043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:41.926516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:41.926930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.164881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.179189 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93231c45-a97a-4ab7-8ef6-7e04909a771d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1472 microversion: 2.1 time: 0.262637 Nov 02 11:53:42.180782 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 496/979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:41 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:42.191902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:42.192771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:42.209043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.209043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.209043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.209043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.209437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.209437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.266697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1921014188", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:42.352675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:53:42.453374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.462632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2bcbcfe-3361-4018-9467-2570e8f10c08 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.277386 Nov 02 11:53:42.464531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 497/980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:42 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:42.469722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:42.470613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:42.477754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.478782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.479946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.480964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.481932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.482637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.581254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.593713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.595506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.603017 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb4184cb-8b03-4421-9fcd-23de767e2528 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.136780 Nov 02 11:53:42.604226 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 498/981] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:42 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:42.619652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9821ea1-aa3e-4089-a23c-abb5073f6d9e", "name": "network-vif-deleted", "tag": "eb76a1a4-12a5-4aa6-8153-52ab5cde950b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:42.633473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:53:42.634265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:53:42.635422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:53:42.635647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:53:42.636658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:53:42.648046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.654712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.654712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.657745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.658430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.658926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.659700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.660143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.660586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.683816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] Creating event network-vif-deleted:eb76a1a4-12a5-4aa6-8153-52ab5cde950b for instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e on n-h2-855649-4 Nov 02 11:53:42.688738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-53312cfb-6fe4-4d76-9e21-9cccf9e475d4 req-71b37878-2ad0-47e0-a664-a067378a7d23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083040 Nov 02 11:53:42.689699 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 499/982] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:42.691752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Getting quotas for project be08d780f94a4716a8a0b6465dc64741. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:53:42.699807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Getting quotas for user 4a85962741804c17a4377f88ab666b32 and project be08d780f94a4716a8a0b6465dc64741. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:53:42.715158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:53:42.718111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:53:42.778608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:42.779400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:42.785920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.786378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.786880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.787625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.788079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.788726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.853485 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27238a13-7147-417e-a71d-3ee77dbf6313 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772436 Nov 02 11:53:42.856754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 484/983] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:53:42.867340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:42.868211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:42.869966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.877450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.878258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.878911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.880080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:42.880728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:42.881351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:42.884415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.886966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:42.897464 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4fa236b-ab0e-4954-a51a-58ebe5ccf351 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.121431 Nov 02 11:53:42.898648 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 500/984] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:42 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:42.905616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a091597-adb0-40f6-b75a-3a28667814dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:42.906575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a091597-adb0-40f6-b75a-3a28667814dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:43.012201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a091597-adb0-40f6-b75a-3a28667814dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.020779 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a091597-adb0-40f6-b75a-3a28667814dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1214 microversion: 2.1 time: 0.120167 Nov 02 11:53:43.021542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 501/985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:42 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:43.077477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.079669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:43.086582 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0895bb29-24c5-4ea0-9515-3f007084c69a tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.224003 Nov 02 11:53:43.087202 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 485/986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:42 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:43.198485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:43.199046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:43.204982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.205502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.205945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.206641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.207155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.207582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.240042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.240531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.240979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.241432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid f9821ea1-aa3e-4089-a23c-abb5073f6d9e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:43.285157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.293157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d174851f-0ed0-4838-8914-b64030895f22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 200 len: 1306 microversion: 2.1 time: 0.098641 Nov 02 11:53:43.293732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 502/987] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:43 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:43.491452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:43.492177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:43.499242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.499860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.506693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.506693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.506693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.506693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.633125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:43.633913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:43.640874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.641254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.641377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.641788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.642491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.642944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.643396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.649699 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1b8baf2-af29-4ccf-b050-03d6d8a4b533 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.163616 Nov 02 11:53:43.650274 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 486/988] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:43 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:43.709386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.718253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.719944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:43.724714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8b64eae-475e-4204-8188-a75c835c1b5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.095563 Nov 02 11:53:43.725276 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 503/989] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:43 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:43.929193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:43.929885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:43.935879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.936362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.936797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:43.937479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:43.937933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:43.938379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.005651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:44.014186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:44.015708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:44.020556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5814dec-de5f-4d16-84c1-56a51dc28592 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.095322 Nov 02 11:53:44.021733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 487/990] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:43 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:44.044091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e1d6fd2-ceea-4808-a688-1448a22771e7 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.044779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e1d6fd2-ceea-4808-a688-1448a22771e7 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.099045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e1d6fd2-ceea-4808-a688-1448a22771e7 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:44.106440 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e1d6fd2-ceea-4808-a688-1448a22771e7 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1214 microversion: 2.1 time: 0.066594 Nov 02 11:53:44.107161 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 504/991] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:44 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:44.109586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.110213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.116353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.116842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.117320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.118021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.118479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.118910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.247285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:44.255075 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22df6f8f-0632-44b4-bb19-743b83512e51 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.149155 Nov 02 11:53:44.255536 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 488/992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:44 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:44.319396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.320080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f9821ea1-aa3e-4089-a23c-abb5073f6d9e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.326574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.329769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.329769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.329769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.329769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.330168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.343176 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e HTTP/1.1 Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:53:44.344819 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. Nov 02 11:53:44.346471 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'f9821ea1-aa3e-4089-a23c-abb5073f6d9e'} Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:53:44.347578 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. Nov 02 11:53:44.348967 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:44.350406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance f9821ea1-aa3e-4089-a23c-abb5073f6d9e could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:53:44.350406 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f104c9d2-63d8-4009-9fe7-ca74a514085c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e" status: 404 len: 111 microversion: 2.1 time: 0.030922 Nov 02 11:53:44.350406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 505/993] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:44 2022] GET /compute/v2.1/servers/f9821ea1-aa3e-4089-a23c-abb5073f6d9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:53:44.357494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.357494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.362748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.363265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.363707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.364401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.364862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.365295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.392262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:53:44.673037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.673650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.680860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.683326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.683326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.683326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.683326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.683850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.740018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebaeafc5-cf97-4106-88e2-55c28908e200 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 204 len: 0 microversion: 2.1 time: 0.388177 Nov 02 11:53:44.740697 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 489/994] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:44 2022] DELETE /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:53:44.749674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:44.750495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:44.756641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.757179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.757684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:44.758907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:44.759393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:44.759811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.119849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.128635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4feb799f-5f73-4c1d-bda8-f344cc45842f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1473 microversion: 2.1 time: 0.459467 Nov 02 11:53:45.129288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 506/995] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:44 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:45.135298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:45.135298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:45.140985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.141548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.142209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.143023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.143574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.144187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.194519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.202429 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a2bae10-efee-462b-81d6-284c653a55d8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1472 microversion: 2.1 time: 0.456812 Nov 02 11:53:45.203023 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 490/996] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:44 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:45.209106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:45.209715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:45.216790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.217389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.218082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.218233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.218965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.219573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.220096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.226272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.228427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.233302 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24130869-9531-4c0e-b727-87998c917b45 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.103074 Nov 02 11:53:45.233859 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 507/997] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:45 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:45.246571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:45.247215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:45.256869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.256869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.256869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.256869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.257254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.257254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.270776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:45.284718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.294205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.295690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.302694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-361befaa-22c5-4c29-923a-9b5245ba1171 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.098658 Nov 02 11:53:45.303309 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 491/998] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:45 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:45.307719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:45.308322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:45.313281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:45.315054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.315539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.315974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.316705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:45.317152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:45.317574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:45.321105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.329074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0ea6a5f-02df-4542-87fa-9945d5d9186e tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1210 microversion: 2.1 time: 0.086362 Nov 02 11:53:45.329834 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 508/999] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:45 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:45.454286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:45.463008 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93dfd6dd-0e35-4dd8-b93d-badb4cfe9ab8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.158467 Nov 02 11:53:45.463614 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 492/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:45 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:46.151908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.152707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.160648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.161134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.161570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.162270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.162751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.163210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.228413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.229164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.236294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.236782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.237464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.238020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.238483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.238908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.329025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.337617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae134abe-e7ff-4921-b852-ca52c9bb03a3 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1491 microversion: 2.1 time: 0.189839 Nov 02 11:53:46.338494 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 509/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1491 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:46.348298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.351172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.357464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.357955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.358387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.359117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.359568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.359986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.395912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.404957 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-452b9f70-a275-4af1-b86f-4e9ab5a7ed9b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1472 microversion: 2.1 time: 0.180734 Nov 02 11:53:46.405548 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 493/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:46.423851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.424653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.425329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.431460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.432034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.432226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.432577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.433327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.433664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.433924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.434419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.438903 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5aa40577-fa44-43d6-9dfd-c58184b98007 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.099443 Nov 02 11:53:46.439511 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 510/1003] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:46.444469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.445644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.452116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.452595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.453032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.453718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.454167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.454588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.502656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.512493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.513958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.519391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54d4019a-001a-45bf-8327-4568e83acb18 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.099066 Nov 02 11:53:46.520180 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 494/1004] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:46.525177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:46.525788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:46.532127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.532631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.534114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.534114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.534385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.534837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.536887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.544786 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54db05b4-4623-450d-b3ab-adf5a3edd8c5 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1210 microversion: 2.1 time: 0.104135 Nov 02 11:53:46.548187 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 511/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:46.643331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-unplugged", "status": "completed", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:46.653430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:46.653935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:46.654360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:46.667308 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] Creating event network-vif-unplugged:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:53:46.670276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:46.672072 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-47f9e134-0b50-4c8b-8f2f-f8380e770f8b req-e931b555-a30e-4b82-92dd-ee17c102cf43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033127 Nov 02 11:53:46.673120 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 512/1006] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:53:46.678568 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd7c1643-d5fc-45c5-bd3d-c6931f3004a9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.157612 Nov 02 11:53:46.679149 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 495/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:46 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:47.363224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.363947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.371716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.372218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.372662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.373384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.373839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.374683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.428380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.429001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.437024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.437519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.437963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.438681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.439182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.439632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.548804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.558231 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e2b426b-1ab1-4c34-8cac-82dd07c43c27 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.200114 Nov 02 11:53:47.558827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 513/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:47.566624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.567504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.580262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.581146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.581777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.582675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.583206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.583635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.626106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.635366 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbec5f65-d5a8-4efe-a976-ea81d56a4a24 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1472 microversion: 2.1 time: 0.211137 Nov 02 11:53:47.636506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 496/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:47.642508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.643325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.651031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.653392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.657659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.657659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.657659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.657659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.658164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.666031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.667511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.672949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f149d8d-ff47-41fd-9a5c-d2b09c5b57ef tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.113075 Nov 02 11:53:47.673524 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 514/1010] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:47.678138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.678751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.685210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.685701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.686139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.686955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.687430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.706316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.729221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.742901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.744668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.750017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7919470e-e280-46bf-8918-319bcf52ee1d tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.112354 Nov 02 11:53:47.750602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 497/1011] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:47.755067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:47.755663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:47.760319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.761992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.762529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.762895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.763707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:47.764522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:47.765283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:47.768762 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34d07d47-361b-4012-b074-8716f5354df4 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1266 microversion: 2.1 time: 0.094245 Nov 02 11:53:47.769857 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 515/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:47.904263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:47.912175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88b39910-f741-481a-87ee-71c054b60a5b tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.160555 Nov 02 11:53:47.912739 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 498/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:47 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:48.582935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:48.583570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:48.591627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.592110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.592545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.593245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.593698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.594135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.659934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:48.660805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:48.668158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.668644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.669083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.669781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.670234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.670695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.760946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:48.769879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdf7aab6-da18-493d-8ebb-2ad8da153703 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.190456 Nov 02 11:53:48.770935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 516/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:48 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:48.778831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:48.779482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:48.787324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.787819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.788468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.790086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.790931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.791758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.853287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:48.867511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32868737-e270-42f1-98e0-c1748f538c63 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1472 microversion: 2.1 time: 0.210488 Nov 02 11:53:48.868114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 499/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:48 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:48.870828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:48.873681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:48.874312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:48.880519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:48.880876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.881413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.881844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.882393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:48.882608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.883012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.883481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.887968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c13bcf3c-060b-4b71-ae85-e83099101da0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.115601 Nov 02 11:53:48.888969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 517/1016] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:48 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:48.893880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:48.894671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:48.901043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.901659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.902161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.902928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:48.903570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:48.904048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:48.999272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:49.002453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:49.004805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:49.007469 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1aced12f-eeb1-4ef6-b75d-2ff46773d991 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1266 microversion: 2.1 time: 0.117458 Nov 02 11:53:49.008008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 518/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:48 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:49.011837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:49.013221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:49.018192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c707479-edeb-46c7-9961-9ab28578a376 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.149148 Nov 02 11:53:49.018900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 500/1018] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:48 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:49.020522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:49.021276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:49.028005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.029871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.030971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:49.031141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.031743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.032183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:49.197194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:49.205274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb2c7eeb-7807-46d9-94cd-8fa4745b8212 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.188642 Nov 02 11:53:49.205855 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 519/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:49 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:49.794453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:49.795091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:49.803416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.806069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.806069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:49.806069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.806384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.806792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:49.890668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:49.891426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:49.899142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.899758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.900378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:49.901337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:49.901990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:49.902619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.108076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.116056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb87eb45-c794-4acc-96e5-07c6402f3137 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.326094 Nov 02 11:53:50.116630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 501/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:49 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:50.121787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:50.122600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:50.128861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.129353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.129793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.130489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.131161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.131745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.174449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.197324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-634961ff-e040-45c8-9d0f-25dff27e10fb tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1472 microversion: 2.1 time: 0.310498 Nov 02 11:53:50.202078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 520/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:49 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:50.215400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:50.216300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:50.227339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.227948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.228535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.229529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.230149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.230715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.237727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.264167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.265613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.277325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-759fa78b-d638-43ad-bccb-145177a76dab tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.158948 Nov 02 11:53:50.285379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:50.287099 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 502/1022] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:50 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:50.313401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:50.314023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:50.325423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.331756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.332632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.333148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.334048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.335173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5fc0021-8e33-42dd-b611-34fa68f366c3 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1274 microversion: 2.1 time: 0.124417 Nov 02 11:53:50.335700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.351011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 521/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:50 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:50.351822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.351957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:50.351957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:50.353123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.359300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.359300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.359300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.359300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.359676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.477029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.488142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.489591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.496175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d570ec68-6932-4ec0-9f56-7f79094fa022 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.186993 Nov 02 11:53:50.520482 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 503/1024] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:50 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:50.619472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:50.627349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54b4147d-4619-4748-97c5-f4d08e73a673 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.290018 Nov 02 11:53:50.627924 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 522/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:50 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:50.797689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648e9260-1754-49ad-8222-b2a4f5e28247", "name": "network-vif-deleted", "tag": "485eebf4-cf4a-4f27-b358-fecda0c6c23a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:50.808127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:50.808833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:50.809364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:50.821639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] Creating event network-vif-deleted:485eebf4-cf4a-4f27-b358-fecda0c6c23a for instance 648e9260-1754-49ad-8222-b2a4f5e28247 on n-h1-855649-4 Nov 02 11:53:50.827235 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c30af7fc-a16e-4142-834b-a140daac8422 req-b2a03cdf-37f3-4b6e-bace-ff333c975d51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 Nov 02 11:53:50.827847 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 504/1026] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:51.144940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.146642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.156450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.157177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.157790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.159789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.160496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.161059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.234299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.235143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.256292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.257101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.258168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.258954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.259466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.259905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.328772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.329962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.330649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.331333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid 648e9260-1754-49ad-8222-b2a4f5e28247 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:51.398474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.419856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-203563db-623d-40da-a7ce-0fcdc930c408 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 200 len: 1307 microversion: 2.1 time: 0.191313 Nov 02 11:53:51.420833 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 505/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:51.432158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.433513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.457637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.461718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.462919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.463535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.477946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.478138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc4b67c4-8a11-43b6-ac68-d1896a7b4ec7 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.332027 Nov 02 11:53:51.478229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.478229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.478443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 523/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:51.482422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.483695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.487403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:51.492003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.492744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.493585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.494815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.495567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.496261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.647972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.660914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.665094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.672522 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d98807b6-a92e-48fc-94e1-f5daf98931de tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.250171 Nov 02 11:53:51.673302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 506/1029] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:51.678377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.680086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.691425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.692269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.724589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.724589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.724589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.724589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.775782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.779250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.785922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.787332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-689b0319-e60b-4bb0-8d40-a5add0776297 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.312409 Nov 02 11:53:51.788272 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 524/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:51.788390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.793713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:51.794653 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7677a2c-bb9b-4024-9143-9c6246006be8 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.119978 Nov 02 11:53:51.794848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:51.795588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 507/1031] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:51.801450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.802025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.802526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.803367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:51.803912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:51.804966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:51.959982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:51.964694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:51.975502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3710cda6-73c9-40f3-940a-eb37ab990409 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.185310 Nov 02 11:53:51.979030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 525/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:51 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:52.466665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.467322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 648e9260-1754-49ad-8222-b2a4f5e28247] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.474310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.475287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.475739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.477040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.477506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.478000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.492899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 HTTP/1.1 Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:53:52.494572 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. Nov 02 11:53:52.496565 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '648e9260-1754-49ad-8222-b2a4f5e28247'} Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:53:52.497537 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. Nov 02 11:53:52.499047 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:53:52.500382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance 648e9260-1754-49ad-8222-b2a4f5e28247 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:53:52.500382 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c7fc520-f3ad-4d61-9e8e-ca84e03989d2 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247" status: 404 len: 111 microversion: 2.1 time: 0.036035 Nov 02 11:53:52.500382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 508/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:52 2022] GET /compute/v2.1/servers/648e9260-1754-49ad-8222-b2a4f5e28247 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:53:52.506252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.506820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.514814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.515398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.515945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.516762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.517286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.517778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.528869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.529573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.536834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.538472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.538472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.539515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.544648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.544648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.552574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:53:52.681288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:52.708133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:52.710957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:52.718167 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa630faa-7409-4513-ad2e-7657a8aeec81 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.193887 Nov 02 11:53:52.719228 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 509/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:52 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:52.724691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.725559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.734156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.734848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.736200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.737241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.737775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.738338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.837215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:52.847346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:52.848820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:52.854468 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51b4481b-deb1-48ab-9a59-391e8577396d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.133641 Nov 02 11:53:52.855084 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 510/1035] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:52 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:52.859882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.860499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.867555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.868037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.868664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.869373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.869826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.870249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.908690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e4b9ced-d532-4f8e-bac4-9ef44a437e4c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 204 len: 0 microversion: 2.1 time: 0.406626 Nov 02 11:53:52.909864 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 526/1036] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:52 2022] DELETE /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:53:52.926344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:52.927213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:52.939792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.940606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.945636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:52.945636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:52.945636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:52.945636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.094078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.113047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.118080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.139165 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcd7d54f-cf27-4121-ab6c-0ce2a8ce9978 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1445 microversion: 2.75 time: 0.221711 Nov 02 11:53:53.153556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.156270 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 527/1037] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:52 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1445 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:53.163836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff3a0e47-16af-43ac-b1fe-f341731f7369 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.307333 Nov 02 11:53:53.164315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:53.165041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:53.166311 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 511/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:52 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:53.172279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:53.172822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.173382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.173694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:53.173897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.174895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.175769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.176641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.197807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.198399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.198906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.199720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.200256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.200751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.426061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.428563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.438808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bde990e-05ea-4e5d-88eb-de6be1ed44d6 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.270902 Nov 02 11:53:53.440042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 512/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:53 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:53.444731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162a4c4e-b03e-4587-9e10-75ae1727d583", "name": "network-vif-plugged", "status": "completed", "tag": "720103ce-5339-4505-b619-52a0d9df27dc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:53.462264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-137c1914-938b-49ac-95cf-f1ae98900297 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1471 microversion: 2.1 time: 0.285308 Nov 02 11:53:53.462752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.462752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.462752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.467761 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 528/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:53 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:53.468029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] Creating event network-vif-plugged:720103ce-5339-4505-b619-52a0d9df27dc for instance 162a4c4e-b03e-4587-9e10-75ae1727d583 on n-h1-855649-4 Nov 02 11:53:53.473803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-92a0b3b4-ce32-4e3a-9957-2a119f941481 req-cd241343-c0e2-4dab-a826-4ea397357e91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Nov 02 11:53:53.474724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 513/1041] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:53.483880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f894005c-510e-402d-9ed6-29bf79d09e5c", "tag": "635abca2-a3c4-43fb-b9f7-670b344601af"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:53.502023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.502843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.503617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.523371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] Creating event network-changed:635abca2-a3c4-43fb-b9f7-670b344601af for instance f894005c-510e-402d-9ed6-29bf79d09e5c on n-h1-855649-4 Nov 02 11:53:53.529521 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-75af5c06-8044-4c0c-b208-589b3264958f req-0deff173-903e-40ec-b988-84744d540d21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059350 Nov 02 11:53:53.530121 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 529/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:53.744346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:53.745151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:53.755621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.755621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.755922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.756586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.757038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.758066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.884497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:53.885309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:53.892241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.892981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.893418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.894223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:53.894807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:53.895256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:53.908827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.921482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96a1b015-3148-4427-a257-70456539c244 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.181308 Nov 02 11:53:53.922371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 514/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:53 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:53.966894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.982089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.983739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:53.990642 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33ac3681-c30b-4763-aa44-9e3a42ff3d23 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.108700 Nov 02 11:53:53.990642 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 530/1044] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:53 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:54.164162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:54.165165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:54.171652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.172145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.172593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.173290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.173751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.174272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.199558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:54.200406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:54.204100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:54.208495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.209095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.209864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.211320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.211916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.212729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.240808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.250030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.251809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.256960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c207eef-e5c2-4490-aff2-65dab0c1ef07 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.097269 Nov 02 11:53:54.257575 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 515/1045] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:54 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:54.394787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.404639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45518f0d-4d7a-4717-9aa6-481f5d9f5e19 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.209823 Nov 02 11:53:54.410331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 531/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:54 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:54.464702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:54.465537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:54.476822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.477536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.478184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.479268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.479949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.481423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.486218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:54.486845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:54.495726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.496568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.497139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.498037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.498510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.499093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.878042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.881188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:54.890765 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9bc5e07-3304-49eb-98e2-48b0007c8f79 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1471 microversion: 2.1 time: 0.408917 Nov 02 11:53:54.891638 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 532/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:54 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:54.911326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c6ccd22-edf4-4829-a90f-881a8105ae56 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.453356 Nov 02 11:53:54.911912 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 516/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:54 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:54.954913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:54.955685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:54.963110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.963980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.964439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:54.965223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:54.965640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:54.966073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.019503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:55.020121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:55.026016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.026507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.026945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.027770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.028129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.028561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.125168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.135488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.137754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.143980 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5f355fc-753e-4995-bc73-d31c366d4356 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.128120 Nov 02 11:53:55.145065 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 517/1049] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:55 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:55.292517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:55.293017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:55.321953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.326623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.328356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.332367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.334188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.335271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.336306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4af589bc-b0eb-4a50-a8d8-c1c3b2ffeb96 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.384561 Nov 02 11:53:55.336806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.337781 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 533/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:54 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:55.435794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:55.436459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:55.436760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.445803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.446495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.453079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.453079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.453079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.453079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.453456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.453456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.462789 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d9f4974-51df-4a2e-b1de-ae10421bb6a1 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.174033 Nov 02 11:53:55.464708 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 518/1051] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:55 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:55.716696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4d2599-dcde-4200-a78a-03abf1f8217f", "name": "network-vif-deleted", "tag": "9f6b4a14-79ed-4102-929a-9ea8df15bcdc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:55.736026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.736796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.737474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.743268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:55.746800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:55.759936 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb14c0d5-ca89-468a-9160-6baba5ab5a45 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.334345 Nov 02 11:53:55.760705 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 534/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:55 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:55.762217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] Creating event network-vif-deleted:9f6b4a14-79ed-4102-929a-9ea8df15bcdc for instance cb4d2599-dcde-4200-a78a-03abf1f8217f on n-h1-855649-4 Nov 02 11:53:55.770804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-09f859d1-d1c0-4b5f-9c12-aa9837a61d22 req-20b88660-eced-40df-a4bf-b11b9b248de7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061502 Nov 02 11:53:55.771856 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 519/1053] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:53:55.920365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:55.920915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:55.931952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.932491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.932999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.933796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.934305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.934800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.947574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:55.948443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:55.956827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.961577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.961577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:55.961577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:55.961577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:55.962796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.063724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.081346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4bc1794-d17e-4fea-8c67-87a15e1be393 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1300 microversion: 2.1 time: 0.170528 Nov 02 11:53:56.082460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 535/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:55 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:56.192767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:56.193620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:56.196950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.200851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.201385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.202057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.202963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.203443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.203870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.207147 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-503a513c-4b27-4b0f-9bc4-4575d3d0238f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.264706 Nov 02 11:53:56.207800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 520/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:55 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:56.276861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.292205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.294553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.302700 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f1783ed-3799-44e5-8035-7a7c2877be67 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.116653 Nov 02 11:53:56.303638 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 536/1056] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:56 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:56.369791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:56.370434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:56.376590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.377096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.377529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.378206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.378655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.379104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.493323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:56.493930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:56.506419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.506900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.507483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.508187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.508639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.509066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.519316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.528500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24289596-50ef-46c1-afa7-b3b4182d116f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.162405 Nov 02 11:53:56.529628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 521/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:56 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:56.579094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.590747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.590747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.595910 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31879923-bb0a-43d4-9f7f-15af7b24aa42 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.107176 Nov 02 11:53:56.598513 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 537/1058] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:56 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:56.785198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:56.785903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:56.792791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.793354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.793798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.794499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:56.794958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:56.795486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:56.978277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:56.987186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c97a386-186f-46e9-a9ba-60f6002175dc tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.205944 Nov 02 11:53:56.988046 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 522/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:56 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:57.110383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:57.111030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:57.118337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.119952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.119952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.120276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.120747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.121222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.154584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-plugged", "status": "completed", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:53:57.155116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.155615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.156054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.156498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid cb4d2599-dcde-4200-a78a-03abf1f8217f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:57.167480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.168489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.169369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.188731 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] Creating event network-vif-plugged:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:53:57.193883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6100a244-497f-4cc9-8efa-2da9bf0ecae4 req-a299603a-f0f3-4cc2-8b68-4c1758e2e936 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043016 Nov 02 11:53:57.195496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 523/1060] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:53:57.202186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.210270 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01126db6-a512-4f2c-acfb-38609bf48915 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1305 microversion: 2.1 time: 0.103790 Nov 02 11:53:57.213014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 538/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:57 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:57.241751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:57.242463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:57.248944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.250689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.250689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.250689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.251028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.251447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.348622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:57.349744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:57.360905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.361703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.363153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.364379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.366608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.369290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.446053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.468925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.474447 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46a6d4b7-41b8-4fbf-b1f6-3b5a4bb211a0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1293 microversion: 2.1 time: 0.236792 Nov 02 11:53:57.475593 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 524/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:57 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1293 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:53:57.480026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.481690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.487001 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba46ef30-2e1a-4109-94aa-dd856a528458 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.145641 Nov 02 11:53:57.487579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 539/1063] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:57 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:57.554332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:57.554946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:57.561760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.562555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.563000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.563757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.564209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.565610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.624094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:57.624701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:57.632174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.632678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.633232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.634031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:57.634568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:57.635008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:57.715321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.723824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.725360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.730928 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ea2e750-ed71-43a1-9ccf-e52fe415aecb tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.110743 Nov 02 11:53:57.731563 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 540/1064] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:57 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:57.732067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:57.740010 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46e332ad-44e2-40d4-96d5-d3ac06ee45eb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.189589 Nov 02 11:53:57.740580 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 525/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:57 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:58.015249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.015805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.022736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.023256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.023731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.024442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.024902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.025335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.029506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:58.170405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.180496 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1863ddba-fff8-4b12-be92-bd25319e979a tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.169256 Nov 02 11:53:58.181071 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 541/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:58.233740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.234348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.241069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.241570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.242186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.243005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.243464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.243888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.275702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.276184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.276642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.277087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid cb4d2599-dcde-4200-a78a-03abf1f8217f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:53:58.333568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.342929 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-123c3c1d-de25-4006-bfad-975e5f167cbd tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 200 len: 1305 microversion: 2.1 time: 0.113001 Nov 02 11:53:58.355823 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 526/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:58.498514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.499261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.513127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.515194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.515791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.519144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.519144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.520229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.551163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.551163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.551163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.551163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.551821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.551821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.551821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.551821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.653055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.666578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.669232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.678700 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be1bc47e-d39d-4fbe-bbe5-2f82ce0035a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.167444 Nov 02 11:53:58.680232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 527/1068] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:58.731316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.739072 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b49d57a7-0304-4f49-a198-552678ffbae9 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1484 microversion: 2.1 time: 0.245188 Nov 02 11:53:58.739689 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 542/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1484 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:58.759740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.760435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.763006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.769555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.769716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:53:58.769716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.769981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.770103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.770322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.770794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.770930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.772093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.772093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.772352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.772495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.772930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.774160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.890237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.899864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.901567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:58.903639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f8517c3-670d-4c02-801c-a17238b9c746 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144627 Nov 02 11:53:58.904650 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 543/1070] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:53:58.907080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6eefb56-890b-4634-833c-d901d13ab4d3 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.151963 Nov 02 11:53:58.907658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 528/1071] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:53:58.909786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:58.910534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:58.918228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.919054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.919912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:58.920783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:58.921403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:58.921826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.090928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:59.100061 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbba462d-a732-413a-ae98-f1ac09fe64be tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.194088 Nov 02 11:53:59.101539 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 544/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:58 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:59.206186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.206648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.215599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.218195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.218195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.218195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.218195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.218800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.369102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.369828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: cb4d2599-dcde-4200-a78a-03abf1f8217f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.377083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.377718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.378261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.379109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.379677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.380230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.396089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:59.403160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f HTTP/1.1 Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:53:59.404852 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. Nov 02 11:53:59.406235 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cb4d2599-dcde-4200-a78a-03abf1f8217f'} Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:53:59.407028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. Nov 02 11:53:59.408895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:53:59.410399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance cb4d2599-dcde-4200-a78a-03abf1f8217f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:53:59.410502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bfcde77-7f9e-4ada-bc1c-cb5b52a7d7aa tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.205439 Nov 02 11:53:59.410603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29ca2fec-cfd9-458a-9207-ce26514319a5 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f" status: 404 len: 111 microversion: 2.1 time: 0.041769 Nov 02 11:53:59.410603 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 545/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:59 2022] GET /compute/v2.1/servers/cb4d2599-dcde-4200-a78a-03abf1f8217f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:53:59.423552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 529/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:53:59 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:53:59.433097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.433097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.439672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.440166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.440604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.441314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.442498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.442946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.478072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:53:59.705713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.706317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.712244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.713005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.713438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.714133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.714585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.715027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.781247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:59.791988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:59.793444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:53:59.798685 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e622851-62d9-472b-b352-71ad625bad44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.096899 Nov 02 11:53:59.799312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 530/1075] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:59 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:53:59.948972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.949541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.955482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.955966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.956398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.957212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.957675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.958098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.970924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a7850cc-d39d-4978-9156-4f478bf6d366 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 204 len: 0 microversion: 2.1 time: 0.545085 Nov 02 11:53:59.974496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 546/1076] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:59 2022] DELETE /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:53:59.980490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:53:59.981079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:53:59.987090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.987578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.988150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:53:59.988854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:53:59.989308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:53:59.989732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.018659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:00.033884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.043172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.044808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.050378 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c91d132-5b2c-4fcf-8640-962532881cc5 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.107645 Nov 02 11:54:00.051193 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 531/1077] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:53:59 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:00.124805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:00.125434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:00.131793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.132982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.146469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.146469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.146469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.146469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.285973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.299637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-043c27a7-c070-473d-b7c0-6c5e310f41a1 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1484 microversion: 2.1 time: 0.180331 Nov 02 11:54:00.310808 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 532/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:00 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1484 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:00.316033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:00.317358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:00.324206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.324444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.324731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.325437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.326066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.326660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.463849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.472270 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2508047f-9fa6-495e-ba7f-36438b4b0a22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 204 len: 0 microversion: 2.1 time: 0.495238 Nov 02 11:54:00.476058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 547/1079] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:53:59 2022] DELETE /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:54:00.477571 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-846776f1-abf3-4d35-bd06-94f8af6e88da tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.165326 Nov 02 11:54:00.478859 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 533/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:00 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:00.484017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:00.484855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:00.491830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.492509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.493143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.497455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162a4c4e-b03e-4587-9e10-75ae1727d583", "tag": "720103ce-5339-4505-b619-52a0d9df27dc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:00.506737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.506737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.506737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.507779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.508045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.508645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.520489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] Creating event network-changed:720103ce-5339-4505-b619-52a0d9df27dc for instance 162a4c4e-b03e-4587-9e10-75ae1727d583 on n-h1-855649-4 Nov 02 11:54:00.525990 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-109e053d-1ae9-44e8-998a-53146f4b0d56 req-d787d981-354c-4d00-91e8-d178c2cc2ee4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048499 Nov 02 11:54:00.526765 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 548/1081] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:00.531886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:00.532606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:00.539225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.541109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.541109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.541109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.541442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.541680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.721634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.734855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.740421 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7ac5e5d-3719-45d0-9a60-383a8c084f34 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.260226 Nov 02 11:54:00.741250 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 534/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:00 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:00.744182 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfceb2e8-3941-44cd-aabd-a3c09fc35135 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1473 microversion: 2.1 time: 0.216277 Nov 02 11:54:00.744943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 549/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:00 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:00.828389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:00.829687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:00.835669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.836303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.837020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.838521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.838697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.839242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:00.919712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.929721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.931431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:00.936904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4df38e22-b1ff-4d3e-ba59-07150333593b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.113186 Nov 02 11:54:00.937782 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 535/1084] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:00 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:00.967690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f894005c-510e-402d-9ed6-29bf79d09e5c", "name": "network-vif-plugged", "status": "completed", "tag": "635abca2-a3c4-43fb-b9f7-670b344601af"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:00.978706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:00.979251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:00.979691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.092414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:01.093256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:01.109853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.110541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.111412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.112333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.113722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.114296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.218422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:01.221120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:01.230750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:01.234017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:01.240447 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15f0c5ba-9ac5-477d-8664-9fd055a7cad6 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1451 microversion: 2.75 time: 0.162035 Nov 02 11:54:01.241853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 536/1085] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:01 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:01.268248 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] Creating event network-vif-plugged:635abca2-a3c4-43fb-b9f7-670b344601af for instance f894005c-510e-402d-9ed6-29bf79d09e5c on n-h1-855649-4 Nov 02 11:54:01.277152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0ea86796-119f-485c-8907-20e691bf2bfa req-193fe252-4a5f-400f-b4ba-67b5f9fc3173 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312520 Nov 02 11:54:01.281689 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 550/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:01.502596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:01.510537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:01.513466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.513984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.514414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.515173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.515633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.516060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.693902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:01.707774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0469acca-ca6a-433e-82a4-4e86fb327091 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.209034 Nov 02 11:54:01.709397 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 537/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:01 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:01.765437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:01.766851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:01.769552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:01.770532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:01.779706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.780528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.780879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.781013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.781701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.781836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.782169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.782512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.783323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:01.783444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:01.783930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:01.784498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.052507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.061381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.063104 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ba3690a-8cb6-4086-8390-75924e40fe09 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1473 microversion: 2.1 time: 0.298428 Nov 02 11:54:02.063701 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 538/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:01 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1473 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:02.068898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:02.069042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:02.073976 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9813cd5a-b4ff-443a-b4fa-9219189352cf tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.313062 Nov 02 11:54:02.074696 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 551/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:01 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:02.074837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.075263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.075692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.076391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.076867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.077290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.143435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.152300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.153760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.158703 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b37fbe0-ae79-46c8-b37d-636e84e117bb tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.094061 Nov 02 11:54:02.159322 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 539/1090] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:02 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:02.274788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:02.275425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:02.282514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.283162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.283661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.284373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.284867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.285297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.379428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.388489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.389967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:02.395294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab15a738-e566-44e1-9059-215a3a19f40f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1436 microversion: 2.75 time: 0.125840 Nov 02 11:54:02.395864 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 552/1091] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:02 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1436 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:02.548471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:02.551726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:02.558065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.558573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.559101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.559818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.560268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.560690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.640621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:54:02.641048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:54:02.641526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:54:02.642193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:54:02.642857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:54:02.738324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:02.739203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:02.746904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.747690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.748403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.749389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.750091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.750670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.883609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:02.895962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.896815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.897407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:02.898204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:02.898892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:02.899365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.010188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.012218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:03.020208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-924b59de-167f-4421-b344-78d7e996ff7d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1479 microversion: 2.1 time: 0.285611 Nov 02 11:54:03.021180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 553/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:02 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1479 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:03.080146 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28a26942-8f14-43a9-a47f-515ba4ff7046 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe/action" status: 202 len: 1938 microversion: 2.75 time: 0.659883 Nov 02 11:54:03.088607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:03.090740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:03.094841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 540/1093] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:54:02 2022] POST /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe/action => generated 1938 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 11:54:03.107612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.109168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.109988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.110743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:03.111651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:03.112754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.116004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.117322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.129304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.130292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.132831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.139193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.139193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.139193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.271253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.280562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d945adf-a65b-44f5-a542-0a5e8bc03980 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1431 microversion: 2.1 time: 0.198135 Nov 02 11:54:03.281053 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 554/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:03 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1431 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:03.286838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:03.287863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:03.301048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.301836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.303128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.304664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.305612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.306234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.415715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.424717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e1adeed-d7ae-4769-beb4-6ee4f838b5a9 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1314 microversion: 2.1 time: 0.326841 Nov 02 11:54:03.425561 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 541/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:03 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:03.426151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:03.430808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc717d3-9a5e-49f9-a01a-0cf651aa0170", "name": "network-vif-deleted", "tag": "62877c90-8086-436b-9673-3a6df76d7a30"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:03.441400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.442177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.442789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.450688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b6fee79-df41-4fc6-b862-a624a25217d7 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.165392 Nov 02 11:54:03.452301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 555/1096] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:03 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:03.457452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:03.461742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:03.463343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:03.465720 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] Creating event network-vif-deleted:62877c90-8086-436b-9673-3a6df76d7a30 for instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 on n-h1-855649-4 Nov 02 11:54:03.467590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.468105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.468578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.469320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:03.469832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:03.470308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:03.477017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e825460c-1065-4336-b2e2-f290d210560c req-caaa64f8-c06e-494c-8ae7-4dbd095b0dee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049801 Nov 02 11:54:03.478080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 542/1097] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:03.496136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:03.557315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.566323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.567909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:03.575532 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b06aca0-6425-405f-ac89-0d9193060f8e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.121598 Nov 02 11:54:03.576785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 556/1098] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:03 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:04.050084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.050821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.057270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.057736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.058180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.058876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.059345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.059777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.313565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.314251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.323738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.324229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.324669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.325391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.325847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.326278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.369123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.369737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.370217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.370676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:04.596333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:04.613840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37ab9290-3b8a-41c4-98bc-096ccb488944 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 200 len: 1308 microversion: 2.1 time: 0.304812 Nov 02 11:54:04.615129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 557/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:04.623664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.624861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.626541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:04.637515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.638550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.639065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.639810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.640368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.641067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.652921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10366982-d173-4760-aca7-2b71255b9b3c tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1464 microversion: 2.1 time: 0.607918 Nov 02 11:54:04.654437 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 543/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1464 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:04.660689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.661833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.675932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.676729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.677407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.678354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.690733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.691635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.886414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:04.917500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8489087-cd24-40d5-a9bf-728bd4a5df89 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.260155 Nov 02 11:54:04.918839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 544/1101] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:04.929609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:04.930945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:04.952758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.953939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.956442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:04.960730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:04.961861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:04.965051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.014928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.038959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c250cc8d-002e-4e5b-aab6-e41209d25f32 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1462 microversion: 2.1 time: 0.421592 Nov 02 11:54:05.051405 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 558/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1462 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:05.051405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:05.051405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.056821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.057328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.057776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.058784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.059824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.060275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.092968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.122129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.123772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.130179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe5b97ff-6d17-4aa2-a832-7701f4201067 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.209321 Nov 02 11:54:05.130769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 545/1103] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:04 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:05.240521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Calling method '.version_select at 0x7ff1b3886a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.253429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.254136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.254640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.273516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.274064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.274505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.313643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6ecb328-ab45-4a60-952d-e27bc3b8b63e tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/be08d780f94a4716a8a0b6465dc64741?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846" status: 200 len: 695 microversion: 2.1 time: 0.167373 Nov 02 11:54:05.323738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 546/1104] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/os-simple-tenant-usage/be08d780f94a4716a8a0b6465dc64741?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846 => generated 695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:05.334689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '.version_select at 0x7ff1b3854160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.354468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.354997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.356625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.370338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.370844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.371313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.387187 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-824abfec-7bed-4c79-9a2e-e963395d7907 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/be08d780f94a4716a8a0b6465dc64741?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846" status: 200 len: 695 microversion: 2.1 time: 0.058553 Nov 02 11:54:05.394937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 547/1105] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/os-simple-tenant-usage/be08d780f94a4716a8a0b6465dc64741?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846 => generated 695 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:05.414714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Calling method '.version_select at 0x7ff1b389bf70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.425134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.428994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.428994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.445130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.445899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.446522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.508556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c81f0c4-cb51-4e25-a330-a2c305cf98bb tempest-TenantUsagesTestJSON-1421317221 tempest-TenantUsagesTestJSON-1421317221-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846&detailed=1" status: 200 len: 13549 microversion: 2.1 time: 0.102063 Nov 02 11:54:05.515132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 548/1106] 10.222.0.48 () {58 vars in 1335 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T11%3A54%3A05.068846&end=2022-11-03T11%3A54%3A05.068846&detailed=1 => generated 13549 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:05.521730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8c071ad-704c-4f72-924c-ad51dcce93ea", "name": "network-vif-deleted", "tag": "b5eafcf5-2cf8-4479-9419-8df955fec7cc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:05.534714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.535526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.536062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.539174 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e324c59e-276b-4c2f-819a-fb2360239a2f tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 0 microversion: 2.1 time: 0.497667 Nov 02 11:54:05.543491 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 559/1107] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:54:05 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:05.549044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.557617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.557617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.557868 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] Creating event network-vif-deleted:b5eafcf5-2cf8-4479-9419-8df955fec7cc for instance f8c071ad-704c-4f72-924c-ad51dcce93ea on n-h2-855649-4 Nov 02 11:54:05.557969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.558499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.559404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.560012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.560600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.562103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b774378-c0cf-437b-a388-2b06fc2ffe5d req-8e39792f-1752-4057-a6af-67d0d1ce70cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045618 Nov 02 11:54:05.563357 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 549/1108] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:05.570498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.571272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.590917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.592055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.592540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.593282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.599179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.599692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.602533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:05.645550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.645927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.655199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.655199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lazy-loading 'fault' on Instance uuid 625bd2f4-c703-4210-9c7e-51e3549762ae {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:05.813113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7576cc96-913b-45ec-abef-49cda4600353 tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1598 microversion: 2.1 time: 0.246917 Nov 02 11:54:05.814910 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 550/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1598 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:05.820440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.821210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 7cc717d3-9a5e-49f9-a01a-0cf651aa0170] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.829368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.830105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.830633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.831565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.832107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.832629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.868930 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 HTTP/1.1 Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:05.872400 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. Nov 02 11:54:05.873862 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '7cc717d3-9a5e-49f9-a01a-0cf651aa0170'} Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:05.874587 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. Nov 02 11:54:05.875921 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:05.877048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance 7cc717d3-9a5e-49f9-a01a-0cf651aa0170 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:05.877048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efbf43fa-8a0d-46d7-a419-e00d7171922d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170" status: 404 len: 111 microversion: 2.1 time: 0.058068 Nov 02 11:54:05.877048 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 551/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/servers/7cc717d3-9a5e-49f9-a01a-0cf651aa0170 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:05.887706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:05.889117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:05.904088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.904559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.905094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.905814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:05.906320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:05.907226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:05.986139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:05.995625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f45b3d16-1335-446b-a92f-577dd83b6bd3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1303 microversion: 2.1 time: 0.112233 Nov 02 11:54:05.996413 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 552/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:05 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:06.001386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:06.003961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.011741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.012227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.012665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.013487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.014045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.014472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.062077 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab67a37f-205c-4d12-bd99-244ba8a5cd9c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 204 len: 0 microversion: 2.1 time: 0.516690 Nov 02 11:54:06.065965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 560/1112] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:05 2022] DELETE /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:06.068511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.069209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.076013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.076509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.077078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.077803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.078256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.078682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.158036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:06.172812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:06.180578 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5467f8d4-b0ff-4b2c-8ab2-b43df8942afd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.116365 Nov 02 11:54:06.181845 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 561/1113] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:06.187104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.188068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.205538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.207745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.208345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.209531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.209995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.210587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.358373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:06.367480 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f20a2625-0363-45cb-93b6-bcf19e89974d tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1468 microversion: 2.1 time: 0.183374 Nov 02 11:54:06.369617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 562/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:06.375255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.381104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.390141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.390634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.391116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.391827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.392284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.392716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.401703 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89ffb195-f3b8-456d-922b-64a9286a0f3c tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action" status: 202 len: 0 microversion: 2.1 time: 0.403729 Nov 02 11:54:06.402617 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 553/1115] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:54:05 2022] POST /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:06.411987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.412888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.420258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.420874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.423723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.423723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.423723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.424646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.463710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:06.473134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:06.474576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:06.480613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66c7e60d-f8bb-4876-b178-bf9c081f4c34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.109542 Nov 02 11:54:06.481339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 563/1116] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:06.558109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64f35925-18bb-478f-a56c-a8ffdcf0440b tempest-ServersAdminTestJSON-69832889 tempest-ServersAdminTestJSON-69832889-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1615 microversion: 2.1 time: 0.150017 Nov 02 11:54:06.558676 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 554/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:06.580279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.580792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.587519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.588003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.588439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.589131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.589588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.590010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.614958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:06.924990 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3084019-3b22-44a6-a4c2-c9c7314eaadb tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 204 len: 0 microversion: 2.1 time: 0.348187 Nov 02 11:54:06.925579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 564/1118] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:06 2022] DELETE /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:54:06.934066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:06.934717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:06.941188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.941700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.942203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:06.942894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:06.943403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:06.943829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.020544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:07.021445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:07.028022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.028600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.029051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.029764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.030235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.030708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.063311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.063806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.064251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.064885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid f8c071ad-704c-4f72-924c-ad51dcce93ea {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:07.095691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.106304 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35ef0d5f-b81c-4761-b508-85698b8eb334 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1469 microversion: 2.1 time: 0.176187 Nov 02 11:54:07.107018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 555/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:06 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:07.113009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.121147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff3580d7-8da4-4c82-888e-bb7fb29f5aca tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1308 microversion: 2.1 time: 0.105037 Nov 02 11:54:07.121834 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 565/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:07 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:07.209042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:07.209565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:07.216382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.216873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.217314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.218014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.218469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.218898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.290725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:07.307726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1a457c0-b9dd-438e-9f8a-eb61db794ed2 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.102729 Nov 02 11:54:07.308309 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 556/1121] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:07 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:07.393274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:07.393897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:07.401807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.402301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.402741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.403490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.403950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.404381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.508101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:07.509372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:07.515490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.515986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.516425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.517136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:07.517596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:07.518028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:07.544751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.552835 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8363b723-da10-468a-b32a-a2e75da3cf47 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1468 microversion: 2.1 time: 0.163568 Nov 02 11:54:07.553409 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 566/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:07 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:07.584289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.593395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.594823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:07.599961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43e31dc3-cd1f-4548-a900-26df0f8718fe tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.095806 Nov 02 11:54:07.600530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 557/1123] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:07 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:08.134606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.135467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.143743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.145156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.145342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.145941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.146932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.147348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.147834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.148409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.156911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:08.157882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.158649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.159267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.160073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.160728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.161700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.210670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.211424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.212872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.213545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid f8c071ad-704c-4f72-924c-ad51dcce93ea {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:08.264368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.272404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab55b6ef-459d-40f2-9621-fa8f96e5c07c tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 200 len: 1308 microversion: 2.1 time: 0.131856 Nov 02 11:54:08.272968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 558/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:08.325459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.337767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.337968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5beaa338-18f0-48b3-8c1f-bde55ebfb057 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1469 microversion: 2.1 time: 0.206882 Nov 02 11:54:08.338561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.340623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:08.351985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.352771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.353849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.359225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.359225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.359625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.437333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f894005c-510e-402d-9ed6-29bf79d09e5c", "name": "network-vif-deleted", "tag": "635abca2-a3c4-43fb-b9f7-670b344601af"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:08.444576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:08.449005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.449709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.450309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.464980 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] Creating event network-vif-deleted:635abca2-a3c4-43fb-b9f7-670b344601af for instance f894005c-510e-402d-9ed6-29bf79d09e5c on n-h1-855649-4 Nov 02 11:54:08.465245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c9c8f6b-ee31-464f-93fe-996261369b47 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.130878 Nov 02 11:54:08.465245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 559/1126] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:08.467957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-aef83f52-c7d6-42ca-bb62-74a7e08f2cb7 req-aef5455e-2b99-418f-899b-d005a911b771 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Nov 02 11:54:08.468836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 568/1127] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:54:08.576225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.576843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.583126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.583624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.584083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.584788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.585257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.585688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.627859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:08.628704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:08.635676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.636242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.636926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.637643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:08.638166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:08.638597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:08.653569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.657694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70c66430-348a-41ad-aa1f-d5f9cef5878c tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1299 microversion: 2.1 time: 0.085262 Nov 02 11:54:08.671334 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:08.710662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.721011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.722366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:08.727717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cd247f6-1be8-401c-b97e-9f6a18fb15e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1558 microversion: 2.91 time: 0.104192 Nov 02 11:54:08.728219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 569/1129] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:08 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1558 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:09.296808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.297649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: f8c071ad-704c-4f72-924c-ad51dcce93ea] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.304065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.304555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.305028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.305723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.306177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.306623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.320601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea HTTP/1.1 Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:09.322149 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. Nov 02 11:54:09.329593 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'f8c071ad-704c-4f72-924c-ad51dcce93ea'} Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:09.330636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. Nov 02 11:54:09.332055 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:09.333349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance f8c071ad-704c-4f72-924c-ad51dcce93ea could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:09.333349 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84b3d8b1-89a6-44c8-99fa-c86bf778b6c8 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea" status: 404 len: 111 microversion: 2.1 time: 0.030890 Nov 02 11:54:09.333349 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 561/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:09 2022] GET /compute/v2.1/servers/f8c071ad-704c-4f72-924c-ad51dcce93ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:09.335857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfe37757-5afc-4e59-889a-cd6cbf7f2f4d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.361687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.362293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.375996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:09.380049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.380572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.381094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.381850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.382374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.382925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.529326 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfe37757-5afc-4e59-889a-cd6cbf7f2f4d tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/f9ed0205-d90d-4b2e-bddb-cafa38aa4506" status: 204 len: 0 microversion: 2.1 time: 0.197166 Nov 02 11:54:09.529958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 570/1131] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 11:54:09 2022] DELETE /compute/v2.1/os-server-groups/f9ed0205-d90d-4b2e-bddb-cafa38aa4506 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:09.534608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.535274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.541923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.542422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.542871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.543608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.544247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.544686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.700548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:09.716928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:09.719173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c78a3b71-19b5-4c32-8e4b-63c56def0a7f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.188027 Nov 02 11:54:09.731445 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 571/1132] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:09 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:09.731639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ab50353-a487-4c40-ae94-ac73a1bd0a17 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1469 microversion: 2.1 time: 0.367970 Nov 02 11:54:09.731725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.731725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.731895 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 562/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:09 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:09.742275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.742275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.746938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.746938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.746938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.747830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.748357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.748798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.759436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.760074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.760512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.761232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.761716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.762150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.787623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:09.822274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.822680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.823520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.823701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lazy-loading 'fault' on Instance uuid f894005c-510e-402d-9ed6-29bf79d09e5c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:09.932102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a85962741804c17a4377f88ab666b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be08d780f94a4716a8a0b6465dc64741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:09.941617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a5953fa-5cef-4524-9514-aa38e54c3f77 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 200 len: 1304 microversion: 2.1 time: 0.210617 Nov 02 11:54:09.955237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 563/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:09 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:09.955237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:09.955237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:09.955237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.955634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.955634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:09.956713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:09.959323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:09.959323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.038253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.046704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.048183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.053112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c42dba67-dd5c-4add-beb9-af30900fee1d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1558 microversion: 2.91 time: 0.110377 Nov 02 11:54:10.053720 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 564/1135] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:09 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1558 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:10.188102 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-102b1b90-aacc-48bb-a9e4-2faa154d6276 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 204 len: 0 microversion: 2.1 time: 0.466998 Nov 02 11:54:10.188877 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 572/1136] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:09 2022] DELETE /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:10.198038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.198539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.204599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.205077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.205515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.206211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.206672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.207192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.232611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:10.370231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c81f15-7201-49b2-9081-a5ef032bc7cd", "name": "network-vif-deleted", "tag": "d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:10.380746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.381382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.381807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.393671 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] Creating event network-vif-deleted:d5ec7cf4-b0c5-4272-bfa0-32bea8bba2ba for instance e4c81f15-7201-49b2-9081-a5ef032bc7cd on n-h2-855649-4 Nov 02 11:54:10.399322 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-04cad2dc-ad9e-4526-b815-b78f0cda789e req-cbc2f2f8-d5d3-4147-a626-0e2dff1ffbc9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033984 Nov 02 11:54:10.399912 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 573/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:10.613657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43b075ca-3155-4dee-993e-5378370a20b7 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 204 len: 0 microversion: 2.1 time: 0.420018 Nov 02 11:54:10.614632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 565/1138] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:10 2022] DELETE /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:10.624716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.625419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.631869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.632258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.632695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.633404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.633863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.634329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.751405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.752554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.759535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.760053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.760460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.761172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.761622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.762038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.799883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.808774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afd119b3-3bff-4c3a-86a3-192700d8bd2f tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1474 microversion: 2.1 time: 0.189702 Nov 02 11:54:10.824571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 574/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:10 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:10.824571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.824571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.824571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.825064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.825064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.825064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.825064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.825450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.841752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:10.845896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:10.851170 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c5b122-a4fb-4379-b3cc-139fd7599926 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1427 microversion: 2.1 time: 0.104920 Nov 02 11:54:10.851768 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:10 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:10.906474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:10.925507 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cefbb9c-8d4c-4ea8-b1a2-af84f0dcc2a0 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.114948 Nov 02 11:54:10.926058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 575/1141] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:10 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:10.970684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:10.971325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] [instance: f894005c-510e-402d-9ed6-29bf79d09e5c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:10.979208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.979696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.980129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.981156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:10.981593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:10.982055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:10.996590 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] HTTP exception thrown: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Request method failure captured: Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c HTTP/1.1 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlpFn6HB9lDJxDWHg4DAmUUhVcmrbeLwg0kkXaiqkXFZP-IEpyfYX-ygCTB4xUCxRBGNMLYVflC1Aq29F7D83zUippN29v-6EYl6fY7hdrUyQkwSP7RpV2Kq2VF5KApOQ5cF2Y9UMzj7oHMi6PnWwcwWq5ykWPAg-2LNPIawbujdJwE Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: be08d780f94a4716a8a0b6465dc64741 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TenantUsagesTestJSON-2050798497 Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:10.998223 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/be08d780f94a4716a8a0b6465dc64741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_be08d780f94a4716a8a0b6465dc64741", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/be08d780f94a4716a8a0b6465dc64741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/be08d780f94a4716a8a0b6465dc64741"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TenantUsagesTestJSON-2050798497 Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: be08d780f94a4716a8a0b6465dc64741 Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2050798497 Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TenantUsagesTestJSON-2050798497-project Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4a85962741804c17a4377f88ab666b32 Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TenantUsagesTestJSON-2050798497-project Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. Nov 02 11:54:10.999803 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'f894005c-510e-402d-9ed6-29bf79d09e5c'} Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:11.000797 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. Nov 02 11:54:11.002135 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:11.003519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] Returning 404 to user: Instance f894005c-510e-402d-9ed6-29bf79d09e5c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:11.003519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fe41b90-a107-4378-ae4e-a829cd4949a1 tempest-TenantUsagesTestJSON-2050798497 tempest-TenantUsagesTestJSON-2050798497-project] 10.222.0.48 "GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c" status: 404 len: 111 microversion: 2.1 time: 0.033890 Nov 02 11:54:11.003519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 567/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:10 2022] GET /compute/v2.1/servers/f894005c-510e-402d-9ed6-29bf79d09e5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:11.082428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:11.083268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:11.093226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.093763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.094278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.095272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.095901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.100375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.186276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:11.197215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:11.198838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:11.206652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c414f16-0031-49d0-8442-a8d0e0d9dd5b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.128627 Nov 02 11:54:11.207645 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 576/1143] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:11 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:11.832701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:11.833960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:11.841863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.842833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.843666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.845170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.846346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.846950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.887502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:11.888413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:11.906628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.907539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.908175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:11.909008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:11.909466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:11.909895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.010638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.022864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80b86742-f37b-4641-9886-77f7428ccc54 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1298 microversion: 2.1 time: 0.147887 Nov 02 11:54:12.035404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 577/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:11 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:12.035404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:12.035404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:12.045918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.045918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.045918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.045918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.046446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.046446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.052239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.062840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa19f322-8b09-435e-b5db-aaa8b3098b80 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1474 microversion: 2.1 time: 0.234189 Nov 02 11:54:12.076064 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 568/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:11 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:12.158619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:12.182086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9ba0760-111d-4bbd-a708-fc819b1a9faf tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.156301 Nov 02 11:54:12.182634 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 578/1146] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:12 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:12.240245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:12.240860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:12.251163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.251881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.254121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.254121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:12.254121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:12.254439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:12.453889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.463625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.465563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:12.480240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4b30eab-ed51-4b82-88a6-126cf16f676c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.244066 Nov 02 11:54:12.481082 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 569/1147] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:12 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:13.050796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.051737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.061755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.062796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.063482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.064430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.065245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.066104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.093571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.094866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.103168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.109548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.110217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.111897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.112766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.113684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.125333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.125991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.126515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.126999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lazy-loading 'fault' on Instance uuid e4c81f15-7201-49b2-9081-a5ef032bc7cd {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:13.219530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.236281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d712da51-60be-4174-ac89-0a500823716e tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1303 microversion: 2.1 time: 0.189759 Nov 02 11:54:13.251836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 579/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:13 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1303 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:13.259184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.260584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.267949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.268663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.269255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.270133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.270756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.271362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.402004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:13.436473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43f2fb42-b970-463d-b8b2-9dc6dbac3e6c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.183053 Nov 02 11:54:13.437088 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 580/1149] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:13 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:13.509436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.509973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.518232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.519036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.519697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.520405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.521029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.521456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.651837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.673406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f17adc53-44d3-4f0d-bdd9-7eb6569b7f83 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1474 microversion: 2.1 time: 0.574223 Nov 02 11:54:13.675682 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 570/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:13 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1474 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:13.711703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.718396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:13.719195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:13.723469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.725931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.726311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.726741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.732105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:13.732848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:13.733067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:13.735394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:13.752135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:13.759662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-188dbb98-6e89-4d28-81e3-e5935cc26c2a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.252803 Nov 02 11:54:13.762064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 581/1151] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:13 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:13.801021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:14.251176 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a17344b0-e3de-45ca-8fa7-db259e38dc1b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 204 len: 0 microversion: 2.1 time: 0.533198 Nov 02 11:54:14.254818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 571/1152] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:13 2022] DELETE /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:14.272574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.272574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.273236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.273236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.279469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.280476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.281119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.281235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.281745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.282187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.282530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.283096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.283794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.283934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.284288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.284825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.362195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.362971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.363804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.364658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lazy-loading 'fault' on Instance uuid e4c81f15-7201-49b2-9081-a5ef032bc7cd {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:14.448610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.470029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2607fcb-d9a6-4f27-a23c-553d361b5cf1 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 200 len: 1303 microversion: 2.1 time: 0.208581 Nov 02 11:54:14.470607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 572/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:14.487080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.487703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.502395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.507208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.507208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.507208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.510040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.510736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.677573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.684506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:14.687455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-686d238d-1a26-4507-b440-0e6db3865c27 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1714 microversion: 2.1 time: 0.426390 Nov 02 11:54:14.704857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:14.705194 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 582/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1714 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:14.710379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.724163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.735568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.737746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.738351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.741715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.742463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.745915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.752962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b428901-6fe3-4626-a891-de4c1ef2f50f tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.281281 Nov 02 11:54:14.767579 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 573/1155] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:14.802046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:14.802655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:14.810572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.813091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.813091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.813091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.813091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.813507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.925571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.935473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e93a1d0-ab6a-4eb7-956c-a5867a8b61ae tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1432 microversion: 2.1 time: 0.228749 Nov 02 11:54:14.937129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 583/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1432 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:14.944789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.956193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d49d4e-ec74-43b4-90f2-ede599ec98ed", "name": "network-vif-deleted", "tag": "8c388c0b-d300-42a8-ae3f-e5600cbba056"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:14.956570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.964026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:14.967900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:14.968392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:14.968991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:14.969678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b94775b-0d52-4a29-ba72-2016cfe12385 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.172255 Nov 02 11:54:14.970574 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 574/1157] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:14 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:14.985016 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] Creating event network-vif-deleted:8c388c0b-d300-42a8-ae3f-e5600cbba056 for instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed on n-h2-855649-4 Nov 02 11:54:14.990676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3cbe6855-46b2-4be1-b9af-600c0a32a1a1 req-d9cd2d63-1b1e-43fe-9c4b-2e7f78b3d197 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052634 Nov 02 11:54:14.993296 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 584/1158] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:15.491931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:15.496928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:15.497560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: e4c81f15-7201-49b2-9081-a5ef032bc7cd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:15.505424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.506137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.507257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.508016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.508487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.508920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.526289 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] HTTP exception thrown: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Request method failure captured: Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd HTTP/1.1 Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmyNG3yRx26eOKJwP1dPFAe94X_g2tYAo53WMftHLMNmqgBZMoiVkfKAtfkyNTAm2ApOupeuTkI2qwf_eplWX0huEk3RUH8E793z4MhfY3P2Ym7mgE3K3I2gey7S4WiXW9CLz12MYUUvpnqTcNolbQ-TDW8lM6rRyBBoF3L_52bGzs Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:15.528230 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed0b3eaeb61546c18a68bf076583582f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e305bf222f694954931ffb496f521eab Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. Nov 02 11:54:15.529784 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'e4c81f15-7201-49b2-9081-a5ef032bc7cd'} Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:15.530626 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. Nov 02 11:54:15.531839 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:15.532950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Returning 404 to user: Instance e4c81f15-7201-49b2-9081-a5ef032bc7cd could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:15.532950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2628e2e-bb73-442f-ac1c-1cdf2308182d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd" status: 404 len: 111 microversion: 2.1 time: 0.039499 Nov 02 11:54:15.532950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 575/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:15 2022] GET /compute/v2.1/servers/e4c81f15-7201-49b2-9081-a5ef032bc7cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:15.541370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:15.542167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:15.550735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.551385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.551885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.556902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.556902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.556902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.589126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:15.720842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:15.721506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:15.728386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.728877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.729313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.730023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.730479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.730931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.880242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:15.888658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f6b5225-beaf-4f35-be9d-d747a9db32b6 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1714 microversion: 2.1 time: 0.173474 Nov 02 11:54:15.889235 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 576/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:15 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1714 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:15.893577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:15.894178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:15.900354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.900839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.901274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.901959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:15.902413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:15.902840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:15.979122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:15.996485 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af4951c9-db0e-41e8-aed6-3d25029ad46b tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.106267 Nov 02 11:54:15.997130 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 577/1161] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:15 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:16.002264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:16.003024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:16.009333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.009885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.010360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.011187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.011652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.012083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.044660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.045141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.045585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.046034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid b0d49d4e-ec74-43b4-90f2-ede599ec98ed {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:16.088408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.096067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0411e5d-706c-4d61-a19a-6bad3f41f8a3 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1308 microversion: 2.1 time: 0.097944 Nov 02 11:54:16.096620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 578/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:15 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:16.101092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:16.101698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:16.108101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.108568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.109002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.109691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.110141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.110560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.174724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.183457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.184969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.190561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e232c14-6a40-4cf7-8c21-cdc91e4a7006 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.092991 Nov 02 11:54:16.191256 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 579/1163] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:16 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:16.572997 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08c866f6-e56b-4a48-a655-d6f37b567194 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 204 len: 0 microversion: 2.1 time: 1.037501 Nov 02 11:54:16.573764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 585/1164] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:15 2022] DELETE /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:16.582038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:16.582646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:16.590542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.591269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.591859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.592713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.593343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.594068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.768473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:16.778860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c09b2c5-35df-402b-9f83-4e12f6648321 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1470 microversion: 2.1 time: 0.200741 Nov 02 11:54:16.793353 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 580/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:16 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:16.914580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:16.915203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:16.921882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.922592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.923220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:16.924145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:16.927254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:16.927254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.022353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748177eb-66a3-4981-b496-4838c6f2c4d7", "name": "network-vif-deleted", "tag": "75a2eede-f2e5-4468-97b7-9f6981479c64"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:17.037958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.039089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.039763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.053864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] Creating event network-vif-deleted:75a2eede-f2e5-4468-97b7-9f6981479c64 for instance 748177eb-66a3-4981-b496-4838c6f2c4d7 on n-h2-855649-4 Nov 02 11:54:17.062330 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1011fffd-0612-4bdb-8bb5-1a7ae5cf6db5 req-0a32c9ac-3565-4605-b60a-d109e531b371 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045146 Nov 02 11:54:17.063709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 581/1166] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:17.073317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:17.074468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:17.082384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.083333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.084047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.085137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.085850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.086493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.121002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:17.132064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.150487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27abf959-17b6-4e35-8caa-6f6a8e7ad9fc tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1714 microversion: 2.1 time: 0.241010 Nov 02 11:54:17.157403 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 586/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:16 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1714 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:17.164196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:17.173971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:17.198229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.199246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.200057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.201205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.202068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.202804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.239312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:17.255463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.256255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.257238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.258451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid b0d49d4e-ec74-43b4-90f2-ede599ec98ed {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:17.296297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-110e8be3-7bef-49af-b190-871bc5a13b0e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.230905 Nov 02 11:54:17.303404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 582/1168] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:17 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:17.327438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:17.331408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:17.351382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.352522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.354060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.354914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.355517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.356150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.368373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.381470 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d38137db-89fb-4aad-ade4-a86a9047ab3b tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 200 len: 1308 microversion: 2.1 time: 0.222454 Nov 02 11:54:17.382433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 587/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:17 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:17.459583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.485190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.487547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:17.497247 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb06d88c-9565-4e16-9aad-bd2313a85e44 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.185645 Nov 02 11:54:17.511018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 583/1170] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:17 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:17.831522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:17.835459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:17.871661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.872488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.873383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:17.876042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:17.878125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:17.878801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.196589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.197846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.235667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.236176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.236629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.237593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.238158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.238637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.351366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:18.361036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1507f40b-8cbe-4bab-bc65-10da127f7e16 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1470 microversion: 2.1 time: 0.556371 Nov 02 11:54:18.367157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 588/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:17 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:18.406213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.407410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.420288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.421249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.421847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.426112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.427066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.427732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.513133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:18.524603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd89f04a-ec02-456f-8cef-8348741fbb4d tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1646 microversion: 2.1 time: 0.333001 Nov 02 11:54:18.526723 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 584/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1646 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:18.532188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.533034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: b0d49d4e-ec74-43b4-90f2-ede599ec98ed] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.545157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.546654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.547286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.551904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.552613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.553241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.582832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed HTTP/1.1 Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:18.586152 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. Nov 02 11:54:18.588512 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b0d49d4e-ec74-43b4-90f2-ede599ec98ed'} Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:18.589351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. Nov 02 11:54:18.590669 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:18.591920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance b0d49d4e-ec74-43b4-90f2-ede599ec98ed could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:18.591920 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a4587b0-97df-4596-91cf-4343ca3768b1 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed" status: 404 len: 111 microversion: 2.1 time: 0.061897 Nov 02 11:54:18.591920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 585/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/b0d49d4e-ec74-43b4-90f2-ede599ec98ed => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:18.601300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e12fdc4-11a1-4993-a2ae-623d8aca991d", "name": "network-vif-deleted", "tag": "1498a22a-1827-4556-bb14-b4d1af271888"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:18.624933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.626119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.628178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.632136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:18.668713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] Creating event network-vif-deleted:1498a22a-1827-4556-bb14-b4d1af271888 for instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d on n-h1-855649-4 Nov 02 11:54:18.670596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bdafd99-8775-4de6-a567-e5faab651e8a tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.271085 Nov 02 11:54:18.674098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 589/1174] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:18.675907 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1cabe9d2-260e-4119-8ab2-dc661de36e31 req-74855ef6-2bc2-4837-84c7-20a6560f33dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080791 Nov 02 11:54:18.676974 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 586/1175] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:18.683638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.684551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.687305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:18.688065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:18.692172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.692978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.695286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.696379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.697074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.697699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.700578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.704236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.704927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.705870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.706505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.707175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.737463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:18.738068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:18.738605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:18.739238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid 748177eb-66a3-4981-b496-4838c6f2c4d7 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:19.309719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.311010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.312031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.312031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.312031 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c5d63ff-9502-44bc-a298-0e920d922172 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.560303 Nov 02 11:54:19.312367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c25e6c2-0a87-4bfc-b22a-61416b5036ea tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 200 len: 1308 microversion: 2.1 time: 0.558697 Nov 02 11:54:19.312367 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 587/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:19.312526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 590/1177] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:18 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:19.395478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:19.396807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:19.406836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.414106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.414865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.416505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.418555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.419827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.566908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:19.567900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:19.575089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.575742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.576467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.577493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.578152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.578801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.632579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.633433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.634242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.635108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lazy-loading 'fault' on Instance uuid 8e12fdc4-11a1-4993-a2ae-623d8aca991d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:19.667338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.687428 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b508f48a-d34a-4c67-a70d-aa450e333c10 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1470 microversion: 2.1 time: 0.296765 Nov 02 11:54:19.698383 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 588/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:19 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:19.714541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:19.715153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:19.737660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.738405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.739253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.739805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:19.740521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:19.741763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:19.838073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764a434df778448f8cb76d1371b867f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314ce714ea624e9c9fcd3258be119e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:19.863495 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-332957ec-3f73-4cda-a780-88321a122b83 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 200 len: 1353 microversion: 2.1 time: 0.301950 Nov 02 11:54:19.866255 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 591/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:19 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 1353 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:19.976524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:20.027044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c5de8b1-bf56-46c8-8c65-5ff7303d625e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.318190 Nov 02 11:54:20.031135 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 589/1180] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:19 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:20.323506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.323506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 748177eb-66a3-4981-b496-4838c6f2c4d7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.328121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.330012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.331235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.333203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.334024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.334401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.338815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.339400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.364871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.366173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.367254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.369640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.370681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.371782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.394487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 HTTP/1.1 Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:20.405709 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. Nov 02 11:54:20.407847 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '748177eb-66a3-4981-b496-4838c6f2c4d7'} Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:20.408820 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. Nov 02 11:54:20.411691 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.413100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance 748177eb-66a3-4981-b496-4838c6f2c4d7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:20.413844 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d9ebb8b-6b8c-41c5-a494-76c2ba33ec76 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7" status: 404 len: 111 microversion: 2.1 time: 0.113142 Nov 02 11:54:20.414200 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 592/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:20 2022] GET /compute/v2.1/servers/748177eb-66a3-4981-b496-4838c6f2c4d7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:20.427072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5e86115-2aef-4e11-8d95-55fc52a439ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.536152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:20.564219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:20.568984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:20.583097 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-444c47c3-d051-4295-9cdb-5fb6eae643a2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.267938 Nov 02 11:54:20.588528 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 590/1182] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:20 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:20.611117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6d7b6a-9909-4289-b081-b99bedae13b0", "name": "network-vif-deleted", "tag": "dba73a21-6615-4b50-998a-c929842502c2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:20.640310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.644478 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5e86115-2aef-4e11-8d95-55fc52a439ab tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/fdd2794a-ba1a-4b09-a3af-25231ab28d5f" status: 204 len: 0 microversion: 2.1 time: 0.221250 Nov 02 11:54:20.644478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 11:54:20 2022] DELETE /compute/v2.1/os-server-groups/fdd2794a-ba1a-4b09-a3af-25231ab28d5f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:20.644792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.644792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.649295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.650337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.676612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] Creating event network-vif-deleted:dba73a21-6615-4b50-998a-c929842502c2 for instance af6d7b6a-9909-4289-b081-b99bedae13b0 on n-h2-855649-4 Nov 02 11:54:20.684855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.685377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.685842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.686047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-def0f3cf-12e9-4ea8-b653-8ff8c020aee8 req-7fa90e6a-2920-4ce0-8557-a3d62237bbdf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085862 Nov 02 11:54:20.686589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.687089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.687532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.693523 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 591/1184] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:20.721801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.723608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.745313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:20.761779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:20.767516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.771202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.776564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.777540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.779550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.782055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.935372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:20.944244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5033b5b4-da70-4e98-b7b4-57a0c6248c4f tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1428 microversion: 2.1 time: 0.233511 Nov 02 11:54:20.945525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 592/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:20 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1428 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:20.951472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:20.952627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:20.959436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.964498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.964498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.964498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:20.964498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:20.965040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:20.986755 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d HTTP/1.1 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:20.990513 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:20.991944 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8e12fdc4-11a1-4993-a2ae-623d8aca991d'} Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:20.992927 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:20.994192 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:20.997153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:20.998319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66d56f8f-21b1-4f1d-99ca-0397d726abfe tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 404 len: 111 microversion: 2.1 time: 0.050732 Nov 02 11:54:20.999479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 593/1186] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:20 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:21.018297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.018780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.030678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.033589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.033589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.033589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.036485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.037537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.059481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 HTTP/1.1 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:21.061566 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.062896 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '322766fc-fbbc-426a-96e1-625a6e32ba38'} Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:21.063716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.065058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.068512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:21.069623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35b42112-d282-40d6-87a2-0e744247e42b tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 404 len: 111 microversion: 2.1 time: 0.064971 Nov 02 11:54:21.070706 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:21 2022] DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:21.076294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.078669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.093099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.096567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.096567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.096567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.096567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.097855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.212872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:21.246211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25a4e768-93a1-406f-b0c4-1f34baac8ddc tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.173571 Nov 02 11:54:21.266525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 595/1188] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:21 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:21.269794 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-042da9ae-1d52-4f0f-bb27-7e04d1181696 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "DELETE /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 204 len: 0 microversion: 2.1 time: 0.624173 Nov 02 11:54:21.272526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 594/1189] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:20 2022] DELETE /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:54:21.281015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.283908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.292110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.292603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.293039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.293875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.294190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.294613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.311946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.312662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.331452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.335121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.335121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.335121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.335121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.337135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.340971 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 HTTP/1.1 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:21.344309 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.345914 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '322766fc-fbbc-426a-96e1-625a6e32ba38'} Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:21.346771 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:21.348202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:21.349326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:21.349326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc9a3949-dbd4-436b-a517-d7bd9039a16f tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 404 len: 111 microversion: 2.1 time: 0.078021 Nov 02 11:54:21.349326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 596/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:21 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:21.360423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb2a17a9-71db-47ea-bfa3-03676528d240 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '.version_select at 0x7ff1b38303a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.381466 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fb2a17a9-71db-47ea-bfa3-03676528d240 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 11:54:21.544113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:21.557500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa60be53-c94c-43d8-9c3c-5987acbd8f4e tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1473 microversion: 2.1 time: 0.277123 Nov 02 11:54:21.559804 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 595/1191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:21 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:21.626430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.627110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.644312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.645132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.645916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.646828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.647624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.648784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.769328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:21.781495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:21.784226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:21.792203 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3da49f5c-1b67-4ab8-9670-e24a73abae57 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.173127 Nov 02 11:54:21.793639 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 596/1192] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:21 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:21.973254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:21.975164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:21.983156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.984186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.984657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:21.985618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:21.986155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:21.986800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.013451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:22.035960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.035960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.035960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.035960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lazy-loading 'fault' on Instance uuid af6d7b6a-9909-4289-b081-b99bedae13b0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:22.106274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.168206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-934c389a-7257-4700-86a2-b5025d3a9260 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1304 microversion: 2.1 time: 0.198981 Nov 02 11:54:22.169322 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 597/1193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:21 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:22.382158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:22.382158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:22.382158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.382158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.383506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.383506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.383506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.383506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.384576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:22.391605 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-fb2a17a9-71db-47ea-bfa3-03676528d240 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46086. Nov 02 11:54:22.396668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-952d0061-77b3-4881-ad28-441f84174527 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.114094 Nov 02 11:54:22.397302 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 598/1194] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:22 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:22.581845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:22.582475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:22.590094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.590899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.591718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.592551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.595419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.595887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.729168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb2a17a9-71db-47ea-bfa3-03676528d240 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559412311" status: 202 len: 0 microversion: 2.1 time: 1.372546 Nov 02 11:54:22.736070 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 597/1195] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 11:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559412311 => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:22.793679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.804068 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82afff55-2a96-473b-b3dc-d9fbc669cf22 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1473 microversion: 2.1 time: 0.224922 Nov 02 11:54:22.815855 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 599/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:22 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:22.830187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:22.830187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:22.838875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.838875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.839241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.839933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:22.840416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:22.841051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:22.965448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.980018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.981501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:22.998835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f51c4a7-1f3e-4efb-9b19-8e00fccbbd34 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.170774 Nov 02 11:54:22.998835 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 598/1197] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:22 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:23.197540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.212628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.236235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.237128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.239821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.241074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.242239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.242918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.364412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.365067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.365534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.372614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lazy-loading 'fault' on Instance uuid af6d7b6a-9909-4289-b081-b99bedae13b0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:23.436434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.439175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.450562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.451235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.451938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.455580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.456290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.459105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.660039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:23.674281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef455281-3484-4188-b4a0-34f78d99bae9 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 200 len: 1304 microversion: 2.1 time: 0.479396 Nov 02 11:54:23.676325 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 600/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 1304 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:23.733090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:23.779901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.780685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.789872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c16a59a-efb4-49dd-b940-b013651d2bda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.357182 Nov 02 11:54:23.792596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.793192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 599/1199] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:23.793704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.795783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.798622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.799449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.800729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.831423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:23.833883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:23.847694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.848544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.849268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:23.851774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:23.851774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:23.852575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.459494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:24.500999 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9be39f4c-eaf8-4685-91bd-fcd888ecf0c1 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 2342 microversion: 2.25 time: 0.725197 Nov 02 11:54:24.502111 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 601/1200] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 2342 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:24.517632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:24.518523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:24.529663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.532427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.533142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.534133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.534762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.536678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.689279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:24.713319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:24.717258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:24.718817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:24.724606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c5eedd4-3cc5-4180-b292-5cd9b437739a tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1473 microversion: 2.1 time: 0.897691 Nov 02 11:54:24.725555 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 600/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:23 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1473 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:24.730772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:24.734595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.734884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.740226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6a128ae-362e-47d1-a55c-58018a9a4839 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.236779 Nov 02 11:54:24.742152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 602/1202] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:24 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:24.763312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:24.764195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: af6d7b6a-9909-4289-b081-b99bedae13b0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:24.766183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.767062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.767558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.767995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.786774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.791574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.792375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.795425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.795845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.796923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.823272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] HTTP exception thrown: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Request method failure captured: Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 HTTP/1.1 Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmyNG3yRx26eOKJwP1dPFAe94X_g2tYAo53WMftHLMNmqgBZMoiVkfKAtfkyNTAm2ApOupeuTkI2qwf_eplWX0huEk3RUH8E793z4MhfY3P2Ym7mgE3K3I2gey7S4WiXW9CLz12MYUUvpnqTcNolbQ-TDW8lM6rRyBBoF3L_52bGzs Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:24.826177 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed0b3eaeb61546c18a68bf076583582f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e305bf222f694954931ffb496f521eab Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. Nov 02 11:54:24.827767 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'af6d7b6a-9909-4289-b081-b99bedae13b0'} Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:24.828761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. Nov 02 11:54:24.830277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:24.834434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Returning 404 to user: Instance af6d7b6a-9909-4289-b081-b99bedae13b0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:24.835681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a6ce394-4f91-4d25-bbdc-23fe56772052 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0" status: 404 len: 111 microversion: 2.1 time: 0.092520 Nov 02 11:54:24.837174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 603/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:24 2022] GET /compute/v2.1/servers/af6d7b6a-9909-4289-b081-b99bedae13b0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:24.845141 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c2ad8d1-bdbe-463d-99e4-c6f69d59feea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.118372 Nov 02 11:54:24.845762 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 601/1204] 10.222.0.48 () {60 vars in 1217 bytes} [Wed Nov 2 11:54:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:24.860718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:24.861810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:24.872003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:24.872998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:24.881857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.882651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.883311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.884286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.884924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.885553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.923431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:24.924932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.929171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.930020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.937751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:24.941551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:24.942270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:24.945811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:25.214072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:25.294636 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba58ca75-1034-4615-8e52-538ec87a0cda tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.455689 Nov 02 11:54:25.333658 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 604/1205] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:24 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:25.439365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06a347f1-37f2-40bd-b214-8f73d6ae62ea tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "DELETE /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 204 len: 0 microversion: 2.1 time: 0.575872 Nov 02 11:54:25.439968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 602/1206] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:24 2022] DELETE /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:25.453062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.454020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:25.472594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.475424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.476783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.480688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.480688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.480688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.590696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7d990cb-dc51-433a-bfd5-46e130b1f191 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.713463 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7d990cb-dc51-433a-bfd5-46e130b1f191 tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/874270517" status: 202 len: 0 microversion: 2.1 time: 0.128261 Nov 02 11:54:25.714791 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 603/1207] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 11:54:25 2022] DELETE /compute/v2.1/flavors/874270517 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:54:25.723372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-010a9e2b-a343-4aa6-a011-02ce9c646f0f tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.767811 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-010a9e2b-a343-4aa6-a011-02ce9c646f0f tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.047080 Nov 02 11:54:25.779159 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 604/1208] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:54:25 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:25.784831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.785772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:25.800203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.802954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.804368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.817861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.818504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.820330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:25.823373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.831404 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8da35c1-d4e1-4fd9-bb04-285a93535bdd tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1470 microversion: 2.1 time: 0.386315 Nov 02 11:54:25.839986 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 605/1209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:25 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:25.855956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:25.856755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:25.877360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.885600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.888749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:25.889659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:25.890287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:25.891955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.105074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.123263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.123263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.137173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15018fe7-f7d7-4deb-bde7-c3eb1f5c819a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.295928 Nov 02 11:54:26.137780 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 606/1210] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:25 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:26.163718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-231ff009-eeeb-468d-bf8a-dec2d15a537c tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.196670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:26.205713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3af16424-ac39-414b-a197-d02a5e1f3769 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1431 microversion: 2.1 time: 0.424883 Nov 02 11:54:26.206317 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 605/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:25 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1431 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:26.221318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f01c5e-3ef8-4f56-affe-03b6962a8975", "name": "network-vif-deleted", "tag": "666857f3-8f5d-4ca6-9913-a1a58f8a4974"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:26.250328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.250897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.251316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.265147 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] Creating event network-vif-deleted:666857f3-8f5d-4ca6-9913-a1a58f8a4974 for instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 on n-h2-855649-4 Nov 02 11:54:26.271816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4ed4ecb2-f271-4edb-9088-333eeea951db req-1a36705c-c45c-4870-8f34-2e50dd20a03e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064182 Nov 02 11:54:26.273171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 606/1212] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:26.314576 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-231ff009-eeeb-468d-bf8a-dec2d15a537c tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1167073119" status: 202 len: 0 microversion: 2.1 time: 0.158298 Nov 02 11:54:26.315608 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 607/1213] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:54:26 2022] DELETE /compute/v2.1/flavors/1167073119 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:26.331108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c10275bc-cd57-4fcb-8e90-f313f04414cf tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.338009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.338769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.359533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.360463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.363487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.369056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c10275bc-cd57-4fcb-8e90-f313f04414cf tempest-ServersWithSpecificFlavorTestJSON-1676733410 tempest-ServersWithSpecificFlavorTestJSON-1676733410-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042269 Nov 02 11:54:26.369752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.371880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 607/1214] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:26.372719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.373561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.406210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.406841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.415596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.420207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.420207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.420207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.420207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.422101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.436083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d HTTP/1.1 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:26.438185 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.439519 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8e12fdc4-11a1-4993-a2ae-623d8aca991d'} Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:26.440661 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.441862 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.445012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:26.449157 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f7357a3-4c7e-4a35-b7da-2afa73e57cba tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 404 len: 111 microversion: 2.1 time: 0.044839 Nov 02 11:54:26.449157 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 608/1215] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:26 2022] DELETE /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:54:26.456225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.456940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 8e12fdc4-11a1-4993-a2ae-623d8aca991d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.464511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.465627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.466303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.467341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.469225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.469883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.487033 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d HTTP/1.1 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:26.488941 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.490541 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8e12fdc4-11a1-4993-a2ae-623d8aca991d'} Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:26.491325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. Nov 02 11:54:26.493011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.497713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 8e12fdc4-11a1-4993-a2ae-623d8aca991d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:26.497713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4103c068-d7f7-4810-b034-10d2f47656a2 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d" status: 404 len: 111 microversion: 2.1 time: 0.045467 Nov 02 11:54:26.501947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 609/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/8e12fdc4-11a1-4993-a2ae-623d8aca991d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:26.507612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.508492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.516581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.517420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.518155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.519216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.520120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.520767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.541358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 HTTP/1.1 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:26.543295 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.544778 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '322766fc-fbbc-426a-96e1-625a6e32ba38'} Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:26.545739 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.547019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.551581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:26.552722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee7e8df2-c625-40fb-9bbb-087c65229b32 tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 404 len: 111 microversion: 2.1 time: 0.049510 Nov 02 11:54:26.557911 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 610/1217] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:54:26 2022] DELETE /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:26.563833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.564747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] [instance: 322766fc-fbbc-426a-96e1-625a6e32ba38] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.573972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.575042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.575795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.577299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.578051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.578852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.601023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] HTTP exception thrown: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Request method failure captured: Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 HTTP/1.1 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlnEXmEq2EQjdiWU6s6W0gusGspq2vf_Ud4OBakjUukBBVgmm17GoIs_1eJfDuEA-9YGksIDtR03oQokiTyTDFtaMtJXgty6EZ93THLiYY-MzF42xAE2_bgm2lPYgp375QX8Yf2NmUdtLTywqtoN9XcRQtUfY1Xc8fTfascE83qYNI4 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:26.605041 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_314ce714ea624e9c9fcd3258be119e24", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/314ce714ea624e9c9fcd3258be119e24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 314ce714ea624e9c9fcd3258be119e24 Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520 Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 764a434df778448f8cb76d1371b867f7 Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-880878520-project Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.606377 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '322766fc-fbbc-426a-96e1-625a6e32ba38'} Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:26.607207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. Nov 02 11:54:26.608389 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:26.610996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] Returning 404 to user: Instance 322766fc-fbbc-426a-96e1-625a6e32ba38 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:26.612442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-065b1571-8db6-41a5-b491-1aa5272443ce tempest-ServersWithSpecificFlavorTestJSON-880878520 tempest-ServersWithSpecificFlavorTestJSON-880878520-project] 10.222.0.48 "GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38" status: 404 len: 111 microversion: 2.1 time: 0.053182 Nov 02 11:54:26.617713 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 611/1218] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/322766fc-fbbc-426a-96e1-625a6e32ba38 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:26.753891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:26.795825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:26.800705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c06a54e8-eb00-43bd-a6ac-e29bb200c5cb tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.467084 Nov 02 11:54:26.804771 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 608/1219] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:26.872760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:26.874694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:26.887890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.891157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.892206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:26.893073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:26.893662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:26.894611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.172978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:27.175461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:27.194671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.196798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.197645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.199790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.201067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.202875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.480549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.499007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.504745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.519751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-420a1112-de7d-420a-82c1-d9a6ac4b88b0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.354740 Nov 02 11:54:27.526361 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 609/1220] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:27 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:27.530254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:27.534867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:27.553427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.557299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.557966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.560018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.561327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.563776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.643473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.657923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdc9ca93-42ab-4700-a25d-3b86727f9561 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1470 microversion: 2.1 time: 0.787035 Nov 02 11:54:27.659834 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 612/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:26 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1470 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:27.683829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.684328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.684780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.685247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lazy-loading 'fault' on Instance uuid 79f01c5e-3ef8-4f56-affe-03b6962a8975 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:27.858101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:27.858798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:27.881814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.885289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.885986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.887102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:27.887684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:27.888211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:27.924313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a56e86810c96430a9db812bdeb895c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43d4aa3b5a443cab0e019f12fad6d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:27.962649 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73b50a5f-54d0-49ce-9516-3373b74cf799 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 200 len: 1307 microversion: 2.1 time: 0.438779 Nov 02 11:54:27.985957 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 610/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:27 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 1307 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:28.556080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:28.558124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:28.577619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.577619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.577619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.577619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.578101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.578101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.718879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:28.762493 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f892cf63-41cb-4e8b-9565-f8c8d1564e71 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.931353 Nov 02 11:54:28.763875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 613/1223] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:27 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:28.770770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:28.771425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:28.789705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.794507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.799715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.801001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:28.814393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:28.823491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:28.861109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:28.876356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:28.877838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:28.885969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d919873-2154-4029-a512-4aadcd68922f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.337185 Nov 02 11:54:28.923908 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 611/1224] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:28 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:28.992510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:28.993718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] [instance: 79f01c5e-3ef8-4f56-affe-03b6962a8975] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:29.003089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.003598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.004057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.009686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.010205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.010658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.033648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] HTTP exception thrown: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Request method failure captured: Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 HTTP/1.1 Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmTRVbC281xf5-YITZgw1-Ql_nF_r1NhJLJ2AnT3bXoNMeT66CLfi31gJOZycIjPZMz0jw3-5in0FUA9TPvDaI6cgCWst7JYG3sl2P9DXbGZY5PkjkgArfDxVhPP9GII5pPhogkeAEVaXA0an-F7daH5JFR1MDXDVpTdoAQh84xT3A Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:29.038540 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e43d4aa3b5a443cab0e019f12fad6d0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e43d4aa3b5a443cab0e019f12fad6d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e43d4aa3b5a443cab0e019f12fad6d0c Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-649307012 Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a56e86810c96430a9db812bdeb895c42 Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersOnMultiNodesTest-649307012-project Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. Nov 02 11:54:29.040716 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '79f01c5e-3ef8-4f56-affe-03b6962a8975'} Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:29.041617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. Nov 02 11:54:29.043166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:29.044362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] Returning 404 to user: Instance 79f01c5e-3ef8-4f56-affe-03b6962a8975 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:29.044362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e9f3c99-2343-4229-81f1-3386b454ded9 tempest-ServersOnMultiNodesTest-649307012 tempest-ServersOnMultiNodesTest-649307012-project] 10.222.0.48 "GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975" status: 404 len: 111 microversion: 2.1 time: 0.051605 Nov 02 11:54:29.049158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 612/1225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:28 2022] GET /compute/v2.1/servers/79f01c5e-3ef8-4f56-affe-03b6962a8975 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:29.249117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8b6f3d-7e29-47d8-9756-38d027459a36 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Action: 'create', calling method: .version_select at 0x7ff1b39a4310>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:29.607621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:29.623977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ff01353-4537-40e9-a622-28710fc5372d tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1470 microversion: 2.1 time: 0.859217 Nov 02 11:54:29.639396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 614/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:28 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1470 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:29.645384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c28bb71f-bc9d-49d1-a297-2dc36ec6dea6", "device": "/dev/xvdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:29.648686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:29.659118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.659961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.660613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:29.661553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:29.662220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:29.662837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.119483 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c568802a-e0e2-48a5-9cb0-4f858f996f29 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.477753 Nov 02 11:54:32.123195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 615/1227] 10.222.0.48 () {62 vars in 1364 bytes} [Wed Nov 2 11:54:29 2022] POST /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 194 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:32.166020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:32.172759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:32.205333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.206497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.206497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.207000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.218252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.218931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.501237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:32.557261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8ecb931-5174-479c-aa30-2ebc3ffadc12 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.427726 Nov 02 11:54:32.560247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 616/1228] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:32 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:32.582729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:32.584908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:32.606600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.607592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.608254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.608997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.609463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.609895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.737173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:32.750082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:32.755861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:32.761200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44c1c8fc-a701-4245-86ec-681a44d048a1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.198590 Nov 02 11:54:32.762938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 617/1229] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:32 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:32.768769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625bd2f4-c703-4210-9c7e-51e3549762ae", "name": "network-vif-deleted", "tag": "520c0c0b-06af-4367-af8c-7a87863e3afe"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:32.801090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.802502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.804530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.845065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] Creating event network-vif-deleted:520c0c0b-06af-4367-af8c-7a87863e3afe for instance 625bd2f4-c703-4210-9c7e-51e3549762ae on n-h2-855649-4 Nov 02 11:54:32.871303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-eba383db-044d-4d12-8a59-947163739825 req-a97f1139-daf2-46e4-b23b-0ee0ac12e17b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100016 Nov 02 11:54:32.871478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 618/1230] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:32.897202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:32.900258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:32.924431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.924940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.925394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:32.932198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:32.932198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:32.932545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.059845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.061365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.068449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.068449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lazy-loading 'fault' on Instance uuid 625bd2f4-c703-4210-9c7e-51e3549762ae {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:33.141889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305bf222f694954931ffb496f521eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed0b3eaeb61546c18a68bf076583582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:33.161184 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b8e3ed4-292f-4c3d-a2e1-8c3d094cf6df tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 200 len: 1304 microversion: 2.1 time: 0.283516 Nov 02 11:54:33.171080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 619/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:32 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:33.597870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:33.598586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:33.613653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.615018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.616514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.623734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.624901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.625712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.711260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f8b6f3d-7e29-47d8-9756-38d027459a36 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.660919 Nov 02 11:54:33.714358 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 613/1232] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 11:54:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:33.728287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fab13cc5-fcac-49dc-a3cc-acae61f256c1 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b3d30160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:33.784043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:33.823801 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3fd889a-2bb9-4897-838b-745b54c149ce tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.230478 Nov 02 11:54:33.825308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 620/1233] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:33 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:33.830934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:33.831932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:33.840156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.840968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.841610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:33.842580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:33.843237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:33.843837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.050063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:34.064225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:34.065705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:34.083666 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82f6f66e-daeb-4bf4-97c5-07dd344d49e3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.256933 Nov 02 11:54:34.085134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 621/1234] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:33 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:34.151675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fab13cc5-fcac-49dc-a3cc-acae61f256c1 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/6c5b0c43-c190-4623-8ce4-8099cec6374b" status: 200 len: 142 microversion: 2.1 time: 0.428648 Nov 02 11:54:34.152801 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 614/1235] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 11:54:33 2022] GET /compute/v2.1/os-floating-ips/6c5b0c43-c190-4623-8ce4-8099cec6374b => generated 142 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:54:34.164889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72b93a9f-be4b-4a55-a3e4-7f9ec966cd4c tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b3700a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:34.220241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:34.221204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] [instance: 625bd2f4-c703-4210-9c7e-51e3549762ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:34.228895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:34.233761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:34.233761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.233761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:34.233761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:34.234138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.249886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] HTTP exception thrown: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Request method failure captured: Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae HTTP/1.1 Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmyNG3yRx26eOKJwP1dPFAe94X_g2tYAo53WMftHLMNmqgBZMoiVkfKAtfkyNTAm2ApOupeuTkI2qwf_eplWX0huEk3RUH8E793z4MhfY3P2Ym7mgE3K3I2gey7S4WiXW9CLz12MYUUvpnqTcNolbQ-TDW8lM6rRyBBoF3L_52bGzs Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:34.252372 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed0b3eaeb61546c18a68bf076583582f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed0b3eaeb61546c18a68bf076583582f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ed0b3eaeb61546c18a68bf076583582f Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminTestJSON-410148503 Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e305bf222f694954931ffb496f521eab Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminTestJSON-410148503-project Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. Nov 02 11:54:34.254073 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '625bd2f4-c703-4210-9c7e-51e3549762ae'} Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:34.254972 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. Nov 02 11:54:34.261880 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:34.263380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] Returning 404 to user: Instance 625bd2f4-c703-4210-9c7e-51e3549762ae could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:34.263380 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b3bd4ba-bca6-42bb-b8ec-df924ae451e8 tempest-ServersAdminTestJSON-410148503 tempest-ServersAdminTestJSON-410148503-project] 10.222.0.48 "GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae" status: 404 len: 111 microversion: 2.1 time: 0.040848 Nov 02 11:54:34.263380 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 615/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:34 2022] GET /compute/v2.1/servers/625bd2f4-c703-4210-9c7e-51e3549762ae => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:54:34.627328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72b93a9f-be4b-4a55-a3e4-7f9ec966cd4c tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.466261 Nov 02 11:54:34.628352 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 622/1237] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 11:54:34 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:34.648393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ad57bb4-4cb1-4f52-9fbf-d76846bab664 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b334ed30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:34.858858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:34.862806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:34.863448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:34.876460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:34.885597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:34.886625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.890537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:34.891109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:34.891654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:34.939903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:35.137534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:35.189440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4bc54b5-569a-4d96-a2cd-e7fea0409e4c tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.331405 Nov 02 11:54:35.193117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 623/1238] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:34 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:35.204296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:35.204932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:35.222410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:35.222908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:35.223387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:35.229274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:35.229772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:35.230220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:35.363663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:35.376137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:35.379360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:35.404254 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07478128-a484-40f1-9271-f6ecde4ca40e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1535 microversion: 2.91 time: 0.206512 Nov 02 11:54:35.417244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 624/1239] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:35 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1535 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:36.064963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7523d85-836a-4910-a883-6f2606ba9726 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:36.073524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7523d85-836a-4910-a883-6f2606ba9726 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.191166 Nov 02 11:54:36.074732 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 625/1240] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:54:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:54:36.217546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:36.228617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:36.229690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:36.243026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.244154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.245265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.246887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.248360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.249127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.387960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:36.425706 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b563110e-a36b-4d47-9cbd-dc609477ed83 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.208898 Nov 02 11:54:36.443187 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 626/1241] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:36 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:36.453669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:36.454738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:36.466946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.467846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.468506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.469439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:36.470066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:36.470688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:36.555729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:36.567965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:36.570225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:36.576773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e701a5e-80e8-41f6-bfcd-51a2299d721a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1535 microversion: 2.91 time: 0.131796 Nov 02 11:54:36.577833 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 627/1242] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:36 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1535 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:36.811035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ad57bb4-4cb1-4f52-9fbf-d76846bab664 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/6c5b0c43-c190-4623-8ce4-8099cec6374b" status: 202 len: 0 microversion: 2.1 time: 2.166101 Nov 02 11:54:36.813460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 616/1243] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:54:34 2022] DELETE /compute/v2.1/os-floating-ips/6c5b0c43-c190-4623-8ce4-8099cec6374b => generated 0 bytes in 2170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:36.826348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21d9301b-e202-46fd-92b7-0b1bc6d86691 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Action: 'create', calling method: .version_select at 0x7ff1b36e1940>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:37.458753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:37.459337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:37.466504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.467384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.468047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.468988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.471126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.471607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.587203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:37.603471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:37.628620 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-497c6540-68b4-41cb-96bd-bac9f72b5ee9 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.174229 Nov 02 11:54:37.630080 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 617/1244] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:37 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:37.635635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:37.637861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:37.645413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.645914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.646363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.647248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.647730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.648160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.750052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:37.760591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:37.763215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:37.771255 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4739a9dc-6e96-48d0-a4f0-6846462b2b76 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1538 microversion: 2.91 time: 0.139570 Nov 02 11:54:37.773115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 618/1245] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:37 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1538 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:37.801196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:37.804037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:37.810794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.811316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.811865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.812530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:37.813327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:37.813963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:37.879247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-855649-4". {{(pid=127568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:54:38.640688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12824ccb-83de-4a67-a1d5-e159e5d07299 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action" status: 202 len: 0 microversion: 2.91 time: 0.844226 Nov 02 11:54:38.643501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 619/1246] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:54:37 2022] POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:54:38.649308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-83086852", "imageRef": "9669b290-324c-41fe-b83f-0703fb774df0", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:38.764400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:54:39.642429 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] Request method failure captured: Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 141 Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlp73A1woE5Z646wxPQliT7AnO7R8jtMj0_0j_Mb6WbXzA7PwxhGn6KbMY0opP3ea01YaIamsdX6vcdGst2RphDdTQSyQq8z0eiUipQM6wepM78JJbrzdwNK8YCxYOX2JUBERM8zjoQYMhY962sPG1qYyena2OijUb_ZnY4vXJ5zbLQ Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: cfa782239ca543d0840a69090b3774be Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FlavorsV2NegativeTest-1000949179 Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:39.645434 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfa782239ca543d0840a69090b3774be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cfa782239ca543d0840a69090b3774be", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cfa782239ca543d0840a69090b3774be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cfa782239ca543d0840a69090b3774be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FlavorsV2NegativeTest-1000949179 Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: cfa782239ca543d0840a69090b3774be Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1000949179 Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FlavorsV2NegativeTest-1000949179-project Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 1d001ef195fa49858f6032b5d8f64ec5 Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FlavorsV2NegativeTest-1000949179-project Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-83086852", "imageRef": "9669b290-324c-41fe-b83f-0703fb774df0", "flavorRef": "452"}} Nov 02 11:54:39.647054 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor's memory is too small for requested image. Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-83086852', 'imageRef': '9669b290-324c-41fe-b83f-0703fb774df0', 'flavorRef': '452'}}} Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:39.647976 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:39.650320 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af59eb52-2b37-48af-9307-b8095511c989 tempest-FlavorsV2NegativeTest-1000949179 tempest-FlavorsV2NegativeTest-1000949179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.003277 Nov 02 11:54:39.651865 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 620/1247] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:54:38 2022] POST /compute/v2.1/servers => generated 93 bytes in 1005 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:54:39.664247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:39.666349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:39.691673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:39.692330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:39.692906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:39.693975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:39.694872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:39.695472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:39.786605 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21d9301b-e202-46fd-92b7-0b1bc6d86691 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.965756 Nov 02 11:54:39.796913 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 628/1248] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 11:54:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:39.801999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:39.816848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:39.828786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:39.829279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:39.829730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:39.832816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:39.833389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:39.833841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:39.895215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:39.909198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:39.924754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:39.946530 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67454a40-8158-4e18-acc5-18334baa0ece tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1486 microversion: 2.91 time: 0.295748 Nov 02 11:54:39.949316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 621/1249] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:39 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1486 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:39.962082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06c2c568-4f17-4108-ab08-392612df4962 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b3ef1e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:39.998399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:40.064285 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63b31a9e-b03b-4a0c-955b-99a5a4f598c1 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.265409 Nov 02 11:54:40.079344 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 629/1250] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:39 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:40.981942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:40.983290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:41.002060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.005811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.005984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.007066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.026636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.026872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.184622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:41.200587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:41.202175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:41.209985 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c562185d-2225-44d7-8b28-0cdb0d805c52 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1486 microversion: 2.91 time: 0.233377 Nov 02 11:54:41.211161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 630/1251] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:40 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:41.240697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:41.240697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:41.241795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.242924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.243572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.244573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:41.245300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:41.245468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:41.418031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:41.436403 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbb909c0-3587-4a67-8574-44bd1b6d6cbd tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1925 microversion: 2.75 time: 0.223240 Nov 02 11:54:41.437171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 631/1252] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:41 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1925 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:41.446969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06c2c568-4f17-4108-ab08-392612df4962 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b" status: 202 len: 0 microversion: 2.1 time: 1.494173 Nov 02 11:54:41.447764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 622/1253] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:54:39 2022] DELETE /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b => generated 0 bytes in 1498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:41.456395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b37654c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:41.514069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65571438-ee5f-4338-a5ce-01a5d14d119b could not be found", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:54:41.516727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] HTTP exception thrown: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Request method failure captured: Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b HTTP/1.1 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlp0XpmDBtfDL3zMwztD1NTqTt03I43fK-pVS6RF6mimOR7A23l1iIQi3aRS2gThaSwaUcODrS5lgvggDnbGwnsXoGMzSqnSA65ZxANb7DfNX9nuTUoye0AgISfS-lAPkDlcspdyGPOMlMDqpGYDAOkSQp7CstH1_3EY-W2Q4CzQSC0 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 840e01e840b1418d9d0ecc7194cff21e Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:41.518551 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_840e01e840b1418d9d0ecc7194cff21e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 840e01e840b1418d9d0ecc7194cff21e Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsTestJSON-1618774219-project Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0b8c2ccbf083459c9f1e063d4674816d Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsTestJSON-1618774219-project Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: exception: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '65571438-ee5f-4338-a5ce-01a5d14d119b'} Nov 02 11:54:41.520151 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:54:41.521252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65571438-ee5f-4338-a5ce-01a5d14d119b could not be found Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61e8d9cf-3fca-4794-bd2e-292db9ec8468'] Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b. Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.522608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:41.524280 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:41.526348 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.526348 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.526348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Returning 404 to user: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:41.526348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0196aec1-6cc0-434d-b79b-9e349c14db26 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b" status: 404 len: 111 microversion: 2.1 time: 0.067509 Nov 02 11:54:41.526348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 632/1254] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 11:54:41 2022] GET /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:41.532304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Calling method '.version_select at 0x7ff1b334e310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:41.588341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65571438-ee5f-4338-a5ce-01a5d14d119b could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 11:54:41.589047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] HTTP exception thrown: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Request method failure captured: Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b HTTP/1.1 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlp0XpmDBtfDL3zMwztD1NTqTt03I43fK-pVS6RF6mimOR7A23l1iIQi3aRS2gThaSwaUcODrS5lgvggDnbGwnsXoGMzSqnSA65ZxANb7DfNX9nuTUoye0AgISfS-lAPkDlcspdyGPOMlMDqpGYDAOkSQp7CstH1_3EY-W2Q4CzQSC0 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 840e01e840b1418d9d0ecc7194cff21e Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:41.590965 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_840e01e840b1418d9d0ecc7194cff21e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/840e01e840b1418d9d0ecc7194cff21e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 840e01e840b1418d9d0ecc7194cff21e Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1618774219 Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsTestJSON-1618774219-project Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0b8c2ccbf083459c9f1e063d4674816d Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsTestJSON-1618774219-project Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '65571438-ee5f-4338-a5ce-01a5d14d119b'} Nov 02 11:54:41.592307 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 11:54:41.593133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65571438-ee5f-4338-a5ce-01a5d14d119b could not be found Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fbdc992-c59d-41e7-8f36-fb8f63dd0521'] Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b. Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.594239 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:41.595526 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:41.596674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b Nov 02 11:54:41.596674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:41.596674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] Returning 404 to user: Floating IP not found for ID 65571438-ee5f-4338-a5ce-01a5d14d119b {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:41.596674 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a23ce8c-7f0a-4232-951d-424a3dce3cd8 tempest-FloatingIPsTestJSON-1618774219 tempest-FloatingIPsTestJSON-1618774219-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b" status: 404 len: 111 microversion: 2.1 time: 0.064682 Nov 02 11:54:41.596674 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 623/1255] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:54:41 2022] DELETE /compute/v2.1/os-floating-ips/65571438-ee5f-4338-a5ce-01a5d14d119b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:42.157525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1046004254", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:42.214290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:54:42.241987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:42.242634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:42.252872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.253368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.253807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.254524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.255005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.255428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.412701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:42.423634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:42.425582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:42.432438 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1577c406-9227-44a8-972e-7b0183c7f034 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1488 microversion: 2.91 time: 0.195857 Nov 02 11:54:42.433408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 624/1256] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:42 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1488 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:42.470195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:42.470892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:42.477839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.478565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.479020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.479729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.480181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.482408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.587304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:42.615068 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed35e9c6-b401-4340-97a6-df3f7fc192ad tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1931 microversion: 2.75 time: 0.149090 Nov 02 11:54:42.630916 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 625/1257] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:42 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1931 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:42.648252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:54:42.650724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:54:42.651272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:54:42.651723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:54:42.652334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:54:42.671684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.672179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.673397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.674148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:42.674616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:42.675126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:42.706711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Getting quotas for project bdbde890d43146d7b34098e4de4e7b0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:42.715334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Getting quotas for user 1a0bf82fdcf14d3d9e628fb5da832b80 and project bdbde890d43146d7b34098e4de4e7b0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:42.732787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:54:42.735443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:54:42.852465 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5fa6f420-2c14-4bfe-badf-4e3d6e4508a6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065466 Nov 02 11:54:42.854542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 633/1258] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:54:42.867257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbe7c814-4b44-404d-a1c6-f4a930732ac3 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:42.868066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbe7c814-4b44-404d-a1c6-f4a930732ac3 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:42.978491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbe7c814-4b44-404d-a1c6-f4a930732ac3 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:42.986000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbe7c814-4b44-404d-a1c6-f4a930732ac3 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1222 microversion: 2.1 time: 0.125412 Nov 02 11:54:42.987043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 626/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:42 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:43.463224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:43.463908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:43.484639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:43.485136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:43.485586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:43.486652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:43.486901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:43.487280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:43.576050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:43.586121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:43.587930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:43.600894 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eed8bf26-2043-400e-acb7-bd6a29f396e9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.143298 Nov 02 11:54:43.605736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 634/1260] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:43 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:43.646867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:43.647687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:43.656032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:43.656721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:43.657206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:43.657909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:43.658579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:43.659000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:43.752445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:43.776306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f98111dd-1160-4a6a-a0b1-fb0037e87555 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1931 microversion: 2.75 time: 0.133183 Nov 02 11:54:43.777418 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 627/1261] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:43 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1931 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:44.010773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6dc96f7f-aa5d-42e6-95a8-e16553f3d783 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:44.011809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6dc96f7f-aa5d-42e6-95a8-e16553f3d783 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:44.144963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6dc96f7f-aa5d-42e6-95a8-e16553f3d783 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:44.155851 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6dc96f7f-aa5d-42e6-95a8-e16553f3d783 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1222 microversion: 2.1 time: 0.149348 Nov 02 11:54:44.156841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 635/1262] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:44 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:44.635126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:44.636562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:44.645994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:44.646882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:44.648459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:44.673249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:44.673249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:44.673249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:44.807416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:44.808363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:44.842966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:44.846400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:44.851183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:44.857381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:44.858233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:44.861990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:44.949432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:44.964441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:44.985604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:45.011377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-efbf1589-50cb-4d55-a293-3c9dd596bde1 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.381190 Nov 02 11:54:45.015886 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 628/1263] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:44 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:45.169246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:45.265623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a67c0b34-4f35-4cc4-9aa5-029cb9a17b41 tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1931 microversion: 2.75 time: 0.460418 Nov 02 11:54:45.266505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 636/1264] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:44 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1931 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:45.275386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:45.277328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:45.291808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:45.292236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:45.292679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:45.295383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:45.297580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:45.300284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:45.314833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaa4215c-67a7-4c82-a252-a469a1611bc3 tempest-ListImageFiltersNegativeTestJSON-2000952357 tempest-ListImageFiltersNegativeTestJSON-2000952357-project] Calling method '.version_select at 0x7ff1b3aba430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:45.366592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-eaa4215c-67a7-4c82-a252-a469a1611bc3 tempest-ListImageFiltersNegativeTestJSON-2000952357 tempest-ListImageFiltersNegativeTestJSON-2000952357-project] HTTP exception thrown: Image not found. Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaa4215c-67a7-4c82-a252-a469a1611bc3 tempest-ListImageFiltersNegativeTestJSON-2000952357 tempest-ListImageFiltersNegativeTestJSON-2000952357-project] Request method failure captured: Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/images/172a0f09-829f-4f2a-8eda-066868976956 HTTP/1.1 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqEgWFNKo--1Q_UojnJkYiAqwsBFSuOaXFLtX1RwQlT99azERv7lnIdmkj7fDGpDyXRple25NA18-8y6kQeoiruBWpqWO36pP_F0TVCg1ccSZhisHuQdaMG8xXB5hUbZX37Mdc1PD8x14j0mePh1Ahf8GeMz6Bq-EtbAIDlAKC-8us Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f96a48c520d349108fdf637c56297782 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2000952357 Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:45.378692 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f96a48c520d349108fdf637c56297782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f96a48c520d349108fdf637c56297782", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f96a48c520d349108fdf637c56297782"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f96a48c520d349108fdf637c56297782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2000952357 Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f96a48c520d349108fdf637c56297782 Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2000952357 Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ListImageFiltersNegativeTestJSON-2000952357-project Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ba93e49a0ff1426b9b40c6fa30883e48 Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2000952357-project Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '172a0f09-829f-4f2a-8eda-066868976956'} Nov 02 11:54:45.380639 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:45.381629 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 172a0f09-829f-4f2a-8eda-066868976956 Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:45.384721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 172a0f09-829f-4f2a-8eda-066868976956 could not be found. Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:45.387183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:45.390902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaa4215c-67a7-4c82-a252-a469a1611bc3 tempest-ListImageFiltersNegativeTestJSON-2000952357 tempest-ListImageFiltersNegativeTestJSON-2000952357-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:45.394129 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eaa4215c-67a7-4c82-a252-a469a1611bc3 tempest-ListImageFiltersNegativeTestJSON-2000952357 tempest-ListImageFiltersNegativeTestJSON-2000952357-project] 10.222.0.48 "GET /compute/v2.1/images/172a0f09-829f-4f2a-8eda-066868976956" status: 404 len: 62 microversion: 2.1 time: 0.364789 Nov 02 11:54:45.394129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 629/1265] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:54:45 2022] GET /compute/v2.1/images/172a0f09-829f-4f2a-8eda-066868976956 => generated 62 bytes in 368 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:45.410894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:45.425855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-922c2d37-9880-4346-a948-9e330ed4b333 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1218 microversion: 2.1 time: 0.156926 Nov 02 11:54:45.439237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 637/1266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:45 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:46.049813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:46.051483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:46.062653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.063141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.063793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.065268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.066023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.066510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.243817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:46.268601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:46.273493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:46.290342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d500984-3359-49b9-80df-94fb2f5f59ff tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.247432 Nov 02 11:54:46.298555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:46.299914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:46.328990 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 630/1267] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:46 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:46.340988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.341666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.342113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.342843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.343359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.343782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.450766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:46.451806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:46.460224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.461142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.462126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.463244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:46.463956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:46.464629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:46.475458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:46.502557 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98875e57-e60d-45cc-a904-dc8c7e70ba1d tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1931 microversion: 2.75 time: 0.209570 Nov 02 11:54:46.504161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 638/1268] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:46 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1931 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:46.573016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:46.579470 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19f743c1-296a-454d-aab6-5ab5e7ea860b tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1274 microversion: 2.1 time: 0.131488 Nov 02 11:54:46.591099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 631/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:46 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:47.359332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:47.360583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:47.379581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.379581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.379581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.379581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.379935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.379935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.519032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:47.533314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:47.533801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:47.533958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:47.536850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:47.549663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.550319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.550803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.553053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c22b43-02dd-49ef-9a6c-5de9f169a2f2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.196445 Nov 02 11:54:47.559294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.559792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.560238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.571297 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 639/1270] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:47 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:47.605787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:47.606921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:47.614608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.615178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.622953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.624439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.625677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.626231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.806816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:47.807283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] Lazy-loading 'services' on Instance uuid 899342e4-6b0c-442f-a92d-b158f16525fe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:47.841806 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80934103-2b53-4d0d-b0bd-aad0c1c54f13 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1274 microversion: 2.1 time: 0.235851 Nov 02 11:54:47.842631 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 640/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:47 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:47.879939 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99fde74a-1e5b-4568-b4e0-c8ef0336b53e tempest-ServersAdmin275Test-987641480 tempest-ServersAdmin275Test-987641480-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1916 microversion: 2.75 time: 0.350858 Nov 02 11:54:47.891365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 632/1272] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:47 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1916 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:47.947372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:47.948145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:47.955379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.956142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.956730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.957584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:47.958185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:47.958759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:47.993396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:54:48.042392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:48.587114 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bea1fda7-ac70-44ec-8451-8d0853b0e45b tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 204 len: 0 microversion: 2.75 time: 0.645885 Nov 02 11:54:48.587747 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 641/1273] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:54:47 2022] DELETE /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:54:48.593155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:48.594531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:48.596917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:48.597628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:48.617527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.623833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.624328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:48.627729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.629452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.630053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:48.640357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.641419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.642106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:48.647048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.647966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.648797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:48.922527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.927123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.952594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.952594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.952801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.954661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:48.963632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be3a4170-9468-41c3-acf5-337917d91f66 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1442 microversion: 2.75 time: 0.371096 Nov 02 11:54:48.964912 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 642/1274] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:48 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1442 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:48.970487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:48.971587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:48.972391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42e6c476-be54-470b-bd84-26d627131345 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.387377 Nov 02 11:54:48.973655 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 633/1275] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:48 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:48.978548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.979045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.979657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:48.980576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:48.981168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:48.987407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:49.178638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:49.179318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:49.211684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:49.214366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:49.214366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:49.216521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:49.217061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:49.217574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:49.491590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:49.524489 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ab5bff6-bab2-4c29-b5cf-461983491782 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1282 microversion: 2.1 time: 0.557811 Nov 02 11:54:49.525495 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 643/1276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:48 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1282 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:49.595413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:49.621328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c1ec945-ca85-475a-8772-f91d4b33284a tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 2420 microversion: 2.25 time: 0.447222 Nov 02 11:54:49.636391 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 634/1277] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:49 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 2420 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:49.657406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": "auto"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:49.660715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:49.668211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:49.669034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:49.669808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:49.671035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:49.671676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:49.672267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:49.703187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'flavor' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:54:49.720252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:54:50.449695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f63f0691-fed2-485a-b50e-e4cb644af545 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2078478327", "id": 886392241, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:50.782904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f63f0691-fed2-485a-b50e-e4cb644af545 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.966917 Nov 02 11:54:50.782904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 635/1278] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:54:49 2022] POST /compute/v2.1/flavors => generated 465 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:50.782904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:50.782904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:50.794115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:50.795077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:50.795766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:50.796702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:50.797394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:50.798086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:50.903039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:50.912032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:50.913911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '496980ce473d4c0abcc8ca47ee949ef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71eb96678e854fa79fd541da1b5b2815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:50.935525 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7fa57ff-c13d-46d1-9a9f-85b6f96c186f tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 200 len: 1442 microversion: 2.75 time: 0.170251 Nov 02 11:54:50.949635 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 636/1279] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:50 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:50.976257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:50.977232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:50.988266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:50.989259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:50.990040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:50.991940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:50.993010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:50.993921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:51.043948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:51.161562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:51.181378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:51.182771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:51.197120 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b275341-49e5-4e69-a686-8119384dedc7 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.238024 Nov 02 11:54:51.207008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 637/1280] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:50 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:51.212703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:51.212703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:51.224774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:51.225278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:51.225723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:51.226451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:51.227526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:51.228006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:51.458948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:51.475495 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d5f0e44-4bc6-432c-9678-ecfd0563c417 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.272774 Nov 02 11:54:51.483138 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 638/1281] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:51 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:51.873671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2f7edb6-2137-4eed-a4a5-440b2f5368c4 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b36388b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzsRBeEApsgpbpUkNB/ACJ8KiBYfGOOiD6BVnxA96LsdYfO9D99NBQQeky7QrA18224iz5X+JGC3ayGlP56A6AlJcuncfuO7lpxaMUoiRPzn69mO2DSfJL0mRs09Qiuug=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2f7edb6-2137-4eed-a4a5-440b2f5368c4 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 257 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:51.879721 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:51.881386 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzsRBeEApsgpbpUkNB/ACJ8KiBYfGOOiD6BVnxA96LsdYfO9D99NBQQeky7QrA18224iz5X+JGC3ayGlP56A6AlJcuncfuO7lpxaMUoiRPzn69mO2DSfJL0mRs09Qiuug=="}} Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzsRBeEApsgpbpUkNB/ACJ8KiBYfGOOiD6BVnxA96LsdYfO9D99NBQQeky7QrA18224iz5X+JGC3ayGlP56A6AlJcuncfuO7lpxaMUoiRPzn69mO2DSfJL0mRs09Qiuug=='}}} Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:51.882281 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:51.884223 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:54:51.886001 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:54:51.887379 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 11:54:51.887379 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:51.888539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2f7edb6-2137-4eed-a4a5-440b2f5368c4 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:51.889598 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2f7edb6-2137-4eed-a4a5-440b2f5368c4 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.403370 Nov 02 11:54:51.890687 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 639/1282] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:51 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:54:52.189406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f46a34e9-faa4-4692-b929-b7b7438e55b6 tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:52.206569 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f46a34e9-faa4-4692-b929-b7b7438e55b6 tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] 10.222.0.48 "GET /compute/v2.1/flavors/886392241" status: 200 len: 465 microversion: 2.61 time: 0.314523 Nov 02 11:54:52.231068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 640/1283] 10.222.0.48 () {60 vars in 1196 bytes} [Wed Nov 2 11:54:51 2022] GET /compute/v2.1/flavors/886392241 => generated 465 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:52.243984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3d0c9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-59870837", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:52.282401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:52.294374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for user 7ec5f70dff684d97bf60ab7ef12d5610 and project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:52.332803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:52.371339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 2165 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-59870837", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:52.374180 n-d-855649-4 devstack@n-api.service[127568]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-59870837', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:52.378087 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.381755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:52.394138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be7b623e-4bed-4ab4-843e-661a7917949a tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144594 Nov 02 11:54:52.394841 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 641/1284] 10.222.0.48 () {60 vars in 1160 bytes} [Wed Nov 2 11:54:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:54:52.405203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:52.407756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] [instance: 899342e4-6b0c-442f-a92d-b158f16525fe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:52.437541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:52.438310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:52.438922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:52.440045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:52.440663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:52.441323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] HTTP exception thrown: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Request method failure captured: Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe HTTP/1.1 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlolxDSZiiO6jqotM0pQS91uWLx10hi1nv00H7JWwlnnAXgutWq4sLNfAwOfSltPZ6jTPGLPJ_8LJdBOk2-xeUQceKMRCiX2e228hyz831lOkQo30zO3zpfuQ2t0MChtnMTFD9aJ7nUtKmb_2a8MtHKdOckNZmkvdHEnCZ-j6sBFdG4 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 71eb96678e854fa79fd541da1b5b2815 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdmin275Test-1792679450 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/71eb96678e854fa79fd541da1b5b2815"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_71eb96678e854fa79fd541da1b5b2815", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/71eb96678e854fa79fd541da1b5b2815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/71eb96678e854fa79fd541da1b5b2815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdmin275Test-1792679450 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 71eb96678e854fa79fd541da1b5b2815 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdmin275Test-1792679450 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdmin275Test-1792679450-project Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 496980ce473d4c0abcc8ca47ee949ef7 Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdmin275Test-1792679450-project Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '899342e4-6b0c-442f-a92d-b158f16525fe'} Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:54:52.486914 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] Returning 404 to user: Instance 899342e4-6b0c-442f-a92d-b158f16525fe could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:52.492235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5427fd6-d81b-4f43-bb67-c817f1d45803 tempest-ServersAdmin275Test-1792679450 tempest-ServersAdmin275Test-1792679450-project] 10.222.0.48 "GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe" status: 404 len: 111 microversion: 2.75 time: 0.086475 Nov 02 11:54:52.494596 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 642/1285] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:52 2022] GET /compute/v2.1/servers/899342e4-6b0c-442f-a92d-b158f16525fe => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:54:52.501830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:52.502803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:52.510219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:52.510701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:52.515314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:52.515314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:52.515314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:52.515314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:52.640229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:52.662612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:52.668111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:52.671121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4fb8a8f-3746-4d22-8e31-9625b922293c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.175028 Nov 02 11:54:52.679191 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 643/1286] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:52 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:52.679191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61e97d2b-b5b6-4c50-93b8-3705fc9f8fc9 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b9629f70>, body: {"flavor": {"description": "new"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:52.684569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:52.839150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61e97d2b-b5b6-4c50-93b8-3705fc9f8fc9 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/886392241" status: 200 len: 466 microversion: 2.61 time: 0.164319 Nov 02 11:54:52.849368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 644/1287] 10.222.0.48 () {62 vars in 1216 bytes} [Wed Nov 2 11:54:52 2022] PUT /compute/v2.1/flavors/886392241 => generated 466 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:54:52.855961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25a8f77d-7eb1-47f4-a7fe-5f1dbfc289eb tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3eee820>, body: {"keypair": {"name": "tempest-keypair-1392111502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2NSKlj9nJU4QLgLjLs299XOr5mmt5HFLMNaAQvpXX7FaxctTMCGCPpDlFMttmtM/B0+PRtwZZRYh/We87TdCwOFDGj1T7mqiCEP2zV4gHqOdXSzc3AALt2TEqFf8hnRQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:52.874426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-25a8f77d-7eb1-47f4-a7fe-5f1dbfc289eb tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:52.881117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-25a8f77d-7eb1-47f4-a7fe-5f1dbfc289eb tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for user 7ec5f70dff684d97bf60ab7ef12d5610 and project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:53.072262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25a8f77d-7eb1-47f4-a7fe-5f1dbfc289eb tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221434 Nov 02 11:54:53.072732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 645/1288] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:53.098858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:53.098858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:53.113983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:53.133655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:53.133655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:53.133655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:53.133655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:53.133655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:53.438932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:53.453150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b26f6fd7-3065-4431-a2dd-f40f4f4aeec9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.376264 Nov 02 11:54:53.469236 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 646/1289] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:53 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:53.504964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c155960f-4c59-4cc0-80a9-6d877d0f4d64", "tag": "e96a95cb-6e30-4cb7-9af9-ab42b1a46797"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:53.521340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:53.525856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:53.527261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:53.546091 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] Creating event network-changed:e96a95cb-6e30-4cb7-9af9-ab42b1a46797 for instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 on n-h1-855649-4 Nov 02 11:54:53.553739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-989796b4-3146-4535-ba33-c4b7ae0de4ea req-b61de400-9657-421d-b286-28f26b23062c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064790 Nov 02 11:54:53.555361 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 647/1290] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:53.564942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7fe04ee6-b651-49a3-855c-e06bde807150 tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:53.612008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7fe04ee6-b651-49a3-855c-e06bde807150 tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.054175 Nov 02 11:54:53.613113 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 648/1291] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:54:53 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:53.638403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b82ceb80>, body: {"keypair": {"name": "tempest-keypair-1392111502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJdQVE6kB/x7xqS5TYVsJjeRhbA1+76yT4SEMmULCERpgH0Rz7wjyl9vHeSJo9HneGbvAm3VdHLsM28b7Kk9Bnl95pHJrPMPQtoibT1pIWQEYbYccyOeMo36LqqnZNjEw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:53.708633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:53.730668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for user 7ec5f70dff684d97bf60ab7ef12d5610 and project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] HTTP exception thrown: Key pair 'tempest-keypair-1392111502' already exists. Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 273 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-keypair-1392111502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJdQVE6kB/x7xqS5TYVsJjeRhbA1+76yT4SEMmULCERpgH0Rz7wjyl9vHeSJo9HneGbvAm3VdHLsM28b7Kk9Bnl95pHJrPMPQtoibT1pIWQEYbYccyOeMo36LqqnZNjEw=="}} Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: exception: Key pair 'tempest-keypair-1392111502' already exists. Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1392111502', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJdQVE6kB/x7xqS5TYVsJjeRhbA1+76yT4SEMmULCERpgH0Rz7wjyl9vHeSJo9HneGbvAm3VdHLsM28b7Kk9Bnl95pHJrPMPQtoibT1pIWQEYbYccyOeMo36LqqnZNjEw=='}}} Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:54:53.854083 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7ec5f70dff684d97bf60ab7ef12d5610-tempest-keypair-1392111502' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result.read() Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 11:54:53.860742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7ec5f70dff684d97bf60ab7ef12d5610-tempest-keypair-1392111502' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 11, 54, 53, 766493), 'updated_at': None, 'name': 'tempest-keypair-1392111502', 'user_id': '7ec5f70dff684d97bf60ab7ef12d5610', 'fingerprint': '1d:d3:4c:c8:09:d0:d2:96:46:45:9e:44:67:03:5e:6a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJdQVE6kB/x7xqS5TYVsJjeRhbA1+76yT4SEMmULCERpgH0Rz7wjyl9vHeSJo9HneGbvAm3VdHLsM28b7Kk9Bnl95pHJrPMPQtoibT1pIWQEYbYccyOeMo36LqqnZNjEw==', 'type': 'ssh'}] Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._create() Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1392111502' already exists. Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 11:54:53.869729 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1392111502' already exists. Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1392111502' already exists. Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 409 to user: Key pair 'tempest-keypair-1392111502' already exists. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f91a5cc0-b8c7-4520-90db-faac3bd35e46 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.240339 Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 649/1292] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:53 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:53.882147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e09b2f5-2fa5-4682-a260-05a809f0348a tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:53.937426 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e09b2f5-2fa5-4682-a260-05a809f0348a tempest-FlavorsV261TestJSON-1136120709 tempest-FlavorsV261TestJSON-1136120709-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.078202 Nov 02 11:54:53.938362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 650/1293] 10.222.0.48 () {60 vars in 1166 bytes} [Wed Nov 2 11:54:53 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:53.953417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:53.958552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:53.962605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:53.963346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:53.964007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:53.965328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:53.965948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:53.966836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:54.155018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:54.213758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:54.234771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:54.240910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:54.258950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c43f0a20-0e70-4223-9059-04c88dbacea5 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.318849 Nov 02 11:54:54.259891 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 651/1294] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:53 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:54.264875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ac9126f-b0e7-40de-affb-8da975b0c9a7 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Calling method '.version_select at 0x7ff1b3d06af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.459531 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ac9126f-b0e7-40de-affb-8da975b0c9a7 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392111502" status: 202 len: 0 microversion: 2.1 time: 0.198332 Nov 02 11:54:54.460408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 652/1295] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 11:54:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392111502 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:54:54.467981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d9f8592-a7f5-430d-926f-5e80ecf41860 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.524544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-558f2c40-4702-47d5-9d89-2245f0a35695 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/action" status: 202 len: 0 microversion: 2.25 time: 4.872449 Nov 02 11:54:54.525543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 644/1296] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:54:49 2022] POST /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/action => generated 0 bytes in 4875 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:54:54.655027 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d9f8592-a7f5-430d-926f-5e80ecf41860 tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/886392241" status: 202 len: 0 microversion: 2.61 time: 0.192356 Nov 02 11:54:54.658602 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 653/1297] 10.222.0.48 () {60 vars in 1199 bytes} [Wed Nov 2 11:54:54 2022] DELETE /compute/v2.1/flavors/886392241 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:54:54.661898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5a2a343-934b-463e-bdd9-846c4e5c7919 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3d78700>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFsn4EtMWRLz784Due2Eg5hiiFO/YLF9Wwn0bRlaSszzpj+ibx7tjwT9yyiESRYU9cbeVHEm/6ELCydkVvF0qXTibMs2zm4Y5gWcKMm9EeggNH1NRPQXbpX5LaQPlp1qg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5a2a343-934b-463e-bdd9-846c4e5c7919 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 247 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFsn4EtMWRLz784Due2Eg5hiiFO/YLF9Wwn0bRlaSszzpj+ibx7tjwT9yyiESRYU9cbeVHEm/6ELCydkVvF0qXTibMs2zm4Y5gWcKMm9EeggNH1NRPQXbpX5LaQPlp1qg=="}} Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFsn4EtMWRLz784Due2Eg5hiiFO/YLF9Wwn0bRlaSszzpj+ibx7tjwT9yyiESRYU9cbeVHEm/6ELCydkVvF0qXTibMs2zm4Y5gWcKMm9EeggNH1NRPQXbpX5LaQPlp1qg=='}}} Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:54:54.667798 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 11:54:54.672839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.675529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5a2a343-934b-463e-bdd9-846c4e5c7919 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:54.676890 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5a2a343-934b-463e-bdd9-846c4e5c7919 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019367 Nov 02 11:54:54.678554 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 654/1298] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:54 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:54:54.687835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.691457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:54.699306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:54.700143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:54.700833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:54.701820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:54.702511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:54.703334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:54.725578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16a64a50-0b0b-4ddb-9cb5-0d248eb7a2b2 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Calling method '.version_select at 0x7ff1b36f84c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.750938 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-16a64a50-0b0b-4ddb-9cb5-0d248eb7a2b2 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16a64a50-0b0b-4ddb-9cb5-0d248eb7a2b2 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/48b5d9e0-fd49-4266-aa32-6265671fa65e/metadata/os_distro HTTP/1.1 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'image_id': '48b5d9e0-fd49-4266-aa32-6265671fa65e', 'id': 'os_distro'} Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48b5d9e0-fd49-4266-aa32-6265671fa65e Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:54.755098 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48b5d9e0-fd49-4266-aa32-6265671fa65e could not be found. Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:54.760500 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:54.765953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16a64a50-0b0b-4ddb-9cb5-0d248eb7a2b2 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:54.766630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16a64a50-0b0b-4ddb-9cb5-0d248eb7a2b2 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "DELETE /compute/v2.1/images/48b5d9e0-fd49-4266-aa32-6265671fa65e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.239870 Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 645/1299] 10.222.0.48 () {58 vars in 1293 bytes} [Wed Nov 2 11:54:54 2022] DELETE /compute/v2.1/images/48b5d9e0-fd49-4266-aa32-6265671fa65e/metadata/os_distro => generated 62 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:54.790012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:54.935490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:54.944605 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45ced5c0-a8f9-4db1-830e-4f0aaab11a03 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.263931 Nov 02 11:54:54.949484 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 655/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:54 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:54.954006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df186012-2950-4e08-992a-ac77bb6693ce tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:54.989575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:54.991969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df186012-2950-4e08-992a-ac77bb6693ce tempest-FlavorsV261TestJSON-379166556 tempest-FlavorsV261TestJSON-379166556-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.044787 Nov 02 11:54:54.993107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 656/1301] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 11:54:54 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:54.997983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3d78550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-548004226", "public_key": " "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:54.999783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:55.001413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:55.003071 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea1d5fb7-07fd-4921-9cc3-df477c5736e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.229985 Nov 02 11:54:55.003849 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 646/1302] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:54 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:55.025032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0b09bbd-aa2b-4315-98dd-f701c44babd7 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Calling method '.version_select at 0x7ff1b36e1430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:55.033431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:55.041805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for user 7ec5f70dff684d97bf60ab7ef12d5610 and project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:55.058730 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c0b09bbd-aa2b-4315-98dd-f701c44babd7 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:55.059877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0b09bbd-aa2b-4315-98dd-f701c44babd7 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/8bc772fe-50cb-4ec7-aaa6-0f761a77c809/metadata/os_version HTTP/1.1 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'image_id': '8bc772fe-50cb-4ec7-aaa6-0f761a77c809', 'id': 'os_version'} Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8bc772fe-50cb-4ec7-aaa6-0f761a77c809 Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:55.060806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8bc772fe-50cb-4ec7-aaa6-0f761a77c809 could not be found. Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:55.066206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 94 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-548004226", "public_key": " "}} Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-548004226', 'public_key': ' '}}} Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.074004 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f453a28f-7654-48f1-b6fc-2ef30026d0a5 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068833 Nov 02 11:54:55.079021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 657/1303] 10.222.0.48 () {60 vars in 1158 bytes} [Wed Nov 2 11:54:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:54:55.082374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0b09bbd-aa2b-4315-98dd-f701c44babd7 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.082374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0b09bbd-aa2b-4315-98dd-f701c44babd7 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "GET /compute/v2.1/images/8bc772fe-50cb-4ec7-aaa6-0f761a77c809/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.068988 Nov 02 11:54:55.082566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2019b92b-ae86-46e6-9ca2-c9b003c2cdf2 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3a2e790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGwlwST0KQaXLiz9iZMwFb0Fsmt0ytaQcgqpxa0+2p4crtN8HFH9QzRPierrxzWLbbLcBtReVusNka7j/M2BzutRF9ugknkm9BoioengUo+VsHfXPW6ZzI2ZXgQzeWB8g=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:55.082669 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 647/1304] 10.222.0.48 () {58 vars in 1293 bytes} [Wed Nov 2 11:54:55 2022] GET /compute/v2.1/images/8bc772fe-50cb-4ec7-aaa6-0f761a77c809/metadata/os_version => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2019b92b-ae86-46e6-9ca2-c9b003c2cdf2 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 507 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGwlwST0KQaXLiz9iZMwFb0Fsmt0ytaQcgqpxa0+2p4crtN8HFH9QzRPierrxzWLbbLcBtReVusNka7j/M2BzutRF9ugknkm9BoioengUo+VsHfXPW6ZzI2ZXgQzeWB8g=="}} Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGwlwST0KQaXLiz9iZMwFb0Fsmt0ytaQcgqpxa0+2p4crtN8HFH9QzRPierrxzWLbbLcBtReVusNka7j/M2BzutRF9ugknkm9BoioengUo+VsHfXPW6ZzI2ZXgQzeWB8g=='}}} Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 11:54:55.082762 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2019b92b-ae86-46e6-9ca2-c9b003c2cdf2 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.088171 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2019b92b-ae86-46e6-9ca2-c9b003c2cdf2 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010899 Nov 02 11:54:55.092238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b1d90b8-fd15-4957-8515-1be4c51bf9f5 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Calling method '.version_select at 0x7ff1b3712310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:55.092436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 658/1305] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:55 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:54:55.094710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Action: 'create', calling method: .version_select at 0x7ff1b3cfb160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2113227076", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:55.107563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7b1d90b8-fd15-4957-8515-1be4c51bf9f5 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b1d90b8-fd15-4957-8515-1be4c51bf9f5 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/6caaed0e-ede1-4b00-863e-7132b7dc7589/metadata HTTP/1.1 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'image_id': '6caaed0e-ede1-4b00-863e-7132b7dc7589'} Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6caaed0e-ede1-4b00-863e-7132b7dc7589 Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:55.109686 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6caaed0e-ede1-4b00-863e-7132b7dc7589 could not be found. Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b1d90b8-fd15-4957-8515-1be4c51bf9f5 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b1d90b8-fd15-4957-8515-1be4c51bf9f5 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "GET /compute/v2.1/images/6caaed0e-ede1-4b00-863e-7132b7dc7589/metadata" status: 404 len: 62 microversion: 2.1 time: 0.029890 Nov 02 11:54:55.113399 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 648/1306] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 11:54:55 2022] GET /compute/v2.1/images/6caaed0e-ede1-4b00-863e-7132b7dc7589/metadata => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:55.120876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:54:55.124028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61773cb2-4422-4d7a-8a78-e62cbede0bb4 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Action: 'update_all', calling method: .version_select at 0x7ff1b36e1b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:55.127632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Getting quotas for user 7ec5f70dff684d97bf60ab7ef12d5610 and project 536eab16fde1441790946c32092004e2. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:54:55.148322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-61773cb2-4422-4d7a-8a78-e62cbede0bb4 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61773cb2-4422-4d7a-8a78-e62cbede0bb4 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/images/ac4e0983-f0c7-49df-9e42-154b1a0ccbf1/metadata HTTP/1.1 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 57 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'image_id': 'ac4e0983-f0c7-49df-9e42-154b1a0ccbf1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac4e0983-f0c7-49df-9e42-154b1a0ccbf1 Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:55.152286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac4e0983-f0c7-49df-9e42-154b1a0ccbf1 could not be found. Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:55.159288 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.162789 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.163007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61773cb2-4422-4d7a-8a78-e62cbede0bb4 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.163007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61773cb2-4422-4d7a-8a78-e62cbede0bb4 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "PUT /compute/v2.1/images/ac4e0983-f0c7-49df-9e42-154b1a0ccbf1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033980 Nov 02 11:54:55.163007 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 649/1307] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:54:55 2022] PUT /compute/v2.1/images/ac4e0983-f0c7-49df-9e42-154b1a0ccbf1/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 118 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2113227076", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2113227076', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 11:54:55.163276 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e7964ac-b060-42e3-aedd-f3cf40276a65 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065565 Nov 02 11:54:55.168954 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 659/1308] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:54:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 11:54:55.173729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd84a4d3-144a-4df1-916b-d941fe41424a tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Action: 'update', calling method: .version_select at 0x7ff1b3830b80>, body: {"meta": {"os_distro": "alt"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:55.178495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73542a6d-d495-47ab-a05f-272963930af0 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Calling method '.version_select at 0x7ff1b3d17160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:55.192171 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-73542a6d-d495-47ab-a05f-272963930af0 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73542a6d-d495-47ab-a05f-272963930af0 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Request method failure captured: Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2076016765 HTTP/1.1 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqKtuQKSPu5ISgTpfZKn6sAST8XqpcKti8EwL-VUdYQYlVuhPrF9XLaEm1Ph5p18jlXrpsjT2flPykOOfLi4ZDcrxn-A3TQ-fZNwIkmk431qiF3IPl7GWtD_u0UpVhTFlaHWJq6O-CLKo1hpPUVgdJLa4QhALX0s5TjIsnOgs-2VQk Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_536eab16fde1441790946c32092004e2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/536eab16fde1441790946c32092004e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/536eab16fde1441790946c32092004e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 536eab16fde1441790946c32092004e2 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-437992218 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-437992218-project Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: exception: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'tempest-keypair-non-existent-2076016765'} Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.194040 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73542a6d-d495-47ab-a05f-272963930af0 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2076016765 not found for user 7ec5f70dff684d97bf60ab7ef12d5610 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73542a6d-d495-47ab-a05f-272963930af0 tempest-KeyPairsNegativeTestJSON-437992218 tempest-KeyPairsNegativeTestJSON-437992218-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2076016765" status: 404 len: 145 microversion: 2.1 time: 0.029080 Nov 02 11:54:55.204607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 660/1309] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 11:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2076016765 => generated 145 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bd84a4d3-144a-4df1-916b-d941fe41424a tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd84a4d3-144a-4df1-916b-d941fe41424a tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/images/71549f19-e047-4fbd-8edb-1e12fbd27bfb/metadata/os_distro HTTP/1.1 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 30 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: {"meta": {"os_distro": "alt"}} Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'image_id': '71549f19-e047-4fbd-8edb-1e12fbd27bfb', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 71549f19-e047-4fbd-8edb-1e12fbd27bfb Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:55.208068 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 71549f19-e047-4fbd-8edb-1e12fbd27bfb could not be found. Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd84a4d3-144a-4df1-916b-d941fe41424a tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd84a4d3-144a-4df1-916b-d941fe41424a tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "PUT /compute/v2.1/images/71549f19-e047-4fbd-8edb-1e12fbd27bfb/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.038215 Nov 02 11:54:55.213169 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 650/1310] 10.222.0.48 () {60 vars in 1310 bytes} [Wed Nov 2 11:54:55 2022] PUT /compute/v2.1/images/71549f19-e047-4fbd-8edb-1e12fbd27bfb/metadata/os_distro => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:55.217129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45320f79-6a61-4ca1-b707-be0b2dac78d3 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Action: 'create', calling method: .version_select at 0x7ff1b39cfee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:55.240926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-45320f79-6a61-4ca1-b707-be0b2dac78d3 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] HTTP exception thrown: Image not found. Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45320f79-6a61-4ca1-b707-be0b2dac78d3 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Request method failure captured: Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/images/62cb18ea-e58c-45b0-9acd-3b485395e9c0/metadata HTTP/1.1 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 57 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqNS3jTTBf09xGTlTY6Edf25ebuz4wMikdTHjieo8yIQ734hwJuqbJTp6coqOm8uzQBxDC_vJo2oeofTTYYOnlY7QfxZCApxyTyn2UzXihYyDxemdTVfmtS2jz0oAMTTpcBE0CXB9_fUkg5pp3dY3yEDi4z5zxnV8InhL4n9tJpV7A Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6cfb1967354301a525f4ef77fc45ac", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6cfb1967354301a525f4ef77fc45ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: bf6cfb1967354301a525f4ef77fc45ac Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-390995339 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: c6a23e65e9c842e7b169004070d9f916 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-390995339-project Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'image_id': '62cb18ea-e58c-45b0-9acd-3b485395e9c0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62cb18ea-e58c-45b0-9acd-3b485395e9c0 Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:54:55.243864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62cb18ea-e58c-45b0-9acd-3b485395e9c0 could not be found. Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45320f79-6a61-4ca1-b707-be0b2dac78d3 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45320f79-6a61-4ca1-b707-be0b2dac78d3 tempest-ImagesMetadataNegativeTestJSON-390995339 tempest-ImagesMetadataNegativeTestJSON-390995339-project] 10.222.0.48 "POST /compute/v2.1/images/62cb18ea-e58c-45b0-9acd-3b485395e9c0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032895 Nov 02 11:54:55.248043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 661/1311] 10.222.0.48 () {60 vars in 1281 bytes} [Wed Nov 2 11:54:55 2022] POST /compute/v2.1/images/62cb18ea-e58c-45b0-9acd-3b485395e9c0/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:54:55.290887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:55.291551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:55.298898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:55.299421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:55.299853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:55.300546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:55.301352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:55.301465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:55.372036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:55.380353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:55.381785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:55.386703 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cbb945f-02d4-450c-b9d1-ae75cd01d035 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.100443 Nov 02 11:54:55.387299 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 651/1312] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:55 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:55.978235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:55.978235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:55.981339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:55.982066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:55.982733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:55.983735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:55.985105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:55.985850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:56.033004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:56.033844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:56.054547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:56.059157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:56.060646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:56.061558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:56.062287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:56.063040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:56.205161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.215391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c328dfd4-a59d-480f-acc9-e84446f7bd98 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.247825 Nov 02 11:54:56.216146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 662/1313] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:55 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:54:56.414184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:56.415042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:56.425722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:56.533368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.543082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.544337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.546073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec303a06-afac-4d97-9afd-1c538d01f592 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.517809 Nov 02 11:54:56.559350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.559699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 652/1314] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:56 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:56.571311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.572783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:56.579791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35dee243-008b-4854-bf3e-8dd6c2aa8275 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.169659 Nov 02 11:54:56.588591 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 663/1315] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:56 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:57.241827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:57.245425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:57.251018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.251018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.251018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.251631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.251712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.252103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.503753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:57.516907 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5fd59370-1d8a-4a95-9791-8eafb1bcd343 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.278815 Nov 02 11:54:57.517506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 653/1316] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:57 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:57.577597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:57.577597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:57.583559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.584129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.584679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.585392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.586620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.587079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.608334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:57.609359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:57.620125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.620949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.621628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.623215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:57.623897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:57.624528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:57.899196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:57.918618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:57.924044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:57.928257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c33bff09-3538-409f-aee8-bfb02e8d6bdb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.355218 Nov 02 11:54:57.929809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 664/1317] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:57 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:58.240564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:58.252768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:58.254827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:58.263606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f3a71a3-22ec-4421-8a15-9f03566d87a4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.659804 Nov 02 11:54:58.264486 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 654/1318] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:57 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:58.542381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:58.543176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:58.549630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:58.550183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:58.550851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:58.551922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:58.552569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:58.553462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:58.779704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:58.791013 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b808627-fee8-44ac-8dc1-44a26e9e014e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.251806 Nov 02 11:54:58.799158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 665/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:58 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:54:58.960042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:58.961835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:58.970595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:58.971308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:58.972135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:58.972954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:58.973691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:58.974116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:59.276471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.290251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.292228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.295831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26ab9e2d-673a-4ba8-920a-4d81c2dc9ae1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.342061 Nov 02 11:54:59.297257 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 655/1320] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:58 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:54:59.316441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:59.318132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:59.331382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:59.333697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:59.334533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:59.335334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:59.335836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:59.336546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:59.441109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.452100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.453979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:54:59.457966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:54:59.461572 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-322709ec-6169-4c26-a8bd-ce50bdd0918a tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.164665 Nov 02 11:54:59.475736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 666/1321] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:54:59 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:54:59.621023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c155960f-4c59-4cc0-80a9-6d877d0f4d64", "name": "network-vif-plugged", "status": "completed", "tag": "e96a95cb-6e30-4cb7-9af9-ab42b1a46797"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:54:59.638106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:59.638785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:59.639510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:59.664652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] Creating event network-vif-plugged:e96a95cb-6e30-4cb7-9af9-ab42b1a46797 for instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 on n-h1-855649-4 Nov 02 11:54:59.670678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-35b83391-fb35-4bff-9f1d-e3a3ff3d5456 req-e133ae1c-a725-4f32-90fc-648ba5fec8c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058390 Nov 02 11:54:59.671524 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 656/1322] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:54:59.819612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:54:59.820385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:54:59.828307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:59.831575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:59.831575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:54:59.831575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:54:59.831575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:54:59.831575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:00.034146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.042967 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f4b1512-ed50-45ac-8d87-77717c18e4cb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.227675 Nov 02 11:55:00.043706 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 667/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:54:59 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:00.326904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:00.327634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:00.333922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:00.334407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:00.335065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:00.339741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:00.339741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:00.339741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:00.491766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:00.492454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:00.498911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.500100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:00.500588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:00.501022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:00.515601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:00.515601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:00.515601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:00.517788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.519707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.521320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3c10c43-cc56-4653-8e12-1ed285b95966 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.199744 Nov 02 11:55:00.537522 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 657/1324] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:00 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:00.589506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.598671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.600165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:00.605330 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f40e5253-a961-4f39-9641-e2ba3b471341 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.118577 Nov 02 11:55:00.606258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 668/1325] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:00 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:01.073341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:01.074315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:01.089510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:01.091322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.091825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.092365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.093088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.093552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.093986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.244996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.253109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce7b582a-f863-4774-8c3f-8907f188afdd tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1322 microversion: 2.1 time: 0.189801 Nov 02 11:55:01.253865 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 658/1326] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:01 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:01.555069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:01.555676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:01.564580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.564580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.564985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.565877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.566385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.567000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.635633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:01.636406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:01.647160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.649377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.650098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.651188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:01.652691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:01.653350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:01.761893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.778468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.780756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.792111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed180143-6941-4b9d-9c4e-db91df380ca0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.161736 Nov 02 11:55:01.795799 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 659/1327] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:01 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:01.813630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.824997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.827125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:01.828754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5f13c24-91f3-431b-9480-84633e0899d3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.278698 Nov 02 11:55:01.829754 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 669/1328] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:01 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:02.281678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.282818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:02.291533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.296976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.297555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.298272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.299811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.302294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.302838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.321724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.322815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.325064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.327375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.328089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.332343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.345140 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d67a3129-aea1-4e60-8391-0dd1fb1e230c tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.198108 Nov 02 11:55:02.345909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 660/1329] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:02.361456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.370672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.402811 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4764469-2919-42f7-b4e6-c8e72f185fae tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.046471 Nov 02 11:55:02.406342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:02.421904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.426239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.426834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.427527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.428540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.429263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.429931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.464932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2ef94cf-27af-4027-8331-0ee81d58f1ef tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051074 Nov 02 11:55:02.472918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 662/1331] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:02.487106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.491405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.491916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.493239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.493456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.494165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.494310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.520303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0606bd8b-2f8a-4682-b3df-9d34f11a7e9e tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-855649-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038215 Nov 02 11:55:02.529101 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 663/1332] 10.222.0.48 () {58 vars in 1194 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services?host=n-d-855649-4&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:55:02.534397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.538490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.539939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.540299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.541034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.541485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.541902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.560546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:02.578355 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21038cb0-b5ba-42cf-b8a5-b46f1dbf4a2b tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048003 Nov 02 11:55:02.579494 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 664/1333] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:02.593793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.598801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.599311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.599757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.600486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.600985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.601511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.629434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-491cc5bd-bf11-4e37-ad56-528b37e13261 tempest-ServicesAdminNegativeTestJSON-935156843 tempest-ServicesAdminNegativeTestJSON-935156843-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.040403 Nov 02 11:55:02.630183 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 665/1334] 10.222.0.48 () {58 vars in 1198 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:55:02.644126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:02.654561 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2364d9d5-db2a-4e1c-9b96-314e64f6729f tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1471 microversion: 2.1 time: 0.378021 Nov 02 11:55:02.658132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 670/1335] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:02.875469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e635e0cf-db39-4463-8ca0-0ab8657cc439 tempest-ServicesAdminNegativeTestJSON-310749823 tempest-ServicesAdminNegativeTestJSON-310749823-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.879202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e635e0cf-db39-4463-8ca0-0ab8657cc439 tempest-ServicesAdminNegativeTestJSON-310749823 tempest-ServicesAdminNegativeTestJSON-310749823-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5d8b37509a384a159ff6da8421a21c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206e0584ff1b4ac2b68ca4c55e3feb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e635e0cf-db39-4463-8ca0-0ab8657cc439 tempest-ServicesAdminNegativeTestJSON-310749823 tempest-ServicesAdminNegativeTestJSON-310749823-project] Request method failure captured: Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqT5gV6b1EjYngFn0Qs9QjhZ9S7ncHt44guhEZ0YNAkseuVxIWeU2e1aF8H1FICTGA4yjy-_xY_5OPrGh7Cu0ngvlYx3U2cnFlL9aY3r_ql2yzDmvRbft2zCz6lpeskb0AqRJ7aty2cxdei5WghUKkRtn0bwiJPp_Xf9U9RUZ5-q2E Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 206e0584ff1b4ac2b68ca4c55e3feb4e Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-310749823 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/206e0584ff1b4ac2b68ca4c55e3feb4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_206e0584ff1b4ac2b68ca4c55e3feb4e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/206e0584ff1b4ac2b68ca4c55e3feb4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/206e0584ff1b4ac2b68ca4c55e3feb4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-310749823 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 206e0584ff1b4ac2b68ca4c55e3feb4e Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-310749823 Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeTestJSON-310749823-project Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 5d8b37509a384a159ff6da8421a21c3f Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-310749823-project Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 11:55:02.881548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e635e0cf-db39-4463-8ca0-0ab8657cc439 tempest-ServicesAdminNegativeTestJSON-310749823 tempest-ServicesAdminNegativeTestJSON-310749823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:02.886376 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e635e0cf-db39-4463-8ca0-0ab8657cc439 tempest-ServicesAdminNegativeTestJSON-310749823 tempest-ServicesAdminNegativeTestJSON-310749823-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.242021 Nov 02 11:55:02.889328 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 666/1336] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/os-services => generated 112 bytes in 248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:02.894298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:02.894956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:02.905460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.906674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.907441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:02.908658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:02.909295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:02.909988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.037576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.046762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.048279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.050966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:03.051787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] [instance: c0b5e709-e465-41eb-a217-12e48a7ce2ff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:03.053393 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7a193e6-870a-4f0d-9269-872f6176b52b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1531 microversion: 2.91 time: 0.163050 Nov 02 11:55:03.054203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 667/1337] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:02 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1531 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:03.068598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:03.068820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] HTTP exception thrown: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. Nov 02 11:55:03.069646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Request method failure captured: Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/c0b5e709-e465-41eb-a217-12e48a7ce2ff/action HTTP/1.1 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqBAY_0HUBag-hxw_uN0voXqgPJl_M2Hlb7At8WBHJeTYEswxCNyFuDGSdo5oEK_ktFXdTRa5js6AlkdlCFkV9vdgHvvTAU20kOl5NJvfAtCds3oug2RjzIFleODSl-_oVSxkZcfEq4En1SqqWuNZ6UiKhMI2Ok0FrvA9UfnBOJLuM Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f27669b4f3474aa0d12fa9b9045950", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 87f18ce832d949c4a8a4c9a3d727d7b0 Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: {"migrate": {}} Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c0b5e709-e465-41eb-a217-12e48a7ce2ff', 'body': {'migrate': {}}} Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:03.071244 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Returning 404 to user: Instance c0b5e709-e465-41eb-a217-12e48a7ce2ff could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:03.081586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84c08fa1-efe4-4469-ad29-d93febd9436f tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c0b5e709-e465-41eb-a217-12e48a7ce2ff/action" status: 404 len: 111 microversion: 2.1 time: 0.398988 Nov 02 11:55:03.082135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.082135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.082135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.082135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.082135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.082498 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 671/1338] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:02 2022] POST /compute/v2.1/servers/c0b5e709-e465-41eb-a217-12e48a7ce2ff/action => generated 111 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:03.082585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.089173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:03.089722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:03.097995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.098489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.098935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.100401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.101112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.101958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.212823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lazy-loading 'services' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:03.238485 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f0e6128-2736-4f66-96c2-e896aaa32841 tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1936 microversion: 2.91 time: 0.155010 Nov 02 11:55:03.251952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 672/1339] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:03 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1936 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:03.274317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:03.274822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:03.290253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.291454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.292825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.294576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.296236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.297978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.309570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.323198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.329891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:03.334457 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9cc1eff-cfd4-48a1-8e14-fc4e84e8d7db tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.278064 Nov 02 11:55:03.335446 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 668/1340] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:03 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:03.343668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:03.348029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lazy-loading 'flavor' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:03.403243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1412754663", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:03.538175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:55:03.827632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:55:03.828058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:55:03.828535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:55:03.828950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:55:03.829371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:55:03.844273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.844711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.847534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.848324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:03.848791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:03.855647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:03.899498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Getting quotas for project bdbde890d43146d7b34098e4de4e7b0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:03.908820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Getting quotas for user 1a0bf82fdcf14d3d9e628fb5da832b80 and project bdbde890d43146d7b34098e4de4e7b0c. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:03.929284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:55:03.933452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:55:04.191662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56f2ae6d-ef4d-420b-a195-fb68a6983534 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792500 Nov 02 11:55:04.195160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 669/1341] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:55:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:55:04.195281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65614076-01d7-4ae6-9ff5-ef5fd89cff92 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action" status: 202 len: 0 microversion: 2.91 time: 0.927444 Nov 02 11:55:04.195281 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 673/1342] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:55:03 2022] POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:04.208576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.210200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:04.240139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.241511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.242344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.244830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.245001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.245469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.332335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.344696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.346938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.353376 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44aa56da-0396-4054-8728-df6a3aea17e0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.154371 Nov 02 11:55:04.365246 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 674/1343] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:04.365246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8bdaf63-9d08-4e23-8e58-4616610c4fd5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.365246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8bdaf63-9d08-4e23-8e58-4616610c4fd5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:04.422901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Calling method '.version_select at 0x7ff1b36e1d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.425976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.426675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.427533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.479840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.481362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.481993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.516254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.518203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.519568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.540191 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b88f80b5-c715-43c5-af8f-e0b56fce7e9b tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.345738 Nov 02 11:55:04.540968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 670/1344] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:04.552074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.555398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:04.568097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.568653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.575310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.575310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.575310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.575310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.579519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8bdaf63-9d08-4e23-8e58-4616610c4fd5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.590316 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8bdaf63-9d08-4e23-8e58-4616610c4fd5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1222 microversion: 2.1 time: 0.234875 Nov 02 11:55:04.591365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 675/1345] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1222 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:04.834351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad009b68-4545-4650-99b9-1d4f9c731a4a tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Calling method '.version_select at 0x7ff1b35f10d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.836776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad009b68-4545-4650-99b9-1d4f9c731a4a tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '9bf63f127c164441a6e2aec70bcf4572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded9e2bc82642cdb393b9a91d36572b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad009b68-4545-4650-99b9-1d4f9c731a4a tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Request method failure captured: Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/n-h1-855649-4/search HTTP/1.1 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqWKarNmLEGgBAeLgkhcUoFEAz-7cRHxNvaXkRQkQQibB0QHRyD-UiV0eFkwCc9gdARKBohLJ386vtTuOH5hKmpa1mw02t3Np1cciPmtJNwFObC2CRcXy5sBGwgoiU6Ksz33aUQD24iRyQOw9d7NgNybQ4woiRxk932Cn5uvuRLrqs Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7ded9e2bc82642cdb393b9a91d36572b Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ded9e2bc82642cdb393b9a91d36572b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7ded9e2bc82642cdb393b9a91d36572b Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474688392-project Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9bf63f127c164441a6e2aec70bcf4572 Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392-project Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'n-h1-855649-4'} Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:04.838523 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad009b68-4545-4650-99b9-1d4f9c731a4a tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad009b68-4545-4650-99b9-1d4f9c731a4a tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-855649-4/search" status: 403 len: 117 microversion: 2.1 time: 0.231478 Nov 02 11:55:04.851454 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 676/1346] 10.222.0.48 () {58 vars in 1209 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-855649-4/search => generated 117 bytes in 234 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:04.855806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Calling method '.version_select at 0x7ff1b348f820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.861424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.862140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.862619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.887076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Request method failure captured: Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqXaOgC4Nvup2N5nGPe4uiSYghVMKvtgsuIXlAntC-UrZKTxqITntwJuNj5KTf6e1UmuRFmT22joSiZptClL0DSVgZxGJbiG8N0IyYZV-BtKu4MfDGHp77T-9nw6XCZImk-1jQCKcfM0Q3h6Wy_o289U56-LpdQ0Xel6-LADRBoJyY Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f7414b4a5e0247839c98906e96a6b0f6 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7414b4a5e0247839c98906e96a6b0f6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f7414b4a5e0247839c98906e96a6b0f6 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a8690c93706d4d12af0bd690d06fa80f Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 11:55:04.892181 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:04.898280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:04.901461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36201f9a-ee97-4be0-a49a-25e7cc3f97fe tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.048567 Nov 02 11:55:04.902614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 677/1347] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:55:04.914183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Calling method '.version_select at 0x7ff1b35f1820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:04.924522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.924893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.925347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.955203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.955697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.956808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.967472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.972907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.976103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:04.981419 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-730b8dc7-9f61-4640-a427-49a68c206009 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.431980 Nov 02 11:55:04.982722 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 671/1348] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:04.987063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:04.988641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:04.989285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:04.999144 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3600d409-78a9-414c-ad44-30305dc8dc42 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088618 Nov 02 11:55:05.000362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 678/1349] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:55:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:05.015070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e665b5f-5eb2-4ec9-99d1-cdea89391db6 tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Calling method '.version_select at 0x7ff1b371a820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:05.016396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e665b5f-5eb2-4ec9-99d1-cdea89391db6 tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '9bf63f127c164441a6e2aec70bcf4572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ded9e2bc82642cdb393b9a91d36572b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e665b5f-5eb2-4ec9-99d1-cdea89391db6 tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Request method failure captured: Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqWKarNmLEGgBAeLgkhcUoFEAz-7cRHxNvaXkRQkQQibB0QHRyD-UiV0eFkwCc9gdARKBohLJ386vtTuOH5hKmpa1mw02t3Np1cciPmtJNwFObC2CRcXy5sBGwgoiU6Ksz33aUQD24iRyQOw9d7NgNybQ4woiRxk932Cn5uvuRLrqs Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7ded9e2bc82642cdb393b9a91d36572b Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ded9e2bc82642cdb393b9a91d36572b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ded9e2bc82642cdb393b9a91d36572b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7ded9e2bc82642cdb393b9a91d36572b Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474688392-project Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9bf63f127c164441a6e2aec70bcf4572 Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474688392-project Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1'} Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:05.018183 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 11:55:05.022764 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.024187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e665b5f-5eb2-4ec9-99d1-cdea89391db6 tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:05.025356 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e665b5f-5eb2-4ec9-99d1-cdea89391db6 tempest-HypervisorAdminNegativeUnderV252Test-474688392 tempest-HypervisorAdminNegativeUnderV252Test-474688392-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016050 Nov 02 11:55:05.026087 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 672/1350] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:55:05 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:05.036656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Calling method '.version_select at 0x7ff1b362a280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:05.039359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:05.040090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:05.040767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:05.048906 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] HTTP exception thrown: No hypervisor matching '43da707c-61d4-4539-b510-9202cb76b332' could be found. Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Request method failure captured: Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-hypervisors/43da707c-61d4-4539-b510-9202cb76b332/servers HTTP/1.1 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqXaOgC4Nvup2N5nGPe4uiSYghVMKvtgsuIXlAntC-UrZKTxqITntwJuNj5KTf6e1UmuRFmT22joSiZptClL0DSVgZxGJbiG8N0IyYZV-BtKu4MfDGHp77T-9nw6XCZImk-1jQCKcfM0Q3h6Wy_o289U56-LpdQ0Xel6-LADRBoJyY Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f7414b4a5e0247839c98906e96a6b0f6 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f7414b4a5e0247839c98906e96a6b0f6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f7414b4a5e0247839c98906e96a6b0f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f7414b4a5e0247839c98906e96a6b0f6 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524 Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a8690c93706d4d12af0bd690d06fa80f Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: exception: No hypervisor matching '43da707c-61d4-4539-b510-9202cb76b332' could be found. Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '43da707c-61d4-4539-b510-9202cb76b332'} Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '43da707c-61d4-4539-b510-9202cb76b332' could be found. Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '43da707c-61d4-4539-b510-9202cb76b332' could be found. Nov 02 11:55:05.050289 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:05.059070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] Returning 404 to user: No hypervisor matching '43da707c-61d4-4539-b510-9202cb76b332' could be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:05.064049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-959c2e97-1472-430a-9375-c90df51487d2 tempest-HypervisorAdminNegativeUnderV252Test-1952279524 tempest-HypervisorAdminNegativeUnderV252Test-1952279524-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/43da707c-61d4-4539-b510-9202cb76b332/servers" status: 404 len: 123 microversion: 2.1 time: 0.031077 Nov 02 11:55:05.068828 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 679/1351] 10.222.0.48 () {58 vars in 1281 bytes} [Wed Nov 2 11:55:05 2022] GET /compute/v2.1/os-hypervisors/43da707c-61d4-4539-b510-9202cb76b332/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:55:05.390103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:05.391034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:05.412870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:05.413278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:05.415470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:05.416438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:05.417080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:05.417702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:05.491990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:05.501324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:05.503292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:05.508639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47de3e9d-dbb7-47cf-87a1-bc85620bc0e2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.122909 Nov 02 11:55:05.510239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 673/1352] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:05 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:05.621071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ffed0d-cb15-40cb-92ae-89c6475f9583 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:05.622626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8ffed0d-cb15-40cb-92ae-89c6475f9583 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:05.757117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8ffed0d-cb15-40cb-92ae-89c6475f9583 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:05.764525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=25 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:05.777676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8ffed0d-cb15-40cb-92ae-89c6475f9583 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1222 microversion: 2.1 time: 0.157881 Nov 02 11:55:05.780437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 680/1353] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:05 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:06.019991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:06.021227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:06.030413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.031199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.031877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.032771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.033409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.034260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.443502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.488929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.496481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.500828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e3f282a-50a5-44d2-85bb-7b8fa0e59dae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.486676 Nov 02 11:55:06.502481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 674/1354] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:06 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:06.542122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:06.542751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:06.558522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.559386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.562918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.562918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.562918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.562918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.806670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:06.807333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:06.817931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.818436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.818885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.833455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:06.834728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:06.835391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:06.910103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.921471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.923766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:06.938969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d45f07c9-53bb-4147-b67f-485d2a8b53c2 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.400942 Nov 02 11:55:06.940190 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 681/1355] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:06 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:07.122604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:07.153673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9bfd972-43fa-47a7-ba33-6ca283cbab75 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1218 microversion: 2.1 time: 0.351614 Nov 02 11:55:07.178237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 675/1356] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:06 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1218 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:07.533937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:07.534579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:07.551307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:07.552216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:07.552836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:07.553982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:07.555274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:07.555950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:07.850161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:07.861944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:07.863739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:07.876670 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f291473-7cd5-4ab2-8415-91d3d96f74ec tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.336667 Nov 02 11:55:07.876670 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 682/1357] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:07 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:07.971241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:07.975737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:07.980129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:07.985204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:07.985657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:07.986413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:07.986870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:07.987317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:08.185856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:08.186492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:08.195303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:08.195805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:08.196250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:08.196968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:08.198901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:08.199682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:08.657577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:08.676323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:08.677863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:08.683615 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bcc0ead-63d5-4717-bf50-5c188235b308 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.717596 Nov 02 11:55:08.713457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:08.715107 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 676/1358] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:07 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:08.723915 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc168ff6-58ce-46f2-bbf3-bc247690157e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1282 microversion: 2.1 time: 0.541791 Nov 02 11:55:08.736660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 683/1359] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:08 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1282 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:08.895176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:08.896097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:08.908711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:08.908711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:08.911925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:08.914621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:08.916983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:08.917530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:09.422289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:09.437798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:09.439464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:09.440702 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41a58037-aa5a-4d93-bb92-2bbee7a4e829 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.551838 Nov 02 11:55:09.452128 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 677/1360] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:08 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:09.721622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:09.722950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:09.738002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:09.744130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:09.744867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:09.747387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:09.747387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:09.747387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:09.750176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:09.751552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:09.767458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:09.768251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:09.769046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:09.770390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:09.772370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:09.774328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:10.116602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.125940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.128086 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfa81631-eb53-4efb-99f5-0a9d9e657189 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1280 microversion: 2.1 time: 0.382065 Nov 02 11:55:10.128950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 678/1361] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:09 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1280 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:10.145567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.149004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.156756 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b2bc2e8-e01c-43e7-82ae-1117901bdaa4 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.439421 Nov 02 11:55:10.157487 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 684/1362] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:09 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:10.478140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.478923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:10.493911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:10.498054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:10.498745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:10.499901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:10.503179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:10.505810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:10.620732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27c25a48-b65f-4cf8-a767-0e719aac7862 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.629111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27c25a48-b65f-4cf8-a767-0e719aac7862 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.292099 Nov 02 11:55:10.630076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 679/1363] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:10.659537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5e01346-729a-45a1-9a24-209f3f3eb108 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.709585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5e01346-729a-45a1-9a24-209f3f3eb108 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.059083 Nov 02 11:55:10.723522 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 680/1364] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:10.732674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a00cdf78-dc2e-4cad-8ff4-b62fac14739b tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.752154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a00cdf78-dc2e-4cad-8ff4-b62fac14739b tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025700 Nov 02 11:55:10.761887 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 681/1365] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:10.767324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-322a7018-f5f4-46f3-be6b-10dbb5080299 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.779270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-322a7018-f5f4-46f3-be6b-10dbb5080299 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015911 Nov 02 11:55:10.804083 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 682/1366] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:10.811425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-607fa87c-1cef-4506-a5c3-bdc6858d12b8 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.830321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.850085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.850085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:10.850085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a8f4b72-edb8-4296-a480-0339409820f2 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.374369 Nov 02 11:55:10.854022 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 685/1367] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:10.878400 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-607fa87c-1cef-4506-a5c3-bdc6858d12b8 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.072495 Nov 02 11:55:10.900852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 683/1368] 10.222.0.48 () {58 vars in 1165 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:10.905529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d464cf1-1cb5-4f39-b55e-5bc9d7c07708 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:10.923530 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d464cf1-1cb5-4f39-b55e-5bc9d7c07708 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021945 Nov 02 11:55:10.925903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 686/1369] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:10.938141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17897e41-6b08-4d99-8b38-db25aea87a4f tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.017875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17897e41-6b08-4d99-8b38-db25aea87a4f tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.083573 Nov 02 11:55:11.019424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 684/1370] 10.222.0.48 () {58 vars in 1169 bytes} [Wed Nov 2 11:55:10 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.042025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a75e408-5af6-419c-b25c-13e249f72374 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.086110 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a75e408-5af6-419c-b25c-13e249f72374 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.051718 Nov 02 11:55:11.093789 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 687/1371] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.111055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cbd91ad-f19e-400f-8444-4450c57de489 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.122739 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cbd91ad-f19e-400f-8444-4450c57de489 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016986 Nov 02 11:55:11.130257 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 685/1372] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.140628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f604c801-01b3-4a10-bd4b-86926f804a6c tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.153951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.154577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:11.179119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.180614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.181699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.182593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.191850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.192624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.244787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f604c801-01b3-4a10-bd4b-86926f804a6c tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.108262 Nov 02 11:55:11.245958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 688/1373] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.256893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.257812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:11.272606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.273432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.284269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.285333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.285973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.305059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.456617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:11.470036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:11.471922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:11.481204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63b540b2-1940-4107-8e5f-65f4ab66202f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.233943 Nov 02 11:55:11.482558 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 689/1374] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:11.488936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d197ee72-d6ac-4b31-a67c-2d54420cef12 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.497556 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d197ee72-d6ac-4b31-a67c-2d54420cef12 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013649 Nov 02 11:55:11.499373 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 690/1375] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.518633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56acaafa-bec1-4502-b645-239a3d8156f2 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.554670 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56acaafa-bec1-4502-b645-239a3d8156f2 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041478 Nov 02 11:55:11.569001 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 691/1376] 10.222.0.48 () {58 vars in 1144 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.573094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b427d23f-7e9c-4137-a576-03254769b048 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.593206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b427d23f-7e9c-4137-a576-03254769b048 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025671 Nov 02 11:55:11.605270 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 692/1377] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.612912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c057bbf-36be-43b0-8b57-48a5f062df2d tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.651647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:11.665294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8a2bfce-ad52-447c-8359-38aaa48e0f05 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.515294 Nov 02 11:55:11.670155 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 686/1378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.695388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c057bbf-36be-43b0-8b57-48a5f062df2d tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.090112 Nov 02 11:55:11.698434 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 693/1379] 10.222.0.48 () {58 vars in 1148 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:11.716872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49d7da5c-c4c0-4360-b61f-e2d1bef70926 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.742211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49d7da5c-c4c0-4360-b61f-e2d1bef70926 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.029198 Nov 02 11:55:11.745013 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 687/1380] 10.222.0.48 () {58 vars in 1140 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.762059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea3dcc65-4331-467e-9537-bc604bceffe6 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.797984 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea3dcc65-4331-467e-9537-bc604bceffe6 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041110 Nov 02 11:55:11.801470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 694/1381] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:11.814522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b30be7fa-5aa5-4f28-81b9-43cdf9e8bfaa tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.876230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.876835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:11.885439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.890139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.892025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.896484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:11.897315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:11.899257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:11.905076 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b30be7fa-5aa5-4f28-81b9-43cdf9e8bfaa tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.095404 Nov 02 11:55:11.909510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 688/1382] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.927404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a988a2cd-6182-4bb6-8bb6-f01f30995a12 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:11.977187 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a988a2cd-6182-4bb6-8bb6-f01f30995a12 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055356 Nov 02 11:55:11.979596 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 689/1383] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:11.999151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6eaebf61-b40e-4662-a6c8-f483064d7552 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:12.022664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6eaebf61-b40e-4662-a6c8-f483064d7552 tempest-FlavorsV2TestJSON-766326352 tempest-FlavorsV2TestJSON-766326352-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026070 Nov 02 11:55:12.024647 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 690/1384] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:12.117940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.136665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.139806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.144150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9228d4ab-df26-4f02-aec5-e3479427bc18 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.273760 Nov 02 11:55:12.147126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 695/1385] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:11 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:12.519762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:12.521707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:12.534920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:12.542960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:12.543519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:12.552176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:12.555203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:12.555731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:12.556190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:12.682616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.696024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:12.698869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:12.709053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.712909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:12.718309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:12.718747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:12.719423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:12.720519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:12.721142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:12.721731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:12.738049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d5aef04-9a44-49ee-b921-2c76b29da27c tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.223542 Nov 02 11:55:12.738737 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 691/1386] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:12 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:13.161926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:13.172993 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fba2881-5030-4ab8-b7ae-9523ccfa5c54 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.481772 Nov 02 11:55:13.173531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 696/1387] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:12 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:13.173735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:13.176133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:13.183599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:13.184320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:13.184954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:13.185847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:13.186461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:13.187338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:13.409466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d253a35a-53f9-485c-9b40-bebc925e8bb8", "tag": "67c44d18-da1f-4896-9dc9-6f8ab7a3f6be"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:13.431644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:13.435450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:13.436292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:13.489516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] Creating event network-changed:67c44d18-da1f-4896-9dc9-6f8ab7a3f6be for instance d253a35a-53f9-485c-9b40-bebc925e8bb8 on n-h2-855649-4 Nov 02 11:55:13.500652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d4d57e94-8d35-4395-9075-043c6aea6e07 req-2b0e6ad0-3fc3-4f18-9836-c69e3ecabdb7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096162 Nov 02 11:55:13.501830 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 697/1388] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:13.549514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:13.565434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:13.573011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:13.574611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2eefa8b-bf32-4383-962e-f4bd0035b394 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.406612 Nov 02 11:55:13.575387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 692/1389] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:13 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:13.774105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:13.777295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:13.790196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:13.791253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:13.794070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:13.796312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:13.799984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:13.803644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:13.974246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:13.975457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:13.999732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:14.013963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:14.016655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:14.023167 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57f84fce-fb3c-42e5-a228-60a58ce69154 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.254526 Nov 02 11:55:14.023913 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 698/1390] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:13 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:14.155574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-758bce5d-fc27-4881-9ece-aee5bc4a2999 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Action: 'create', calling method: .version_select at 0x7ff1b3854d30>, body: {"keypair": {"name": "tempest-keypair-1895224268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoC4KEylhFAApcV8WdcoCWR8bEoc63ZWHbyVJsxsVLzlb59SGqLNBxciGrCLILs+R4sXcxFftTrRtAZcdIjrz7fjNDRNrhZzuivaWnVvjqSgYxueKC0QLvwq6u+P7KqcQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:14.181931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-758bce5d-fc27-4881-9ece-aee5bc4a2999 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Getting quotas for project 83940f46b8404015b53f2cbc4e1a70ab. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:14.198331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:14.199589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:14.207031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-758bce5d-fc27-4881-9ece-aee5bc4a2999 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Getting quotas for user 3712294d721c40eca3125a1a1b0ebf0a and project 83940f46b8404015b53f2cbc4e1a70ab. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:14.210061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:14.213037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:14.214607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:14.216769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:14.219443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:14.220421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:14.385045 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-758bce5d-fc27-4881-9ece-aee5bc4a2999 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.420491 Nov 02 11:55:14.391658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 693/1391] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:55:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:55:14.395947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:14.406722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-122c3ea8-2a58-402f-b695-5dd2262104d6 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.213205 Nov 02 11:55:14.430271 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 699/1392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:14 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:14.607211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:14.608083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:14.624335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:14.625039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:14.627608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:14.628317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:14.628779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:14.631957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:15.063125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33d3a674-35c3-44a4-b7f8-d1469a37e7d2 tempest-InstanceUsageAuditLogTestJSON-507611477 tempest-InstanceUsageAuditLogTestJSON-507611477-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:15.089606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33d3a674-35c3-44a4-b7f8-d1469a37e7d2 tempest-InstanceUsageAuditLogTestJSON-507611477 tempest-InstanceUsageAuditLogTestJSON-507611477-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 11:55:14" status: 200 len: 318 microversion: 2.1 time: 0.283537 Nov 02 11:55:15.091308 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 700/1393] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 11:55:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2011%3A55%3A14 => generated 318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:55:15.096291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:15.097045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:15.105012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:15.105773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:15.106414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:15.107337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:15.108079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:15.108713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:15.410395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.416029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:15.428104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.429933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.451370 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-949d2f01-8bbe-4c42-ae76-4006707ae192 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.350164 Nov 02 11:55:15.471150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 701/1394] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:15 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:15.484752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-447e08a1-ab71-4776-bb9d-a013ffaeea94 tempest-InstanceUsageAuditLogTestJSON-507611477 tempest-InstanceUsageAuditLogTestJSON-507611477-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:15.517998 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-447e08a1-ab71-4776-bb9d-a013ffaeea94 tempest-InstanceUsageAuditLogTestJSON-507611477 tempest-InstanceUsageAuditLogTestJSON-507611477-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045509 Nov 02 11:55:15.518627 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 702/1395] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:55:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:15.540556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:15.542570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:15.557153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:15.558200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:15.559693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:15.562772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:15.563437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:15.563937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:15.584180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.607185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.611961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.615213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5676f29e-f40b-4a48-a9cc-dd70fc218784 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 1.012425 Nov 02 11:55:15.618271 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 694/1396] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:14 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:15.918510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:15.926271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-407a7212-55b2-496a-b109-01320b8d64a5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.406542 Nov 02 11:55:15.926857 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 703/1397] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:15 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:16.033045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "name": "network-vif-unplugged", "status": "completed", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:16.045542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:16.046012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:16.047052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:16.066934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] Creating event network-vif-unplugged:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h1-855649-4 Nov 02 11:55:16.073791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-36a43672-d4ed-4fd5-b6da-7dd2bd924065 req-b425c0d5-f178-48d6-8d2e-411b5ada029a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046697 Nov 02 11:55:16.075140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 704/1398] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:55:16.171462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-366268910", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:16.240318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:55:16.496737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:16.497757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:16.509372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:16.510069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:16.510528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:16.511354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:16.511942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:16.512276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:16.642229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:16.658442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:16.664346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:16.679827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-023cd5f0-1cfc-4dab-87c0-7ac78cc1d95e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.188180 Nov 02 11:55:16.680443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 705/1399] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:16 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:16.691386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:16.694406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:16.707319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:16.707816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:16.708265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:16.708986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:16.715192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:16.717837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.150729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.164560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.166627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.168580 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-778a6761-c7fc-4cd8-83c0-b2dfefcd166c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.485510 Nov 02 11:55:17.169748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 706/1400] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:16 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:17.175074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:17.175946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:17.186208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.186956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.189416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.190208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.190685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.191178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.383358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:55:17.384320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:55:17.385362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:55:17.385970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:55:17.386598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:55:17.407548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.410886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.412369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.416820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.417722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.419236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.480290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:17.500495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:17.524204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.532577 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3100625e-3735-4b2e-88c3-0843a29be02c tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.360984 Nov 02 11:55:17.550444 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 707/1401] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:17 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:17.555760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:55:17.558560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:55:17.725803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81c124c3-aa06-4ea9-bd7a-91af02ff39cf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756012 Nov 02 11:55:17.734712 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 695/1402] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:55:17.734712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:17.734712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:17.740873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.741331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.742622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.743655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:17.744452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:17.745122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:17.811740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1865047169", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:17.888129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:55:17.902646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.924393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.932852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:17.959177 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b6b155e-328f-4235-b7d1-8ba3bfdb1c17 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.230591 Nov 02 11:55:17.960949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 696/1403] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:17 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:17.973961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1a1a430-6d81-4261-b241-f6efed97698d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:17.983898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1a1a430-6d81-4261-b241-f6efed97698d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:18.203800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1a1a430-6d81-4261-b241-f6efed97698d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:18.222246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1a1a430-6d81-4261-b241-f6efed97698d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1207 microversion: 2.1 time: 0.249597 Nov 02 11:55:18.224058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 697/1404] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:17 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1207 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:18.230899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:18.272297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.273573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.275077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.318771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] Creating event network-changed:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h1-855649-4 Nov 02 11:55:18.324538 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-54ea1207-7ad8-4a33-af92-8771cebba8f2 req-ec54aa5a-8d1b-42a8-b905-bec0d031569c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098957 Nov 02 11:55:18.324976 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 698/1405] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:18.330327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:18.331414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:18.339687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.340189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.347994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.347994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.347994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.347994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.347994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:18.380653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:55:18.381489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:55:18.381972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:55:18.382409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:55:18.383635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:55:18.385308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:18.393252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.393807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.394221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.394948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.395456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.395883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.420883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Getting quotas for project 0861126d143b41e1aca61a5e6c5c5e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:18.427027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Getting quotas for user c8481204674b4e47911ca5dbfbf9ea8d and project 0861126d143b41e1aca61a5e6c5c5e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:18.463566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:55:18.466230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:55:18.675135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:18.681866 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-357ed784-836c-492b-85de-c9673c7fe583 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108413 Nov 02 11:55:18.684632 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 708/1406] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:55:18.702652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:18.709526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:18.719083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:18.723194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:18.729245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e2bade3-8d64-42e2-9da1-b04e1c3c92e9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.402984 Nov 02 11:55:18.731277 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 699/1407] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:18 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:18.742366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.742882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.743363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.744090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:18.744549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:18.745900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:18.749208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfa7c223-3e83-4b6f-9282-8885462e422e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:18.752157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfa7c223-3e83-4b6f-9282-8885462e422e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:18.962709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dfa7c223-3e83-4b6f-9282-8885462e422e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:18.997122 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfa7c223-3e83-4b6f-9282-8885462e422e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1217 microversion: 2.1 time: 0.262331 Nov 02 11:55:19.003907 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 700/1408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:18 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:19.020653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:19.023194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:19.036340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:19.036844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:19.037293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:19.038020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:19.038521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:19.038952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:19.290856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:19.308032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:19.310061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:19.329877 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2bffa2fd-303a-4dad-a2c7-980ede8a332b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.324192 Nov 02 11:55:19.334117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 701/1409] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:19 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:19.359481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16f5e68e-fc62-4924-8f31-0120787dcf45 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:19.360118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16f5e68e-fc62-4924-8f31-0120787dcf45 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:19.490753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16f5e68e-fc62-4924-8f31-0120787dcf45 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:19.514746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16f5e68e-fc62-4924-8f31-0120787dcf45 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1207 microversion: 2.1 time: 0.179606 Nov 02 11:55:19.519390 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 702/1410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:19 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1207 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:19.641419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:19.670192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-754f8475-a691-43dc-9514-61a0b88b698e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.982330 Nov 02 11:55:19.671942 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 709/1411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:18 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:19.768081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:19.768081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:19.781190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:19.781633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:19.782075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:19.791199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:19.791800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:19.792254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:19.892034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "aa6b842d-7647-470d-8a95-6b0b756ad8ad"}], "security_groups": [{"name": "tempest-securitygroup--502639611"}], "key_name": "tempest-keypair-1895224268", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:20.270284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] validate_networks() for [('aa6b842d-7647-470d-8a95-6b0b756ad8ad', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:55:20.368243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.382247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.383821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.394217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5938017-c949-464f-ba82-dff004a2e094 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.638164 Nov 02 11:55:20.395506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 703/1412] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:19 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:20.409201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be472d52-f0cc-42f1-a43a-0295aee52981 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:20.410169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be472d52-f0cc-42f1-a43a-0295aee52981 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:20.501959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be472d52-f0cc-42f1-a43a-0295aee52981 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.516758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be472d52-f0cc-42f1-a43a-0295aee52981 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1217 microversion: 2.1 time: 0.119885 Nov 02 11:55:20.517378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 704/1413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:20 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:20.523857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:20.524720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:20.536659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.537223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.537715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:20.539115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.539486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.539974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:20.652026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.666054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.667743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.674657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-651e99bf-4450-4119-bdc0-2599b5e710ec tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1558 microversion: 2.91 time: 0.156241 Nov 02 11:55:20.675280 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 705/1414] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:20 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:20.680266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:20.680893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:20.687205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.687831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.688370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:20.690677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.691377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.695539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:20.793514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:20.806168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94f8db13-a99c-4b57-abac-a2a6a952992f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1203 microversion: 2.1 time: 0.129612 Nov 02 11:55:20.826893 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 706/1415] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:20 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1203 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:20.828708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:20.830028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:20.837155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.837889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.838069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:20.839059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:20.839732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:20.840403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.084673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:55:21.086371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:55:21.087637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:55:21.088290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:55:21.088702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:55:21.103127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.110931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.110931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.110931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.110931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.110931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.136518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.148617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a199b61-7086-4799-b4ea-367f27936098 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.324198 Nov 02 11:55:21.149640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 707/1416] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:20 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:21.182957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Getting quotas for project 83940f46b8404015b53f2cbc4e1a70ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:21.191534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Getting quotas for user 3712294d721c40eca3125a1a1b0ebf0a and project 83940f46b8404015b53f2cbc4e1a70ab. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:21.224907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:55:21.228029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:55:21.414440 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be4030d8-05cf-484e-81e1-61c67cb52fc9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.532825 Nov 02 11:55:21.421341 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 710/1417] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:55:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:55:21.422384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:21.423296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:21.438377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cede73cb-e696-4b80-85f9-4f2ebb657d12 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:21.441482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cede73cb-e696-4b80-85f9-4f2ebb657d12 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:21.455612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.456376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.457022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.476000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.476602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.477066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.558341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cede73cb-e696-4b80-85f9-4f2ebb657d12 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.568598 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cede73cb-e696-4b80-85f9-4f2ebb657d12 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1226 microversion: 2.1 time: 0.145556 Nov 02 11:55:21.587285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 711/1418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:21 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:21.602282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:21.604844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:21.621113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.622213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.638555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.644228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.651115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.652892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.705378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.726884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.728945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.735831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac183899-f41f-461b-a380-7b45011df1a0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.317472 Nov 02 11:55:21.736668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 708/1419] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:21 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:21.753004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:21.761446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:21.779431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.779947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.780440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.788942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.789498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.789942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.846826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.861394 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84ebf023-6f44-47f5-ac7c-f1153997db45 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1213 microversion: 2.1 time: 0.265571 Nov 02 11:55:21.862239 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 712/1420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:21 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:21.872234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:21.872977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:21.896229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.902911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.902911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.902911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:21.902911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:21.902911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:21.969311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.978607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.980908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:21.993326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc1ff5e4-3a74-44eb-a2a7-b30e0db639a3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.248507 Nov 02 11:55:22.004119 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 709/1421] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:21 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:22.182825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:22.184035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:22.193924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.194546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.195280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.196128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.196688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.197343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.412320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:22.422724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ceb93ca-250f-4956-94dd-b353a5bb474c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1259 microversion: 2.1 time: 0.557906 Nov 02 11:55:22.423539 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 713/1422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:21 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1259 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:22.461261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d253a35a-53f9-485c-9b40-bebc925e8bb8", "name": "network-vif-plugged", "status": "completed", "tag": "67c44d18-da1f-4896-9dc9-6f8ab7a3f6be"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:22.470922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.471625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.472216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.484844 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] Creating event network-vif-plugged:67c44d18-da1f-4896-9dc9-6f8ab7a3f6be for instance d253a35a-53f9-485c-9b40-bebc925e8bb8 on n-h2-855649-4 Nov 02 11:55:22.490118 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-df12bd64-77a2-4830-bec4-5edffea63bcb req-faaea452-bfcf-408e-8db1-041cd2ac5eda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034655 Nov 02 11:55:22.490715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 714/1423] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:22.536123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:22.547814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81364533-2dc6-4191-9d52-2e02efdcf2ad tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.378458 Nov 02 11:55:22.548822 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 710/1424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:22 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:22.595594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffd5acb8-30ba-424f-bd07-494562be1cd9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:22.596318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffd5acb8-30ba-424f-bd07-494562be1cd9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:22.720587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffd5acb8-30ba-424f-bd07-494562be1cd9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:22.748025 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffd5acb8-30ba-424f-bd07-494562be1cd9 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1226 microversion: 2.1 time: 0.156399 Nov 02 11:55:22.764514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 715/1425] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:22 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:22.773129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:22.774167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:22.780490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.781223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.781661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.782365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.782850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.788527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.891765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:22.892516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:22.899745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.900404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.900965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:22.901672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:22.902150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:22.902565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.049893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.060599 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-174f96e4-abfb-4cc2-9a2c-2af37dc1187e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1269 microversion: 2.1 time: 0.174350 Nov 02 11:55:23.061259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 716/1426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:22 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:23.080769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:23.081734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:23.091318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.092073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.092679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.093398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.094015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.094776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.111311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.127836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.129665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.131228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b60e930b-4520-4811-89d7-e8d07046e14d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.365267 Nov 02 11:55:23.148415 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 711/1427] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:22 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:23.216748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.230685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.233758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.256589 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-752c611a-6390-4c85-b554-0adcd2acf94f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.194170 Nov 02 11:55:23.259047 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 717/1428] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:23.455252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:23.456422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:23.473764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.475129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.477285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.479933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.481899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.482531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.573705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:23.575193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:23.590113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.590963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.593970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.596279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.599613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.600589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.618772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.634186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d7d6606-afab-4c0e-96bf-e6793bec63a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1265 microversion: 2.1 time: 0.184780 Nov 02 11:55:23.637185 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 712/1429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:23.907619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a786ab4-3b78-4281-8998-bb8f910faede tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:23.911684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1a786ab4-3b78-4281-8998-bb8f910faede tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a786ab4-3b78-4281-8998-bb8f910faede tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin] Request method failure captured: Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqrT8iHgaqqAOY6na5gAg8AQaAqxsIFyXGcj9iLXQiJ5rNjb7w2_I0J_-h0BZI6znKQZ1tD8K064GLu-X_iylg-YOaOOlq9Y_xVC6ZOf8owYJllzTIsujIGnOFaQzg6zX5-AKWizXRt-kXixqk5BuH3ZeCRqoWVrRiSE-AxMw2iEnM Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: cf7d6d5a388f4cee9a521b420cc47df9 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf7d6d5a388f4cee9a521b420cc47df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cf7d6d5a388f4cee9a521b420cc47df9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cf7d6d5a388f4cee9a521b420cc47df9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cf7d6d5a388f4cee9a521b420cc47df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: cf7d6d5a388f4cee9a521b420cc47df9 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 05ca059a39e24d1082934198354ea39e Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid timestamp for date invalid_time Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'invalid_time'} Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:23.923278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:23.928515 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 11:55:23.928515 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:23.931900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:23.939713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a786ab4-3b78-4281-8998-bb8f910faede tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:23.940829 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a786ab4-3b78-4281-8998-bb8f910faede tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762 tempest-InstanceUsageAuditLogNegativeTestJSON-1197813762-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.280816 Nov 02 11:55:23.941948 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 713/1430] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 11:55:23.952363 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17dc3d05-c3be-458c-ab3f-6374513eae45 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1322 microversion: 2.1 time: 0.384661 Nov 02 11:55:23.960922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:23.962228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:23.967564 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 718/1431] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:23.978015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.978575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.979082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:23.980654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:23.981353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:23.985113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.103119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.114110 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9f35540-7e64-4032-8db6-e3793f2a0f05 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1230 microversion: 2.1 time: 0.169600 Nov 02 11:55:24.115697 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 714/1432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1230 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:24.121757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.122390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:24.129841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.130415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.131039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.132914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.133746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.134575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.215939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4c408d8-eb7c-48be-9810-c534ec77a2ec tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.218159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4c408d8-eb7c-48be-9810-c534ec77a2ec tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '9b97e7fde4f241ccbf8e2b1107992b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13930f80671247798486478ae285ebd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4c408d8-eb7c-48be-9810-c534ec77a2ec tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Request method failure captured: Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqqtu4JeqwxLFrYt0E3vGQ6fwxrqlY0uq-K2eZ0nsyk1MR272iQUwzlg7hwZ5C91kvHCXgG6C40DT3UhXvtJnDYZ6XsgRWR7yXgCh4rTGSSZkXoBO8Tpbdsxjfq1lVSVGgpA9O7wYCYFLBcIt4qElzX-GuJq9neJGFNMoJxI9s1RsU Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 13930f80671247798486478ae285ebd3 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13930f80671247798486478ae285ebd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13930f80671247798486478ae285ebd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13930f80671247798486478ae285ebd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13930f80671247798486478ae285ebd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 13930f80671247798486478ae285ebd3 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9b97e7fde4f241ccbf8e2b1107992b50 Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: action_args: {} Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.220362 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 11:55:24.225146 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.230769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4c408d8-eb7c-48be-9810-c534ec77a2ec tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:24.231956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4c408d8-eb7c-48be-9810-c534ec77a2ec tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.263044 Nov 02 11:55:24.239279 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 719/1433] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 11:55:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:24.245503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.251957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:24.306913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.315949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.316719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.317722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.318355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.318946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.333229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.348306 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbcce1c8-1455-4b32-b823-923dded91221 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1275 microversion: 2.1 time: 0.231488 Nov 02 11:55:24.349000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 715/1434] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:24.365606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b880b613-89ff-4a95-af6c-f7af7b18de8f tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.384522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b880b613-89ff-4a95-af6c-f7af7b18de8f tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '9b97e7fde4f241ccbf8e2b1107992b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13930f80671247798486478ae285ebd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b880b613-89ff-4a95-af6c-f7af7b18de8f tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Request method failure captured: Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2011:55:24 HTTP/1.1 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqqtu4JeqwxLFrYt0E3vGQ6fwxrqlY0uq-K2eZ0nsyk1MR272iQUwzlg7hwZ5C91kvHCXgG6C40DT3UhXvtJnDYZ6XsgRWR7yXgCh4rTGSSZkXoBO8Tpbdsxjfq1lVSVGgpA9O7wYCYFLBcIt4qElzX-GuJq9neJGFNMoJxI9s1RsU Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 13930f80671247798486478ae285ebd3 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13930f80671247798486478ae285ebd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_13930f80671247798486478ae285ebd3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/13930f80671247798486478ae285ebd3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/13930f80671247798486478ae285ebd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 13930f80671247798486478ae285ebd3 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9b97e7fde4f241ccbf8e2b1107992b50 Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '2022-11-02 11:55:24'} Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.386364 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b880b613-89ff-4a95-af6c-f7af7b18de8f tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:24.391149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b880b613-89ff-4a95-af6c-f7af7b18de8f tempest-InstanceUsageAuditLogNegativeTestJSON-941701016 tempest-InstanceUsageAuditLogNegativeTestJSON-941701016-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 11:55:24" status: 403 len: 128 microversion: 2.1 time: 0.030553 Nov 02 11:55:24.403152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 716/1435] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2011%3A55%3A24 => generated 128 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:24.414255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.420067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:24.440744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.442256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.444426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.445368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.447572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.448234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.622927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.638584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.642274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.658806 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-803cd91c-0544-4093-a66c-a69c2e9d12bc tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.254215 Nov 02 11:55:24.659511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 717/1436] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:24.673327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.674187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:24.689783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.692645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.694205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.697410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.698144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.703990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.755420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.771982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.776140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:24.780029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f2e3b9a-b093-4e10-bfa3-394e2ba2d10a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.539419 Nov 02 11:55:24.782929 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 720/1437] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:24.983293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:24.984406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:24.992444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.992945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.993572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:24.994589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:24.995093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:24.995525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.102801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:25.117380 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12c3876d-396a-476b-9563-5f02d01feb8a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.455722 Nov 02 11:55:25.118402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 718/1438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:25.141168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:25.142288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:25.152706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.153452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.153903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.157917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.159188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.159643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.430659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:25.440128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0294550f-7018-4e18-9199-72cdc1b9ba0f tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1278 microversion: 2.1 time: 0.305587 Nov 02 11:55:25.442969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:25.456131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 719/1439] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:25 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:25.458676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5cc6e3e-198e-4e57-98d8-7cc6c9549ba5 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1472 microversion: 2.1 time: 0.478892 Nov 02 11:55:25.460067 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 721/1440] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:24 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1472 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:25.470387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:25.486519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:25.487202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:25.487904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:25.496300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.496959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.497481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.498278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.503840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.503840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.514383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.515030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.515697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.517995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:25.518672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:25.532054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:25.536611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lazy-loading 'flavor' on Instance uuid d253a35a-53f9-485c-9b40-bebc925e8bb8 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:26.042848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.046488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:26.057542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eef3b4a9-9f7a-404e-806d-16ccac16a77a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.599493 Nov 02 11:55:26.058381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 720/1441] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:25 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:26.066218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:26.069277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:26.075447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:26.087219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.088101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.088810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.089547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.090027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.090458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.183827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f748501-b33a-445a-b164-ad809d185cfd tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8/action" status: 202 len: 0 microversion: 2.1 time: 0.695014 Nov 02 11:55:26.183827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 722/1442] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:25 2022] POST /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:55:26.188816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:26.189985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:26.201395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.216582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.220954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.221653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.227861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.230056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.231923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.236968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.237493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.249318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2b71a47-9819-424e-83a6-ed705c5b9090 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.189583 Nov 02 11:55:26.250164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 721/1443] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:26 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:26.263928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:26.272768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:26.304748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.312953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.312953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.312953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.312953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.312953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.316043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:26.644433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.659913 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80e20f67-4a42-4fad-8ee4-8ab50dcaa4f1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.399671 Nov 02 11:55:26.660519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 722/1444] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:26 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:26.669358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:26.670006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:26.680943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.682802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.683387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.684910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.685620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.689215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.690056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.713550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.716145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.719737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34edd8a2-74bd-4eaf-9ce0-5e27451b2fd8 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.537224 Nov 02 11:55:26.736904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 723/1445] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:26 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:26.762191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:26.767592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:26.774827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.775582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.776177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.777057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:26.779791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:26.780510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:26.948109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:26.956304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4efc1f25-cbb3-491f-8c3d-cfc209121941 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1284 microversion: 2.1 time: 0.217898 Nov 02 11:55:26.981485 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 724/1446] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:26 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:27.080769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:27.081676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:27.090226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.097872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.098392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.099189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.099823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.101566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.430944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29417835-88fd-45f4-8a6b-e3d7eb5c094c tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1631 microversion: 2.1 time: 0.769350 Nov 02 11:55:27.435652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 723/1447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:26 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1631 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:27.451789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e8454f-78e0-4835-b09a-6d7ded72d0e6", "tag": "f3674df5-ee54-4d78-b9f7-96a67e714f22"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:27.474328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:27.481937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.485065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.487850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.513557 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] Creating event network-changed:f3674df5-ee54-4d78-b9f7-96a67e714f22 for instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 on n-h1-855649-4 Nov 02 11:55:27.538361 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ec97b825-1463-4b47-89ca-1e1e5a35b37d req-44cbc5ef-521b-473c-b36d-dbc1938d9aaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100872 Nov 02 11:55:27.539550 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 724/1448] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:27.542305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:27.549121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:27.551492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:27.553410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c4ad626-aa5b-4fae-870f-53914ff33ea0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.476372 Nov 02 11:55:27.554406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 725/1449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:27 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:27.559609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:27.570338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.573209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.573209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.573209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.573209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.573583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.582595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.583454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.584113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.599629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] Creating event network-changed:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:55:27.607107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-427749e9-098c-48a4-8f5a-a55ebc8ffe06 req-492179e7-e660-4070-8de9-b0be7e30aa12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051115 Nov 02 11:55:27.608309 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 726/1450] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:27.685451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:27.686623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:27.699045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.700842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.701745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.702889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.703665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.704375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.800457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:27.817486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:27.819967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:27.836079 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-460abbb2-6e1a-44d4-8d67-157aea11ec2f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.293987 Nov 02 11:55:27.836695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 725/1451] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:27 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:27.841760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:27.849400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:27.857018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.858625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.859272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:27.860942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:27.864846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:27.865518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.220928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.234300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-470bff63-43db-41b6-aaad-de72ec442519 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.553294 Nov 02 11:55:28.235468 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 727/1452] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:27 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:28.240705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:28.241840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:28.249124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.249936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.250549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.251541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.252366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.252955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.291255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.313711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.317022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.320201 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29fb72b1-140a-408e-bcd9-6a37df9b8bbb tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.482313 Nov 02 11:55:28.321451 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 726/1453] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:27 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:28.472530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:28.475150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:28.484394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.569865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.569865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.569865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.569865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.569865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.641322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.650020 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3149e54-8c80-4496-9abd-876f1b5e0a1c tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.413293 Nov 02 11:55:28.657822 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 728/1454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:28 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:28.657822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:28.657822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:28.664675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.672231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.672231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.672231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.672231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.672231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.760537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44e9e364-38da-4872-9027-00ee8e47ee30 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1614 microversion: 2.1 time: 0.301349 Nov 02 11:55:28.762425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 727/1455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:28 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1614 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:28.785339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:28.786194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:28.793113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.796563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.796563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.796563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.796563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.796563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.927659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:28.936591 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b95c3632-4628-4978-b15c-2574fbf586da tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.284567 Nov 02 11:55:28.937860 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 729/1456] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:28 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:28.946949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:28.950493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:28.961366 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] HTTP exception thrown: Cannot 'migrate' instance d253a35a-53f9-485c-9b40-bebc925e8bb8 while it is in vm_state suspended Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Request method failure captured: Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8/action HTTP/1.1 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 15 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqBAY_0HUBag-hxw_uN0voXqgPJl_M2Hlb7At8WBHJeTYEswxCNyFuDGSdo5oEK_ktFXdTRa5js6AlkdlCFkV9vdgHvvTAU20kOl5NJvfAtCds3oug2RjzIFleODSl-_oVSxkZcfEq4En1SqqWuNZ6UiKhMI2Ok0FrvA9UfnBOJLuM Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f27669b4f3474aa0d12fa9b9045950", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 87f18ce832d949c4a8a4c9a3d727d7b0 Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: {"migrate": {}} Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'migrate' instance d253a35a-53f9-485c-9b40-bebc925e8bb8 while it is in vm_state suspended Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd253a35a-53f9-485c-9b40-bebc925e8bb8', 'body': {'migrate': {}}} Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:55:28.963385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d253a35a-53f9-485c-9b40-bebc925e8bb8 while it is in vm_state suspended Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d253a35a-53f9-485c-9b40-bebc925e8bb8 while it is in vm_state suspended Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Returning 409 to user: Cannot 'migrate' instance d253a35a-53f9-485c-9b40-bebc925e8bb8 while it is in vm_state suspended {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:28.970652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f73ed944-27b7-4fc5-8602-b81ac9355699 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8/action" status: 409 len: 148 microversion: 2.1 time: 0.184356 Nov 02 11:55:28.974295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.974462 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 728/1457] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:28 2022] POST /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8/action => generated 148 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:55:28.974802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.976725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.977463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:28.979869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:28.980141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fb1b879-0df6-444d-bcd2-93966e8f4611 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:28.980293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fb1b879-0df6-444d-bcd2-93966e8f4611 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Request method failure captured: Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action HTTP/1.1 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 39 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqBAY_0HUBag-hxw_uN0voXqgPJl_M2Hlb7At8WBHJeTYEswxCNyFuDGSdo5oEK_ktFXdTRa5js6AlkdlCFkV9vdgHvvTAU20kOl5NJvfAtCds3oug2RjzIFleODSl-_oVSxkZcfEq4En1SqqWuNZ6UiKhMI2Ok0FrvA9UfnBOJLuM Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f27669b4f3474aa0d12fa9b9045950", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 87f18ce832d949c4a8a4c9a3d727d7b0 Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: {"os-resetState": {"state": "invalid"}} Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c155960f-4c59-4cc0-80a9-6d877d0f4d64', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:55:28.983883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fb1b879-0df6-444d-bcd2-93966e8f4611 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:28.993802 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fb1b879-0df6-444d-bcd2-93966e8f4611 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action" status: 400 len: 144 microversion: 2.1 time: 0.009870 Nov 02 11:55:28.999287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 729/1458] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:28 2022] POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:55:29.010691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7315cb0-522c-4437-997c-24839246d52d tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7315cb0-522c-4437-997c-24839246d52d tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Request method failure captured: Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action HTTP/1.1 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 31 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqBAY_0HUBag-hxw_uN0voXqgPJl_M2Hlb7At8WBHJeTYEswxCNyFuDGSdo5oEK_ktFXdTRa5js6AlkdlCFkV9vdgHvvTAU20kOl5NJvfAtCds3oug2RjzIFleODSl-_oVSxkZcfEq4En1SqqWuNZ6UiKhMI2Ok0FrvA9UfnBOJLuM Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f27669b4f3474aa0d12fa9b9045950", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 87f18ce832d949c4a8a4c9a3d727d7b0 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: {"os-resetState": {"state": 1}} Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c155960f-4c59-4cc0-80a9-6d877d0f4d64', 'body': {'os-resetState': {'state': 1}}} Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 1 Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 11:55:29.021338 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7315cb0-522c-4437-997c-24839246d52d tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7315cb0-522c-4437-997c-24839246d52d tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action" status: 400 len: 120 microversion: 2.1 time: 0.022457 Nov 02 11:55:29.032482 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 730/1459] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:28 2022] POST /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64/action => generated 120 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:55:29.046560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:29.048964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Failed to fetch instance by id 999 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 11:55:29.049447 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Request method failure captured: Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 37 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqBAY_0HUBag-hxw_uN0voXqgPJl_M2Hlb7At8WBHJeTYEswxCNyFuDGSdo5oEK_ktFXdTRa5js6AlkdlCFkV9vdgHvvTAU20kOl5NJvfAtCds3oug2RjzIFleODSl-_oVSxkZcfEq4En1SqqWuNZ6UiKhMI2Ok0FrvA9UfnBOJLuM Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f27669b4f3474aa0d12fa9b9045950", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f27669b4f3474aa0d12fa9b9045950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e2f27669b4f3474aa0d12fa9b9045950 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1732760240 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 87f18ce832d949c4a8a4c9a3d727d7b0 Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1732760240-project-admin Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: {"os-resetState": {"state": "error"}} Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 999 could not be found. Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:29.051193 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3dc46fe-cfa4-486e-a181-b1aeb45ec938 tempest-ServersAdminNegativeTestJSON-1732760240 tempest-ServersAdminNegativeTestJSON-1732760240-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022119 Nov 02 11:55:29.062608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 731/1460] 10.222.0.48 () {60 vars in 1179 bytes} [Wed Nov 2 11:55:29 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 11:55:29.067905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:29.077774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:29.086250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.086758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.087253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:29.087989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.094839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.099933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:29.146962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:55:29.603651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:29.623262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:29.628616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:29.643494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e191df9-aa0e-478f-8c07-14f723eae871 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.704483 Nov 02 11:55:29.655755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 730/1461] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:28 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:29.662575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:29.663980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:29.675875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ae89fd6-f618-4632-9e62-3e28086043a4 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 204 len: 0 microversion: 2.1 time: 0.615350 Nov 02 11:55:29.678224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 732/1462] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:55:29 2022] DELETE /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:29.691344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:29.694755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:29.708348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.713271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.714051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:29.716483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.716973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.718425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.720816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.721328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:29.722176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:29.723962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:29.727409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:29.729258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.199684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.211557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1527ee59-6765-4717-a75a-5c7e8ac4d01f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.560312 Nov 02 11:55:30.215625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 731/1463] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:29 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:30.223770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:30.227779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:30.237812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.240230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.244506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.244506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.244506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.244506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.285595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.320759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.324224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.328702 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2aac2b12-96ef-4da0-9370-8668fe624337 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.648670 Nov 02 11:55:30.329807 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 733/1464] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:29 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:30.344871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:30.348707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:30.367492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.368301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.370462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.371609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.372228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.372808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.511079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:30.528530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.540811 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03c62721-c2f5-4fab-8b9d-072a36dd6364 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.323328 Nov 02 11:55:30.541843 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 732/1465] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:30 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:30.553305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:30.557350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:30.571096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.571980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.573140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.576513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.577322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.577983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.752406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:30.763254 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb1d28a5-4859-462c-b5fe-f32babdb3647 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1469 microversion: 2.1 time: 0.430991 Nov 02 11:55:30.779340 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 734/1466] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:30 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:30.779950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:30.780592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:30.802868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.803689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.805163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:30.806051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:30.806737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:30.807427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.011696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:31.024715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:31.038826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:31.040087 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-378c5a65-ccc3-4f1d-b741-c7daeaeb6b7d tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.495927 Nov 02 11:55:31.040690 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 733/1467] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:30 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:31.041228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:31.052524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbb6b3b7-31c8-4484-af57-96a51797e147 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.280208 Nov 02 11:55:31.053465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 735/1468] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:30 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:31.236613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:31.237236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:31.247697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:31.249402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.253658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.254361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.261803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.261803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.261803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.347792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:31.357761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:31.366538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Searching by: {'deleted': False, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:55:31.392004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.399726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.399726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.399726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.399726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.399726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.476205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:55:31.572186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3365c61-0d55-4500-923d-c3e1e5905bb7 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.229766 Nov 02 11:55:31.574226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 736/1469] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:55:31 2022] GET /compute/v2.1/servers => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:31.592976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:31.597989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:31.628678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.629169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.629790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:31.630560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:31.631312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:31.633346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.226605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.244281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.249254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.253717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f40f1ee1-e408-481c-b34d-0e64362a5e7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.677105 Nov 02 11:55:32.268506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 737/1470] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:31 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:32.279630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:32.280712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:32.287722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.289498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.290229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.291248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.291935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.292586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.370090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.393119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0c389e3-eb4c-4d8b-a27f-2b242e7b63c0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 1.160825 Nov 02 11:55:32.394144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 734/1471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:31 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:32.407913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:32.419551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.427238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Searching by: {'deleted': False, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:55:32.433361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.433856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.434306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.436934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.439748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.446268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.503737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:55:32.651152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.657986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.658486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.659059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.701911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:32.718617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9213a42a-0f45-46df-83fd-a42da64a1d9e tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.444260 Nov 02 11:55:32.720753 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 738/1472] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:32 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:32.727997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f", "tag": "8d847874-3baa-4fb4-a248-eaf5a2b642f8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:32.750220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.750993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.751589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.771756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] Creating event network-changed:8d847874-3baa-4fb4-a248-eaf5a2b642f8 for instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f on n-h2-855649-4 Nov 02 11:55:32.778749 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1f03333c-7efe-43dc-b2d9-230d8a75966a req-d97c834e-a838-438b-a3a7-8081b140931b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055995 Nov 02 11:55:32.779984 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 739/1473] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:32.786312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:32.788156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:32.797849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.798520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.799166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.800505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.801138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.801734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.888855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d89c5a4-52b0-4d8f-b677-a0b9dee16f66 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.493524 Nov 02 11:55:32.889961 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 735/1474] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 11:55:32 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:32.894826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:32.895749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:32.908033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.920201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.920201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.920201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:32.920201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:32.920201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:32.929305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:33.475540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:33.484454 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07716381-bd49-4df7-a8c9-673c7e9debdb tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1469 microversion: 2.1 time: 0.703007 Nov 02 11:55:33.507715 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 740/1475] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:32 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1469 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:33.512858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:33.513479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:33.520331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:33.532513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.533012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.533458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.534180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.536303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f492dc4b-1603-4995-8f73-baec902b7fe3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.641451 Nov 02 11:55:33.540546 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 736/1476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:32 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:33.552331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.553423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d253a35a-53f9-485c-9b40-bebc925e8bb8", "name": "network-vif-unplugged", "status": "completed", "tag": "67c44d18-da1f-4896-9dc9-6f8ab7a3f6be"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:33.557181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.577623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.608931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.608931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.608931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] Creating event network-vif-unplugged:67c44d18-da1f-4896-9dc9-6f8ab7a3f6be for instance d253a35a-53f9-485c-9b40-bebc925e8bb8 on n-h2-855649-4 Nov 02 11:55:33.620773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7a003833-1e9e-47ea-bfd3-c1772fe975a3 req-53da83d8-7064-4728-9e3d-97845f05e9c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078222 Nov 02 11:55:33.622217 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 737/1477] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:33.628926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2ea45fb-34a5-4417-aba5-c028b59b11d0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:33.639488 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2ea45fb-34a5-4417-aba5-c028b59b11d0 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015414 Nov 02 11:55:33.640589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 738/1478] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:55:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:33.655749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:33.657037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:33.665896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.667145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.667860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.669129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.671980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.672727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.701657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:33.728552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:33.731017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:33.736998 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ba7085f-82eb-47a0-8fe1-0567c96c3956 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.228117 Nov 02 11:55:33.737592 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 741/1479] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:33 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:33.749258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:33.756213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:33.771971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.772803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.773414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:33.775608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:33.776308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:33.777405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.529584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:34.542238 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9058e8b2-8541-4b7d-9ba2-e9df5ed7d751 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.803325 Nov 02 11:55:34.542842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 742/1480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:33 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:34.545957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:34.548159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:34.548765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:34.557715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.558327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.558795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.559521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.559790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:34.559974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.560406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.564606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:34.568217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84a02664-6425-4595-8089-71770e5ed5b7 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.917042 Nov 02 11:55:34.569637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 739/1481] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:33 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:34.574935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:34.575817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:34.583580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:34.586603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.587726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.588513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.589683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.590205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.590634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.620362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:55:34.699229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:34.707598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:34.716106 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b21eced6-1743-4aa3-ad7a-ec7d712bb641 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.172056 Nov 02 11:55:34.716699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 743/1482] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:34 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:34.721953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:34.722838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:34.729454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.731626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.731626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:34.731626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:34.733912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:34.733912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.008753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.021895 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14e276b1-cbcd-4446-ac21-72ea296f0185 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1469 microversion: 2.1 time: 0.303866 Nov 02 11:55:35.023226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 744/1483] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:34 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1469 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:35.029097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:35.038640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:35.038640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.038640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.038640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.039821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.040508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.041332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.213285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1758580-86d3-4b75-bb86-e82f5e9ebdff tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 204 len: 0 microversion: 2.1 time: 0.642009 Nov 02 11:55:35.215274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 740/1484] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:55:34 2022] DELETE /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:35.221088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:35.224244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:35.251485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.254859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.255403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.256203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.256683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.257124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.436850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.448812 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5754a387-99f2-422a-ae65-f03083f0722b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.424205 Nov 02 11:55:35.449418 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 745/1485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:35 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:35.468270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d253a35a-53f9-485c-9b40-bebc925e8bb8", "name": "network-vif-deleted", "tag": "67c44d18-da1f-4896-9dc9-6f8ab7a3f6be"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:35.521623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.522110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.523120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.583946 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] Creating event network-vif-deleted:67c44d18-da1f-4896-9dc9-6f8ab7a3f6be for instance d253a35a-53f9-485c-9b40-bebc925e8bb8 on n-h2-855649-4 Nov 02 11:55:35.605919 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2349571f-9910-48b4-9011-75953bea0b6c req-26e86759-4877-4d40-861d-8ca2ddb328a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142585 Nov 02 11:55:35.607398 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 746/1486] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:35.621431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:35.624471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:35.625123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.646400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.646400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.646400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.646400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.646841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.646951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.646951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.647153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.666677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6166d7fc-7905-4629-9bac-ba3884ba1a6b tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.450251 Nov 02 11:55:35.667872 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 741/1487] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:35 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:35.680947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:35.682084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:35.695391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.695880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.696393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.697100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.697545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.697967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.847315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:35.859739 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-003992f7-d4ce-445d-b1b9-fcd8db714cf8 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1609 microversion: 2.1 time: 0.248878 Nov 02 11:55:35.863978 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 747/1488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:35 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1609 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:35.869124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:35.872630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:35.891402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.895261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.895261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:35.895261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:35.895261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:35.895261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.011838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.033360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62763f77-beb7-4a83-b7c9-9e3af311be4c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.360599 Nov 02 11:55:36.034487 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 742/1489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:35 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:36.040487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e8454f-78e0-4835-b09a-6d7ded72d0e6", "name": "network-vif-plugged", "status": "completed", "tag": "f3674df5-ee54-4d78-b9f7-96a67e714f22"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:36.052162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.053037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.053821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.073170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] Creating event network-vif-plugged:f3674df5-ee54-4d78-b9f7-96a67e714f22 for instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 on n-h1-855649-4 Nov 02 11:55:36.080884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-43d3a509-ff3f-4f82-91b8-db8486be512e req-e57f9c44-befe-46fc-886c-f75381c70f16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Nov 02 11:55:36.082304 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 743/1490] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:36.091303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:36.098683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:36.109342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.110416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.110871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.111940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.112469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.112966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.323697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.334321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.340107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.341357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b51bbeeb-c2c7-4119-9dc3-f691327e0f14 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.476081 Nov 02 11:55:36.342400 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 748/1491] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:35 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:36.347235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:36.347797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:36.358479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.359007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.359536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.360319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.360782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.361209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.422223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.435924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ad296ef-665e-400d-84f2-29e58d45b2ad tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.352231 Nov 02 11:55:36.437067 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 744/1492] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:36 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:36.471559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.479886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:36.481216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:36.483957 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4140dcc8-08ca-4fde-a04b-bbaf54a7fd0e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1427 microversion: 2.1 time: 0.140502 Nov 02 11:55:36.489522 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 749/1493] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:36 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:36.508509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.509206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.509712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.510648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.517402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.517402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.701056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:36.701683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:36.712543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.713363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.714008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.715472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.716344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.716990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.743612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.757020 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bd27e9c-3a29-4e37-a006-543a75d81d14 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.282331 Nov 02 11:55:36.761127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 745/1494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:36 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:36.812123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.823871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.830374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:36.833852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e854ad1-9b75-4aa0-8b25-65a76e7328bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.136949 Nov 02 11:55:36.837932 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 750/1495] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:36 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:36.887863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:36.888545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:36.896036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.896614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.897897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:36.898584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:36.899143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:36.899584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.060210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:37.061150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:37.071734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.072565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.076336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.080233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.081121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.081769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.171301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:37.181107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f69678c-56c2-4e17-afe8-c2b44c913e08 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1609 microversion: 2.1 time: 0.297802 Nov 02 11:55:37.194120 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 746/1496] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:36 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1609 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:37.371283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:37.372034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:37.379628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.379906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.380559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.381528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.382592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.383077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.549812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:37.560832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-769a5ce0-048b-49bc-b090-f172e17f4dbd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1307 microversion: 2.1 time: 0.505414 Nov 02 11:55:37.562386 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 751/1497] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:37 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:37.568803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:37.569729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:37.589047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.589047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.589047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:37.591426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:37.592578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:37.593218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.162384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.172352 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7e89ac5-2af4-4df0-a210-6fa569e31321 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.608465 Nov 02 11:55:38.189051 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 752/1498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:37 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:38.198375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:38.199835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:38.211127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.212872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.213595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.215338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.216067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.216817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.257237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.258102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.258741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.259445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lazy-loading 'fault' on Instance uuid d253a35a-53f9-485c-9b40-bebc925e8bb8 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:38.378936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.403169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.407216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.413410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38a85055-03c8-4d43-aca6-6f48667cb0cc tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 1.047126 Nov 02 11:55:38.414623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 747/1499] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:37 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:38.424241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:38.425137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:38.440545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.441111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.441950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.442717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.445811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.446447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.550916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.561760 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-509cb33c-41ed-4708-8747-4bf677827bcc tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 200 len: 1312 microversion: 2.1 time: 0.371124 Nov 02 11:55:38.575766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 753/1500] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:38 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:38.589198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:38.590204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:38.599335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.600194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.601317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.602297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.603020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.603674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.768911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.785273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.789732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:38.797226 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b54f084-25ad-48ec-b0cb-a7b28ed6a217 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.212620 Nov 02 11:55:38.798380 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 754/1501] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:38 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:38.805870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:38.806774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:38.835953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.839231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.840073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:38.848204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:38.848811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:38.849470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:39.190055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:39.213085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63e17a95-0a92-42a2-9796-beb0c4c0e4e7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.796431 Nov 02 11:55:39.219319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 748/1502] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:38 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:39.230624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-plugged", "status": "completed", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:39.254729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:39.256230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:39.259513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:39.281252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] Creating event network-vif-plugged:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:55:39.306594 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-964ed83f-f743-42e4-b1c6-78d9263b23c1 req-9783e89c-7a8a-4d3c-aec7-686cf38d3c74 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080896 Nov 02 11:55:39.306594 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 749/1503] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:39.319408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:39.322310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:39.337620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:39.339405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:39.341366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:39.346481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:39.346481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:39.346481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:39.457607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:39.480571 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8b6c919-067a-453e-a2fd-8f37c4a9a4e3 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1609 microversion: 2.1 time: 0.679554 Nov 02 11:55:39.481604 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 755/1504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:38 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1609 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:39.491501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:39.494417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:39.512947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:39.514026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:39.520278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:39.520278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:39.520278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:39.520278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.356336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.365069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3db4971e-cd05-4ed1-96f9-3372abf18f25 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.882247 Nov 02 11:55:40.375775 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 756/1505] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:39 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:40.381052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:40.382656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:40.396782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.398131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.398759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.399741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.405136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.405917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.410731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:40.615010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.638561 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-271a56e6-8b7f-4dea-9b66-870df08fcbf9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1486 microversion: 2.1 time: 1.332649 Nov 02 11:55:40.641979 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 750/1506] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:39 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1486 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:40.676473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:40.677351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: d253a35a-53f9-485c-9b40-bebc925e8bb8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:40.688301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.689095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.689772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.690715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.692827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.693472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.721855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] HTTP exception thrown: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Request method failure captured: Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 HTTP/1.1 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqAdJS7uTFLiq5a0AD-Yx0zNDzfzBFkhjChK2exMBFsIwlbjbkxnN0lOYLOBxk8IKlHEDnR9BkkBErujZ8DXmHdTaPwnKfDhX6uPu3FMjOeE9-_fz1cKRi32YAL_BKAikPF9e1m-rmYyuM13wVApftnNhlcmPsNNjByS5cVmfddQlc Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: bdbde890d43146d7b34098e4de4e7b0c Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bdbde890d43146d7b34098e4de4e7b0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: bdbde890d43146d7b34098e4de4e7b0c Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-771376049-project Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 1a0bf82fdcf14d3d9e628fb5da832b80 Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-771376049-project Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd253a35a-53f9-485c-9b40-bebc925e8bb8'} Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:40.724435 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. Nov 02 11:55:40.729307 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:55:40.734177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Returning 404 to user: Instance d253a35a-53f9-485c-9b40-bebc925e8bb8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:40.738308 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9aef3317-b1f0-4df5-a0dd-f106a71fbb3e tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8" status: 404 len: 111 microversion: 2.1 time: 0.082047 Nov 02 11:55:40.740151 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 751/1507] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:40 2022] GET /compute/v2.1/servers/d253a35a-53f9-485c-9b40-bebc925e8bb8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:40.747251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:40.754045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:40.762278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.763082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.765380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.766599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:40.769446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:40.770151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:40.924594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.960894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.971916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.974909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.979198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.983519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:40.984716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d21ceaed-bfc2-42c5-b4e6-e7324c96339f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1812 microversion: 2.25 time: 0.604106 Nov 02 11:55:40.986227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 757/1508] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:40 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1812 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:40.996442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:40.998188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:41.009017 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c227f69a-edee-4660-a970-bbe9abb429bf tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.267007 Nov 02 11:55:41.011734 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 752/1509] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:40 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:41.021234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:41.022379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.024310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:41.024609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.025311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.027032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.031813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.032603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.046959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.049510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.051574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.055505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.056242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.056847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.427834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:41.581983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:41.595462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:41.602958 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf06a848-e9d4-40b5-a2d5-543942b9f386 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1609 microversion: 2.1 time: 0.588969 Nov 02 11:55:41.602958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 753/1510] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:41 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1609 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:41.623957 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a937bb4-593a-4a76-9446-56d2ebfcecb4 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1317 microversion: 2.1 time: 0.636171 Nov 02 11:55:41.645341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 758/1511] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:40 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:41.664362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:41.669082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:41.670192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:41.674447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:41.687873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.688396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.689141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.689904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.690579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.691784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.692275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.693747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.695471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:41.696153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.696903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:41.702160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:41.832398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:55:42.157152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd181759-86a2-445e-8fe2-4b297e0a3834 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6/action" status: 202 len: 0 microversion: 2.1 time: 0.531305 Nov 02 11:55:42.166819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 754/1512] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:41 2022] POST /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:55:42.176569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:42.177652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:42.191751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.192948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.193653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.194928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.195635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.197457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.310584 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ace858e-7c10-4c7b-8360-75f1fd9118de tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 204 len: 0 microversion: 2.1 time: 0.663480 Nov 02 11:55:42.317450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 759/1513] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:55:41 2022] DELETE /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:42.328031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:42.334208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:42.347650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.351248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.353039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.354060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.354691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.356135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.471323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:42.647773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=27 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:42.662419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.672304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d088855-ddda-43c9-b300-aa59cd8b4ceb tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.511768 Nov 02 11:55:42.677244 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 755/1514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:42 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:42.697008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:42.698180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:42.716677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.718274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.718861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.719448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.723929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.724946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.732868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.733048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.733048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.734651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea808b14-7a58-44b6-91f7-f0e52897b8c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1802 microversion: 2.25 time: 0.415787 Nov 02 11:55:42.735764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 760/1515] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:42 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1802 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:42.742932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:42.743986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:42.749882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:42.752263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.753003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.753622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.754660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.755380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.756026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.911549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.929046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.933552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:42.944418 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb833a55-b790-43c3-acb9-7a88e2840286 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.265978 Nov 02 11:55:42.946664 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 756/1516] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:42 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:42.964152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:42.964785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:42.982411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.988620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.988620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:42.988620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:42.988620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:42.988620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.029311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:43.045630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5efbeb0e-cb94-4c80-b0f1-e7e3263d41a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1491 microversion: 2.1 time: 0.306040 Nov 02 11:55:43.051813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 761/1517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:42 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1491 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:43.052384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162a4c4e-b03e-4587-9e10-75ae1727d583", "name": "network-vif-deleted", "tag": "720103ce-5339-4505-b619-52a0d9df27dc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:43.064057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.064766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.065547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.115037 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] Creating event network-vif-deleted:720103ce-5339-4505-b619-52a0d9df27dc for instance 162a4c4e-b03e-4587-9e10-75ae1727d583 on n-h1-855649-4 Nov 02 11:55:43.132658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dc482626-e73c-4996-a4d3-aa50b089414b req-816f2737-3fa1-461c-abde-fd89ec3645e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084301 Nov 02 11:55:43.133517 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 762/1518] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:43.139338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:43.140532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:43.149232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.150187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.151614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.152825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.153601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.154302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.257160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:43.261362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:43.270038 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7097cb8d-e3e7-4fee-81c4-ce6e348632f8 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1477 microversion: 2.1 time: 0.321184 Nov 02 11:55:43.274269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 757/1519] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:42 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:43.286896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:43.288239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:43.302500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.303163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.303731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.304548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.307425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.307974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.323981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:43.336344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-555bb139-f816-45c0-a79e-605fcf7bf882 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1541 microversion: 2.1 time: 0.201546 Nov 02 11:55:43.338190 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 763/1520] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:43 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1541 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:43.347894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eaa45d6d-a5a5-4b49-bd9b-a6a3d9d811ea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '.version_select at 0x7ff1b39891f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:43.356340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa45d6d-a5a5-4b49-bd9b-a6a3d9d811ea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.358641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa45d6d-a5a5-4b49-bd9b-a6a3d9d811ea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.359363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa45d6d-a5a5-4b49-bd9b-a6a3d9d811ea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.374808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eaa45d6d-a5a5-4b49-bd9b-a6a3d9d811ea tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.033883 Nov 02 11:55:43.391161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 764/1521] 10.222.0.48 () {60 vars in 1184 bytes} [Wed Nov 2 11:55:43 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:43.409265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f", "name": "network-vif-plugged", "status": "completed", "tag": "8d847874-3baa-4fb4-a248-eaf5a2b642f8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:43.422363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.422848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.424210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.443196 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] Creating event network-vif-plugged:8d847874-3baa-4fb4-a248-eaf5a2b642f8 for instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f on n-h2-855649-4 Nov 02 11:55:43.464100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-02cf4cb1-8138-4c35-bc34-7fd2262b1197 req-e344eb91-a0a5-41a2-a218-e6e004d9a3e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072157 Nov 02 11:55:43.465477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 765/1522] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:43.478488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:43.482235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:43.496596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.497118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.497567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.498288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.501666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.503196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.592723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:43.613808 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0af463ec-a331-481e-bcbf-c4e4e289a3ff tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1466 microversion: 2.1 time: 0.338115 Nov 02 11:55:43.614408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 758/1523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:43 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1466 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:43.651560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-634980334", "metadata": {"image_type": "test"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:43.654382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:43.669298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.669858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.670334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.671098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.671571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.672011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.730584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Getting quotas for project 0861126d143b41e1aca61a5e6c5c5e6d. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:55:43.737145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Getting quotas for user c8481204674b4e47911ca5dbfbf9ea8d and project 0861126d143b41e1aca61a5e6c5c5e6d. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:55:43.807552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:43.836774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-046390cc-c592-4de2-8ed4-e2c443dc9f77 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 2420 microversion: 2.25 time: 0.369932 Nov 02 11:55:43.837552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 766/1524] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:43 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 2420 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:43.863221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:43.863854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:43.870510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.871973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.871973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:43.873216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:43.873697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:43.874152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.144163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:44.157535 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af39d533-cd00-49eb-82fc-a2fcbf35ad29 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.299644 Nov 02 11:55:44.159395 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 767/1525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:43 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:44.167762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:44.169312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:44.181097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.184167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.184649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.185465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.185936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.186368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.371462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-338177b2-c4e4-4e2f-9632-08356bfe283f tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "POST /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d/action" status: 202 len: 0 microversion: 2.1 time: 0.724480 Nov 02 11:55:44.372115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 759/1526] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:43 2022] POST /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:55:44.385200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:44.386096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:44.409764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.411697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.412349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.413890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.414530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.415787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.442686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:44.475947 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f597107c-13c6-4d68-a127-8af406402c89 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 2420 microversion: 2.25 time: 0.305832 Nov 02 11:55:44.491751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 768/1527] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:44 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 2420 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:44.506048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:44.507732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:44.517290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.518285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.518886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.519815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.523470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.526732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.533718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:44.553564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:44.559474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:44.568442 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb787e40-9ecb-4c45-9cfc-2db5adc61e3e tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1553 microversion: 2.91 time: 0.193262 Nov 02 11:55:44.577945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 760/1528] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:44 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:44.603465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:44.603465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:44.613882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.614823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.615944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:44.616856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:44.617482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:44.618083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.107501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:45.119163 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ef73429-d818-4292-afaf-d902240d34aa tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1477 microversion: 2.1 time: 0.538634 Nov 02 11:55:45.120124 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 761/1529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:44 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1477 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:45.127046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:45.134298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:45.146949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.152970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.153652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.154825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.155291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.163020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.315476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:45.336289 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd97dd98-34f6-4ce5-bd45-5765a2862daf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 200 len: 1471 microversion: 2.1 time: 0.842769 Nov 02 11:55:45.339599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 769/1530] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:44 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 1471 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:45.356816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce959c52-094e-47fd-9948-72237894cadb tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3be2a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:45.401837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:45.414466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0ff6204-a4f7-4232-bd2c-21fb78367435 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1252 microversion: 2.1 time: 0.291173 Nov 02 11:55:45.415073 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 762/1531] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:45 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1252 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:45.421047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce959c52-094e-47fd-9948-72237894cadb tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1423 microversion: 2.1 time: 0.079807 Nov 02 11:55:45.421267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:45.421690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:45.428788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.429509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.430106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.431394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.431783 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 770/1532] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:45 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:45.432234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.432951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.438389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:45.439454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:45.447942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.449809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.450479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.454300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:45.455304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:45.455938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:45.667294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lazy-loading 'services' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:45.993720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.001810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28b798da-6258-47d5-b2e7-c6f82d6ceaa5 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1351 microversion: 2.1 time: 0.568480 Nov 02 11:55:46.002385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 771/1533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:45 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1351 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:46.007097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-66553927"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:46.009590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.020693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.137589 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fce30996-5ce6-40ed-b07c-0d6b90bede80 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments/c28bb71f-bc9d-49d1-a297-2dc36ec6dea6" status: 202 len: 0 microversion: 2.25 time: 0.720887 Nov 02 11:55:46.138792 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 763/1534] 10.222.0.48 () {60 vars in 1457 bytes} [Wed Nov 2 11:55:45 2022] DELETE /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments/c28bb71f-bc9d-49d1-a297-2dc36ec6dea6 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:46.157075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.158019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:46.173514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.174008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.187267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.187267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.187267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.187267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.275284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.318640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.320906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.330356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4547d26b-f0a7-41a0-8717-873a45a52754 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1535 microversion: 2.91 time: 0.189981 Nov 02 11:55:46.346026 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 764/1535] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1535 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:46.356546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c155960f-4c59-4cc0-80a9-6d877d0f4d64", "name": "network-vif-deleted", "tag": "e96a95cb-6e30-4cb7-9af9-ab42b1a46797"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:46.375462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.376207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.377259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.429484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] Creating event network-vif-deleted:e96a95cb-6e30-4cb7-9af9-ab42b1a46797 for instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 on n-h1-855649-4 Nov 02 11:55:46.439115 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8e377b2e-b630-4156-a685-053682e8d3f5 req-dc82b6ee-a61d-42e6-9b96-6fbf19ad0184 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090518 Nov 02 11:55:46.443314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 765/1536] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:46.450065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.451111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:46.459128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.459664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.460382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.461130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.461589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.462092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.570448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.579245 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71512d87-887b-4f85-80ba-bc4c6114e4f9 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1435 microversion: 2.1 time: 0.134348 Nov 02 11:55:46.582464 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 766/1537] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1435 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:46.587243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.589740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:46.597059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.597903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.598593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.599839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.601114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.602364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.642562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92553956-569c-4cde-96da-41efdbd95041 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059937 Nov 02 11:55:46.643696 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 767/1538] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:55:46.649217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.649996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:46.656882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.657512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.658204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.659040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:46.659738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:46.660400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:46.680928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46eb1c08-a1b7-42c4-95da-8e1bcbecdf8b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6/action" status: 202 len: 0 microversion: 2.1 time: 0.677293 Nov 02 11:55:46.687916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 772/1539] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:55:46 2022] POST /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:55:46.701560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00ea4c48-27c6-45b9-b289-746d3bef3074 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b37cda60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.754178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:46.773841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00ea4c48-27c6-45b9-b289-746d3bef3074 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1423 microversion: 2.1 time: 0.084262 Nov 02 11:55:46.775603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a13e973-e1d7-4024-997d-ff0f986d6a5f tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1252 microversion: 2.1 time: 0.123327 Nov 02 11:55:46.776815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 768/1540] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1252 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:46.787338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea4b154d-2765-4064-a6b2-c72bfe6c91a7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3228e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:46.788270 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 773/1541] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:46.862489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea4b154d-2765-4064-a6b2-c72bfe6c91a7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1412 microversion: 2.1 time: 0.084294 Nov 02 11:55:46.872768 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 769/1542] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:46 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:47.029552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.030305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.038425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.038967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.039448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.040956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.041476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.042093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.047493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:47.251867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:47.261913 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20325fa6-2c65-46bc-9058-34853ee32b45 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1540 microversion: 2.1 time: 0.236515 Nov 02 11:55:47.262505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 774/1543] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1540 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:47.285681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.286463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.309398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.311855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.312797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.313641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.317205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.317663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.363647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.364653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.375552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.376411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.378732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.379754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.380444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.382365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.483114 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d84c4400-2a90-487c-b2db-408e4543b1a2 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201620 Nov 02 11:55:47.484538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 770/1544] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:55:47.588071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:47.597444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:47.606565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:47.610256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.611150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.620945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-501fae69-3177-4fe3-a665-9f208782df9d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1535 microversion: 2.91 time: 0.261343 Nov 02 11:55:47.627333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.628419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 775/1545] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1535 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:55:47.629184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.629632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.630365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.630822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.634502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.656996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.660143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.672336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.677328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.680197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.683440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.684028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.687453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.712715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.713200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.713903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.714542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lazy-loading 'fault' on Instance uuid c155960f-4c59-4cc0-80a9-6d877d0f4d64 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:47.794753 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2b46bf9-778b-48fe-a190-16290635f9ce tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137665 Nov 02 11:55:47.801153 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 776/1546] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:55:47.810886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22846513-356d-4cf4-9397-078610c986e8 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3dd8ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.877349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:47.882122 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22846513-356d-4cf4-9397-078610c986e8 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1423 microversion: 2.1 time: 0.079031 Nov 02 11:55:47.882709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 777/1547] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:47.894960 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2abe6b09-8fc5-48cb-ae03-23cb5dc5f307 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1312 microversion: 2.1 time: 0.289067 Nov 02 11:55:47.901822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.902445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:47.904660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 771/1548] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1312 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:55:47.918534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31586f93-4974-4d7b-a204-d741aa95acfb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b32b0280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:47.954370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.956918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.958256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:47.960464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:47.961639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:47.966343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:48.009332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31586f93-4974-4d7b-a204-d741aa95acfb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1412 microversion: 2.1 time: 0.103522 Nov 02 11:55:48.010337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 772/1549] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:48.378828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:48.409474 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c9ef73b-a811-41de-8fe6-aafaeec84449 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1252 microversion: 2.1 time: 0.522385 Nov 02 11:55:48.412377 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 778/1550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:47 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1252 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:48.667414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:48.669375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:48.686880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:48.689561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:48.690618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:48.691636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:48.693413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:48.696157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:48.834846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:48.842336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:48.857895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:48.866816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:48.872478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:48.872478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:48.872478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:48.872478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:48.873000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:48.888286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:48.893153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:48.926632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bc2fa03-15e3-4a77-b366-519061d8d555 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1538 microversion: 2.91 time: 0.266948 Nov 02 11:55:48.927725 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 773/1551] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:48 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1538 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:48.937228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb8c3d7c-818f-4446-bb58-2fbd9d9396df tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3276310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:48.951716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3eb9d76e-3f7d-4b0d-88e8-679250122208 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147268 Nov 02 11:55:48.958751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 779/1552] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:55:48 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:55:48.968409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:48.975700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:48.991622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.001355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.003620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.006951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.016408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.018115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.033594 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb8c3d7c-818f-4446-bb58-2fbd9d9396df tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1423 microversion: 2.1 time: 0.102436 Nov 02 11:55:49.036648 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 774/1553] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:48 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:49.061767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:49.064451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:49.089099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.093249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.093249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.093249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.093639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.093809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.111060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.111561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.112005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.112493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lazy-loading 'fault' on Instance uuid c155960f-4c59-4cc0-80a9-6d877d0f4d64 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:55:49.133122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:49.203589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-855649-4". {{(pid=127568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 11:55:49.233778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a0bf82fdcf14d3d9e628fb5da832b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbde890d43146d7b34098e4de4e7b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:49.246000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ef43afa-09be-4b82-92af-ef7a0fc0ce07 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 200 len: 1312 microversion: 2.1 time: 0.287840 Nov 02 11:55:49.248219 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 780/1554] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:48 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:49.266142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-820a5f3c-7b27-4dba-947a-1c7753788de2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3989ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:49.355344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-820a5f3c-7b27-4dba-947a-1c7753788de2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1412 microversion: 2.1 time: 0.104781 Nov 02 11:55:49.363874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 781/1555] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:49 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:49.436943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:49.437928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:49.457023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.458207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.458769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.461576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.462380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.463267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.571869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:49.583279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-904626bb-39ce-42d1-b72d-a839a8eb406c tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1252 microversion: 2.1 time: 0.150626 Nov 02 11:55:49.601882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 782/1556] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:49 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1252 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:49.825402 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5766c102-a8ec-4f7d-9190-61e7e624b8de tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action" status: 202 len: 0 microversion: 2.91 time: 0.787299 Nov 02 11:55:49.826021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 775/1557] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:55:49 2022] POST /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:55:49.848459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:49.849083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:49.867069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:55:49.868704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.869196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.869640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:49.870355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:49.870830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:49.871291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.152012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:50.163013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:50.164530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:50.204988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14a28a81-d3ad-4116-a426-2b89e83d97d3 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1486 microversion: 2.91 time: 0.356107 Nov 02 11:55:50.206683 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 776/1558] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:49 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1486 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:50.225791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:50.228413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:50.235574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.237800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.239016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.239186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-plugged", "status": "completed", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:50.240461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.243881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.244592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.316537 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-779c50b5-d6d7-44e0-ad4c-672fbe8ec4ae tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108477 Nov 02 11:55:50.317719 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 777/1559] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:55:50 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:55:50.324097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.324929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.325544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.341429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c11b74e8-137d-40fc-b770-d6432987b964 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3276790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:50.356579 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] Creating event network-vif-plugged:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:55:50.369782 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f0c78a5f-b2eb-4bbd-b4ab-637bb8f5cc7b req-cca3fca8-d118-4a55-99b4-f28a35602e82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.628900 Nov 02 11:55:50.373578 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 783/1560] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:55:50.387071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:50.388483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] [instance: c155960f-4c59-4cc0-80a9-6d877d0f4d64] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:50.400102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.400975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.402488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.403506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.404631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.405316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.441879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] HTTP exception thrown: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Request method failure captured: Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 HTTP/1.1 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqAdJS7uTFLiq5a0AD-Yx0zNDzfzBFkhjChK2exMBFsIwlbjbkxnN0lOYLOBxk8IKlHEDnR9BkkBErujZ8DXmHdTaPwnKfDhX6uPu3FMjOeE9-_fz1cKRi32YAL_BKAikPF9e1m-rmYyuM13wVApftnNhlcmPsNNjByS5cVmfddQlc Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bdbde890d43146d7b34098e4de4e7b0c Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bdbde890d43146d7b34098e4de4e7b0c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bdbde890d43146d7b34098e4de4e7b0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bdbde890d43146d7b34098e4de4e7b0c Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-771376049 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-771376049-project Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 1a0bf82fdcf14d3d9e628fb5da832b80 Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-771376049-project Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c155960f-4c59-4cc0-80a9-6d877d0f4d64'} Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:50.448004 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] Returning 404 to user: Instance c155960f-4c59-4cc0-80a9-6d877d0f4d64 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:55:50.452077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-998b67d1-2515-4bdb-9bf7-951d86130d59 tempest-ServersAdminNegativeTestJSON-771376049 tempest-ServersAdminNegativeTestJSON-771376049-project] 10.222.0.48 "GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64" status: 404 len: 111 microversion: 2.1 time: 0.076964 Nov 02 11:55:50.454264 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 784/1561] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:50 2022] GET /compute/v2.1/servers/c155960f-4c59-4cc0-80a9-6d877d0f4d64 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:55:50.468607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f53108cb-0c4e-4565-9747-c2c8f38d355e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3a109d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:50.488148 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c11b74e8-137d-40fc-b770-d6432987b964 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1423 microversion: 2.1 time: 0.168234 Nov 02 11:55:50.493268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 778/1562] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:50 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1423 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:50.591178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f", "tag": "8d847874-3baa-4fb4-a248-eaf5a2b642f8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:55:50.612931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.614937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.616201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.658578 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f53108cb-0c4e-4565-9747-c2c8f38d355e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1412 microversion: 2.1 time: 0.196292 Nov 02 11:55:50.658893 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] Creating event network-changed:8d847874-3baa-4fb4-a248-eaf5a2b642f8 for instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f on n-h2-855649-4 Nov 02 11:55:50.659111 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 785/1563] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:50 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:50.673894 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fb0b90d1-4bff-42c2-b5dc-b2dfee43d527 req-2207b8a2-e85f-4b1e-b968-538214616486 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086303 Nov 02 11:55:50.689775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:50.693257 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 779/1564] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:55:50.698705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:50.730574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.735844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.738705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:50.745167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:50.749382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:50.752751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:51.105511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9adf6d939b944575a9320a21e331ce34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcdaa2663aca442eb46cc53a7d2aee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:51.130692 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2558200-d298-4a43-b3c6-2dc9d72a4196 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 200 len: 1252 microversion: 2.1 time: 0.464323 Nov 02 11:55:51.134957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 786/1565] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:55:50 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 1252 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:55:51.257888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:51.258589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:51.311230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:51.312998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:51.315127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:51.321920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:51.322876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:51.335548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:51.340875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:51.342265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:55:51.397411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:51.405615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:51.406456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:51.416829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:55:51.417645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:55:51.418253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:55:51.520764 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cff67d6-3594-4ffe-9597-e28d39c49e20 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.193823 Nov 02 11:55:51.532854 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 787/1566] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:55:51 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 11:55:51.547757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-194d418c-8ca0-4db5-94e7-d50e7f941399 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b8410f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:55:51.695683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:51.716188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:51.720896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:55:51.744504 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4eda4ecb-8d14-46c4-8a33-e87cda5d4992 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1486 microversion: 2.91 time: 0.491839 Nov 02 11:55:51.747324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 780/1567] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:55:51 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1486 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:55:51.767484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82df6ba4-3420-4b1c-acf8-0da1d3125e7d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b317bf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:01.377420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:01.490850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=58 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:01.931067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:01.991103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:14.598675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-194d418c-8ca0-4db5-94e7-d50e7f941399 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1432 microversion: 2.1 time: 23.063549 Nov 02 11:56:14.600215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 788/1568] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:51 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1432 bytes in 23066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:14.607679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82df6ba4-3420-4b1c-acf8-0da1d3125e7d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1421 microversion: 2.1 time: 22.858928 Nov 02 11:56:14.609936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:14.610545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] [instance: 162a4c4e-b03e-4587-9e10-75ae1727d583] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.619991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 781/1569] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:55:51 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1421 bytes in 22869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:14.633432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.633432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.635747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.637684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.638823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.639464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.663070 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] HTTP exception thrown: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Request method failure captured: Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 HTTP/1.1 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYln-ZoN_4h0dDmElOqJsqhp0bLP4F4u_wxmpjIPdv98FgwKwwQOjcONKJAVDkGNFPhEdpZPLIJxkEf9wefyHmUSYNwe5Q2Ex6CfrJMs-4R007q3BmQw0cTwyGfTbE9DlYDlxIdaBMZYzgxOkXkzQe3u7NCFJyMgJxGQedvxDzN9G0PQ Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bcdaa2663aca442eb46cc53a7d2aee4f Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestBootFromVolume-1149505178 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bcdaa2663aca442eb46cc53a7d2aee4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bcdaa2663aca442eb46cc53a7d2aee4f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bcdaa2663aca442eb46cc53a7d2aee4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bcdaa2663aca442eb46cc53a7d2aee4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestBootFromVolume-1149505178 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bcdaa2663aca442eb46cc53a7d2aee4f Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1149505178 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestBootFromVolume-1149505178-project Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9adf6d939b944575a9320a21e331ce34 Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestBootFromVolume-1149505178-project Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '162a4c4e-b03e-4587-9e10-75ae1727d583'} Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:14.668429 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Returning 404 to user: Instance 162a4c4e-b03e-4587-9e10-75ae1727d583 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c276d951-5313-4b8c-a172-e078e085da85 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583" status: 404 len: 111 microversion: 2.1 time: 0.069029 Nov 02 11:56:14.674383 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 789/1570] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:14 2022] GET /compute/v2.1/servers/162a4c4e-b03e-4587-9e10-75ae1727d583 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:56:14.680621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:14.684770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.689542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.690184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.690793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.691717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.692334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.693073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.767718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:14.778951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:14.780728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:14.786811 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ffdf667-6758-469e-ade0-8cd0fc434104 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.111667 Nov 02 11:56:14.795103 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 790/1571] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:14 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:14.980945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:14.983434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:14.992298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.992907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.993357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:14.994236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:14.994707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:14.995172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:15.029370 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93cd4869-06eb-404e-9030-9ab6d5a0fdb1 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.408186 Nov 02 11:56:15.030270 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 782/1572] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:56:14 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b/os-volume_attachments => generated 25 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:15.035168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e8454f-78e0-4835-b09a-6d7ded72d0e6", "name": "network-vif-plugged", "status": "completed", "tag": "f3674df5-ee54-4d78-b9f7-96a67e714f22"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:15.060909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:15.061417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:15.061854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:15.073873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] Creating event network-vif-plugged:f3674df5-ee54-4d78-b9f7-96a67e714f22 for instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 on n-h1-855649-4 Nov 02 11:56:15.079716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4fb2d537-56de-4021-bc4b-769c4eddc4c8 req-b01cf5b9-84fe-4dc0-a85f-0eaeff440dd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047979 Nov 02 11:56:15.080695 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 783/1573] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:15.087440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cecd3ad-9529-46b3-b83a-fbc1a3394ff3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3107820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:15.114285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1916605189", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "187618f9-0ea2-4688-b320-9ee5aae0805b"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:15.315567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cecd3ad-9529-46b3-b83a-fbc1a3394ff3 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 200 len: 1432 microversion: 2.1 time: 0.233865 Nov 02 11:56:15.317158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 784/1574] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:15 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 1432 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:15.334698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79e1a924-baec-4468-a7cd-c0e9dae78ba8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b31b9310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:15.356943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] validate_networks() for [('187618f9-0ea2-4688-b320-9ee5aae0805b', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:56:15.518409 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79e1a924-baec-4468-a7cd-c0e9dae78ba8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 200 len: 1421 microversion: 2.1 time: 0.199876 Nov 02 11:56:15.519004 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 785/1575] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:15 2022] GET /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 1421 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:15.526907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09fe5233-de17-4ce2-b3cc-b5895f4a3e06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] Calling method '.version_select at 0x7ff1b31079d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:15.670198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09fe5233-de17-4ce2-b3cc-b5895f4a3e06 tempest-ServersTestBootFromVolume-1149505178 tempest-ServersTestBootFromVolume-1149505178-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754306462" status: 202 len: 0 microversion: 2.1 time: 0.150066 Nov 02 11:56:15.675467 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 786/1576] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 11:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754306462 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:56:15.682417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:15.684001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:15.695549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:15.696386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:15.696995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:15.697933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:15.698737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:15.699591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:16.116790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:16.131187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93a2f2f1-b587-49b5-afb0-55e7d774519b tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1466 microversion: 2.1 time: 0.453585 Nov 02 11:56:16.135718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 787/1577] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:15 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1466 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:16.161615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3be65a4b-6369-4b97-89c5-275c454d84b9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3276820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:17.481496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:56:17.482302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:56:17.482760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:56:17.483400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:56:17.483977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:56:17.504086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.504689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.505233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.506141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.506702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.507246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.543389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:56:17.553173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for user 29699172e95148b99d076a8bcfc09668 and project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:56:17.586658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:56:17.589635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:56:17.804681 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2298028e-788a-4e7b-854b-2da3a39b2049 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.005502 Nov 02 11:56:17.808923 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 791/1578] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:56:17.836767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:17.837588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:17.849159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.851334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.855026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:17.855026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:17.855026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:17.855026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:18.134249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:18.154739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:18.156825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:18.165269 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-571dd7f0-5773-4299-aa18-a230e99fa3af tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.348743 Nov 02 11:56:18.185784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 792/1579] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:17 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:18.195179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a53e4f1-0ad6-4fd0-900f-8c991bb4ad41 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b399ba60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.171139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3be65a4b-6369-4b97-89c5-275c454d84b9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 204 len: 0 microversion: 2.1 time: 3.030961 Nov 02 11:56:19.172280 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 788/1580] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:16 2022] DELETE /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 0 bytes in 3036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:56:19.181606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83d1718c-d2ce-47f4-97c1-46c1eab03df6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.182919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83d1718c-d2ce-47f4-97c1-46c1eab03df6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.311363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a53e4f1-0ad6-4fd0-900f-8c991bb4ad41 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043" status: 200 len: 784 microversion: 2.1 time: 1.123979 Nov 02 11:56:19.314347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 793/1581] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:18 2022] GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043 => generated 784 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:19.328019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.329015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.357525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.358344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.359879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.362688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.363761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.364976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.444984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:56:19.503661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83d1718c-d2ce-47f4-97c1-46c1eab03df6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.513439 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83d1718c-d2ce-47f4-97c1-46c1eab03df6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1211 microversion: 2.1 time: 0.339848 Nov 02 11:56:19.514756 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 789/1582] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:19 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1211 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:19.520252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.524627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:19.531016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.535799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.536478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.537640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:19.538322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:19.539199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:19.649448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.661637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.664778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:19.672108 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3eef992-9e26-46fc-b44b-02764e1cd99f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.156121 Nov 02 11:56:19.673068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 790/1583] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:19 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:19.678638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d585b50d-db4a-4c47-b6a5-bf9b530990b0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:19.686775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d585b50d-db4a-4c47-b6a5-bf9b530990b0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012430 Nov 02 11:56:19.696221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 791/1584] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 11:56:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:19.702690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4a9c6a0-5f2d-4d6f-a879-4875402fd6a0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3108d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:20.707877 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7994c1b-ac81-4e9f-bee3-b90b5b6b459e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 204 len: 0 microversion: 2.1 time: 1.390563 Nov 02 11:56:20.712408 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 794/1585] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:56:19 2022] DELETE /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 0 bytes in 1394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:56:20.720735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:20.720735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:20.754897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:20.756554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:20.757165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:20.757921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:20.760426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:20.760872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.281600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:21.297041 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e3ef259-e86a-4923-988c-60902d15f76d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1215 microversion: 2.1 time: 0.586367 Nov 02 11:56:21.297907 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 795/1586] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:20 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1215 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:21.316206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:21.317023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:21.328834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:21.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:21.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:21.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:21.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:21.525742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:21.547834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:21.547834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:21.582211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-512f37c1-7618-4ee5-8e69-adcc9b1a90c0 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.258334 Nov 02 11:56:21.583453 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 796/1587] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:21 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:21.589039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-774946102", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:27.533162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:27.568012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:29.510499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:29.658445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:29.699632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:31.530383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:31.620523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:32.963834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4a9c6a0-5f2d-4d6f-a879-4875402fd6a0 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "DELETE /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 204 len: 0 microversion: 2.1 time: 13.258960 Nov 02 11:56:32.963834 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 792/1588] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:19 2022] DELETE /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 0 bytes in 13261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:56:32.963834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-unplugged", "status": "completed", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:32.973291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:32.974305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:32.974733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:32.990256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] Creating event network-vif-unplugged:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:56:32.995704 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b3fab76c-313d-496a-b90e-49f9ae9940ac req-6b7fe900-50fa-4cba-8705-5eebccee7f36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036755 Nov 02 11:56:32.996593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 793/1589] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:33.001792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:33.002496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:33.011583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.012065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.012711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.013430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.013889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.014394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.226442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:56:33.237625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:33.251728 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7bf6bca1-e806-4e60-87ed-f7f4bfbb1c95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 0.253673 Nov 02 11:56:33.253293 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 794/1590] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:32 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:33.258477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:33.259468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:33.266400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.267211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.267828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.268732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.281950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.282484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.421890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:33.432077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:33.435466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:33.448646 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-824e16f3-19f3-418a-94d9-f0fb5f450c00 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.194050 Nov 02 11:56:33.452159 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 795/1591] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:33 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:33.650520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e8454f-78e0-4835-b09a-6d7ded72d0e6", "name": "network-vif-deleted", "tag": "f3674df5-ee54-4d78-b9f7-96a67e714f22"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:33.664798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.665173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.665980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.684288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] Creating event network-vif-deleted:f3674df5-ee54-4d78-b9f7-96a67e714f22 for instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 on n-h1-855649-4 Nov 02 11:56:33.691257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-12b38de7-cc0a-4a14-9a18-f98c3f18b796 req-734ea864-100e-4a02-b094-f48732b55b6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237146 Nov 02 11:56:33.693239 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 796/1592] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:33.699102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10b6def0-045f-48ae-9b3d-cfdb0212e7ba tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b314e280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:33.956261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:56:33.957602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:56:33.958475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:56:33.959812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:56:33.960568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:56:33.978075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.979345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.980420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:33.981556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:33.982249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:33.982852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.006615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:56:34.019841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:56:34.034488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:56:34.037538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:56:34.457729 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c42922df-e4bf-405a-964d-fe09c8c6b2e9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.872577 Nov 02 11:56:34.464292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 797/1593] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 12880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:56:34.485539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:34.487877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:34.515028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.516416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.517600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:34.519281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:34.520349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:34.521144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.059398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:35.078427 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7360377-61f2-4d53-b585-a5e7e135c380 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 0.608247 Nov 02 11:56:35.095717 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 798/1594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:34 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:35.095717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccd6045a-caca-4f3d-9006-d6f304f51771 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:35.095717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccd6045a-caca-4f3d-9006-d6f304f51771 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:35.465596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccd6045a-caca-4f3d-9006-d6f304f51771 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:35.481906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccd6045a-caca-4f3d-9006-d6f304f51771 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1207 microversion: 2.1 time: 0.394903 Nov 02 11:56:35.483122 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 799/1595] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:35 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1207 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:35.505696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:35.512840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:35.540814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:35.541944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:35.543514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.544631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:35.546937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:35.548268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.750553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:35.761502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:35.763811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:35.770127 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ea71316-d4a4-478f-8fa6-4ae2f64b981f tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.285498 Nov 02 11:56:35.771638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 800/1596] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:35 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:35.777004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e8454f-78e0-4835-b09a-6d7ded72d0e6", "name": "network-vif-unplugged", "status": "completed", "tag": "f3674df5-ee54-4d78-b9f7-96a67e714f22"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:35.790626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:35.791589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:35.792311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.810248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] Creating event network-vif-unplugged:f3674df5-ee54-4d78-b9f7-96a67e714f22 for instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 on n-h1-855649-4 Nov 02 11:56:35.818879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4c1702d3-21bf-419e-bda0-4adab47af688 req-c866e713-d40d-4590-b1e1-2198e559180f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045777 Nov 02 11:56:35.819726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 801/1597] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:35.826032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9671e65-0441-47f2-aabc-2c3b9d75d998", "tag": "9f2865b3-4fce-4238-98ff-582aa1c59ce7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:35.838464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:35.839110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:35.839794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:35.854775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] Creating event network-changed:9f2865b3-4fce-4238-98ff-582aa1c59ce7 for instance b9671e65-0441-47f2-aabc-2c3b9d75d998 on n-h1-855649-4 Nov 02 11:56:35.860447 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-33c75c51-ec41-4ab6-8887-8b1a4b0a2631 req-e3a24471-074f-4db7-81cf-f97984740ba8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038601 Nov 02 11:56:35.861570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 802/1598] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:36.107654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:36.108384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:36.126286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.127742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.131831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.132827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.134236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.136221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.377078 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-10b6def0-045f-48ae-9b3d-cfdb0212e7ba tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] HTTP exception thrown: Image not found. Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10b6def0-045f-48ae-9b3d-cfdb0212e7ba tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Request method failure captured: Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 HTTP/1.1 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqlKmq9OdBgmXA5Mz_VYJRYhmtOIDhatOMLoyxQ8TCjk7H8PMensTgc-_hXHcuJy1SZsPuxaU8DoTl1Q6nbp3gqRsiqYk1sLG3_o0zNF1xzI5Jca3v5Z1WmyMZwnIaG1dCpLD1aDtRHL6kFQbBfbWuOjLoDOWSLjwkCFeVg4yVLBAQ Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0861126d143b41e1aca61a5e6c5c5e6d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: c8481204674b4e47911ca5dbfbf9ea8d Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '320e09ca-3edc-4869-80e2-6f86ee0c2986'} Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 320e09ca-3edc-4869-80e2-6f86ee0c2986 Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:56:36.381189 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 320e09ca-3edc-4869-80e2-6f86ee0c2986 could not be found. Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10b6def0-045f-48ae-9b3d-cfdb0212e7ba tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:56:36.387441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10b6def0-045f-48ae-9b3d-cfdb0212e7ba tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 404 len: 62 microversion: 2.1 time: 2.687848 Nov 02 11:56:36.396868 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 797/1599] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:33 2022] GET /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 62 bytes in 2699 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:56:36.400344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1132941806"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:36.403353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:36.421853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.422112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.423710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.424275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.425528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.425967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.659261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:36.685887 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bad46771-ab91-45ef-926a-8e2bda2b8514 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 0.583988 Nov 02 11:56:36.701312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 803/1600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:36 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:36.716115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:36.718357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:36.725599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.726622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.727345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.728510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.729448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.730088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.920729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:36.930413 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab5740af-841e-4d3a-a37b-70926ac91669 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1211 microversion: 2.1 time: 0.225237 Nov 02 11:56:36.943474 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 804/1601] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:36 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1211 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:36.957944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:36.957944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:36.963665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.964436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.965114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:36.966048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:36.967517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:36.968311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:37.055076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92f9fef1-924a-45c9-bfcb-bd926b4658d6 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "POST /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d/action" status: 202 len: 0 microversion: 2.1 time: 0.654247 Nov 02 11:56:37.058931 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 798/1602] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:56:36 2022] POST /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:56:37.100522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-426613f0-7948-44ae-b008-dbf0824ddb87 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b311fd30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:37.193003 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-426613f0-7948-44ae-b008-dbf0824ddb87 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 0.121181 Nov 02 11:56:37.202038 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 799/1603] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:37 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:37.276061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:37.309537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:37.312574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:37.319142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bf97539-b983-4f86-adee-a539453cc701 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.374136 Nov 02 11:56:37.320005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 805/1604] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:36 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:37.721688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:37.722537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:37.736568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:37.737332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:37.738541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:37.739620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:37.740295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:37.741885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:37.962856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:37.964057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:38.001393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:38.002060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:38.002997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:38.004582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:38.018697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:38.020946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:38.183733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:38.214869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd511021-1030-44b2-bee7-66fd871f3eb1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 0.496303 Nov 02 11:56:38.222515 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 800/1605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:37 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:38.237684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60a04089-70b3-475e-a8d7-4a4fa64e5933 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b314edc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:38.243676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:38.262887 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb03d80c-cd46-48cc-9cfa-80eef9608783 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1259 microversion: 2.1 time: 0.302923 Nov 02 11:56:38.298614 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 806/1606] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:37 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1259 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:38.361309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:38.362863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:38.382333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:38.384798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:38.385370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:38.388015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:38.388747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:38.390411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:38.604983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:38.615420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:38.619483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:38.628154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83083945-e30c-4726-9550-37a948a7744d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.274712 Nov 02 11:56:38.628942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 807/1607] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:38 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:56:39.245063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:39.247890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:39.254198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.262939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.263569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.265617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.267701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.268793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.832342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60a04089-70b3-475e-a8d7-4a4fa64e5933 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 1.613311 Nov 02 11:56:39.835569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 801/1608] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:38 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:39.848795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:39.850231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:39.855731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:39.861239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.863195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.864187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.865769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.866494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.866638 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8486bfde-7bb1-4323-ba9b-ec2b94f381d0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 0.625374 Nov 02 11:56:39.867266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.867800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 808/1609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:39 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:39.877152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9671e65-0441-47f2-aabc-2c3b9d75d998", "name": "network-vif-plugged", "status": "completed", "tag": "9f2865b3-4fce-4238-98ff-582aa1c59ce7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:39.901379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.902218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.903491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.927129 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] Creating event network-vif-plugged:9f2865b3-4fce-4238-98ff-582aa1c59ce7 for instance b9671e65-0441-47f2-aabc-2c3b9d75d998 on n-h1-855649-4 Nov 02 11:56:39.935967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6b091c40-4c01-4b14-a292-b105380ca500 req-d595354b-7951-4615-a0db-c67705777e77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062304 Nov 02 11:56:39.939562 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 809/1610] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:39.950172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:39.954651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:39.964374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.964874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.965323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:39.966105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:39.966626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:39.967364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:40.163757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:40.172360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04bf0a2c-3fc9-40a2-a37b-ce78854be5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1265 microversion: 2.1 time: 0.335291 Nov 02 11:56:40.179631 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 802/1611] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:39 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:40.180711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:40.192171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:40.194623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:40.202430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed075f23-8281-42cc-be8a-f1496688598d tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1544 microversion: 2.91 time: 0.261500 Nov 02 11:56:40.211785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 810/1612] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:39 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:40.856180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46f52c6a-4151-4747-b359-2357259240b7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b31083a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:40.904291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:40.909196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:40.952948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:40.955896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:40.967322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:40.971047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:40.977431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:40.978684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:40.996282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46f52c6a-4151-4747-b359-2357259240b7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 0.148221 Nov 02 11:56:41.004360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 803/1613] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:40 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:41.227012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:41.227012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:41.255544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:41.258269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:41.258945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:41.265201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:41.266270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:41.292157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:42.356734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:42.378355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e317f2f-be1f-4823-bcca-17aa752459c8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1265 microversion: 2.1 time: 1.169331 Nov 02 11:56:42.380494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:42.389266 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18d0a18a-a8da-400a-836c-e0cc6f818285 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1311 microversion: 2.1 time: 1.495124 Nov 02 11:56:42.391632 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 804/1614] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:41 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1265 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:42.393818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 811/1615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:40 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1311 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:56:42.408400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9bff810-bc06-4ddf-a290-fffc9ff75e16 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b8410f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:42.427571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:42.431372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:42.454405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:42.465626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:42.470627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:42.472190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:42.474541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:42.476508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:42.516126 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9bff810-bc06-4ddf-a290-fffc9ff75e16 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 0.112629 Nov 02 11:56:42.524654 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 812/1616] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:42 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:42.861090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:42.873817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:42.875401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:42.893803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-733f309e-43bf-4f44-9739-8faed625ed85 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1531 microversion: 2.91 time: 0.498609 Nov 02 11:56:42.894399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 805/1617] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:42 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1531 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:42.942822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:42.958197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:42.993472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:42.993970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.003853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.007575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:43.007575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.019430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.402727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] Lazy-loading 'services' on Instance uuid 407e51e2-f40d-4258-be51-6a74e9714a52 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:56:43.413540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:43.414172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:43.433818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:43.435271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.436102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.437796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:43.438653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.439321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.465607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1e25837-dc41-42b7-879a-28118984cc2f tempest-UnshelveToHostMultiNodesTest-401639404 tempest-UnshelveToHostMultiNodesTest-401639404-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1936 microversion: 2.91 time: 0.531487 Nov 02 11:56:43.467964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 813/1618] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:42 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1936 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:43.482576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:43.487544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:43.516987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:43.516987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.516987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.516987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:43.516987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:43.521094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:43.969395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:43.978011 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2254ad44-2c9b-4aaa-9b01-dfeabf5c0900 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.569499 Nov 02 11:56:43.990717 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 806/1619] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:43 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:43.996540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:44.012582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85dda785-ca15-43b8-b145-c221eb9a7045 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b31a8b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:44.177434 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85dda785-ca15-43b8-b145-c221eb9a7045 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 0.185443 Nov 02 11:56:44.185466 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 807/1620] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:43 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:44.191135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:44.216272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:44.261147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:44.261654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:44.278421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:44.279357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:44.279860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:44.280317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:44.422143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:56:44.873487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:44.901993 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afcee334-411b-4eeb-b0e9-2a2f15214e3c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1494 microversion: 2.1 time: 1.432292 Nov 02 11:56:44.913646 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 814/1621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:43 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1494 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:45.069304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c991b56-63d1-4afc-b280-362bbdbe6888 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "DELETE /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 204 len: 0 microversion: 2.91 time: 0.882338 Nov 02 11:56:45.070087 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 808/1622] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:56:44 2022] DELETE /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:56:45.076270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:45.077277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:45.103680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.105543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.107048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:45.109006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.113821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.117476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:45.401130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:45.404981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:45.421295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.426302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.430917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:45.430917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.430917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.439918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:45.499872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:45.903672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:45.918474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47de79d4-a787-4aa9-a670-54a69f1ef874 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.846863 Nov 02 11:56:45.925263 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 809/1623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:45 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:45.953351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:45.953351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:45.964327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.964830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.965277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:45.970598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:45.971072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:45.971528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:46.000981 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-743a1571-2c41-4f8d-af77-92fe77734161 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1645 microversion: 2.1 time: 1.058426 Nov 02 11:56:46.004135 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 815/1624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:44 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1645 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:46.018741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75d552cf-8317-4568-8b1e-e60f61466196 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b3e22670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:46.190302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:46.204388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:46.206258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f502ff21451342df8c8ba71e6d893b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a79df55f6bd4c42a4b44c9180370c53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:46.219742 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa802966-ffc9-4c92-907f-85305c62d7d9 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 200 len: 1537 microversion: 2.91 time: 0.292964 Nov 02 11:56:46.241892 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 810/1625] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:45 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 1537 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:56:46.247191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-plugged", "status": "completed", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:46.277250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:46.281546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:46.282713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:46.314099 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] Creating event network-vif-plugged:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:56:46.325592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a208b863-4d8d-4f31-a35f-8952c14a146a req-fb3a452d-ab21-4b16-815f-856d16560b60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081969 Nov 02 11:56:46.332919 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 811/1626] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:46.356550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:46.361778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:46.389800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:46.390296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:46.390732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:46.391467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:46.401230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:46.403032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:46.872857 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f7f8d71-f956-4085-8a94-f2636841366d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1645 microversion: 2.1 time: 0.536067 Nov 02 11:56:46.873526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 812/1627] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:46 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1645 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:46.886353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76336a1f-b324-432e-88e3-38d43e8c0160", "tag": "244e718d-bb3d-4ca9-9e92-744898c3211f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:46.948627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:46.950045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:46.952467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:46.997895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] Creating event network-changed:244e718d-bb3d-4ca9-9e92-744898c3211f for instance 76336a1f-b324-432e-88e3-38d43e8c0160 on n-h2-855649-4 Nov 02 11:56:47.022074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7eff15fa-2175-44fe-81c7-aa47434a2dcb req-bf81e39c-b003-457d-abed-9a3721b4e8b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142296 Nov 02 11:56:47.030554 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 813/1628] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:47.030554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:47.047734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.048237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.048685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.049444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.049898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.050325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.067741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:47.133191 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b1355a9-a38b-44eb-aeb5-9e4d4c854795 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.107162 Nov 02 11:56:47.135810 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 814/1629] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:56:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:56:47.143450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:47.144716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:47.155797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.156674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.157337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.161529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.162588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.166148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.637343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:56:47.649702 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4a4465f-e6aa-4b99-90ef-53eacc8d2c50 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.509941 Nov 02 11:56:47.651706 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 815/1630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:56:47 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:56:47.667192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:47.684479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:47.727646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.728455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.729093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.730642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:47.735478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:47.736155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:47.843643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lazy-loading 'flavor' on Instance uuid b9671e65-0441-47f2-aabc-2c3b9d75d998 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:56:47.882510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:56:52.978127 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c65c1d9-515f-40b2-a3d7-357972980063 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998/action" status: 202 len: 0 microversion: 2.1 time: 5.325026 Nov 02 11:56:52.979736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 816/1631] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:56:47 2022] POST /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:56:52.985122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:56:52.985939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] [instance: 407e51e2-f40d-4258-be51-6a74e9714a52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:56:52.998770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:52.999315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:52.999760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:53.000519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:56:53.011737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:56:53.012518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:56:53.042288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] HTTP exception thrown: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Request method failure captured: Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 HTTP/1.1 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlo4zfbI6dB7msdzm-nbzXCxswQzULn3v-sUohtBumpaEr_GRWE1pl9QXQrb6_d9g-F6AyL9nLqzX2vrpqSbDduPdzfvJGr0V2z-CQG7HbrYnvWumunfko_pAGo_-n4qMGm_kIG6s44YQ1WtRQJLQLRU-z29RwMwPM_cmgyJcC_enp8 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0a79df55f6bd4c42a4b44c9180370c53 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1738105851 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a79df55f6bd4c42a4b44c9180370c53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0a79df55f6bd4c42a4b44c9180370c53", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0a79df55f6bd4c42a4b44c9180370c53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0a79df55f6bd4c42a4b44c9180370c53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1738105851 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0a79df55f6bd4c42a4b44c9180370c53 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1738105851 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-UnshelveToHostMultiNodesTest-1738105851-project Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f502ff21451342df8c8ba71e6d893b97 Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1738105851-project Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '407e51e2-f40d-4258-be51-6a74e9714a52'} Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. Nov 02 11:56:53.044069 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. Nov 02 11:56:53.049486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:56:53.060147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] Returning 404 to user: Instance 407e51e2-f40d-4258-be51-6a74e9714a52 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:56:53.061416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c1dbcb5-e190-42f1-a5b6-ed65a475e646 tempest-UnshelveToHostMultiNodesTest-1738105851 tempest-UnshelveToHostMultiNodesTest-1738105851-project] 10.222.0.48 "GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52" status: 404 len: 111 microversion: 2.91 time: 0.080565 Nov 02 11:56:53.065692 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 817/1632] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:56:52 2022] GET /compute/v2.1/servers/407e51e2-f40d-4258-be51-6a74e9714a52 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:56:53.185698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-571657024", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1e3154fb-1823-4dc2-b516-a95f79d74986"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:56:55.421261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:55.995314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=88 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:56:57.067736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:02.259864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75d552cf-8317-4568-8b1e-e60f61466196 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1429 microversion: 2.1 time: 16.251523 Nov 02 11:57:02.267620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 816/1633] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:56:46 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1429 bytes in 16261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:02.279217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:02.279796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] validate_networks() for [('1e3154fb-1823-4dc2-b516-a95f79d74986', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:02.280261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:02.287542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:02.288584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:02.289221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:02.290162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:02.290770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:02.291420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:02.547027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:02.562196 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f614a73-0691-4115-90b0-c69d8cdb9320 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.295230 Nov 02 11:57:02.568166 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 817/1634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:02 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:02.574860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:02.575740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:02.586174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:02.586960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:02.587581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:02.589736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:02.590375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:02.591233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:02.934496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:02.951385 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d72e9302-e1c5-43bd-939c-6b4135420aa3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1504 microversion: 2.1 time: 0.380257 Nov 02 11:57:02.951990 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 818/1635] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:02 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:02.956565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9671e65-0441-47f2-aabc-2c3b9d75d998", "name": "network-vif-unplugged", "status": "completed", "tag": "9f2865b3-4fce-4238-98ff-582aa1c59ce7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:02.966867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:02.967724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:02.968324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:02.983487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] Creating event network-vif-unplugged:9f2865b3-4fce-4238-98ff-582aa1c59ce7 for instance b9671e65-0441-47f2-aabc-2c3b9d75d998 on n-h1-855649-4 Nov 02 11:57:02.989775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5ed361f3-68e1-4d94-b110-92966021ed1b req-6f232b69-e71b-4418-9d4b-db2171f2a784 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036592 Nov 02 11:57:02.990935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 819/1636] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:02.996541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76336a1f-b324-432e-88e3-38d43e8c0160", "name": "network-vif-plugged", "status": "completed", "tag": "244e718d-bb3d-4ca9-9e92-744898c3211f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:03.006661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.007798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.008401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.021456 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] Creating event network-vif-plugged:244e718d-bb3d-4ca9-9e92-744898c3211f for instance 76336a1f-b324-432e-88e3-38d43e8c0160 on n-h2-855649-4 Nov 02 11:57:03.026733 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ce80ec76-8e45-4042-a9bf-a50f264dfb3d req-7df54a50-9bc2-486a-913e-da385f20513d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Nov 02 11:57:03.027574 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 820/1637] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:03.042800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:03.222091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:03.284796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:03.285974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:03.286434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:03.286938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:03.287636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:03.307376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.308002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.308606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.315967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.316812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.317489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.318402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e4de7c6-29bf-4c96-9618-2d3b44ded1cb tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Action: 'create', calling method: .version_select at 0x7ff1b3df0e50>, body: {"keypair": {"name": "tempest-keypair-660485653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqk23TUFlglky8M/O9u5R3VS6Nkw2kWYG++PpESL5n5Xyu7c/WSGdyyh0SK1d1cVWjCHltFurnWAyE95IDVuy+7llxJe/cRoxKibmk9H4tsJkRzacEu1LczlfTm68zFwg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:03.340569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e4de7c6-29bf-4c96-9618-2d3b44ded1cb tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Getting quotas for project 362be4a089a242e9aed574854f849ee8. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:03.344714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Getting quotas for project 97f3df4d86624fb099055183e4046e0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:03.349516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5e4de7c6-29bf-4c96-9618-2d3b44ded1cb tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Getting quotas for user dca67dc2c5a744fe9575a2fa01d4be58 and project 362be4a089a242e9aed574854f849ee8. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:03.352654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Getting quotas for user a10791601b7f44cea5752c01781f3be9 and project 97f3df4d86624fb099055183e4046e0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:03.386336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Going to run 2 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:03.389866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 2d4bf562-7c86-492b-9d0a-8d75ce69733f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:03.495264 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e4de7c6-29bf-4c96-9618-2d3b44ded1cb tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.466158 Nov 02 11:57:03.501468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 821/1638] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:57:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:03.501615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02e93e83-003b-40d2-b985-c80e1ea60dda tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b35cd8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:03.552097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=2d4bf562-7c86-492b-9d0a-8d75ce69733f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:03.581782 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02e93e83-003b-40d2-b985-c80e1ea60dda tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1438 microversion: 2.1 time: 0.083570 Nov 02 11:57:03.584790 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 822/1639] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:03 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:03.598451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:03.601448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:03.611402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.612254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.612947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.614593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.615886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.616514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.727182 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9546d0fa-11a1-4b2e-9596-318e09e2dd7e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.659946 Nov 02 11:57:03.728655 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 818/1640] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 10662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:57:03.739163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d853f9b-aa24-4c3a-a7ef-50a71e38adef tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b30cef70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:03.821992 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d853f9b-aa24-4c3a-a7ef-50a71e38adef tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 200 len: 1438 microversion: 2.1 time: 0.091707 Nov 02 11:57:03.822590 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 819/1641] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:03 2022] GET /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:03.848386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:03.856113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:03.859177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Searching by: {'deleted': False, 'project_id': '97f3df4d86624fb099055183e4046e0b'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:57:03.883292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.884116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.890357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.890357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:03.890357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:03.890357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:03.997991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96ec2d71-8646-4797-bfe8-45936d9b0f66 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.155967 Nov 02 11:57:04.007836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 820/1642] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:57:03 2022] GET /compute/v2.1/servers => generated 675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:04.013276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:04.015733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:04.024129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:04.025551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:04.025551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:04.026439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:04.027239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:04.027850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:04.091354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:04.102054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd099d22-372d-4ad5-9207-41a83e0b5668 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.512053 Nov 02 11:57:04.115448 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 823/1643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:03 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:04.125718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:04.131914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:04.133717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:04.134400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:04.135023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:04.135894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:04.136511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:04.137096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:04.681928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:04.692523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b388461-4964-4b70-b286-8da52be40716 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1466 microversion: 2.1 time: 0.689662 Nov 02 11:57:04.697379 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 821/1644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:04 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1466 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:04.728358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5a87d31-5aa5-43b3-bbe5-976466a8be3d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:04.728358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5a87d31-5aa5-43b3-bbe5-976466a8be3d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:04.787899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:04.802098 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e8166e1-01d5-4b64-b38e-19c44b05bc95 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1504 microversion: 2.1 time: 0.685369 Nov 02 11:57:04.803137 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 824/1645] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:04 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1504 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:04.813310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b70d809d-fbfe-4469-a1e9-03228074e11e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b399ba60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:04.814580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5a87d31-5aa5-43b3-bbe5-976466a8be3d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:04.825041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5a87d31-5aa5-43b3-bbe5-976466a8be3d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1219 microversion: 2.1 time: 0.103870 Nov 02 11:57:04.825910 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 822/1646] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:04 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:05.062342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9671e65-0441-47f2-aabc-2c3b9d75d998", "tag": "9f2865b3-4fce-4238-98ff-582aa1c59ce7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:05.147076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:05.148322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:05.149698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:05.170435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] Creating event network-changed:9f2865b3-4fce-4238-98ff-582aa1c59ce7 for instance b9671e65-0441-47f2-aabc-2c3b9d75d998 on n-h1-855649-4 Nov 02 11:57:05.179384 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3d11cf7d-158a-4d6a-9ba4-856bbf9cc6d6 req-6baf2e57-7890-4087-88ac-a2ebb13b0af0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135840 Nov 02 11:57:05.180985 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 823/1647] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:05.202311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:05.204691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:05.214763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:05.216514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:05.217153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:05.218230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:05.218858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:05.219640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:05.888336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:05.899920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b68618f3-66e5-4f9b-89f9-4f1dcd04c8a1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1307 microversion: 2.1 time: 0.716489 Nov 02 11:57:05.901176 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 824/1648] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:05 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1307 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:05.909790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:05.910655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:05.918513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:05.919541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:05.920175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:05.921064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:05.921690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:05.922342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:06.739785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:06.782024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1144c07-b62e-4d31-9165-5a13745ba5ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1504 microversion: 2.1 time: 0.879372 Nov 02 11:57:06.783307 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 825/1649] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:05 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1504 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:06.794884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62ffe19b-17d3-42b3-8e0b-70e444d15950 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:06.796246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62ffe19b-17d3-42b3-8e0b-70e444d15950 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:06.937840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62ffe19b-17d3-42b3-8e0b-70e444d15950 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:06.948446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62ffe19b-17d3-42b3-8e0b-70e444d15950 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1219 microversion: 2.1 time: 0.162932 Nov 02 11:57:06.951193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 826/1650] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:06 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:06.962959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-unplugged", "status": "completed", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:06.976194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:06.977097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:06.977760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:06.994169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] Creating event network-vif-unplugged:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:57:07.001456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-da9c0175-c68e-460d-8ef5-3bbc18624b83 req-513b485b-6cc7-4252-9b99-a52dc028bcda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047775 Nov 02 11:57:07.002407 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 827/1651] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:07.015236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:07.016149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:07.025705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:07.026585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:07.027316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:07.028254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:07.029006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:07.029661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:07.502309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:07.504809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b70d809d-fbfe-4469-a1e9-03228074e11e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "DELETE /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1" status: 204 len: 0 microversion: 2.1 time: 2.699552 Nov 02 11:57:07.505548 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 825/1652] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:04 2022] DELETE /compute/v2.1/images/ee86e1c1-beed-437b-af20-c9da802307a1 => generated 0 bytes in 2702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:57:07.511170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad96fa15-67f5-4e43-9118-e13bb5f9a847 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1486 microversion: 2.1 time: 0.505974 Nov 02 11:57:07.512121 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 828/1653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:07 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:07.514188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bca5a16a-6f58-45c4-9a70-2aa107c4bd1a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '.version_select at 0x7ff1b37cde50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:07.536653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:07.543344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:07.543830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:07.544263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:07.569839 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bca5a16a-6f58-45c4-9a70-2aa107c4bd1a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] HTTP exception thrown: Image not found. Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bca5a16a-6f58-45c4-9a70-2aa107c4bd1a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Request method failure captured: Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 HTTP/1.1 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqlKmq9OdBgmXA5Mz_VYJRYhmtOIDhatOMLoyxQ8TCjk7H8PMensTgc-_hXHcuJy1SZsPuxaU8DoTl1Q6nbp3gqRsiqYk1sLG3_o0zNF1xzI5Jca3v5Z1WmyMZwnIaG1dCpLD1aDtRHL6kFQbBfbWuOjLoDOWSLjwkCFeVg4yVLBAQ Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0861126d143b41e1aca61a5e6c5c5e6d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c8481204674b4e47911ca5dbfbf9ea8d Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '320e09ca-3edc-4869-80e2-6f86ee0c2986'} Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 320e09ca-3edc-4869-80e2-6f86ee0c2986 to delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 320e09ca-3edc-4869-80e2-6f86ee0c2986 could not be found. Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.599709 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:57:07.604999 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:07.607849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bca5a16a-6f58-45c4-9a70-2aa107c4bd1a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:57:07.608932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bca5a16a-6f58-45c4-9a70-2aa107c4bd1a tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "DELETE /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986" status: 404 len: 62 microversion: 2.1 time: 0.099299 Nov 02 11:57:07.611671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 826/1654] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:07 2022] DELETE /compute/v2.1/images/320e09ca-3edc-4869-80e2-6f86ee0c2986 => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:57:07.621158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 11:57:07.623885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:07.628729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:07.643793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:07.644240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:07.645256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:07.650880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:07.653384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:07.653836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:07.703580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:57:08.091957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46d72933-b464-4c57-bef8-d34900af267c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160/action" status: 202 len: 0 microversion: 2.1 time: 0.560081 Nov 02 11:57:08.097669 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 829/1655] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:57:07 2022] POST /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:57:08.104124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:08.104973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:08.111700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.112270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.116070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.116070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.116070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.116070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.353037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:08.362763 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d4005e6-7827-4c6f-b137-10019de15cbe tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1504 microversion: 2.1 time: 0.263047 Nov 02 11:57:08.371652 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 830/1656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:08 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:08.377423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:08.381141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:08.385001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.385518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.386018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.386716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.387250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.387679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.456015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bab0d92d-d7f7-4cdf-9343-2a786edcce1e tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 204 len: 0 microversion: 2.1 time: 0.837697 Nov 02 11:57:08.456621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 827/1657] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:57:07 2022] DELETE /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:57:08.475893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:08.479420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:08.490080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:08.504902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.506130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.506728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.508928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.510851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.516403 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff04935b-4e09-4048-a085-02af963c1923 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1215 microversion: 2.1 time: 0.143530 Nov 02 11:57:08.517188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.520231 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 831/1658] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:08 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:08.538916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-643388760", "imageRef": "edb83522-25d7-4178-9357-8787d4c206ca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cf32e8a9-b03b-43cc-8e4c-01aa0ee3deab"}], "security_groups": [{"name": "tempest-securitygroup--1368206822"}], "key_name": "tempest-keypair-660485653", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:08.713812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] validate_networks() for [('cf32e8a9-b03b-43cc-8e4c-01aa0ee3deab', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:08.842058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:08.856559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e90573ff-9447-4dd1-9462-5f5902b90a69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.392396 Nov 02 11:57:08.871010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 828/1659] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:08 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:08.871010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:08.871010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:08.874060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.874891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.875647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:08.876717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:08.877376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:08.877869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.189481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:09.200301 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4506ce6-e2bb-4583-8845-572400088905 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1472 microversion: 2.1 time: 0.339154 Nov 02 11:57:09.201510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 829/1660] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:08 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:09.379239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:09.379971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:09.380145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:09.380774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:09.381392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:09.400674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:09.400674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:09.407181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.407645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.408092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.408840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.409300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.409731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.416728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.417233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.417675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.418398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.418857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.419418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.474782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Getting quotas for project 362be4a089a242e9aed574854f849ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:09.485760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Getting quotas for user dca67dc2c5a744fe9575a2fa01d4be58 and project 362be4a089a242e9aed574854f849ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:09.525236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:09.529781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='edb83522-25d7-4178-9357-8787d4c206ca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:09.728048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:09.744873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1da883c5-1fbe-4bca-bbe9-7dfe28d111f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1494 microversion: 2.1 time: 0.353549 Nov 02 11:57:09.747082 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 830/1661] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:09 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:09.754298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:09.756064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:09.763440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.764353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.765174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.766660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.767399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.768274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.808877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97efa4f6-e9d2-4b8b-92ef-de992a1559e0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.287175 Nov 02 11:57:09.811354 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 832/1662] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:57:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:57:09.824655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22e7e7cc-a09f-4fb1-a398-5cf1f1e7701f tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '.version_select at 0x7ff1b314e4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:09.840556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22e7e7cc-a09f-4fb1-a398-5cf1f1e7701f tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.843017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22e7e7cc-a09f-4fb1-a398-5cf1f1e7701f tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.843607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22e7e7cc-a09f-4fb1-a398-5cf1f1e7701f tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.874920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:09.882156 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22e7e7cc-a09f-4fb1-a398-5cf1f1e7701f tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.069445 Nov 02 11:57:09.887623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 833/1663] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:57:09 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:09.893400 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ce5e15a-361d-4dcb-9b3b-c6e6c5f4765d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1271 microversion: 2.1 time: 0.143979 Nov 02 11:57:09.895500 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 831/1664] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:09 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:09.905494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:09.906116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:09.906788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29e545cb-7f9c-40a6-b717-b6a635319efe tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:09.907916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29e545cb-7f9c-40a6-b717-b6a635319efe tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:09.927996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.928484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.928927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:09.929626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:09.930080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:09.930533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:10.041732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29e545cb-7f9c-40a6-b717-b6a635319efe tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:10.047785 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29e545cb-7f9c-40a6-b717-b6a635319efe tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1244 microversion: 2.1 time: 0.153693 Nov 02 11:57:10.049319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 834/1665] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:09 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1244 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:10.056090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:10.057017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:10.081275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:10.308645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:10.324726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ffa69cc-3a05-4b02-a7d6-3495e4636747 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.428082 Nov 02 11:57:10.333600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 832/1666] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:09 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:10.342686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:10.343958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:10.358042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:10.358042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:10.359092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:10.359814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:10.360433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:10.361104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:10.712296 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64269815-a2e2-425c-9837-7d34cc523af7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1645 microversion: 2.1 time: 0.660141 Nov 02 11:57:10.713904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 835/1667] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:10 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1645 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:10.921457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-249945253", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "187618f9-0ea2-4688-b320-9ee5aae0805b"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:11.016940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] validate_networks() for [('187618f9-0ea2-4688-b320-9ee5aae0805b', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:11.341285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:11.356044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-399b59e4-a4a1-4215-90b8-77c6c14ff2ce tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1472 microversion: 2.1 time: 1.027493 Nov 02 11:57:11.356956 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:10 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1472 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:11.361762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:11.371744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:11.393828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:11.396516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:11.397907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:11.413666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:11.415138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:11.416124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:11.570110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:11.584296 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7459e1e6-2033-40bc-b027-7b146249cfae tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1279 microversion: 2.1 time: 0.225897 Nov 02 11:57:11.585171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 834/1669] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:11 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:11.601564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-228dafe4-3f3c-4fd2-9474-ff86244be1c0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:11.602878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-228dafe4-3f3c-4fd2-9474-ff86244be1c0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:11.726229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-228dafe4-3f3c-4fd2-9474-ff86244be1c0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:11.733807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-228dafe4-3f3c-4fd2-9474-ff86244be1c0 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1244 microversion: 2.1 time: 0.147480 Nov 02 11:57:11.734401 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 835/1670] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:11 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1244 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:11.741993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:11.742887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:11.763525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.356219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:12.361890 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0263b630-0389-42d2-bde4-796d3cfbade4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.625858 Nov 02 11:57:12.362598 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 836/1671] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:11 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:12.393748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:12.394954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:12.404738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.423111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.424428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.425834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.426505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.427145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.603258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:12.607815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:12.608899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:12.609708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:12.610932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:12.624434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.624928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.625371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.626113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.626593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.627075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.648605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:12.654251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for user 29699172e95148b99d076a8bcfc09668 and project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:12.671960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:12.675409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:12.748827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:12.758551 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3be5d599-17ae-4854-ae89-f5628796e2c7 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1472 microversion: 2.1 time: 0.370591 Nov 02 11:57:12.759479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 837/1672] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:12 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:12.767922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:12.769071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:12.779386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.779985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.781043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.786347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.786861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.787371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.797144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:12.874183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:12.882651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89416c3f-7611-42c3-a75a-7757c98c5ec4 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1277 microversion: 2.1 time: 0.121314 Nov 02 11:57:12.885381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 838/1673] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:12 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:12.888379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:12.889480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:12.896704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.897385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.898062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.899240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.899690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.900117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:12.968667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:12.977107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54f00a4b-0a12-4d99-b3d4-d20f350b00d4 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1248 microversion: 2.1 time: 0.092770 Nov 02 11:57:12.977697 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 839/1674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:12 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:12.982520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d", "name": "network-vif-deleted", "tag": "c3e637e6-612c-4bb3-924d-3e7b92450e69"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:12.992252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:12.992737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:12.993171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.005415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] Creating event network-vif-deleted:c3e637e6-612c-4bb3-924d-3e7b92450e69 for instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d on n-h1-855649-4 Nov 02 11:57:13.011299 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-649705dd-3eb9-4a8c-be4b-3a47ee979c33 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095774 Nov 02 11:57:13.012323 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 836/1675] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:57:13.013494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2b314f16-ee7b-4d70-b414-5e950e1e437a req-1440b166-ee4c-4b17-aaf5-ec19e59e1a3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034588 Nov 02 11:57:13.014580 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 840/1676] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:13.025605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48b69a37-a472-44fc-8eb7-441010bead69 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:13.026750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48b69a37-a472-44fc-8eb7-441010bead69 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:13.138464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48b69a37-a472-44fc-8eb7-441010bead69 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:13.202372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48b69a37-a472-44fc-8eb7-441010bead69 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1210 microversion: 2.1 time: 0.173622 Nov 02 11:57:13.219723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 837/1677] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:13 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1210 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:13.395171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:13.399820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:13.418603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.420653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.423297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.424601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.426337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.426599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.782910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.800542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.834894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:13.844780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c46e9f0a-123b-4b27-a77e-d0eb24e3b6f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.457137 Nov 02 11:57:13.848417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 841/1678] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:13 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:13.854801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.857924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.857924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.857924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lazy-loading 'fault' on Instance uuid d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:57:13.902654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8481204674b4e47911ca5dbfbf9ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0861126d143b41e1aca61a5e6c5c5e6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:13.911432 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1904f702-445f-4aad-8d29-916f7e951194 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 200 len: 1307 microversion: 2.1 time: 0.133067 Nov 02 11:57:13.912047 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 838/1679] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:13 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:13.912700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:13.913734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:13.922149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.923617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.923617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:13.924902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:13.925978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:13.926623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.003029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:14.003703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:14.027658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.029734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.032354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.035571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.036313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.038493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.166326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:14.175142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1071f77b-b402-46fb-80ad-c412ee4de286 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1296 microversion: 2.1 time: 0.178120 Nov 02 11:57:14.176105 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 839/1680] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:13 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:14.234092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81b97419-ae99-45f6-b78a-48e995554570 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:14.234754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81b97419-ae99-45f6-b78a-48e995554570 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:14.257315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:14.323885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81b97419-ae99-45f6-b78a-48e995554570 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:14.329478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:14.333324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81b97419-ae99-45f6-b78a-48e995554570 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1210 microversion: 2.1 time: 0.102907 Nov 02 11:57:14.337477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 840/1681] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:14 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:14.351147 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a79c6566-e245-4670-8aa9-ef1c9b47cb9f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 0.441285 Nov 02 11:57:14.351147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 842/1682] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:13 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:14.872115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:14.873483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:14.883725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.885884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.886573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.889041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.889818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.891285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.934526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:14.936153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] [instance: d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:14.950672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.951358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.951902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.954697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:14.955338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:14.956018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:14.975860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] HTTP exception thrown: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Request method failure captured: Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d HTTP/1.1 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqlKmq9OdBgmXA5Mz_VYJRYhmtOIDhatOMLoyxQ8TCjk7H8PMensTgc-_hXHcuJy1SZsPuxaU8DoTl1Q6nbp3gqRsiqYk1sLG3_o0zNF1xzI5Jca3v5Z1WmyMZwnIaG1dCpLD1aDtRHL6kFQbBfbWuOjLoDOWSLjwkCFeVg4yVLBAQ Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0861126d143b41e1aca61a5e6c5c5e6d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0861126d143b41e1aca61a5e6c5c5e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0861126d143b41e1aca61a5e6c5c5e6d Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1686610210 Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c8481204674b4e47911ca5dbfbf9ea8d Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerTestJSON-1686610210-project Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d'} Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:14.977871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. Nov 02 11:57:14.982196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:14.984407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] Returning 404 to user: Instance d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:57:14.985892 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f947f60d-7d36-45ea-bf62-04e30296a3d9 tempest-ImagesOneServerTestJSON-1686610210 tempest-ImagesOneServerTestJSON-1686610210-project] 10.222.0.48 "GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d" status: 404 len: 111 microversion: 2.1 time: 0.055943 Nov 02 11:57:14.993718 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 843/1683] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:14 2022] GET /compute/v2.1/servers/d4cbc5ea-ebc0-4c3d-a81d-b51506d7a98d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:57:15.201852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:15.204144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:15.212678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.213535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.214076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.215387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.216100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.216627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.345226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:15.361571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:15.365921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ba5ebe0-4ea1-481f-be0a-34d1a14a3c27 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1304 microversion: 2.1 time: 0.167056 Nov 02 11:57:15.388192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 844/1684] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:15 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:15.398561 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2eb80df-ec57-48dd-a3bf-7d66b055100d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.530131 Nov 02 11:57:15.400750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:15.402719 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 841/1685] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:14 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:15.403245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:15.421886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.421886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.421886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.421886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.423880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:15.429455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:15.430571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.431917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.451575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.458771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.459460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.464195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:15.464704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:15.465159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:15.731792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:15.760046 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0291dc2-da6a-4502-894d-53899ce1c57e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1214 microversion: 2.1 time: 0.370975 Nov 02 11:57:15.761385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 845/1686] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:15 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:15.943286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:15.943286 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dea0247-678a-4b59-bdb1-8738e007e36b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 0.479131 Nov 02 11:57:15.943286 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 842/1687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:15 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:16.410299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:16.411737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:16.431733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.432894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.443457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.459262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.460048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.460823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.525512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91bd107-963a-492e-b226-568de002ac41", "tag": "1ff30a54-3c01-405c-b8de-301ab1a2634c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:16.569374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.571052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.573549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.613535 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] Creating event network-changed:1ff30a54-3c01-405c-b8de-301ab1a2634c for instance c91bd107-963a-492e-b226-568de002ac41 on n-h1-855649-4 Nov 02 11:57:16.633212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-66a7130c-d622-4923-a669-984f03e7efe2 req-57a81d97-0eec-4a15-becc-073844ef3642 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377929 Nov 02 11:57:16.634672 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 846/1688] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:16.653570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:16.656590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:16.681881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.684908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.686355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.687350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.689270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.690080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.792842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:16.797403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:16.821031 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16115042-e2a7-4883-8788-40a70d3e3e65 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1302 microversion: 2.1 time: 0.416117 Nov 02 11:57:16.824247 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 843/1689] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:16 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1302 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:16.846472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4bf562-7c86-492b-9d0a-8d75ce69733f", "tag": "85ea31a7-1e9b-4b31-817d-e4a09d599f1a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:16.874062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.876088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.876646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.913175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] Creating event network-changed:85ea31a7-1e9b-4b31-817d-e4a09d599f1a for instance 2d4bf562-7c86-492b-9d0a-8d75ce69733f on n-h1-855649-4 Nov 02 11:57:16.926807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-46aaa9a4-52e7-4956-9e61-e8fb132975cb req-a69c8e86-3c93-4b0f-9249-e587f1a5ceb9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099997 Nov 02 11:57:16.933027 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 844/1690] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:16.951856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:16.962276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:16.965717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.966825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.967614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:16.968914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:16.969561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:16.970409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.012000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:57:17.520295 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d9bb63f-2300-4d02-93c6-456d5d607682 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 204 len: 0 microversion: 2.1 time: 0.588574 Nov 02 11:57:17.521207 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 845/1691] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:57:16 2022] DELETE /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:57:17.528055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:17.530645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:17.536508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.537306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.537991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.538904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.539551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.540142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.794102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:17.797207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:17.804504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ed63c58-6ad7-4ddc-8098-fe68284120f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 1.168364 Nov 02 11:57:17.808521 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 847/1692] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:16 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:17.819748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:17.820602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:17.823399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e7dc684-0fae-4dab-b3d0-16e491226999 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1262 microversion: 2.1 time: 0.300563 Nov 02 11:57:17.831179 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 846/1693] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:17 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1262 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:17.831179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:17.831179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:17.834067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.834564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.835030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.835751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.836210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.836641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.838109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.838661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.839206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:17.840178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:17.840841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:17.841467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.693514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:18.702153 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c96c593-a73b-4fe2-84b9-48de81db6746 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1664 microversion: 2.1 time: 0.876783 Nov 02 11:57:18.708440 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 847/1694] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:17 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1664 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:18.708957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:18.709084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:18.709084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:18.715055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.715764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.716383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.717280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.718061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.718656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.727835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60b5a6c5-ec83-4fc6-bcdf-928878dd8672 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 0.917890 Nov 02 11:57:18.728437 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 848/1695] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:17 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:18.826629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:18.835234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:18.836565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:18.848937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.849727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.850463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.851452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.852206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.854210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.856102 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c472cd34-c216-4898-8bb4-3e106f66c5dd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1302 microversion: 2.1 time: 0.150058 Nov 02 11:57:18.857033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 848/1696] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:18 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1302 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:18.874484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:18.875585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:18.883889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.885089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.886882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:18.889943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:18.890619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:18.893322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:19.148192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:19.168393 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-979f0318-7566-422c-85f0-b8aa1c38b193 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1262 microversion: 2.1 time: 0.310012 Nov 02 11:57:19.170014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 849/1697] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:18 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1262 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:19.733261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:19.734006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:19.755739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:19.756356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:19.756907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:19.757753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:19.758315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:19.758877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.121523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:20.134996 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1896927d-2455-4065-a2fc-46f72bd9c0cc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 1.304181 Nov 02 11:57:20.136253 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 849/1698] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:18 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:20.143389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:20.144811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:20.168252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.168996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:20.169604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.170675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.171171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:20.171601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.554662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:20.574214 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a91401f-24f9-46ef-b16a-2e9353a1143b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1664 microversion: 2.1 time: 0.845132 Nov 02 11:57:20.578067 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 850/1699] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:19 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1664 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:20.608755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:20.611747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:20.644805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.645726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:20.650924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.654189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.654764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:20.660869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.940225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:20.954049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9f5b648-0a8d-4c3d-a30d-5349e15b196f tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 0.816418 Nov 02 11:57:20.956944 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 850/1700] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:20 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:20.977984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:20.982124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:20.988788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.991659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:20.996062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:20.998612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:20.999404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:21.000141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:21.515431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:21.525796 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-332e6310-33bc-45c4-bfe4-b047a0992052 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1268 microversion: 2.1 time: 0.569241 Nov 02 11:57:21.532292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 851/1701] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:20 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1268 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:21.547078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:21.547804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:21.555631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:21.556474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:21.557084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:21.558116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:21.558860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:21.559528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:21.733041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:22.341597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:22.374009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c199dd0-3118-4b73-9fcc-6afa1699b770 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 1.793515 Nov 02 11:57:22.375500 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 851/1702] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:20 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:22.384136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:22.384136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:22.392575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:22.393416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:22.394718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:22.397823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:22.399599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:22.400325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:22.617894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:22.638365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:22.642044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-567e1f7c-968f-44ee-97e7-4fcdb17d6d5b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 1.107879 Nov 02 11:57:22.663040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 852/1703] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:21 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:22.698027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:22.699283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:22.721044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:22.721869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:22.723436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:22.724363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:22.725077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:22.726651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:23.629416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:23.646520 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f6055f7-f711-43ee-abbe-3986d2cb7413 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1664 microversion: 2.1 time: 1.269082 Nov 02 11:57:23.648435 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 852/1704] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:22 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1664 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:23.671627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:23.674248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:23.706108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:23.706949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:23.707591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:23.708724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:23.709329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:23.711349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:24.102848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:24.115500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e82f94c9-193d-4cc0-9a60-cf05ed55626e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 1.451039 Nov 02 11:57:24.119305 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 853/1705] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:22 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:24.142353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:24.143225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:24.164989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:24.169079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:24.169505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:24.173377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:24.174133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:24.174561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:24.184651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:24.198628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fdbea2eb-7b66-4a77-b6db-889ce1a33f81 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1268 microversion: 2.1 time: 0.548725 Nov 02 11:57:24.217789 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 853/1706] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:23 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1268 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:24.232405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:24.233182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:24.255884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:24.261460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:24.261460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:24.261460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:24.261460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:24.261460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:24.334931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=28 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:25.140280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:25.152359 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe130498-e12f-4f2b-949c-98b3e18977e2 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 1.029643 Nov 02 11:57:25.165264 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 854/1707] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:24 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:25.178409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4bf562-7c86-492b-9d0a-8d75ce69733f", "name": "network-vif-plugged", "status": "completed", "tag": "85ea31a7-1e9b-4b31-817d-e4a09d599f1a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:25.185600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:25.196690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-261f6ea1-e115-4550-8261-09e1583ad4f9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.977246 Nov 02 11:57:25.197497 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 854/1708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:24 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:25.212053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.217542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-541094781", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1e42d025-6f92-4be4-aebf-e40b0c181c05"}], "block_device_mapping_v2": [{"uuid": "4cee242b-5783-4b90-b02a-d6fbb634e7f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:25.217723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.217723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.235854 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] Creating event network-vif-plugged:85ea31a7-1e9b-4b31-817d-e4a09d599f1a for instance 2d4bf562-7c86-492b-9d0a-8d75ce69733f on n-h1-855649-4 Nov 02 11:57:25.242134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a79f2a3c-6511-42c1-b1ec-d2bd2e90ae6d req-f046fdba-7d20-46e7-8343-3afae3e78d0a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075494 Nov 02 11:57:25.243197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 855/1709] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:25.248410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:25.249331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:25.256494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.257192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.257810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.258697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.259683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.260633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.374476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] validate_networks() for [('1e42d025-6f92-4be4-aebf-e40b0c181c05', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:25.529500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:25.552552 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-985d48d0-cbb7-4ec9-9263-dbff4983eb66 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1597 microversion: 2.1 time: 0.305995 Nov 02 11:57:25.556851 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 856/1710] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:25 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1597 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:25.568162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3c29ab-6131-49b6-a145-1710d75bfe90", "tag": "c422a904-e62f-491a-90bc-457d3531211a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:25.614754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.618255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.620203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.669049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] Creating event network-changed:c422a904-e62f-491a-90bc-457d3531211a for instance fc3c29ab-6131-49b6-a145-1710d75bfe90 on n-h2-855649-4 Nov 02 11:57:25.680004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f0ac3036-fe64-4424-b315-0ff467900757 req-db6fbd14-0f16-4129-a449-6f89e7877e20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121659 Nov 02 11:57:25.680998 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 857/1711] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:25.695764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:25.696972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:25.713224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.717975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.718718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.719724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:25.720352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:25.720982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:25.736701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:27.005140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:27.005950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:27.006603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:27.007268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:27.007851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:27.032160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.033169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.033640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:27.036827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.039587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.041044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:27.121043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:27.132020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Getting quotas for user 7827c83ee4674362bab55ca9c40d16fb and project 7b4127e1b3c0429690c7d1905258e750. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:27.200049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:27.218247 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fe87899-959d-4e13-830a-1845fc976b1d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 1.529690 Nov 02 11:57:27.218247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 858/1712] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:25 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:27.225143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:27.226079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:27.237444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:27.241557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.247061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.247061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:27.247061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.247655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:27.247766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.247863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:27.250216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cee242b-5783-4b90-b02a-d6fbb634e7f3',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:27.920737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcfe48bc-51cd-45f7-92e8-85a6b3f5f6c5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.721400 Nov 02 11:57:27.931875 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 855/1713] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:57:27.937884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:27.939415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:27.948347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.953246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.953246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:27.953246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:27.953246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:27.953246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:28.509504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:28.527488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-581412db-838a-4c31-a25a-7ddbef5642aa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 1.300002 Nov 02 11:57:28.545769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 859/1714] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:27 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:28.553540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:28.554379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:28.582255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:28.583683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:28.587630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:28.590220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:28.590849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:28.594405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:28.652877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:28.663245 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b662e3c-9c34-4387-b4ab-bc6f6d2690ec tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.729367 Nov 02 11:57:28.675029 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 856/1715] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:27 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:28.675029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:28.675029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:28.691957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:28.692459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:28.692902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:28.693623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:28.699736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:28.700392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:29.492851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3712294d721c40eca3125a1a1b0ebf0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83940f46b8404015b53f2cbc4e1a70ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:29.514617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c901ad7-b000-42cb-9b3d-6007b2b9798b tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 200 len: 1311 microversion: 2.1 time: 0.843435 Nov 02 11:57:29.516936 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 857/1716] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:28 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 1311 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:29.540313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f", "name": "network-vif-unplugged", "status": "completed", "tag": "8d847874-3baa-4fb4-a248-eaf5a2b642f8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:29.578541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:29.581831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:29.582371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:29.623417 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] Creating event network-vif-unplugged:8d847874-3baa-4fb4-a248-eaf5a2b642f8 for instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f on n-h2-855649-4 Nov 02 11:57:29.658221 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-dc263b18-27f3-4c14-b6de-ddd81c51f8e5 req-875690bd-d8f9-4a31-a835-3152f412940f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137796 Nov 02 11:57:29.659327 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 858/1717] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:29.667582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:29.668302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:29.699046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:29.700671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:29.701968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:29.702730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:29.703234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:29.705772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:29.979105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:29.999360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:30.001162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:30.004369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:30.005563 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99d66870-de69-451e-b385-e304cd734f57 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1184 microversion: 2.25 time: 0.344704 Nov 02 11:57:30.006141 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 859/1718] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:29 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1184 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:30.010879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b5cd502-d2b8-482a-9d34-e4c7003538c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 1.476048 Nov 02 11:57:30.022653 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 860/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:28 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:30.027889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f", "name": "network-vif-deleted", "tag": "8d847874-3baa-4fb4-a248-eaf5a2b642f8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:30.035344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:30.040455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:30.061551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.062607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.064442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.065371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.067322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.069208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.078208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.084409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.085223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.126142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] Creating event network-vif-deleted:8d847874-3baa-4fb4-a248-eaf5a2b642f8 for instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f on n-h2-855649-4 Nov 02 11:57:30.137884 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8fd30e90-1c33-4656-b28e-bf1d5e3d9d30 req-cd4a6815-0bfe-4cb8-803e-164c22f9bad8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113380 Nov 02 11:57:30.145673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 861/1720] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:30.164530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:30.172134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:30.182173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.183448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.184148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.188537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.188537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.188537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.751390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:30.755560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:30.780916 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec86ec67-de93-4009-aa69-487d20780a33 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 0.773672 Nov 02 11:57:30.796150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 860/1721] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:30 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:30.796150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:30.796150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:30.820489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.821028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.821483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:30.822238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:30.822695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:30.823132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.466598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:31.479374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1267dc6-30fa-4697-a810-a22cd831a32c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 1.331957 Nov 02 11:57:31.503040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 862/1722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:30 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:31.513748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:31.515730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] [instance: d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:31.539314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.543667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.545001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.556607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.557127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.557591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.627924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] HTTP exception thrown: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Request method failure captured: Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f HTTP/1.1 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqhK7hpzlnNXwIkhUIuj_OJ560x3rEwNxQ9TO65sSZ9oRMFyWl9eeNYBE15l9dpP16yUgd0L-R8mp1_pkxCxE-0qml-aD-6L98nCyYhpNOMC7oyKo7Rb2Ai3Ol7pR5Es_jc7em-mOXxxSUG8EZcRgImoA4K7X_WJSYzwL01xvHV1Q0 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 83940f46b8404015b53f2cbc4e1a70ab Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestFqdnHostnames-1657148188 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/83940f46b8404015b53f2cbc4e1a70ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_83940f46b8404015b53f2cbc4e1a70ab", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/83940f46b8404015b53f2cbc4e1a70ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/83940f46b8404015b53f2cbc4e1a70ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestFqdnHostnames-1657148188 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 83940f46b8404015b53f2cbc4e1a70ab Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1657148188 Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestFqdnHostnames-1657148188-project Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 3712294d721c40eca3125a1a1b0ebf0a Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestFqdnHostnames-1657148188-project Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd7fa714b-6e02-49cb-8ccc-83ea64e8ca7f'} Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:57:31.635930 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. Nov 02 11:57:31.642215 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:57:31.648207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Returning 404 to user: Instance d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:57:31.651763 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbbf08f3-d277-478b-ae21-48eec396bad6 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f" status: 404 len: 111 microversion: 2.1 time: 0.157516 Nov 02 11:57:31.658061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 863/1723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:31 2022] GET /compute/v2.1/servers/d7fa714b-6e02-49cb-8ccc-83ea64e8ca7f => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:57:31.662157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:31.662856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:31.678994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.681068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.681068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.682480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.683466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.685337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.795284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:31.806179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:31.810527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d567cee-32d8-43d7-a4e7-57b470184338 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 1.024393 Nov 02 11:57:31.811557 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 861/1724] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:30 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:31.820007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:31.821114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:31.834884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.835671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.836150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.836874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.837388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.837969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.839522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:31.840962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:31.842772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65948686-2d39-4d06-b96b-dd0e1ec2b711 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1232 microversion: 2.25 time: 0.187957 Nov 02 11:57:31.843550 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 864/1725] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:31 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1232 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:31.852503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e967558-967f-4dc8-ae46-0979713f8ac0 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] Calling method '.version_select at 0x7ff1b3e37430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:31.934877 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e967558-967f-4dc8-ae46-0979713f8ac0 tempest-ServersTestFqdnHostnames-1657148188 tempest-ServersTestFqdnHostnames-1657148188-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895224268" status: 202 len: 0 microversion: 2.1 time: 0.086610 Nov 02 11:57:31.940568 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 865/1726] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 11:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895224268 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:57:31.944468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bd107-963a-492e-b226-568de002ac41", "name": "network-vif-plugged", "status": "completed", "tag": "1ff30a54-3c01-405c-b8de-301ab1a2634c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:31.961117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:31.975924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:31.976873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:31.991704 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] Creating event network-vif-plugged:1ff30a54-3c01-405c-b8de-301ab1a2634c for instance c91bd107-963a-492e-b226-568de002ac41 on n-h1-855649-4 Nov 02 11:57:32.002728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e9fdbf9a-f157-455b-b1ec-c44e764e846c req-c247f408-4d7c-402f-ab18-cb5658a0b661 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065184 Nov 02 11:57:32.004752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 866/1727] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:32.025487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:32.026723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:32.037831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:32.038813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:32.039550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:32.040726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:32.041534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:32.042243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:32.699194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:32.713323 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94a18140-20a4-4f05-a1a3-42c23b65096a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.892991 Nov 02 11:57:32.713323 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 862/1728] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:31 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:32.726931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:32.732020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:32.759256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:32.759769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:32.760401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:32.761124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:32.761583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:32.762006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.211927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.220603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63610ddd-231a-4b10-884d-e7727591a18f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.508085 Nov 02 11:57:33.227737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 863/1729] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:32 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:33.234221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc44e92c-29a5-41a6-870c-a9d881e34e8c", "tag": "0b1af59e-6454-43b1-84c1-2c0adf0311fa"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:33.242310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.269566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.271078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8c8686e-0809-47eb-8c9e-577228eca9b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1319 microversion: 2.1 time: 1.262100 Nov 02 11:57:33.271519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.271963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.272868 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 867/1730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:32 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1319 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:33.278839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:33.280088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:33.286134 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] Creating event network-changed:0b1af59e-6454-43b1-84c1-2c0adf0311fa for instance fc44e92c-29a5-41a6-870c-a9d881e34e8c on n-h2-855649-4 Nov 02 11:57:33.288335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.295797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.295797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.295797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.295797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.295797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.313781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2f82d251-4799-4fee-bc01-b11981362b4e req-3bb9dc7a-1a72-447e-8063-7c91eba93e3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083946 Nov 02 11:57:33.317891 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 864/1731] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:33.333019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:33.339312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:33.352086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.352864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.353485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.360399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.360399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.360399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.533341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.542905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.552929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.554117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b0ef959-b3cf-4a95-bb06-8ce141f1d2f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1250 microversion: 2.25 time: 0.234364 Nov 02 11:57:33.572170 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 865/1732] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:33 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1250 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:33.718751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:33.729611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d88568a-f1e2-402c-9b4c-acacf193fef8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.455212 Nov 02 11:57:33.732509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 868/1733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:33 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:33.750027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:33.750655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:33.758579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.759107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.759550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:33.760260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:33.760715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:33.761135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:34.066525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:34.077558 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94b96738-65be-4dac-865d-e0848d79693f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1496 microversion: 2.1 time: 0.346129 Nov 02 11:57:34.079111 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 866/1734] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:33 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1496 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:34.257575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:34.258881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:34.266731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:34.267555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:34.268247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:34.269356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:34.270088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:34.270674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:34.296487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:34.297055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:34.310692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:34.311509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:34.312010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:34.312901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:34.313532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:34.314134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.439158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.448151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.457373 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea3040f5-bd91-46ba-a37c-00226edfb9b0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 200 len: 1507 microversion: 2.1 time: 1.163371 Nov 02 11:57:35.460938 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 867/1735] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:34 2022] GET /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 1507 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:35.472452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:35.472452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:35.480531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a97a6782-3830-4fd4-8e16-df30d36b1c7d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 1.232545 Nov 02 11:57:35.481152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 869/1736] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:34 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:35.482324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.483101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.483822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.484792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.485477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.486155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.502805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:35.504197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:35.517103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.517608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.518049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.519415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.519884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.520316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.745996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.749738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.758402 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50c6b4ee-c7dc-4aca-a5df-d2d48c25afdd tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.261705 Nov 02 11:57:35.759006 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 870/1737] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:35 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:35.763818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:35.767398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:35.770758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.770930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.771624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.772248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.773134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.773987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.774634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.777601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:35.778877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bc00cb2-f13a-4609-a0ad-3be5660e96e6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1292 microversion: 2.25 time: 0.316472 Nov 02 11:57:35.795522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 868/1738] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:35 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1292 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:35.795948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:35.796774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 2d4bf562-7c86-492b-9d0a-8d75ce69733f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:35.813101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.813604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.814049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:35.814769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:35.818812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:35.819326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:36.042148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:36.050586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71ec6fa5-bd40-4253-a692-36bd49f5ab68 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/2d4bf562-7c86-492b-9d0a-8d75ce69733f" status: 200 len: 1508 microversion: 2.1 time: 0.269933 Nov 02 11:57:36.051116 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 869/1739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:35 2022] GET /compute/v2.1/servers/2d4bf562-7c86-492b-9d0a-8d75ce69733f => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:36.067617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:36.067617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d46dd0c3-256b-4b3c-8b4c-eb886470eafa tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 200 len: 1473 microversion: 2.1 time: 0.305120 Nov 02 11:57:36.073263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:36.073958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 2d4bf562-7c86-492b-9d0a-8d75ce69733f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:36.080064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:36.080558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:36.081571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:36.088037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:36.088174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 871/1740] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:35 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:36.088308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:36.088308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:36.094805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-283217596"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:36.097996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:36.113213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:36.113730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:36.114179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:36.114927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:36.115430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:36.115867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:36.116784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 2d4bf562-7c86-492b-9d0a-8d75ce69733f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:57:37.085928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:37.138147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:37.219391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf32dd7b-9c5a-4f81-9811-e044463433a7 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d4bf562-7c86-492b-9d0a-8d75ce69733f" status: 204 len: 0 microversion: 2.1 time: 1.149396 Nov 02 11:57:37.221263 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 870/1741] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:57:36 2022] DELETE /compute/v2.1/servers/2d4bf562-7c86-492b-9d0a-8d75ce69733f => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:57:37.228928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:37.231012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:37.244675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:37.245451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:37.247588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:37.248598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:37.252776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:37.253758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:37.492907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:37.510956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e501e410-35e1-4a6d-a0df-343276d5218b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.281656 Nov 02 11:57:37.515374 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 871/1742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:37 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:37.516271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b90df436-fa2b-4b34-9bcc-16dacbe2874e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160/action" status: 202 len: 0 microversion: 2.1 time: 1.425078 Nov 02 11:57:37.524202 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 872/1743] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:57:36 2022] POST /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160/action => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 11:57:37.739568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-654619291", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "34d7f901-5e5b-4df2-9ee6-5f746868b4a2"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:37.814144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-340135b3-3f82-4785-bd35-f3cf6b892292 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Action: 'create', calling method: .version_select at 0x7ff1b302b940>, body: {"keypair": {"name": "tempest-keypair-511364844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjUyFCycHl/uOTV85Dn/JuV8/2InwHjXh4YYSOJ9Uukre/KWw8daYv7DalGidBWSX9xxWnpru4xMAPyWi4f858X1VLUyp/F3Dy+7EkMvy+dY425ejFHKblqqIEafGwOug=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:37.842387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] validate_networks() for [('34d7f901-5e5b-4df2-9ee6-5f746868b4a2', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:37.889042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-340135b3-3f82-4785-bd35-f3cf6b892292 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:37.914185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-340135b3-3f82-4785-bd35-f3cf6b892292 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for user aa7142c46289437f9c9e74b11d27e5e5 and project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:37.969079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:38.133207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-340135b3-3f82-4785-bd35-f3cf6b892292 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.616355 Nov 02 11:57:38.134628 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 872/1744] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:57:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:38.140474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:38.141440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:38.161130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:38.161988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:38.162650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:38.163719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:38.164897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:38.165548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:38.745428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:38.756730 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7374326-f8e0-4c34-998f-ee4245a88a0d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.620489 Nov 02 11:57:38.757189 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 873/1745] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:38 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:38.776329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:38.779006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:38.803666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:38.806756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:38.806756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:38.806756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:38.806756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:38.806756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:39.490797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:39.495032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:39.495032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:39.495032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:39.495032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:39.523251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:39.542799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:39.542799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:39.544368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:39.545188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:39.545907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:39.593802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:39.617706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:39.625600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:39.626156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:39.635596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ae5b10e-db67-44db-bce5-a01bd1c929f3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1292 microversion: 2.25 time: 0.867567 Nov 02 11:57:39.637355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 874/1746] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:38 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1292 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:39.664986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for user 0ddce8ede1194d26a83ed481de2a3db5 and project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:39.670774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:39.678433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:39.689864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:39.695769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:39.697026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:39.697599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:39.698261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:39.699559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:39.701492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:39.710268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:39.792607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: c91bd107-963a-492e-b226-568de002ac41] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:57:39.962125 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1df73996-1092-44d7-a090-a5956b420b42 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.434963 Nov 02 11:57:39.963538 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 873/1747] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:57:39.974347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5a17e64-6d10-4f70-aa2e-d24d5aee75cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35e98b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:40.060361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:40.079060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5a17e64-6d10-4f70-aa2e-d24d5aee75cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.109313 Nov 02 11:57:40.082930 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 874/1748] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:39 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:40.102826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c98427-f8a4-4a54-bd49-2beb66cc6c65", "tag": "0f4115b4-e3f6-4e46-9180-93e3d932e9f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:40.169914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:40.171241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:40.172926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:40.214628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] Creating event network-changed:0f4115b4-e3f6-4e46-9180-93e3d932e9f6 for instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 on n-h1-855649-4 Nov 02 11:57:40.234393 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-650e3e4e-5268-4fec-b6fd-dade7d7902bd req-8f71d554-ce1e-470d-a8af-b73f69905f81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146156 Nov 02 11:57:40.239134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 875/1749] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:40.258523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:40.259328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:40.287500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:40.291754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:40.292214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:40.292971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:40.293436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:40.293904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:40.392015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5d58d19-df4a-4db0-be2d-b224d18b55f6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41" status: 204 len: 0 microversion: 2.1 time: 0.727770 Nov 02 11:57:40.394072 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 875/1750] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:57:39 2022] DELETE /compute/v2.1/servers/c91bd107-963a-492e-b226-568de002ac41 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:57:40.414360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:40.417513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:40.447259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:40.447770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:40.457244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:40.458583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:40.459135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:40.459570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:41.471272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:41.480637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc295742-1032-4563-86a7-d06e144a7ff8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 1.240109 Nov 02 11:57:41.488642 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 876/1751] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:40 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:41.497749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a36d521c-bd69-44ea-978e-72413bfefa36 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:41.511915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a36d521c-bd69-44ea-978e-72413bfefa36 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:41.640369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a36d521c-bd69-44ea-978e-72413bfefa36 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:41.651724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a36d521c-bd69-44ea-978e-72413bfefa36 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1224 microversion: 2.1 time: 0.157698 Nov 02 11:57:41.655230 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 877/1752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:41 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:41.668272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:41.669310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:41.693193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:41.693828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:41.694370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:41.695228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:41.695966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:41.697588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:41.701738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:41.711161 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f565f219-aa75-4b62-ad46-6e9ae255b6be tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 1.309740 Nov 02 11:57:41.719215 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 876/1753] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:40 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:41.727122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1346865818", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1e3154fb-1823-4dc2-b516-a95f79d74986"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:41.827738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] validate_networks() for [('1e3154fb-1823-4dc2-b516-a95f79d74986', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:42.389396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:42.410693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:42.412156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:42.419492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-663fd726-3011-4014-8c0d-137b49fa8b99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1292 microversion: 2.25 time: 0.762613 Nov 02 11:57:42.420097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 878/1754] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:41 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1292 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:42.452895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9b73215-87a5-4b2e-95b3-22b36a56577b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35cde50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:42.557800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9b73215-87a5-4b2e-95b3-22b36a56577b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.123384 Nov 02 11:57:42.569013 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 879/1755] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:42 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:42.576714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4bf562-7c86-492b-9d0a-8d75ce69733f", "name": "network-vif-deleted", "tag": "85ea31a7-1e9b-4b31-817d-e4a09d599f1a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:42.613875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:42.616466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:42.616913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:42.638368 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] Creating event network-vif-deleted:85ea31a7-1e9b-4b31-817d-e4a09d599f1a for instance 2d4bf562-7c86-492b-9d0a-8d75ce69733f on n-h1-855649-4 Nov 02 11:57:42.644507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4ae422da-fdd2-4693-b98f-d39622389581 req-d5824346-c7c6-4ae1-bd62-ea374992c0ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074144 Nov 02 11:57:42.645119 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 880/1756] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:42.650635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:42.651519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:42.658311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:42.658899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:42.659986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:42.660767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:42.661167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:42.661594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:42.681862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:43.355291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:43.355291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:43.355291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:43.355291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:43.356098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:43.377204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.378760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.379239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.382725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.383402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.384033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.422900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Getting quotas for project 97f3df4d86624fb099055183e4046e0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:43.429694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Getting quotas for user a10791601b7f44cea5752c01781f3be9 and project 97f3df4d86624fb099055183e4046e0b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:43.454999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Going to run 2 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:43.463905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:43.468828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:43.472507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0936cbf1-7ac4-4745-b8e0-c14c3c6ad4ad tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.826171 Nov 02 11:57:43.473108 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 881/1757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:42 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:43.498325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:43.498964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:43.517280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.517782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.518472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.519320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.522040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.523003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.611500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:43.634049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13152f7b-a649-47e2-a366-be89104f6529 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1276 microversion: 2.1 time: 0.142531 Nov 02 11:57:43.634049 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 882/1758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:43 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:43.647458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:43.648187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:43.676562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=ec3baa3b-1ff1-4b4b-8664-15101565ce6c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.676705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.882766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:43.894183 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd610f71-840d-4a1a-bc47-c039cdc9db80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.257581 Nov 02 11:57:43.894774 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 883/1759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:43 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:43.906668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-395522a7-8b4b-4031-b59d-3f563ebc1f17 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.185969 Nov 02 11:57:43.909667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:43.913000 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 877/1760] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:57:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 2193 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 11:57:43.925687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:43.943035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.943543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.943846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74812211-309d-4f60-bee2-e8bb6b5ebfe7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b2facca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:43.943971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:43.944734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:43.945212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:43.945655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.070372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74812211-309d-4f60-bee2-e8bb6b5ebfe7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.155760 Nov 02 11:57:44.072363 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 878/1761] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:43 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:44.094010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91bd107-963a-492e-b226-568de002ac41", "name": "network-vif-deleted", "tag": "1ff30a54-3c01-405c-b8de-301ab1a2634c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:44.121763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.124666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.127667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.146463 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] Creating event network-vif-deleted:1ff30a54-3c01-405c-b8de-301ab1a2634c for instance c91bd107-963a-492e-b226-568de002ac41 on n-h1-855649-4 Nov 02 11:57:44.152158 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5bdf48b0-8e02-49b9-814b-d07f432625ef req-a75eb158-9128-4a98-9b10-35dabde6ca3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078208 Nov 02 11:57:44.153226 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 879/1762] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:44.160092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:44.165881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.166993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Searching by: {'deleted': False, 'project_id': '97f3df4d86624fb099055183e4046e0b'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 11:57:44.185484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.186016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.186470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.187435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.187999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.188440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.226335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 11:57:44.294611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.305344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.308189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.309518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9c45ca3-c257-432d-af43-179dd2484585 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.408685 Nov 02 11:57:44.311208 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 884/1763] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:43 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:44.354691 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d9e4cec-9b98-45d4-ae7a-365f7fcd4f84 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.199960 Nov 02 11:57:44.355727 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 880/1764] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 11:57:44 2022] GET /compute/v2.1/servers => generated 1004 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:44.367996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45fde2d3-32db-415c-a789-eec423c5c6ce tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:44.368630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45fde2d3-32db-415c-a789-eec423c5c6ce tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:44.465622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45fde2d3-32db-415c-a789-eec423c5c6ce tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.476944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45fde2d3-32db-415c-a789-eec423c5c6ce tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1218 microversion: 2.1 time: 0.112915 Nov 02 11:57:44.477539 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 885/1765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:44 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:44.499361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:44.500127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:44.509065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.509878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.510497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.511518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.512174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.512826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.553935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3c29ab-6131-49b6-a145-1710d75bfe90", "name": "network-vif-plugged", "status": "completed", "tag": "c422a904-e62f-491a-90bc-457d3531211a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:44.592470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.592968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.593394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.614999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] Creating event network-vif-plugged:c422a904-e62f-491a-90bc-457d3531211a for instance fc3c29ab-6131-49b6-a145-1710d75bfe90 on n-h2-855649-4 Nov 02 11:57:44.620163 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-52a6ccad-1e79-4c8c-8518-5b86673db191 req-9c0ef19a-004e-4d64-b927-f6cf6339a6fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070620 Nov 02 11:57:44.621419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 886/1766] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:44.665054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:44.665990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:44.677135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.677888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.678510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.679463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.681346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.681992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.709009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.720067 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f79dae27-f09c-4df5-b15c-b60fb0cc3618 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.224448 Nov 02 11:57:44.721040 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 881/1767] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:44 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:44.793701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:44.803255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-624f72d1-d2f7-4085-a86f-cbf57ae74212 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1276 microversion: 2.1 time: 0.144846 Nov 02 11:57:44.815355 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 887/1768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:44 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:44.920583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:44.927227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:44.934879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.935483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.936171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:44.937602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:44.937602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:44.938027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:45.092663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5754338e-53c9-41ed-b779-79162cf62f86 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35e6f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:45.160781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5754338e-53c9-41ed-b779-79162cf62f86 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.078001 Nov 02 11:57:45.161673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 888/1769] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:45 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:45.261348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:45.271797 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eadab366-5961-448d-ad59-4a51179754a8 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.355966 Nov 02 11:57:45.273323 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 882/1770] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:44 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:45.337085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:45.337840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:45.351259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:45.354959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:45.355462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:45.358611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:45.359278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:45.359721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:45.436944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2049571801", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "fc34eb09-c1a5-4b74-a421-ca48a9800d8e"}], "security_groups": [{"name": "tempest-securitygroup--1967324352"}], "key_name": "tempest-keypair-511364844", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:45.739229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] validate_networks() for [('fc34eb09-c1a5-4b74-a421-ca48a9800d8e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:57:45.878253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:45.896489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:45.898020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:45.900258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06d1ffb7-5c83-4953-8a1a-6aff7677eb64 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.567078 Nov 02 11:57:45.901384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 889/1771] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:45 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:45.907600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ad114a-9688-4ac8-94e2-62028275c68e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:45.908408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94ad114a-9688-4ac8-94e2-62028275c68e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:46.043452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94ad114a-9688-4ac8-94e2-62028275c68e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:46.051924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94ad114a-9688-4ac8-94e2-62028275c68e tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1218 microversion: 2.1 time: 0.149276 Nov 02 11:57:46.052599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 890/1772] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:45 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:46.057363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:46.058188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:46.065367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.065962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.066599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.067520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.068258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.068828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.500961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:46.510034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea341245-87b4-4edc-b4b6-9bbcc35f0bbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.456129 Nov 02 11:57:46.511009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 891/1773] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:46 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:46.515535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:46.519271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:46.522024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.522516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.522933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.523646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.524330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.524922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.627428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:46.636928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25269543-37d2-489f-8772-70862e0c65fd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1282 microversion: 2.1 time: 0.124883 Nov 02 11:57:46.637525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 892/1774] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:46 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:46.642185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c8bc88a-c0e9-4083-8891-b3a96507350a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35f4c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:46.691660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c8bc88a-c0e9-4083-8891-b3a96507350a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.052876 Nov 02 11:57:46.692750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 893/1775] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:46 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:46.698307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:46.698966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:46.712942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.713776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.714495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.715539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.716509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.717431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.762826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:57:46.765015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:57:46.768297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:57:46.769164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:57:46.771396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:57:46.790274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.790855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.791394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.792245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.792769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.793414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.816468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:57:46.821883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for user aa7142c46289437f9c9e74b11d27e5e5 and project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:57:46.834868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:57:46.837393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:57:46.902686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:46.911061 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b306d179-09e8-47d1-b131-b4b1c8994a72 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.216746 Nov 02 11:57:46.911671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 894/1776] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:46 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:46.916606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76336a1f-b324-432e-88e3-38d43e8c0160", "name": "network-vif-plugged", "status": "completed", "tag": "244e718d-bb3d-4ca9-9e92-744898c3211f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:46.927385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.927928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.928383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.939798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] Creating event network-vif-plugged:244e718d-bb3d-4ca9-9e92-744898c3211f for instance 76336a1f-b324-432e-88e3-38d43e8c0160 on n-h2-855649-4 Nov 02 11:57:46.944885 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4c00f350-5e77-4a10-a9c7-1e5918799c0f req-2c7c777f-8f3e-4253-b6e9-b5018300e168 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Nov 02 11:57:46.945632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 895/1777] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:46.950679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:46.951419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:46.957883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.958694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.958843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:46.959570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:46.960023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:46.965100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.050168 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51219811-d46f-4e89-8b81-f49131125aa4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.617420 Nov 02 11:57:47.058628 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 883/1778] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:57:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 11:57:47.083560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-370a24ec-bdff-48d9-a6eb-16f0635e5d9a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.084229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-370a24ec-bdff-48d9-a6eb-16f0635e5d9a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:47.204725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-370a24ec-bdff-48d9-a6eb-16f0635e5d9a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.245046 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-370a24ec-bdff-48d9-a6eb-16f0635e5d9a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1241 microversion: 2.1 time: 0.178272 Nov 02 11:57:47.247139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 884/1779] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1241 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:47.256207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.257059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:47.277826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.277826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.277826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.278723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.281166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.281721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.286720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.302548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.304089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.305237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2ac1220-0a25-4159-bebe-cc891809c967 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.358690 Nov 02 11:57:47.305787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 896/1780] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:46 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:47.400243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.408411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc32616c-a9fe-4f98-899e-11a1ecd246ed tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1222 microversion: 2.1 time: 0.160084 Nov 02 11:57:47.409943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 885/1781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:47.533562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.534205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:47.540736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.541225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.541705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.542404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.542858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.543319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.662899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.663839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:47.672964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.673453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.675369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.676128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.677415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.678823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.807973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:47.819801 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49b9170d-559d-417c-9889-ba82e1ab6258 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.290099 Nov 02 11:57:47.821715 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 897/1782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:47.837465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2007e2d-8611-44b4-b098-78121c2d0376 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35f51f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.910882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2007e2d-8611-44b4-b098-78121c2d0376 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.081440 Nov 02 11:57:47.916172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 898/1783] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:47.936943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:47.944174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:47.948762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.949298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.949713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:47.950571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:47.950969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:47.951568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.010288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.019235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24c22475-c773-4fbd-977a-cae58b763b87 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.360920 Nov 02 11:57:48.020087 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 886/1784] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:48.252570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.262708 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b37d6fa9-59bb-40ef-9556-a918543f0f3a tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1370 microversion: 2.1 time: 0.331441 Nov 02 11:57:48.275008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-323b30fd-20d1-46ff-957e-258625d479f5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:48.275008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-323b30fd-20d1-46ff-957e-258625d479f5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:48.275974 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 899/1785] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:47 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:48.331874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:48.333204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:48.354379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.354881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.355394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.356099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.356552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.357011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.396928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-323b30fd-20d1-46ff-957e-258625d479f5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.409534 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-323b30fd-20d1-46ff-957e-258625d479f5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1241 microversion: 2.1 time: 0.141433 Nov 02 11:57:48.410683 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 887/1786] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:48 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:48.434419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:48.449698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:48.449698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.449698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.453367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.453367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.453367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.470675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.604925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.613244 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4c124fc-5f1c-4071-8ec2-7645264f1fd8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1270 microversion: 2.1 time: 0.183802 Nov 02 11:57:48.614438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 888/1787] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:48 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:48.671307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.679979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.681874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:48.684590 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4b9f2b6-82de-4659-92dc-d84f959a0129 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.356462 Nov 02 11:57:48.684590 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 900/1788] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:48 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:48.844876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:48.845963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:48.861795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.862504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.864856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.868431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:48.870073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:48.870528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:48.931066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-076c81f4-0590-4a4f-9771-bb471a05f664 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b824e280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.015548 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-076c81f4-0590-4a4f-9771-bb471a05f664 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.089441 Nov 02 11:57:49.016337 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 901/1789] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:48 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:49.042595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.043237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.050241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.051199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.051656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.052362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.052998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.053430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.186219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.191511 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e436133c-44c1-4687-9daa-f23656d7afec tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.348504 Nov 02 11:57:49.192447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 889/1790] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:48 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:49.287617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.294344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.303878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.310224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.310726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.311200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.311911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.312368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.312863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.322759 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-522d5db3-7db4-4d4c-a5bf-c799478545b1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.271566 Nov 02 11:57:49.335439 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 902/1791] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:49.372460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276d7694-f2be-4aed-b4cc-720a7ced2aef", "tag": "cf220b2b-5c25-47e2-a13f-5e63393a48da"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:49.393846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.394572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.400406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.409566 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] Creating event network-changed:cf220b2b-5c25-47e2-a13f-5e63393a48da for instance 276d7694-f2be-4aed-b4cc-720a7ced2aef on n-h1-855649-4 Nov 02 11:57:49.414840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e219c9fa-043c-4838-832e-5bffa4cb0af3 req-79c1356d-1bba-4f13-aa0b-656ae7ef9b0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046818 Nov 02 11:57:49.415936 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 903/1792] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:57:49.439954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.441044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.447735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.449503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.449992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.450721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.451471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.452208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.453381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.522310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.530886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e8ed46a-f8d4-44c2-be46-0c80dc3b9e33 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1557 microversion: 2.1 time: 0.247785 Nov 02 11:57:49.535086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 890/1793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:49.556351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.556893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.564940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.565443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.566336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.567265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.567897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.568543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.569772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:49.577437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:49.592947 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e90e3044-3f70-4227-94c9-71301f70d65f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1245 microversion: 2.1 time: 0.158444 Nov 02 11:57:49.593534 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 904/1794] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:57:49.645944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:49.647690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:49.662130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.663013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.663809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:49.665844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:49.670064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:49.670750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.310443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:50.322379 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c20411f-d85d-4fc9-a183-613bdb88a444 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1278 microversion: 2.1 time: 0.683406 Nov 02 11:57:50.323030 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 905/1795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1278 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:50.339611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:50.340557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:50.347883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.355975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1de3981b-00ac-4124-8386-67bd0bfb218f tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.803864 Nov 02 11:57:50.357621 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 891/1796] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:57:49 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-interface => generated 285 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:57:50.364346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91bb95f6-fcf3-4a20-822d-000523f75024 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b30ddca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:50.373965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.375603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.377298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.383694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.386851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.402031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:50.466446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91bb95f6-fcf3-4a20-822d-000523f75024 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.107382 Nov 02 11:57:50.467195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 892/1797] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:50 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:50.479293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:50.501758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:50.517421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.520626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.521350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:50.522327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:50.523827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:50.524450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.123715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:51.140569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:51.140569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:51.141257 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8daeba0a-446b-4411-bacb-f2c431e5cdd6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.813513 Nov 02 11:57:51.141822 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 906/1798] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:50 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:51.173397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:51.174037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:51.192543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.196140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.198720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.201566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.202057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.202501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.271504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:51.284423 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2aa44c05-f509-4579-b4bb-a0323d6ee753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 0.812051 Nov 02 11:57:51.285292 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 893/1799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:50 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:51.290246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:51.301414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:51.311141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.311648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.312105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.312839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.319650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.320295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.547073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:51.564669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a736a7e9-ed79-47d5-b5c0-48c824a3e1de tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1301 microversion: 2.1 time: 0.277947 Nov 02 11:57:51.566632 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 894/1800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:51 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1301 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:51.573133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc44e92c-29a5-41a6-870c-a9d881e34e8c", "name": "network-vif-plugged", "status": "completed", "tag": "0b1af59e-6454-43b1-84c1-2c0adf0311fa"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:51.620425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.622281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.624543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.643879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] Creating event network-vif-plugged:0b1af59e-6454-43b1-84c1-2c0adf0311fa for instance fc44e92c-29a5-41a6-870c-a9d881e34e8c on n-h2-855649-4 Nov 02 11:57:51.652533 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e4eb568d-ec5e-42a7-8b23-760930856c4f req-a125f409-3127-405b-b96d-632896c7ccfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083363 Nov 02 11:57:51.661565 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 895/1801] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:51.684034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3baa3b-1ff1-4b4b-8664-15101565ce6c", "tag": "e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:51.717861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.719816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.720577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.740055 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] Creating event network-changed:e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62 for instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c on n-h1-855649-4 Nov 02 11:57:51.747170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-70f0cf6b-811a-489d-b1a3-07ece18ab0b2 req-e4b0796c-b920-4147-9512-f0144b9b86ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087502 Nov 02 11:57:51.749131 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 896/1802] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:51.756294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:51.757246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:51.765755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.766508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.767221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:51.768149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:51.769168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:51.770046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.051741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.059827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0dc4f87-13cb-4554-878e-f534ccaa2804 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1276 microversion: 2.1 time: 0.309292 Nov 02 11:57:52.078152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 897/1803] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:51 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:52.083530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92154e68-a6bf-4c61-9f8d-c7857a43d303 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b2f85280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:52.147357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92154e68-a6bf-4c61-9f8d-c7857a43d303 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.067952 Nov 02 11:57:52.148151 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 898/1804] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:52 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:52.171194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:52.172071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:52.206901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.208187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.208970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.211216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.212002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.213204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.270099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.284127 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c62e7a5b-23ef-4c5c-9633-6567ea461bf4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 1.141040 Nov 02 11:57:52.286674 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 907/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:51 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:52.314442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:52.317556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:52.326060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.327019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.328796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.328796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.329891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.331170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.751529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.762076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.774585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:52.776168 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e418c12-00a5-4474-ae63-f232d0c0865c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.608866 Nov 02 11:57:52.777261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 899/1806] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:52 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:57:52.801434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:52.801434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:52.806355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.815404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.815404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:52.815404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:52.815404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:52.815404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:53.694813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:53.708278 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7298cbc-5353-4606-a682-4d6cb652abe4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1310 microversion: 2.1 time: 1.399003 Nov 02 11:57:53.709251 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 908/1807] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:52 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1310 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:53.726132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:53.728063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:53.756135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:53.758461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:53.759485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:53.760836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:53.762133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:53.762830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:53.885550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:53.893572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:53.902580 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1d6ba89-0d39-4624-b3fc-a7c33e001bc4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 1.123616 Nov 02 11:57:53.903815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 900/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:52 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:53.910858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d518f175-06f3-430b-ab97-6c1d0304c801 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b2f85310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:53.993097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:54.008720 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7cf80dc-cae4-436b-b2cd-1c690993242b tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1276 microversion: 2.1 time: 0.298207 Nov 02 11:57:54.009937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d518f175-06f3-430b-ab97-6c1d0304c801 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.104771 Nov 02 11:57:54.021092 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 901/1809] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:53 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:54.026726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 909/1810] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:53 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:54.027184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:54.028097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:54.038908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.040110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.040939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.042298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.042955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.043678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.046255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:54.046867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:54.054499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.055223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.056058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.057382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.058013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.063681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.869180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:54.886668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-183ca085-0b07-42b4-ad67-a1b39c8a104c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.863938 Nov 02 11:57:54.919829 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 902/1811] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:54 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:54.919829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:54.921302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:54.934754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.935584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.936190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:54.937090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:54.937700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:54.938386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.005109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.026933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.031512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.042417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d287139e-2571-4698-ba3d-873dff3efd17 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 1.014079 Nov 02 11:57:55.045396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 910/1812] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:54 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:55.066056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c859a0-5be4-47cb-a1d3-5d54a5edfa31", "tag": "4802d97c-ffe5-4b54-a1e2-512e7a006f7e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:55.089601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.090593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.091169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.108109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] Creating event network-changed:4802d97c-ffe5-4b54-a1e2-512e7a006f7e for instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 on n-h1-855649-4 Nov 02 11:57:55.114614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9bbf7f7d-f13b-40f9-8bc6-2dcc39b5fa58 req-32811827-3764-4b81-abc9-d56840451346 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064886 Nov 02 11:57:55.115553 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 911/1813] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:55.121229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:55.121966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:55.133527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.134487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.135696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.136952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.137639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.138518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.517148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.521898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:55.531423 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57f4f1e3-66ad-4777-9973-aaff83339ffa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 0.413666 Nov 02 11:57:55.533143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d37629dc-fbfa-4d92-bf73-68c199990d0e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1494 microversion: 2.1 time: 0.644444 Nov 02 11:57:55.534346 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 903/1814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:54 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1494 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:55.535491 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 912/1815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:55 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:55.540835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:55.542027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:55.550500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.563864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.567811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.574410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.574668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42010a66-7065-44aa-a562-ad1acdfc8809 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b2f244c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:55.574764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.574764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.680101 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42010a66-7065-44aa-a562-ad1acdfc8809 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.121546 Nov 02 11:57:55.681358 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 904/1816] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:55 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:55.693229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:55.696597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:55.709560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:55.713926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.716772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.718065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:55.719144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:55.719827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:55.720458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.047685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:56.673139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:56.683664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-454d58ba-23e6-418e-85d8-46690b96183d tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 1.146895 Nov 02 11:57:56.685843 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 913/1817] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:55 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:56.694671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c98427-f8a4-4a54-bd49-2beb66cc6c65", "name": "network-vif-plugged", "status": "completed", "tag": "0f4115b4-e3f6-4e46-9180-93e3d932e9f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:56.727647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:56.728436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:56.729085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.758040 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] Creating event network-vif-plugged:0f4115b4-e3f6-4e46-9180-93e3d932e9f6 for instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 on n-h1-855649-4 Nov 02 11:57:56.763694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a8aa5b8d-ed9b-44c4-8a2b-9d5339c961d6 req-507c0d61-3dc0-4f75-9630-3479897d6437 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075504 Nov 02 11:57:56.764543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 914/1818] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:56.772292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:56.775026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:56.783287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:56.786389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:56.786389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.786389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:56.786389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:56.787778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:56.806518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:57.700917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51538e26-043a-4b4a-a5b2-2d8bd6149cb0 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1645 microversion: 2.1 time: 2.018215 Nov 02 11:57:57.715582 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 905/1819] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:55 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1645 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:57.720432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:57.722574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:57.733820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.734574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.735970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:57.736817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.743791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.744345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:57.814757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:57.842023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea379850-9879-424b-b301-b609aebaf160 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 1.075447 Nov 02 11:57:57.844102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:56 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:57.854334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:57.855374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:57.864201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.865038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.865670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:57.867193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:57.867992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:57.868697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:58.322595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:58.335236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:58.336961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:58.338298 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6916b597-837a-4b2c-9ef2-88c9257d679d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.635412 Nov 02 11:57:58.340070 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 906/1821] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:57 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:57:58.353887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11721ae6-da99-430f-8df3-ebc3172f357f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b2f24e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:58.392399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:58.404934 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dab6e005-30a3-439d-9007-bc6e293dd75e tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 0.558658 Nov 02 11:57:58.405305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:57:58.405572 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 916/1822] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:57 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:58.426239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3c29ab-6131-49b6-a145-1710d75bfe90", "tag": "c422a904-e62f-491a-90bc-457d3531211a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:57:58.446107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11721ae6-da99-430f-8df3-ebc3172f357f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.104768 Nov 02 11:57:58.446680 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 907/1823] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:57:58 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:58.459605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:58.460531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:58.469512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:58.471608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:58.472285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:58.473026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:58.473672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:58.474266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:58.474628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:58.475282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:58.475893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:58.506506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] Creating event network-changed:c422a904-e62f-491a-90bc-457d3531211a for instance fc3c29ab-6131-49b6-a145-1710d75bfe90 on n-h2-855649-4 Nov 02 11:57:58.512216 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b1ac32a1-5d98-43b4-b770-442f86645d63 req-5204c0c0-4ffa-40ee-9d7d-ed6abefaafc1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104960 Nov 02 11:57:58.513664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 917/1824] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:57:58.520585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:58.521385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:58.529360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:58.529954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:58.530470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:58.531284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:58.531882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:58.532331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.166051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:57:59.185074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-027bd0eb-f2c6-458e-ac6c-4ccb84c5f519 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.736016 Nov 02 11:57:59.199005 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 908/1825] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:58 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:59.200139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:59.209989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:59.218234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.220025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.220025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.220025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.220372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.221542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.338791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7107613e-829e-4477-a922-bfef45ea292d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1645 microversion: 2.1 time: 0.823863 Nov 02 11:57:59.339411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 918/1826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:58 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1645 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:57:59.364608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:59.367683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.368157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.368606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.373247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.373734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.374186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.401177 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a844a5b1-4763-4551-abf1-b37583d27a3b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043750 Nov 02 11:57:59.402445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 919/1827] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:57:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:57:59.409267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:57:59.409267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:57:59.416262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.417142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.417768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:57:59.418680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:57:59.419338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:57:59.419938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.044311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:00.064639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fddc594c-59fc-44ed-a486-1a0f033aac9b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.874602 Nov 02 11:58:00.065873 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 909/1828] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:57:59 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:00.083758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:00.088868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:00.100370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.101133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.115526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.115526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.115526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.115526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.146550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:00.156063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:00.157775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:00.159751 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7f5f334-f31e-4c7a-b993-c6485c9b2fb0 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1280 microversion: 2.25 time: 0.755406 Nov 02 11:58:00.176265 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 920/1829] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:57:59 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1280 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:00.184109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:00.185019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:00.192212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.193049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.193698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.194664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.195387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.196056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.463076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1c57af6-e5d8-454e-8627-4f31a1b03570 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.393447 Nov 02 11:58:00.467805 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 910/1830] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:00 2022] POST /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:58:00.476784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17896c4f-7867-4ff3-af99-ae21343ddfe7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b313c670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:00.578439 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17896c4f-7867-4ff3-af99-ae21343ddfe7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.112659 Nov 02 11:58:00.588961 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 911/1831] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:00 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:00.600165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:00.601218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:00.612553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.613392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.613901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:00.614806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:00.615513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:00.616013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.198259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:01.206724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e36979bf-042f-42a5-8559-0daf727a94a8 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 1.029102 Nov 02 11:58:01.207910 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 921/1832] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:00 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.212826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:01.214121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:01.222301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.223196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.224029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.225246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.225923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.226562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.261827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:01.277670 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a55facca-072e-4919-ae5b-c28ea13b3520 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.685503 Nov 02 11:58:01.287075 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 912/1833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:00 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.299164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5388f4-aecb-4ccf-86a1-fb4ec8862101", "tag": "ebb65088-8e54-4c8c-8d1b-9ddaac157097"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:01.322167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.322167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.322167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.338761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] Creating event network-changed:ebb65088-8e54-4c8c-8d1b-9ddaac157097 for instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 on n-h1-855649-4 Nov 02 11:58:01.344515 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6323d7d2-ba75-4ba8-bed5-bc1d0ceed040 req-cea80ec6-25ab-46dc-b94e-efc01d5c13de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064269 Nov 02 11:58:01.345873 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 913/1834] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:01.352257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:01.352975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:01.359583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.361217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.361217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.361463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.361805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.362532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.668762 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce04030d-5bd5-4b29-b189-32c9ff0acfd1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1650 microversion: 2.1 time: 0.459427 Nov 02 11:58:01.677800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 922/1835] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:01 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1650 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.686161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:01.689290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:01.709936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.712919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.713554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.714535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.717285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.718613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.737259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:01.748977 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b360721-db6c-446b-82c1-5d3ab43f3882 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.399251 Nov 02 11:58:01.753578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 914/1836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:01 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.781467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-634c8f4e-2338-4531-9c6b-2a893f915206 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b313c4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:01.865155 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-634c8f4e-2338-4531-9c6b-2a893f915206 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.110339 Nov 02 11:58:01.866438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 915/1837] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:01 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:01.911661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276d7694-f2be-4aed-b4cc-720a7ced2aef", "name": "network-vif-plugged", "status": "completed", "tag": "cf220b2b-5c25-47e2-a13f-5e63393a48da"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:01.937987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:01.939350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:01.941973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:01.955117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] Creating event network-vif-plugged:cf220b2b-5c25-47e2-a13f-5e63393a48da for instance 276d7694-f2be-4aed-b4cc-720a7ced2aef on n-h1-855649-4 Nov 02 11:58:01.961346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-43ad0698-fffa-4424-aea7-b05ec04829fc req-17cc7312-ca47-40a4-99e6-66c6e054aea3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055965 Nov 02 11:58:01.962132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 916/1838] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:58:02.006460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:02.019558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:02.021026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:02.022564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b64ca945-0815-47d2-93d6-194e351fa948 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1475 microversion: 2.25 time: 0.343496 Nov 02 11:58:02.035330 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 923/1839] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:01 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1475 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:02.233587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:02.235127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:02.251748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.255955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.256861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.259212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.263611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.263907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.550877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:02.550877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:02.555218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.555806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.556325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.557477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.559107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.559623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ba5c1de-1ca2-49a0-b8cc-786ea7c7ac22 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 0.433461 Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 924/1840] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:02 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:02.789204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:03.095441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid c1c98427-f8a4-4a54-bd49-2beb66cc6c65 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:03.128471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8095a4f5-cbad-4ae4-bf3b-a32910abfd41 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1967 microversion: 2.25 time: 1.083997 Nov 02 11:58:03.129380 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 917/1841] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:02 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1967 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:03.137805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:03.142953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:03.157457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.159986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.160651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.168748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.172333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.173007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.385883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:03.406231 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1509444e-358c-49ff-9d1c-34f90cb1b270 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.741356 Nov 02 11:58:03.425008 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 925/1842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:02 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:03.431486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:03.432785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:03.440946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.442343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.443089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.444074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.445822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.446923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.801296 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d5c7d7e-3972-40f8-96b2-e5aa8f5a9d2c tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1630 microversion: 2.1 time: 0.666965 Nov 02 11:58:03.803977 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 918/1843] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:03 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1630 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:03.810640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f73da2c-1cea-4ccd-a7da-129c6f1b23d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b30dddc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:03.917925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f73da2c-1cea-4ccd-a7da-129c6f1b23d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.112329 Nov 02 11:58:03.919242 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 919/1844] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:03 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:03.927571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:03.927571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:03.934777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.936801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.937529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:03.941014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:03.942160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:03.942758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.314350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:04.324614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-231575e4-6fe5-4838-96ee-644836a5f876 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1324 microversion: 2.1 time: 0.897584 Nov 02 11:58:04.326771 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 926/1845] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:03 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1324 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:04.342266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:04.343578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:04.358020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.365510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.366122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.367011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.371573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.373997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.661153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid c1c98427-f8a4-4a54-bd49-2beb66cc6c65 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:04.703074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bde42294-e842-47da-be74-3d0944cd5e90 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1967 microversion: 2.25 time: 0.782423 Nov 02 11:58:04.707581 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 920/1846] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:03 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1967 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:04.722518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-855649-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:04.727754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:04.740206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.741345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.775291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.779768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:04.786097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:04.786762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:04.826106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lazy-loading 'flavor' on Instance uuid fc44e92c-29a5-41a6-870c-a9d881e34e8c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:04.847760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Going to try to live migrate instance to n-h1-855649-4 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:58:04.927729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:04.956690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae0e396e-8d10-4b10-b115-d6aaded28332 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1367 microversion: 2.1 time: 0.627300 Nov 02 11:58:04.969150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 927/1847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:04 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:04.974759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3baa3b-1ff1-4b4b-8664-15101565ce6c", "name": "network-vif-plugged", "status": "completed", "tag": "e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62"}, {"server_uuid": "28c859a0-5be4-47cb-a1d3-5d54a5edfa31", "name": "network-vif-plugged", "status": "completed", "tag": "4802d97c-ffe5-4b54-a1e2-512e7a006f7e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:05.004740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.006668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.010861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.032097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:05.045155 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Creating event network-vif-plugged:e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62 for instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c on n-h1-855649-4 Nov 02 11:58:05.051548 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] Creating event network-vif-plugged:4802d97c-ffe5-4b54-a1e2-512e7a006f7e for instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 on n-h1-855649-4 Nov 02 11:58:05.060412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ee91fa80-a72a-41a8-a9d2-4d3e19fb616f req-607d51ee-6445-4423-b7b5-350005591d7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089867 Nov 02 11:58:05.063065 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 928/1848] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:05.071015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:05.073610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:05.101977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.115836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.119252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.123026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.123770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.125335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.740231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:05.754469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4783d0c-2a19-4aad-8d89-d54adfc0c007 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.687123 Nov 02 11:58:05.755803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 929/1849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:05 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:05.771906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:05.778645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.779423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.783337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.784438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:05.785092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:05.786282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:05.897110 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d58f81f5-b849-4834-83b9-69b62a307149 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.139960 Nov 02 11:58:05.902405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 930/1850] 10.222.0.48 () {60 vars in 1217 bytes} [Wed Nov 2 11:58:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 11:58:05.923371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d03c885-c747-4084-836f-f6a41afd8ec5 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35f4ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:06.003500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d03c885-c747-4084-836f-f6a41afd8ec5 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1413 microversion: 2.1 time: 0.099839 Nov 02 11:58:06.004161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 931/1851] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:05 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:06.023032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:06.023674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:06.040085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.041288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.041288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.041918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.042388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.042823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.762610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:06.788119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cd48de0-4ee2-47d4-885e-1f306f4a0cd7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.782580 Nov 02 11:58:06.789049 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 932/1852] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:06 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:06.797248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": "auto"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:06.801188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:06.811867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.813126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.817565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.818617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:06.819327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:06.819957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:06.855132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'flavor' on Instance uuid c1c98427-f8a4-4a54-bd49-2beb66cc6c65 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:06.883012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:58:10.067148 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ab21e9c-ab73-44b8-a48f-2c7cb6a792f1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c/action" status: 202 len: 0 microversion: 2.1 time: 5.355458 Nov 02 11:58:10.071816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 921/1853] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:04 2022] POST /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c/action => generated 0 bytes in 5362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:58:10.078165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:10.079066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:10.088070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.088800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.089932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.091109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.091731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.092491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.358383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:10.381712 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecc379fe-aecf-4f7a-9c3c-a4680af192ab tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1557 microversion: 2.1 time: 0.303576 Nov 02 11:58:10.395493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 922/1854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:10 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1557 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:10.407452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:10.408978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:10.417077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.418080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.418726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.419704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.420460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.421118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.574021 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5c3bf00-5081-4646-8d44-435846689c4d tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65/action" status: 202 len: 0 microversion: 2.25 time: 3.783542 Nov 02 11:58:10.575673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 933/1855] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 11:58:06 2022] POST /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65/action => generated 0 bytes in 3785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:10.582680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:10.587643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:10.602615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.604420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.604420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.604657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:10.608441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:10.610548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:10.913309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:10.923812 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0cae5f2e-5044-46cd-865a-1c2822f738e8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.525035 Nov 02 11:58:10.926740 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 923/1856] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:10 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:10.937757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c3ca77e-fc77-48ce-8a16-a5fdd7a13fa4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b30dddc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:11.007309 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c3ca77e-fc77-48ce-8a16-a5fdd7a13fa4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1422 microversion: 2.1 time: 0.078979 Nov 02 11:58:11.007910 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 924/1857] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:10 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:11.013473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5388f4-aecb-4ccf-86a1-fb4ec8862101", "name": "network-vif-plugged", "status": "completed", "tag": "ebb65088-8e54-4c8c-8d1b-9ddaac157097"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:11.058488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.063992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.063992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.077084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] Creating event network-vif-plugged:ebb65088-8e54-4c8c-8d1b-9ddaac157097 for instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 on n-h1-855649-4 Nov 02 11:58:11.085414 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5cf0567a-2f66-419b-b909-1632e7c90afe req-2b13e74b-a93f-4f32-9136-86345a34f52f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075080 Nov 02 11:58:11.085659 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 925/1858] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:11.099411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:11.114494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:11.134931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.134931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.134931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.135813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.136099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.137634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.164301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:11.177483 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5b3d3b8-a109-4776-84b9-10d46010320e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.598150 Nov 02 11:58:11.180834 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 934/1859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:10 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:11.191941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:11.192456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:11.215693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.219110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.219987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.221604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.223164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.224205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.565020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fd9f179-44a0-48d2-8a3b-bd3d102fc813 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.382910 Nov 02 11:58:11.565842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 935/1860] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:58:11 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:11.570718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:11.571595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:11.592485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:11.877704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:11.889990 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eebe507-4fe8-4b7c-a37f-42441d5aca83 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.795774 Nov 02 11:58:11.891653 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 926/1861] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:11 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:11.901242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6250d30-415b-47d4-a093-013fa2c199ff tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3108040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:12.031371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6250d30-415b-47d4-a093-013fa2c199ff tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 200 len: 1422 microversion: 2.1 time: 0.135944 Nov 02 11:58:12.032833 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 927/1862] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:11 2022] GET /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:12.038621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c13cdd4-5dd6-43d5-b804-f3d00372974c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1740333885", "metadata": {"": ""}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c13cdd4-5dd6-43d5-b804-f3d00372974c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action HTTP/1.1 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 107 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1740333885", "metadata": {"": ""}}} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1740333885', 'metadata': {'': ''}}}} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:58:12.045742 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:12.054314 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:12.058677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c13cdd4-5dd6-43d5-b804-f3d00372974c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:12.059848 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c13cdd4-5dd6-43d5-b804-f3d00372974c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action" status: 400 len: 170 microversion: 2.1 time: 0.025813 Nov 02 11:58:12.065049 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 928/1863] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Nov 2 11:58:12 2022] POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:58:12.071170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:12.072058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:12.079236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.080038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.080634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:12.081558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.082459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.083363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:12.540976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:12.603155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:12.612976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:12.614659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d4d1826-2038-4d2d-9730-898cff7b7a7f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 1.047703 Nov 02 11:58:12.624343 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 936/1864] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:11 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:12.639467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04f9c56f-13f4-4248-a3d4-8398d27ecb9b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35b0940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:12.826397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:12.841337 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-277d40f3-3bb1-4a8f-9644-fb22f00cd4cb tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1318 microversion: 2.1 time: 0.778504 Nov 02 11:58:12.842317 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 929/1865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:12 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:12.851584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:12.855172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:12.867085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.878449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.878919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:12.879758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:12.880228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:12.880662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:13.203986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:13.220396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4663bed1-aca7-46fd-9d66-a13196cc8432 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.372766 Nov 02 11:58:13.223248 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 930/1866] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:12 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:13.236476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1680184958", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "3e5c3cb6-6366-43cd-ada5-02c201988b99"}, {"uuid": "5d361023-1ba7-438a-bb1e-da3e2ca21aef"}, {"uuid": "3e5c3cb6-6366-43cd-ada5-02c201988b99"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:13.392016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] validate_networks() for [('3e5c3cb6-6366-43cd-ada5-02c201988b99', None, None, None, None, None), ('5d361023-1ba7-438a-bb1e-da3e2ca21aef', None, None, None, None, None), ('3e5c3cb6-6366-43cd-ada5-02c201988b99', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:14.585259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04f9c56f-13f4-4248-a3d4-8398d27ecb9b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 204 len: 0 microversion: 2.1 time: 1.959558 Nov 02 11:58:14.586720 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 937/1867] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:12 2022] DELETE /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 0 bytes in 1962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:14.599139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:14.600034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:14.617859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.618685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.619365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:14.620281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.620908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.621503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:14.895803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:14.921065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8e588f8-7c74-442d-9244-b12d142a915a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.332762 Nov 02 11:58:14.921975 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 938/1868] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:14 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:14.931220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:14.932136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:14.942356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.947632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.948337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:14.950766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:14.954426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:14.956815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.115214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:15.115814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:15.116597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:15.117214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:15.117814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:15.138189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.147678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.148330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.149956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.150620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.152265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.207113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Getting quotas for project 14c077c616bb4ade937d69a58dc21bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:15.223190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Getting quotas for user 2bc8e86ed3c244618a5f331ac316a968 and project 14c077c616bb4ade937d69a58dc21bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:15.242767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.247579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:15.250120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:15.252610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e54cce0-f8c7-46b7-90d9-57bfaaed79d7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.326788 Nov 02 11:58:15.253664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 939/1869] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:14 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:15.258500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c859a0-5be4-47cb-a1d3-5d54a5edfa31", "tag": "4802d97c-ffe5-4b54-a1e2-512e7a006f7e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:15.273111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.273900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.274831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.296538 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] Creating event network-changed:4802d97c-ffe5-4b54-a1e2-512e7a006f7e for instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 on n-h1-855649-4 Nov 02 11:58:15.312929 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0fbb4958-06a1-499f-9755-06584268f833 req-abc74cfa-aee8-4bfd-929f-df08d56fa090 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057756 Nov 02 11:58:15.313542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 940/1870] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:15.319687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.320614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:15.332062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.336627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.339752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.340754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.341297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.341672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.413278 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-241f4092-8485-40e6-b0e3-90a4210a0d9c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187521 Nov 02 11:58:15.421869 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 931/1871] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:15.433130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.435998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:15.475130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.475637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.477560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.478230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.479203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.479806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.726626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.751404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.772527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.775139 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f86c9a99-fc45-4639-91fe-887d9f8959dd tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.458811 Nov 02 11:58:15.777376 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 941/1872] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:15.783033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc44e92c-29a5-41a6-870c-a9d881e34e8c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b1af59e-6454-43b1-84c1-2c0adf0311fa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:15.797243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:15.797375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.797919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.800111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.803333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c17a49d-796d-4dd1-bd16-e68f650499b6 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 200 len: 1506 microversion: 2.1 time: 0.380171 Nov 02 11:58:15.803884 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 932/1873] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:15.818009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:15.818304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.818304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:15.818487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] Creating event network-vif-unplugged:0b1af59e-6454-43b1-84c1-2c0adf0311fa for instance fc44e92c-29a5-41a6-870c-a9d881e34e8c on n-h2-855649-4 Nov 02 11:58:15.832724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-213a38e1-0877-4403-acbb-2bfdc161c0d6 req-8efe27f4-fd02-4392-bd4e-8d17f69bc068 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053899 Nov 02 11:58:15.835381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 942/1874] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:15.836966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.847385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.847964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.848737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.849306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.849653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.849955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76336a1f-b324-432e-88e3-38d43e8c0160", "name": "network-vif-unplugged", "status": "completed", "tag": "244e718d-bb3d-4ca9-9e92-744898c3211f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:15.869644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:15.872672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:15.873414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:15.893932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:15.904281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] Creating event network-vif-unplugged:244e718d-bb3d-4ca9-9e92-744898c3211f for instance 76336a1f-b324-432e-88e3-38d43e8c0160 on n-h2-855649-4 Nov 02 11:58:15.918861 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fa437088-4eb7-4060-9f08-09e1031fb989 req-537c1105-ae67-45ed-a64a-73cfc9b84311 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081877 Nov 02 11:58:15.919909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 943/1875] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:15.934225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b14f58ff-3dcb-4e0e-8f14-1db6feab1d3f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1367164867", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b14f58ff-3dcb-4e0e-8f14-1db6feab1d3f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action HTTP/1.1 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 619 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1367164867", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1367164867', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:58:15.942172 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:58:15.945823 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:15.950198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b14f58ff-3dcb-4e0e-8f14-1db6feab1d3f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:15.954969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b14f58ff-3dcb-4e0e-8f14-1db6feab1d3f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action" status: 400 len: 938 microversion: 2.1 time: 0.028379 Nov 02 11:58:15.957610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 944/1876] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Nov 2 11:58:15 2022] POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:58:15.970778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85f5527c-4cd3-4b70-8fd0-76f439d4cb72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:15.973836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85f5527c-4cd3-4b70-8fd0-76f439d4cb72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.078323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85f5527c-4cd3-4b70-8fd0-76f439d4cb72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.088055 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85f5527c-4cd3-4b70-8fd0-76f439d4cb72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1213 microversion: 2.1 time: 0.126489 Nov 02 11:58:16.091581 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 945/1877] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:15 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:16.116770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.118669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.128975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.132716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.132716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.132716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.132716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.132716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.293285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1668100-a15d-4020-a339-51810229d9cd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 204 len: 0 microversion: 2.1 time: 0.486907 Nov 02 11:58:16.297754 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 933/1878] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:58:15 2022] DELETE /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:16.300649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.301379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.316779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.317189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.317644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.318388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.318838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.319312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.547711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.560486 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f54d727f-b7de-4944-bcc0-831e8b936005 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 200 len: 1507 microversion: 2.1 time: 0.451887 Nov 02 11:58:16.581061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 946/1879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:16 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:16.599585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.600532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:16.609064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.610262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.611735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.614150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:16.614824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:16.615597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:16.650642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.662768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31c044a7-503e-4b52-9c75-5722971fff78 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.367051 Nov 02 11:58:16.666882 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 934/1880] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:16 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:16.672955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-334533676", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:16.780145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:16.948562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:16.957291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:16.970526 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f3b6e10-4339-4137-958f-5e30d9b8c4f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.377074 Nov 02 11:58:16.971955 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 947/1881] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:16 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:16.978822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:16.979642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:17.005907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.007929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.009129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.010870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.011651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.012278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.053435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:17.437469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:17.438543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:17.440018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:17.440884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:17.441470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:17.453274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.454062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.455487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.456507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.458133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.458756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.490807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a952529f-9c16-4c45-a6df-f8f8ce1ac348 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 204 len: 0 microversion: 2.1 time: 0.517298 Nov 02 11:58:17.491934 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 948/1882] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:58:16 2022] DELETE /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:17.498137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:17.498954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:17.509547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.511019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.511948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.514242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:17.520845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.521519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.523772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.528703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:17.548824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:17.551747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:17.709866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:17.723840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:17.726000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:17.727507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8099720b-1125-4ba9-8635-26c3febbe81f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.233562 Nov 02 11:58:17.728114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 949/1883] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:17 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:17.734305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:17.735278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:17.738284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:17.745017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.745701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.746202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.747185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.748241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.748515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.825392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2c31d6f-c98e-4513-bc78-376edb12c79e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156070 Nov 02 11:58:17.827368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 935/1884] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:17.837971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:17.839274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:17.848584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.849690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.850413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.851399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:17.852046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:17.852665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:17.969596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:17.978659 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5260f9ca-d1a7-4308-95be-296d0b9782aa tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1217 microversion: 2.1 time: 0.149239 Nov 02 11:58:17.990043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 936/1885] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:17 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.006418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.007019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.009839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:18.014872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.015420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.015869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.016598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.017066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.017691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.028528 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d56cba0-d52d-421c-b5c8-8520b6d24e09 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.299181 Nov 02 11:58:18.039005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 950/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:17 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.039005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.039005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.043569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.047596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.048350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.051266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.051266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.056241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.078218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:18.359535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:18.368179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a9de5f7-fa35-448f-ac99-df09fb9629ab tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.337519 Nov 02 11:58:18.368774 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 951/1887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:18 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.373807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5045b87-c90f-4c73-8b29-90a74b8ea09b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.374431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5045b87-c90f-4c73-8b29-90a74b8ea09b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.421985 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ba4eca8-4bf4-4a21-9fc4-019e8aa149b8 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 204 len: 0 microversion: 2.1 time: 0.427256 Nov 02 11:58:18.425607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 937/1888] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:58:17 2022] DELETE /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:58:18.441348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc44e92c-29a5-41a6-870c-a9d881e34e8c", "tag": "0b1af59e-6454-43b1-84c1-2c0adf0311fa"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:18.454250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5045b87-c90f-4c73-8b29-90a74b8ea09b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:18.456784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.457533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.458946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.469673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5045b87-c90f-4c73-8b29-90a74b8ea09b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1207 microversion: 2.1 time: 0.099438 Nov 02 11:58:18.472934 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 952/1889] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:18 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1207 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:18.492763 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] Creating event network-changed:0b1af59e-6454-43b1-84c1-2c0adf0311fa for instance fc44e92c-29a5-41a6-870c-a9d881e34e8c on n-h2-855649-4 Nov 02 11:58:18.499877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8ba7734b-9a0e-497f-a611-cecb15c92a52 req-c9498d61-941b-42dc-bcd0-ef668c652ac0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069818 Nov 02 11:58:18.501003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 938/1890] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:18.502899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85ec6cd8-f610-4e99-8e3d-bf77e21f233e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:18.510423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.511481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85ec6cd8-f610-4e99-8e3d-bf77e21f233e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action HTTP/1.1 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 285 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.519604 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:18.524593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85ec6cd8-f610-4e99-8e3d-bf77e21f233e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:18.530612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85ec6cd8-f610-4e99-8e3d-bf77e21f233e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action" status: 400 len: 619 microversion: 2.1 time: 0.049938 Nov 02 11:58:18.530612 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 953/1891] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Nov 2 11:58:18 2022] POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:58:18.542364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:18.546226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:18.546376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.546863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.547659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.549761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.551254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.551881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.553721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.554224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.554670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:18.555934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:18.556408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:18.556842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.272268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.276607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.281217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-710cf8d7-33bb-436a-8857-fb516464ff25 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.748348 Nov 02 11:58:19.295024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 954/1892] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:18 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:19.295024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.295024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.302091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.308104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52f904e2-71bc-4b44-a3c6-d18a9a7560e0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 200 len: 1513 microversion: 2.1 time: 0.802755 Nov 02 11:58:19.310915 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 939/1893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:18 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 1513 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:19.316806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.318287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.326091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.326589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.327409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.328266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.328697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.329129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.334936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:19.464890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.478587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1db0ec36-f1da-4029-b847-356dddea82c4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1265 microversion: 2.1 time: 0.166239 Nov 02 11:58:19.480502 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 940/1894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:19.493371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.494268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.509672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:19.511727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.513159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.513159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.514042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.514683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.515338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.739289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.749738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.751384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.753544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ba1d0b4-9e9e-4d6d-af3a-f9e37e7365b4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.470380 Nov 02 11:58:19.756589 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 955/1895] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:19.773593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:19.774272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:19.785806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.785806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.785806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.785806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:19.786290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:19.786455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:19.967004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:19.991948 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85d37f81-7690-4d4a-bb34-d840658acc7e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.509275 Nov 02 11:58:19.993756 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 941/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:20.005901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:20.006771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.015890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.016657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.017347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.018826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.020273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.021152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.219669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:20.230921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-398c09ff-1079-449b-8691-f285501ea11e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1203 microversion: 2.1 time: 0.229311 Nov 02 11:58:20.232273 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 942/1897] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:20 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1203 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:20.237866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1673752632"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:20.241118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.249162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.250392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.251187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.252410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.253167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.254379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.261155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:20.270698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-893695a9-4580-4a83-a6bc-b23f6a303bf6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.512018 Nov 02 11:58:20.272862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 956/1898] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:19 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:20.333894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:20.334803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.350601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.350601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.350601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.350601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.350601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.351197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.820284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:20.828452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef1cc360-dd3c-4e92-b6bd-596b872fb11c tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 200 len: 1513 microversion: 2.1 time: 0.499274 Nov 02 11:58:20.829048 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 957/1899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:20 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:20.834451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:20.835086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.844491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.844994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.846045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.846764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.847420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.847859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.848036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19cc1840-57e5-462a-bb3c-89d6c796e8dd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action" status: 202 len: 0 microversion: 2.1 time: 0.614262 Nov 02 11:58:20.848986 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 943/1900] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:20 2022] POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:58:20.854398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76336a1f-b324-432e-88e3-38d43e8c0160", "name": "network-vif-deleted", "tag": "244e718d-bb3d-4ca9-9e92-744898c3211f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:20.865629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.869354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.869354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.880087 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] Creating event network-vif-deleted:244e718d-bb3d-4ca9-9e92-744898c3211f for instance 76336a1f-b324-432e-88e3-38d43e8c0160 on n-h2-855649-4 Nov 02 11:58:20.887374 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d9d73398-8fc7-454f-b3b4-6a66d4444d62 req-6130b47d-3c9f-4220-b98c-bfcb6c9bf9fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Nov 02 11:58:20.889662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 944/1901] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:20.896607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:20.897525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:20.904936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.905502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.906034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.906959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:20.907511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:20.908606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:20.963583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:20.972517 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e14b59e-6adc-4325-bc4f-2439c3461c47 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1271 microversion: 2.1 time: 0.142400 Nov 02 11:58:20.973101 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 958/1902] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:20 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:20.987480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2064640100"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:20.989920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:21.004260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.004773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.005289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.006319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.007516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.013666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.053271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Cannot 'createImage' instance 276d7694-f2be-4aed-b4cc-720a7ced2aef while it is in task_state image_snapshot_pending Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action HTTP/1.1 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 85 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2064640100"}} Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'createImage' instance 276d7694-f2be-4aed-b4cc-720a7ced2aef while it is in task_state image_snapshot_pending Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2064640100'}}} Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 11:58:21.058204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 276d7694-f2be-4aed-b4cc-720a7ced2aef while it is in task_state image_snapshot_pending Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 276d7694-f2be-4aed-b4cc-720a7ced2aef while it is in task_state image_snapshot_pending Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 409 to user: Cannot 'createImage' instance 276d7694-f2be-4aed-b4cc-720a7ced2aef while it is in task_state image_snapshot_pending {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:21.064106 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1e42935-f83f-4b0c-b744-04d0cb796061 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action" status: 409 len: 167 microversion: 2.1 time: 0.083647 Nov 02 11:58:21.065348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 959/1903] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:20 2022] POST /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef/action => generated 167 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:58:21.073188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be3846b1-148c-4595-87fd-a59656ec8b30 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1b35bb3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:21.256554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:21.277560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:21.279196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:21.280569 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20c9e373-0ce1-4a3e-b762-fd756b6294d9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.389333 Nov 02 11:58:21.281132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 945/1904] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:20 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:21.313832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:21.316075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:21.340361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.343143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.343584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.345837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.345837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.345837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.436452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be3846b1-148c-4595-87fd-a59656ec8b30 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/images/b95f5735-11c3-40cb-88da-1e642722119e" status: 204 len: 0 microversion: 2.1 time: 0.367935 Nov 02 11:58:21.441639 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 960/1905] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:21 2022] DELETE /compute/v2.1/images/b95f5735-11c3-40cb-88da-1e642722119e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:58:21.444785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:21.445436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:21.453910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.454410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.455457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.456239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.457078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.457585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.524257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:21.540866 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47f2f07b-18ef-410f-946c-74592205974b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1267 microversion: 2.1 time: 0.245053 Nov 02 11:58:21.558662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 946/1906] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:21 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:21.579255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:21.580099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:21.588329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.591239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.591239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:21.591239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:21.591239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:21.591239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.552642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:22.562907 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15a6e03c-9e73-423f-b68e-94e7cde42e16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 1.124709 Nov 02 11:58:22.563560 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 961/1907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:21 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:22.569766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:22.570382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:22.586505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.587308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.587748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.589055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.589807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.590335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.703294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:22.719875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df50b22f-0d30-4737-ba6d-bcd01728506f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1534 microversion: 2.1 time: 1.159567 Nov 02 11:58:22.721827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 947/1908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:21 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1534 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:22.726063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:22.726682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:22.739303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.740047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.740523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.744727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.744727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.744727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.885530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:22.895296 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9eefae39-1dce-4402-9b2c-3145e3bfad97 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1271 microversion: 2.1 time: 0.173218 Nov 02 11:58:22.896134 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 948/1909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:22 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:22.900694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:22.901615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:22.908271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.908774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.912099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:22.912099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:22.912099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:22.912099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.255924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.277349 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a743600-c06d-40ab-97b9-c49e2842b6f0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 200 len: 1513 microversion: 2.1 time: 0.712299 Nov 02 11:58:23.279724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 962/1910] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:22 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 1513 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:23.305630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:23.306724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:23.315447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.315950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.316388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.318345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.318345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.318893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.489338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.508657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebb85c17-8e6e-44d3-b1df-f791bdbd4a42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1265 microversion: 2.1 time: 0.222861 Nov 02 11:58:23.509700 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 963/1911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:23 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:23.582215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.602456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.605403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:23.610439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:23.610687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:23.617791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40486ff3-c6fa-4157-8303-4cc132021c53 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.718450 Nov 02 11:58:23.620047 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 949/1912] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:22 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:23.630865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.631884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.632547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.633465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.634220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.634878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.745198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:23.746818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:23.757198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.758342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.759367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:23.760350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:23.761405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:23.762207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.396102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.405277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a9ef841-1ea5-4181-81be-7a5236ca1002 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.811612 Nov 02 11:58:24.405879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 964/1913] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:23 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:24.417977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3baa3b-1ff1-4b4b-8664-15101565ce6c", "name": "network-vif-deleted", "tag": "e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:24.418145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.435363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.436185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.436819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.447370 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55b1013f-781a-4e71-b878-c4a37bece8b5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1540 microversion: 2.1 time: 0.706983 Nov 02 11:58:24.449426 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 950/1914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:23 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1540 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:24.463995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:24.464839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:24.473418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.474308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.475438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.480089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.480833 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] Creating event network-vif-deleted:e2d43af1-bd95-45b1-a5b3-bea4b4dd7a62 for instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c on n-h1-855649-4 Nov 02 11:58:24.481787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.482504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.486634 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5d877385-28b7-435c-bead-abde27873740 req-90c522ed-a2fc-4a58-9e5a-ca10a2c9d848 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079128 Nov 02 11:58:24.487460 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 965/1915] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:24.493297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:24.494285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:24.511554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.521413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.521413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.521413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.521413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.521413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.541337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:24.557687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.558012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.558630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.559197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lazy-loading 'fault' on Instance uuid ec3baa3b-1ff1-4b4b-8664-15101565ce6c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:24.661293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10791601b7f44cea5752c01781f3be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f3df4d86624fb099055183e4046e0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.671306 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61bd527e-5a6f-4a47-a0b7-63b298630fff tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 200 len: 1308 microversion: 2.1 time: 0.182400 Nov 02 11:58:24.672057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 966/1916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:24 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:24.677704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:24.678926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:24.693273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.694100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.694537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.695374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.695840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.696681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.792872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.802279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c6c5c6b-a974-4762-967a-04db0e81db72 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1265 microversion: 2.1 time: 0.128764 Nov 02 11:58:24.803191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 967/1917] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:24 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:24.808504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:24.809124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:24.816643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.817371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.817988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.818905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:24.819558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:24.820161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:24.914164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:24.928132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-704327a6-2d63-49ed-9058-a5c6a366aabd tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1313 microversion: 2.1 time: 0.477753 Nov 02 11:58:24.937131 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 951/1918] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:24 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:25.273254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:25.297239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:25.299625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:25.301069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-215cc7f3-9c6e-4f7a-b67e-e1ca59a13185 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.496831 Nov 02 11:58:25.301643 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 968/1919] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:24 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:25.430222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:25.431051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:25.438092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.438655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.439220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:25.440061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.440621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.441169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:25.478107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:25.479476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:25.485908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.486386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.487113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:25.487836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:25.488293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:25.488723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.131479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:26.140846 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4812ff9f-4bd8-4ac4-a339-f0bfb12adb89 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1504 microversion: 2.1 time: 0.714797 Nov 02 11:58:26.141825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 952/1920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:25 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1504 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:26.150922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.152627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: ec3baa3b-1ff1-4b4b-8664-15101565ce6c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.164987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.171102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.171102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.171102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.171102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.171102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.188746 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] HTTP exception thrown: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Request method failure captured: Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c HTTP/1.1 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlr_yJG72cCt6O4vIip3LMvemZryr3k3wunFRT6j_idaiCSlz-2jt5xtPyUMj0OzLAr21jUt_xmoBaZF072hALp-Gi1SB2bDvM9R9ey7_v-7khY32CumJsdzkypCLDSFiVJtfM43KjMc59vZz9Jv5QPBg_SiU-_9krunKMnBpxPcZdA Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 97f3df4d86624fb099055183e4046e0b Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f3df4d86624fb099055183e4046e0b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 97f3df4d86624fb099055183e4046e0b Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateTestJSON-1272383076-project Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a10791601b7f44cea5752c01781f3be9 Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateTestJSON-1272383076-project Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ec3baa3b-1ff1-4b4b-8664-15101565ce6c'} Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:26.190948 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. Nov 02 11:58:26.195573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.199436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Returning 404 to user: Instance ec3baa3b-1ff1-4b4b-8664-15101565ce6c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:26.202696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af141648-bcd0-4598-aed8-ad680f430cc0 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c" status: 404 len: 111 microversion: 2.1 time: 0.058755 Nov 02 11:58:26.203887 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 953/1921] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/ec3baa3b-1ff1-4b4b-8664-15101565ce6c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:58:26.210522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:26.218106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276d7694-f2be-4aed-b4cc-720a7ced2aef", "name": "network-vif-plugged", "status": "completed", "tag": "cf220b2b-5c25-47e2-a13f-5e63393a48da"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:26.218598 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f03e120-4dc9-4ebf-b8e8-4a885aeb47a4 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1540 microversion: 2.1 time: 0.744332 Nov 02 11:58:26.219235 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 969/1922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:25 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1540 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:26.231287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.231641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.231914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.232528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.239799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.252351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.252847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.253281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.254047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.254444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.254867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.264910 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] Creating event network-vif-plugged:cf220b2b-5c25-47e2-a13f-5e63393a48da for instance 276d7694-f2be-4aed-b4cc-720a7ced2aef on n-h1-855649-4 Nov 02 11:58:26.271277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-971918a7-ae34-49dd-9cc9-604399ee4088 req-11167ab0-b2dd-45cb-856b-63300de569ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063333 Nov 02 11:58:26.272508 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 954/1923] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:26.279789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.280573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.290401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.291293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.292917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.294169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.294862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.295589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.770838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:26.788563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-873100f6-1ab6-4cac-8739-1a647059d03d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.559503 Nov 02 11:58:26.788563 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 970/1924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:26.788563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.788563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] [instance: 9e5388f4-aecb-4ccf-86a1-fb4ec8862101] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.792200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.792682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.793284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.793990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.794450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.794901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.797389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:26.805754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-166fe54c-305b-4f1d-83c7-85da01ec952c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1334 microversion: 2.1 time: 0.531580 Nov 02 11:58:26.811460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] HTTP exception thrown: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Request method failure captured: Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 HTTP/1.1 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlr_yJG72cCt6O4vIip3LMvemZryr3k3wunFRT6j_idaiCSlz-2jt5xtPyUMj0OzLAr21jUt_xmoBaZF072hALp-Gi1SB2bDvM9R9ey7_v-7khY32CumJsdzkypCLDSFiVJtfM43KjMc59vZz9Jv5QPBg_SiU-_9krunKMnBpxPcZdA Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 97f3df4d86624fb099055183e4046e0b Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f3df4d86624fb099055183e4046e0b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f3df4d86624fb099055183e4046e0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 97f3df4d86624fb099055183e4046e0b Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1272383076 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateTestJSON-1272383076-project Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: a10791601b7f44cea5752c01781f3be9 Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateTestJSON-1272383076-project Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '9e5388f4-aecb-4ccf-86a1-fb4ec8862101'} Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:26.813195 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] Returning 404 to user: Instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:26.820928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b75b45bb-b3bc-4591-8d50-c8bda3b88f32 tempest-MultipleCreateTestJSON-1272383076 tempest-MultipleCreateTestJSON-1272383076-project] 10.222.0.48 "GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101" status: 404 len: 111 microversion: 2.1 time: 0.035624 Nov 02 11:58:26.821662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 955/1925] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:26.822927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 971/1926] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/9e5388f4-aecb-4ccf-86a1-fb4ec8862101 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:58:26.824746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:26.825581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:26.832906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5388f4-aecb-4ccf-86a1-fb4ec8862101", "name": "network-vif-deleted", "tag": "ebb65088-8e54-4c8c-8d1b-9ddaac157097"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:26.833347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.833932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.834439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.836767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.836767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.836767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.842722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:26.843286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:26.843725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:26.855808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] Creating event network-vif-deleted:ebb65088-8e54-4c8c-8d1b-9ddaac157097 for instance 9e5388f4-aecb-4ccf-86a1-fb4ec8862101 on n-h1-855649-4 Nov 02 11:58:26.862059 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-72351e80-aa28-4199-8bb3-7da6498d2a0a req-f95ebabd-0c3a-4c8a-8a06-f3bd39ae2a82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036881 Nov 02 11:58:26.863421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 972/1927] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:27.172460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.175915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:27.182174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.182669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.183148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.184167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.184715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.185308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.185440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.195216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.197010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.199020 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eadd1a4-f216-474b-ae29-bcb91a169c39 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.378354 Nov 02 11:58:27.200162 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 956/1928] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:26 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:27.266024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.267048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:27.275530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.276474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.277177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.278117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.278578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.279026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.309957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:27.474487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:27.538143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:27.641055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.650949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cb71e53-f766-430a-8191-19ffc6fac289 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1479 microversion: 2.1 time: 0.489286 Nov 02 11:58:27.666019 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 973/1929] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:27 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1479 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:27.675402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eac5c801-7171-4eba-8203-a2d0d3d3c8ef tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '.version_select at 0x7ff1bbb76940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.681368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac5c801-7171-4eba-8203-a2d0d3d3c8ef tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.682926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac5c801-7171-4eba-8203-a2d0d3d3c8ef tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.683643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac5c801-7171-4eba-8203-a2d0d3d3c8ef tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.706598 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eac5c801-7171-4eba-8203-a2d0d3d3c8ef tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.036224 Nov 02 11:58:27.708809 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 974/1930] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 11:58:27 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:27.719867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:27.729287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.730083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:27.736875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ded95215-8a38-4025-9559-b498addd3b95 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1522 microversion: 2.1 time: 0.477802 Nov 02 11:58:27.737480 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 957/1931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:27 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:27.741105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.742855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.743583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.744463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.745083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.745620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.762490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:27.763021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:27.769808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.770457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.770903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.771957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:27.772385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:27.772865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:27.806433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:28.026294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-141d9fd2-d59a-4387-a1eb-56156c037368 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1630 microversion: 2.1 time: 0.288151 Nov 02 11:58:28.039496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 975/1932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:27 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1630 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:28.046588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:28.047831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:28.108929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.110080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.111687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.115713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.115713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.115713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.196523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca34a086-c374-44e9-9618-d108cae1c45d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 204 len: 0 microversion: 2.1 time: 0.437577 Nov 02 11:58:28.197526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 958/1933] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:58:27 2022] DELETE /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:58:28.204074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:28.209543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:28.228722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.229813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.230414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.231319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.237796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.238524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.461223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:28.745776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:28.759028 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb866b74-d344-4df4-94d5-d3e826145cde tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.717738 Nov 02 11:58:28.760759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 976/1934] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:28 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:28.767941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7089577a-c50a-46d7-8a39-1124be2e94e4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: .version_select at 0x7ff1b35f5280>, body: {"keypair": {"name": "tempest-keypair-453736248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnpei1YWGQqrgL8QEgR8v5DNXh3KPApY9Q+Q3xseZ5DAyvb7lTr+kY1/inEKJIzn7K1zFC/JO8rgDukVD2FkxhZ1ArkpM9pD8rgVitUuSslUV/LxfkNODvBTWpxTg4QsA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:28.790059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7089577a-c50a-46d7-8a39-1124be2e94e4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:28.796962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-7089577a-c50a-46d7-8a39-1124be2e94e4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for user 29699172e95148b99d076a8bcfc09668 and project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:28.799069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:28.811931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61721446-08d0-4cf9-bb08-89af6c2e634f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.612584 Nov 02 11:58:28.823021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 959/1935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:28 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:28.836368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:28.837006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:28.854050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.854513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.855859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.856628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.858095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.858662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.909756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7089577a-c50a-46d7-8a39-1124be2e94e4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147081 Nov 02 11:58:28.910434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 977/1936] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:58:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:28.915698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:28.916312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:28.934933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.940342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.940879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:28.942558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:28.943607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:28.944335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.433710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:29.442258 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75de37a0-99f7-44c8-a82b-0bbc282072b3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1528 microversion: 2.1 time: 0.614471 Nov 02 11:58:29.442853 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 960/1937] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:28 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:29.465932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103d200a-8c8d-49ed-871e-9916ea9a2163", "tag": "c1d2dc31-6685-4faa-9b41-efc52d9cbf8c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:29.480740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:29.486566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.486566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.486566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.501546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] Creating event network-changed:c1d2dc31-6685-4faa-9b41-efc52d9cbf8c for instance 103d200a-8c8d-49ed-871e-9916ea9a2163 on n-h2-855649-4 Nov 02 11:58:29.511333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:29.518305 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8d0f6477-c6e2-4c85-8450-59f9d15aeca3 req-9badd2a2-aac5-405c-b9d9-6e60f759bcd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066789 Nov 02 11:58:29.519382 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 961/1938] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:29.522159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:29.523767 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0cefdf9-6425-479d-a8ba-b803aba5ad70 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.612379 Nov 02 11:58:29.525021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 978/1939] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:28 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:29.796513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:29.800961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:29.810824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.811373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.812344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.813031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.813603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.814033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.839444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:29.840562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:29.852844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.856836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.856836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:29.857620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:29.858114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:29.859127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.770935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:30.795264 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da593acc-29d2-4e41-903a-5836fa96237f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.960606 Nov 02 11:58:30.795451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:30.801100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 979/1940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:29 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:30.806277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15618ef6-ca4f-4765-8395-32d58e0c325b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 1.022259 Nov 02 11:58:30.811780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276d7694-f2be-4aed-b4cc-720a7ced2aef", "name": "network-vif-unplugged", "status": "completed", "tag": "cf220b2b-5c25-47e2-a13f-5e63393a48da"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:30.823436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 962/1941] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:29 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:30.833607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.834441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.835080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.842200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:30.845017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.865207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.867793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] Creating event network-vif-unplugged:cf220b2b-5c25-47e2-a13f-5e63393a48da for instance 276d7694-f2be-4aed-b4cc-720a7ced2aef on n-h1-855649-4 Nov 02 11:58:30.875324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3345098c-b182-4be3-8732-0023a06523e7 req-445f56f5-d991-4dfa-9b0c-7deafb539b7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072555 Nov 02 11:58:30.877125 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 980/1942] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:30.887271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:30.888268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:30.902689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.904236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.904902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:30.906233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:30.907369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:30.908559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.443810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:31.453872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:31.465034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:31.467303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:31.472426 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d20ac16-3e79-4974-bc19-ead1370f29da tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.590317 Nov 02 11:58:31.473345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 981/1943] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:30 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:31.475923 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cdaab34-b2d7-457f-b44f-18dee6a605a3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1528 microversion: 2.1 time: 0.646991 Nov 02 11:58:31.495911 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 963/1944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:30 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1528 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:31.572074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c98427-f8a4-4a54-bd49-2beb66cc6c65", "name": "network-vif-unplugged", "status": "completed", "tag": "0f4115b4-e3f6-4e46-9180-93e3d932e9f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:31.594123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.596245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.601538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.633136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] Creating event network-vif-unplugged:0f4115b4-e3f6-4e46-9180-93e3d932e9f6 for instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 on n-h1-855649-4 Nov 02 11:58:31.643234 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6fa33c16-3337-402b-bc9b-4b7958484e08 req-8af4fc2c-0b12-4cb1-9e17-40ae3e0be1eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081539 Nov 02 11:58:31.644857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 982/1945] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:31.826034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:31.827777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:31.835350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:31.838440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:31.852798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.853544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.854272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.854883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.855602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.856576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.857338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.864090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:31.864657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.864847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:31.865143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:31.865666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.297714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.310240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72b0fe9e-8ed2-4683-8d07-8807ee09539c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.478854 Nov 02 11:58:32.312958 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 983/1946] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:31 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:32.322910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.338521 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4dccd4b-afc9-4537-8dbe-da04a1ad5d98 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.516467 Nov 02 11:58:32.358223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 964/1947] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:31 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:32.505646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:32.505886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:32.506326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:32.506679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:32.513747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.514826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.515571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.516537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.517781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.518215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.518489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.519686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.520443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.521398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.521931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.522300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.560777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:32.561482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:32.562099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:32.562731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lazy-loading 'fault' on Instance uuid 276d7694-f2be-4aed-b4cc-720a7ced2aef {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:32.636047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.645617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85bc507f-877c-40c8-9ab7-25ae895e5cab tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1314 microversion: 2.1 time: 0.144281 Nov 02 11:58:32.648469 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 965/1948] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:32 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:32.792733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.802368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.803859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:32.805027 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d99d92be-a2ef-4fe0-a483-abd62a1e595f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.303938 Nov 02 11:58:32.805582 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 984/1949] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:32 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:58:33.337771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:33.337771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:33.349246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.349744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.350189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.351007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.351444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.351881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.362516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:33.363211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:33.378525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.379333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.381487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.382540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.388099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.391292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.848835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:33.859470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48d34be4-3903-441b-9ae1-67a06522f3ae tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.501215 Nov 02 11:58:33.860115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:33.860308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 985/1950] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:33 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:33.865576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1053203424", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "187618f9-0ea2-4688-b320-9ee5aae0805b"}], "security_groups": [{"name": "tempest-securitygroup--2134023431"}], "key_name": "tempest-keypair-453736248", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:33.869707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c903a38-dd31-4e34-892e-4dee57b7b27b tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.537488 Nov 02 11:58:33.878252 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 966/1951] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:33 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:33.881950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c98427-f8a4-4a54-bd49-2beb66cc6c65", "tag": "0f4115b4-e3f6-4e46-9180-93e3d932e9f6"}, {"name": "network-changed", "server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "tag": "d1bd83fd-f730-4593-ab99-f51e250875eb"}, {"server_uuid": "276d7694-f2be-4aed-b4cc-720a7ced2aef", "name": "network-vif-deleted", "tag": "cf220b2b-5c25-47e2-a13f-5e63393a48da"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:33.894255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.903395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.903395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.910376 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Creating event network-changed:0f4115b4-e3f6-4e46-9180-93e3d932e9f6 for instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 on n-h1-855649-4 Nov 02 11:58:33.910897 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Creating event network-changed:d1bd83fd-f730-4593-ab99-f51e250875eb for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:58:33.911466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] Creating event network-vif-deleted:cf220b2b-5c25-47e2-a13f-5e63393a48da for instance 276d7694-f2be-4aed-b4cc-720a7ced2aef on n-h1-855649-4 Nov 02 11:58:33.921785 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ae3096c5-7c1c-4d78-bb1c-c79382fccb67 req-2a6bc269-c4dc-4d9f-9a00-046e33c2641a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.045070 Nov 02 11:58:33.922552 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 967/1952] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:33.929109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:33.929827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:33.937169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.937666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.938335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.939145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.939614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.940049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.976581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:33.977405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:33.977529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:33.977998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lazy-loading 'fault' on Instance uuid 276d7694-f2be-4aed-b4cc-720a7ced2aef {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:34.078315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] validate_networks() for [('187618f9-0ea2-4688-b320-9ee5aae0805b', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:34.080720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:34.089678 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe0abf30-bbe7-40f5-b569-1a74405bd41f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 200 len: 1314 microversion: 2.1 time: 0.165094 Nov 02 11:58:34.090250 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 968/1953] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:33 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:34.108239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:34.112719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:34.115817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:34.116319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:34.116762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:34.117486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:34.117944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:34.118379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:34.702748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:34.712980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:34.715209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:34.716851 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23c24dd7-432f-4850-8a36-1c6608f2cc82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.612445 Nov 02 11:58:34.717437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 969/1954] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:34 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:34.885048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:34.885948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:34.898479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:34.899252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:34.899937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:34.900839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:34.901486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:34.902078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.627463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:35.636026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f003e36-8205-4ea8-996a-fce3e325c009 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.754897 Nov 02 11:58:35.636607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 970/1955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:34 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:35.642743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:35.643705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:35.651338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.653125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.653125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.653637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.654131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.654578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.746176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:35.747400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:35.748081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:35.748662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:35.749258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:35.760467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.761712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.762330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.764083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.764730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.765742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.788132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:35.793639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for user 29699172e95148b99d076a8bcfc09668 and project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:35.808329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:35.810852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:35.901148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:35.910334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a6f5a4-8a25-44c4-933f-ef432a457393 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.272450 Nov 02 11:58:35.928504 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 971/1956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:35 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:35.934349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:35.935831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:35.942119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.942944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.943613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.944514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.945145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.945891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.949074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f3c9bba-c971-49ac-821a-e1a37917e64c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.087245 Nov 02 11:58:35.955300 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 986/1957] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:35.966388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:35.967817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:35.974789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.975687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.977533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.978470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:35.979134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:35.979731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:35.997981 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef HTTP/1.1 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef'} Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:36.000488 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 11:58:36.006110 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:58:36.008322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:58:36.010965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed8121fe-87c1-460a-bcbf-1cc09a04c1c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 404 len: 111 microversion: 2.1 time: 0.080925 Nov 02 11:58:36.011786 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 972/1958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:35 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:58:36.026580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "tag": "047174a4-38c6-46c4-a684-788b6ab58d06"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:36.036982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:36.037733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:36.041976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:36.049689 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] Creating event network-changed:047174a4-38c6-46c4-a684-788b6ab58d06 for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:58:36.057105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-be7f73e4-1266-4ce7-b591-9ef7bf6d6985 req-4d46a615-14ad-4f80-9e61-3e1dc0b35565 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043020 Nov 02 11:58:36.057825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 973/1959] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:36.063422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6556879f-7fad-49d4-a526-8e6413beb091 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:36.064600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6556879f-7fad-49d4-a526-8e6413beb091 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:36.210016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6556879f-7fad-49d4-a526-8e6413beb091 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:36.217420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6556879f-7fad-49d4-a526-8e6413beb091 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1234 microversion: 2.1 time: 0.158050 Nov 02 11:58:36.235847 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 974/1960] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:36 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1234 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:36.241718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13181e1b-b3bb-4223-8d23-1a7b8e1ec8d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'create', calling method: .version_select at 0x7ff1b32a5b80>, body: {"keypair": {"name": "tempest-keypair-719767839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbE2dK+jgMh8LHhpYROfov4bPwQXv5nsWPzFRcnfYz6SsmC8tmC8zEVDf2gSWtHJS6aYbI2UM4IFuO+Bxti9aMroxZz4C6P13Pd8Rgd5zRyI+nRwIhbqhGdBM2da98/ZA=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:36.262568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-13181e1b-b3bb-4223-8d23-1a7b8e1ec8d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for project 800e17a4635e409bb8094879d36c155a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:36.269463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-13181e1b-b3bb-4223-8d23-1a7b8e1ec8d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for user 0ddce8ede1194d26a83ed481de2a3db5 and project 800e17a4635e409bb8094879d36c155a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:36.380293 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13181e1b-b3bb-4223-8d23-1a7b8e1ec8d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145219 Nov 02 11:58:36.381144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 975/1961] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 11:58:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:36.454852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:36.454852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:36.463928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:36.465802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:36.467824 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-579b9e5a-cbd3-4579-ac53-4dfca7cc2ace tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.511453 Nov 02 11:58:36.468480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 987/1962] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:35 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:36.660035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:36.661030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:36.667827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:36.668912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:36.669622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:36.671349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:36.672094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:36.672740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:36.696524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:36.936446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:36.937393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:36.941984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:36.950248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:36.951401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:36.952332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:36.953285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:36.954209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:36.955780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:36.997890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.008739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb9764ce-06c0-41eb-8f56-fdcc8c80273e tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.351485 Nov 02 11:58:37.022460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 976/1963] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:36 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:37.151956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d200a-8c8d-49ed-871e-9916ea9a2163", "name": "network-vif-plugged", "status": "completed", "tag": "c1d2dc31-6685-4faa-9b41-efc52d9cbf8c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:37.165435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:37.165435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:37.166063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:37.184111 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] Creating event network-vif-plugged:c1d2dc31-6685-4faa-9b41-efc52d9cbf8c for instance 103d200a-8c8d-49ed-871e-9916ea9a2163 on n-h2-855649-4 Nov 02 11:58:37.190437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a4538491-ab91-4105-bfb5-f53e3d8f137c req-1322a826-ac6b-404f-921b-c883486b88e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042433 Nov 02 11:58:37.199399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 977/1964] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:58:37.225613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.243826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e328f0e-5937-4966-840c-7422a28bddfc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.313280 Nov 02 11:58:37.245095 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 988/1965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:36 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:37.252557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c168e64-d78d-44b8-894f-998bef01b595 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:37.258849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c168e64-d78d-44b8-894f-998bef01b595 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:37.398219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c168e64-d78d-44b8-894f-998bef01b595 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.409096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c168e64-d78d-44b8-894f-998bef01b595 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1234 microversion: 2.1 time: 0.167701 Nov 02 11:58:37.419635 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 978/1966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:37 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1234 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:37.494757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:37.496066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:37.504365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:37.505310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:37.505995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:37.507399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:37.508089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:37.509074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:37.791584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.803500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.806761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:37.808339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bf1c1cf-49e8-45ad-871c-370e9d975eb3 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.318304 Nov 02 11:58:37.821119 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 989/1967] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:37 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:38.035541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:38.036895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:38.042477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:38.047424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.048596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.049136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.050426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.051107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.051609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.110152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "tag": "12af01b0-1c02-4ac7-ac2d-5518c3f0859d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:38.124980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.125850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.127421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.146404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] Creating event network-changed:12af01b0-1c02-4ac7-ac2d-5518c3f0859d for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:58:38.155153 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-55c88bbe-3501-4e91-8b31-97242b2c9cd1 req-e4e71a61-c976-4def-a72e-35641fa70011 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047518 Nov 02 11:58:38.156638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 990/1968] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:58:38.262545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:38.270710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-686c895f-01ee-4fb9-9f4c-8771c6a111de tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.240749 Nov 02 11:58:38.271339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 979/1969] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:38 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:38.272117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:38.273163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:38.282747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.284505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.286202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.287966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.289193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.290111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.438391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:38.439592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:38.456805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.457669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.458447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.471586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.471586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.471586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.472030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:38.483808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91e049df-04a5-4dd0-81f1-197d48789791 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1307 microversion: 2.1 time: 0.218974 Nov 02 11:58:38.485111 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 991/1970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:38 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:38.618607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:38.627176 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c600d777-b613-4dc3-9737-70fed28c0fd2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1286 microversion: 2.1 time: 0.192680 Nov 02 11:58:38.639883 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 980/1971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:38 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1286 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:38.839760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:38.841804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:38.849771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.850268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.850711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:38.851736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:38.852336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:38.852976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.162798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:39.182227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:39.183982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:39.193354 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-220bd6f8-6b4e-44b5-bfca-1ac1a599378f tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.351096 Nov 02 11:58:39.193354 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 992/1972] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:38 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:39.297220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:39.298680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:39.312729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.314074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.314719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.315892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.316532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.317186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.530345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:39.530345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:39.536475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.537409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.538079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.539234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.539857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.540490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.858944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:39.868193 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aaeabf60-7917-4d15-8118-06b4b5148f2a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.577378 Nov 02 11:58:39.868879 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 981/1973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:39 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:39.873600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:39.874253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:39.885595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.886493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.886934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:39.887683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:39.888141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:39.888770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:40.085707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:40.097734 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97c8d74b-cd63-4172-b77c-2409b3174bb9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1294 microversion: 2.1 time: 0.227093 Nov 02 11:58:40.113945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 982/1974] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:39 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:40.216062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:40.217043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:40.225010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:40.225639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:40.226179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:40.227019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:40.227743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:40.228437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:40.516326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:40.527624 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efdc1249-8c41-4611-9c23-4466a81bdf4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1486 microversion: 2.1 time: 1.011660 Nov 02 11:58:40.528416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 993/1975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:39 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1486 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:40.556663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:40.557211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:40.564750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:40.565581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:40.566031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:40.566745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:40.567225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:40.567650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:40.596826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lazy-loading 'flavor' on Instance uuid 103d200a-8c8d-49ed-871e-9916ea9a2163 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:40.992674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.012706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.015678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.020591 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9888ba5-dc86-4783-8318-da2ca302b19a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.807745 Nov 02 11:58:41.020591 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 983/1976] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:40 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:41.026403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:41.027134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:41.034840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.035371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.036180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.037080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.037775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.038376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.106262 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-783faa76-03f9-4236-afd7-589409fa9e00 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163/action" status: 202 len: 0 microversion: 2.1 time: 0.553205 Nov 02 11:58:41.108173 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 994/1977] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:40 2022] POST /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 11:58:41.146601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:41.149699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:41.162051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.162924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.163597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.165270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.167089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.167710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.633948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.642809 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fda8ddd-ce0f-49f5-ba76-0db329aa6a31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.623029 Nov 02 11:58:41.655002 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 984/1978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:41 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:41.655002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:41.655002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:41.667048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.673638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.673638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.673638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:41.673638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:41.673638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:41.763006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.777006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e818e1d-9f64-4d1c-a5d6-92da8065e6a0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1494 microversion: 2.1 time: 0.652828 Nov 02 11:58:41.791003 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 995/1979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:41 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1494 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:41.929752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:41.939592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02f4a2dc-a0ee-4fd0-976d-e6c883db7c32 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1292 microversion: 2.1 time: 0.290382 Nov 02 11:58:41.955446 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 985/1980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:41 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1292 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:42.045877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:42.047752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:42.055687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.056184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.056619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:42.057423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.058318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.058569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:42.602247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:42.618069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:42.620878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:42.623456 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1f1bfcd-2d1f-421e-8e5f-e105dc94fe0a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.581882 Nov 02 11:58:42.624341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 996/1981] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:42 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:42.670899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:42.671408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:42.685085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.686499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.686956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:42.687721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.688253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.689289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:42.807874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:42.808470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:42.815905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.816795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.817529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:42.818491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:42.819251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:42.821428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:43.752974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:43.762961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6ab8af3-092f-4172-8ffa-2f1a217dbd99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 200 len: 1477 microversion: 2.1 time: 0.961798 Nov 02 11:58:43.772192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 997/1982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:42 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 1477 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:43.790469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:43.791941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:43.813471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:43.813471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:43.813471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:43.814460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:43.814947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:43.815411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:43.872571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:43.883307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87d520b2-1fcd-4430-b8f3-02328eea92d0 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 1.218432 Nov 02 11:58:43.884988 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 986/1983] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:42 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:43.891096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:43.892192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:43.904890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:43.905416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:43.906786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:43.909638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:43.911771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:43.911771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:44.278377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:44.287855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01030903-eba1-4cea-aa9b-a84804e4c1f9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.511276 Nov 02 11:58:44.305817 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 998/1984] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:43 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:44.312429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-724846821"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:44.316762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:44.327468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:44.328584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:44.330148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:44.332774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:44.333267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:44.333767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:44.381332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:44.395425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:44.406915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:44.409519 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa62d3b4-b74c-406e-93ef-2169001841c9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.522689 Nov 02 11:58:44.410944 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 987/1985] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:43 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:44.619266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2111532429", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:44.686548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] validate_networks() for [('3dac2e1c-0801-4b9c-8a30-713718193355', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:44.961761 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57011450-5495-42b5-b75d-7ebe23a2d03a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163/action" status: 202 len: 0 microversion: 2.1 time: 0.654115 Nov 02 11:58:44.963658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 999/1986] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:58:44 2022] POST /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:58:44.971232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-374022301", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:45.043733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] validate_networks() for [('34d7f901-5e5b-4df2-9ee6-5f746868b4a2', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:58:45.466433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:45.468984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:45.468984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:45.468984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:45.468984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:45.478662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.479098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.479540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:45.480277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.480811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.481240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:45.503162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Getting quotas for project 7b8724dfbe8944a3b205d92eb2cb715d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:45.509880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Getting quotas for user 0f1f1a2a69f34710a07ccb4313b70458 and project 7b8724dfbe8944a3b205d92eb2cb715d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:45.524505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:45.527110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:45.729554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:58:45.729904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:58:45.730594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:58:45.731201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:58:45.732291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:58:45.743740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.744794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.745408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:45.747242 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ddef6da5-646c-4467-8645-a663b5376c03 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333400 Nov 02 11:58:45.747458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.748103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.748760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:45.758082 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 988/1987] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:45.770915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:45.770915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:45.773439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:58:45.782604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for user 0ddce8ede1194d26a83ed481de2a3db5 and project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:58:45.823653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:58:45.826522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:58:45.837555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.838073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.843287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:45.844761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:45.845429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:45.846118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.045166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b51d03c-6359-478f-9052-68ebadab612d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.079563 Nov 02 11:58:46.056341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1000/1988] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:58:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:58:46.063053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c12a816-be7d-425e-a4f8-c8d7b6ef0c3f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb82310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:46.139318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c12a816-be7d-425e-a4f8-c8d7b6ef0c3f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.081520 Nov 02 11:58:46.139983 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1001/1989] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:46 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:46.153326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:46.153946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:46.159460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.163854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:46.168954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:46.168954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.168954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:46.168954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:46.168954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.170073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85d5c50a-ae5e-449d-8105-682f30d79705 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.409941 Nov 02 11:58:46.170727 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 989/1990] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:45 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:46.180966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:46.185551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:46.197174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:46.197668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:46.198110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.198835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:46.203735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:46.204499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.502008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.509873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.521300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-adb477af-6e2b-4fc1-8589-a231b3997db8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.372070 Nov 02 11:58:46.521781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.525173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.526690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04969645-831a-4a37-a548-362bd18a3f65 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.354939 Nov 02 11:58:46.528612 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 990/1991] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:46 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:46.535197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:46.537098 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1002/1992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:46 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:46.544919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62ff6f55-1823-4d52-b292-5bad58981bbd tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:46.545837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62ff6f55-1823-4d52-b292-5bad58981bbd tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:46.552917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:46.555020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:46.555020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:46.574632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] Creating event network-changed:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h1-855649-4 Nov 02 11:58:46.583202 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a980abf7-3ffa-4e20-9c0d-005085ca75d3 req-ac16c385-4c36-4ecd-94e3-c3908fc3c54e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052710 Nov 02 11:58:46.584268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 991/1993] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:46.590614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00154eef-6257-4885-9da7-53958164c1d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:46.591321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00154eef-6257-4885-9da7-53958164c1d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:46.624093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62ff6f55-1823-4d52-b292-5bad58981bbd tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.632494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62ff6f55-1823-4d52-b292-5bad58981bbd tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1224 microversion: 2.1 time: 0.093989 Nov 02 11:58:46.633195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1003/1994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:46 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:46.656090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00154eef-6257-4885-9da7-53958164c1d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:46.668028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00154eef-6257-4885-9da7-53958164c1d2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1224 microversion: 2.1 time: 0.082081 Nov 02 11:58:46.669409 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 992/1995] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:46 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:47.155470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30231186-6d30-4835-9686-47e9c045b5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb291f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:47.197790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:47.198484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:47.208615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.210623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.210623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:47.210623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.210972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.211323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:47.213014 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30231186-6d30-4835-9686-47e9c045b5f2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.061253 Nov 02 11:58:47.213596 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1004/1996] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:47 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:47.445860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:47.458349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-287a3ae8-8cbc-4c62-a4ba-c235cd3976e9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.266525 Nov 02 11:58:47.467378 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 993/1997] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:47 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:47.549627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:47.550169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:47.556928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.557432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.557875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:47.558589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.559081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.559520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:47.560897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:47.562182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:47.571129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.571701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.572211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:47.572994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:47.573983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:47.574798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.037203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.052101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.057239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.057437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.057564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:48.059169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9dfc8afe-6f40-43d0-b8ab-14f3c1d075ad tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1485 microversion: 2.25 time: 0.504582 Nov 02 11:58:48.061820 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 994/1998] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:47 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1485 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:48.068475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:48.069331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:48.080099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.080258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d9d8e9e-6650-44ee-9990-598546a96bb6 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.532106 Nov 02 11:58:48.080375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.080472 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1005/1999] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:47 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:48.080565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.080565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.080565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.081121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.092514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:48.093458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:48.104877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.106719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.107983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.109832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.110570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.111423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.585674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.587403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.594960 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4ce365c-9bfe-40e3-824c-279571d742d7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1228 microversion: 2.1 time: 0.531846 Nov 02 11:58:48.595592 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 995/2000] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:48 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1228 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:48.596649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c160b3f7-5556-428f-9f4a-498fb901c542 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1228 microversion: 2.1 time: 0.510466 Nov 02 11:58:48.599084 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1006/2001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:48 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1228 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:48.615824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:48.616400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d215da7-76b2-49c8-b74d-6643efdf26d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b39cf820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:48.616548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:48.632480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.632872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.633265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.633992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:48.634463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:48.634904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:48.696282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d215da7-76b2-49c8-b74d-6643efdf26d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.099367 Nov 02 11:58:48.697778 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 996/2002] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:48 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:48.889537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:48.897975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d595092-ea5e-45e7-b4f1-9ed6ddfaf44b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.297639 Nov 02 11:58:48.898732 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1007/2003] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:48 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:49.093653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.094278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.109429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.110109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.120727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.121054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.121580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.122019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.123017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.123464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.123990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.124419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.125021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.129005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.129480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.130088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.418970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.428922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.430270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.432760 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76efd89f-4976-4d33-af3a-913baa2ddcda tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1475 microversion: 2.25 time: 0.343651 Nov 02 11:58:49.434221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 997/2004] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:49.462214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ddc0559-df4f-4595-85ae-66ceb69ac4e5 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '.version_select at 0x7ff1b32a5820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.464252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.476877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ddc0559-df4f-4595-85ae-66ceb69ac4e5 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.483869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b456edf8-c652-4d91-8272-a831095d06b3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.371642 Nov 02 11:58:49.483869 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1008/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:49.484226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ddc0559-df4f-4595-85ae-66ceb69ac4e5 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.484226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ddc0559-df4f-4595-85ae-66ceb69ac4e5 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.490868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:49.497468 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ddc0559-df4f-4595-85ae-66ceb69ac4e5 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2780 microversion: 2.25 time: 0.039665 Nov 02 11:58:49.498595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 998/2006] 10.222.0.48 () {60 vars in 1184 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/os-migrations => generated 2780 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:49.514714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.515644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.529798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.622048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.622591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.639007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.751248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.761433 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-760fc8e0-91ba-41cf-b995-e57fa3d320b6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1276 microversion: 2.1 time: 0.143398 Nov 02 11:58:49.762399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 999/2007] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:49.767770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.768589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.783511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.784438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.784438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.785214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.785833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.786107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.857413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] Lazy-loading 'services' on Instance uuid c1c98427-f8a4-4a54-bd49-2beb66cc6c65 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:58:49.874650 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d7d495d-19da-49cb-8e5c-20dcf96f93f4 tempest-LiveAutoBlockMigrationV225Test-195426199 tempest-LiveAutoBlockMigrationV225Test-195426199-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1967 microversion: 2.25 time: 0.363607 Nov 02 11:58:49.876385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1009/2008] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1967 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:49.881572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ce2a749-1d65-4b3f-a1ee-2fef813389be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b35e9e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.929773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:49.941330 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ce2a749-1d65-4b3f-a1ee-2fef813389be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.063494 Nov 02 11:58:49.941996 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1010/2009] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:49.947964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.948942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.952640 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-395ba45a-a917-43f5-bca7-3785a8c61f10 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1284 microversion: 2.1 time: 0.188945 Nov 02 11:58:49.953545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1000/2010] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:49.959324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:49.959948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:49.967016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.975776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.975776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.975776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.975776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.976246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.976375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.976481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.976617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.976721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:49.976721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:49.976721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:49.995023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:58:50.218024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.225858 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76174402-bbfc-433c-b9b6-4ce1e94294a4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.282890 Nov 02 11:58:50.226433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1011/2011] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:49 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:50.231036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "name": "network-vif-plugged", "status": "completed", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:50.241534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.245869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.245869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.258800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] Creating event network-vif-plugged:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h1-855649-4 Nov 02 11:58:50.264271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cf818467-17c0-410d-9e70-b62f38c72d11 req-a08081fc-eaa9-4032-81ab-29f53973ed0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036649 Nov 02 11:58:50.265367 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1012/2012] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:50.393898 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-511ff1e4-e7f2-44b8-82c8-583e731ae430 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 204 len: 0 microversion: 2.25 time: 0.438226 Nov 02 11:58:50.394601 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1001/2013] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:58:49 2022] DELETE /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:58:50.403593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:50.404373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:50.411785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.415027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.415027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.415027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.415027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.415027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.508248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:50.508960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:50.515654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.516191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.516681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.517360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.517898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.518236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.825053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.834836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.836338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.837546 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f8ab9cd-303d-4609-a85e-92e4294e6539 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1481 microversion: 2.25 time: 0.438453 Nov 02 11:58:50.838259 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1013/2014] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:50 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1481 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:58:50.842855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:50.843394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.843870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:50.851540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.852161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.852601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.852752 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c198e904-b7a3-4e3d-917f-359e72dc20e3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.348920 Nov 02 11:58:50.853302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.853754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.854960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.856816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1002/2015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:50 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:50.921098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:50.929034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dad0efb-6e3f-4b9a-92ea-1a6b23751ebf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1284 microversion: 2.1 time: 0.089762 Nov 02 11:58:50.929613 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1014/2016] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:50 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:50.958180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f9e2ae4-d98f-4d88-84e6-2a14b466fecd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b326cee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:50.986412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:50.993212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:50.994530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.995354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.995907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:50.996751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:50.997560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:50.998088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.019949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f9e2ae4-d98f-4d88-84e6-2a14b466fecd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.066512 Nov 02 11:58:51.031025 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1003/2017] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:50 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:51.230604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:51.241165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e38f264-6e24-4fa1-9ef2-4f5abd717bb1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.259796 Nov 02 11:58:51.244409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1015/2018] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:50 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:51.250392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:51.251813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:51.259027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.259826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.260292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.261022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.261488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.261955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.595883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:51.605086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94ed7158-3cf9-41f4-9515-bec8f06e93e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.360618 Nov 02 11:58:51.615373 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1004/2019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:51 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:51.876253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:51.877156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:51.879574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:51.884441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:51.884595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.884595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.884806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.885557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.886105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.886649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.891877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.892568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.893238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:51.894162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:51.894632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:51.895098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.398527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:52.401231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:52.408567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:52.410247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:52.411442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-973d495b-7b07-4c45-8659-69fb1228f579 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1481 microversion: 2.25 time: 0.540905 Nov 02 11:58:52.423192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecc9b158-d8f3-43f0-bf42-7729c6524e62 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1360 microversion: 2.1 time: 0.538825 Nov 02 11:58:52.423455 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1016/2020] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:51 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1481 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:52.423572 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1005/2021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:51 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1360 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:52.423572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97324752-599d-4aa5-b7cc-e1b66fd69243 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b39cf790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:52.432620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:52.433241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:52.439712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.440210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.441901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.441901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.441901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.442449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.472920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97324752-599d-4aa5-b7cc-e1b66fd69243 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.059382 Nov 02 11:58:52.473509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1006/2022] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:52 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:52.486102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:52.486726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:52.492862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.493350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.493789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.494527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.494992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.495445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.553155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:52.561001 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f837d09-d012-42f4-aa54-6e1fab3e47c0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1282 microversion: 2.1 time: 0.136145 Nov 02 11:58:52.561587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1017/2023] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:52 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1282 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:52.629586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:52.630094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:52.636375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.636874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.637323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:52.638039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:52.638496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:52.638930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.317920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.321101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.328143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08095d1a-1262-4041-a711-e3abc1fb38a2 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.702575 Nov 02 11:58:53.329762 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1018/2024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:52 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:53.338826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c98427-f8a4-4a54-bd49-2beb66cc6c65", "name": "network-vif-deleted", "tag": "0f4115b4-e3f6-4e46-9180-93e3d932e9f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:53.347997 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ca33dfd-fbbf-4660-9a0c-6f815c2082e0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.865352 Nov 02 11:58:53.348611 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1007/2025] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:52 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:53.350623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.351300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.351916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.365164 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] Creating event network-vif-deleted:0f4115b4-e3f6-4e46-9180-93e3d932e9f6 for instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 on n-h2-855649-4 Nov 02 11:58:53.371212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-42d3fc26-3c72-452b-a997-79e44b56d343 req-f08152b9-3aeb-4c69-84f5-d35693062ade service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039614 Nov 02 11:58:53.372127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1019/2026] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:53.435562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:53.438196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:53.446234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.446884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.447454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.448326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.450905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:53.451687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:53.454115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.455178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.465596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.466095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.466542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.467297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.467759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.468191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.652673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.670069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.676883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.678110 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-857c04f6-3424-4856-8fbf-f68092dc6e91 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1265 microversion: 2.25 time: 0.240636 Nov 02 11:58:53.678872 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1020/2027] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:53 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:53.697326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8194d975-1276-4b86-b7a4-3beda09c63f7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb765e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:53.751804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8194d975-1276-4b86-b7a4-3beda09c63f7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.059669 Nov 02 11:58:53.752706 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1021/2028] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:53 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:53.758185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:53.759226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:53.765898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.766447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.766891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.767637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.768383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.768737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.776515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:53.785780 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1538062e-2c1d-4e6f-92da-d0ce5e0704eb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1543 microversion: 2.1 time: 0.355138 Nov 02 11:58:53.803943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1008/2029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:53 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1543 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:53.815398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:53.816103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:53.822381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.823316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.823883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:53.824677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:53.825209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:53.825865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:54.081665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc86080d-5915-4bc1-ab45-2c42163af16a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271168 Nov 02 11:58:54.082298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1009/2030] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 11:58:53 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:54.238126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:54.254464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edecb701-4e3f-4147-b41a-4974ac04dfbf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.499854 Nov 02 11:58:54.271094 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1022/2031] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:53 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:54.354585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:54.355214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:54.367450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:54.367957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:54.368396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:54.374374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:54.375346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:54.385038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:54.390151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:54.390918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:54.391456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:54.394837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:54.398721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:54.409842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:54.410861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:54.411582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.021351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.034160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fde9653-75bc-4313-8fde-3687150ace7f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.685203 Nov 02 11:58:55.038389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1010/2032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:54 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:55.051885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:55.054310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:55.068091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.068788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.069432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.070321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.070943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.071567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.185060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.195567 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b8161d9-5521-4ff9-bce9-f1d0c909f699 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.825314 Nov 02 11:58:55.220452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1023/2033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:54 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:55.229252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65910cc6-d370-4a83-922e-ef9724aafbd6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb76dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:55.269787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.291888 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65910cc6-d370-4a83-922e-ef9724aafbd6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.068928 Nov 02 11:58:55.293420 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1024/2034] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:55 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:55.293543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.295225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.296437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f5a2df5-c459-42fd-9a72-e996e0425536 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1265 microversion: 2.25 time: 0.256782 Nov 02 11:58:55.296987 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1011/2035] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:55 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:55.307869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:55.308711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:55.312192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-plugged", "status": "completed", "tag": "12af01b0-1c02-4ac7-ac2d-5518c3f0859d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:55.332945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.333715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.334366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.335301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.335915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.336492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.342228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.343451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.344069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.366265 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] Creating event network-vif-plugged:12af01b0-1c02-4ac7-ac2d-5518c3f0859d for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:58:55.383227 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f411d620-5bfc-4fb9-9507-c164f5be9dfa req-6cd8d98e-a258-47a5-a66a-cb5179839e4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089285 Nov 02 11:58:55.384369 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1025/2036] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:55.399643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e", "tag": "23722e01-5597-4a20-bbbe-10a0d06cf1e2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:55.413297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.415130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.418960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.441066 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] Creating event network-changed:23722e01-5597-4a20-bbbe-10a0d06cf1e2 for instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e on n-h1-855649-4 Nov 02 11:58:55.452992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-02e3078a-2708-4e72-b62d-550f46d4d01e req-0fabbcfd-c2bd-4f42-9074-48167b90cb39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057966 Nov 02 11:58:55.455107 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1026/2037] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:58:55.492054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:55.596726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:55.624498 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a53670ac-0f2a-4b4d-aa26-ba3f6275df80 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.323493 Nov 02 11:58:55.624498 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1012/2038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:55 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:55.837984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:55.843644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:55.853938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:55.854502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:55.854939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:55.874891 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] Creating event network-changed:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h1-855649-4 Nov 02 11:58:55.881113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e52eb0bf-2024-4fd6-afbf-9123ecfe0e69 req-4b3cc9c9-2e3b-4134-ad21-989f4ef11940 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047524 Nov 02 11:58:55.881721 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1027/2039] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:56.059802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:56.060532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:56.078750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.079284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.079729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.080455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.081176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.081604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.224635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:56.225126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:56.232450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.233256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.233865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.235537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.236173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.236606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.256287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:56.269373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:56.278622 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e7b16dd-df6b-4092-90aa-2ae1cd344733 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.223567 Nov 02 11:58:56.279812 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1013/2040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:56 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:56.309782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c4a6736-ee43-42f3-85b7-745b867c2e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b32a5af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:56.441834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c4a6736-ee43-42f3-85b7-745b867c2e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.136402 Nov 02 11:58:56.443768 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1014/2041] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:56 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:58:56.458522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:56.460556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.483749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.628233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:56.635748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:56.640056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:56.655223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:56.662582 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-735c932f-0500-4fb0-a7c8-311fbf09505e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.442138 Nov 02 11:58:56.670011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:56.671469 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e78c8286-f8a3-44ea-81c0-19f4db270648 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1265 microversion: 2.25 time: 0.224063 Nov 02 11:58:56.672498 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1015/2042] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:56 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:56.677921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:56.678604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:56.686477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1028/2043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:56 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:56.687877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:56.693899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.694382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.694837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:56.695585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:56.697400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:56.698044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:57.313740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:57.314860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:57.356374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:57.357369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:57.363007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:57.364899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:57.368813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:57.370142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:57.678400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:57.697689 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d04518d2-1210-4f45-a10d-decc799289cc tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 1.023236 Nov 02 11:58:57.699661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1016/2044] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:56 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:57.720375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed2195c8-a50f-4c8f-803f-81a604af7ffe tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b32f7430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:57.836685 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed2195c8-a50f-4c8f-803f-81a604af7ffe tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.129335 Nov 02 11:58:57.840423 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1017/2045] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:57 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:57.854080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7a1536-03df-4eea-853a-4e5194a6a76e", "tag": "1e497207-4dfa-45c1-9663-609655a95e2a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:57.884566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:57.886477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:57.887894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:57.897841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:58:57.921483 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] Creating event network-changed:1e497207-4dfa-45c1-9663-609655a95e2a for instance cf7a1536-03df-4eea-853a-4e5194a6a76e on n-h1-855649-4 Nov 02 11:58:57.933830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-301770b3-ecaf-43e0-8035-6976fb8b21c5 req-2c424934-82d9-4f15-957d-f1ab354bc8a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090351 Nov 02 11:58:57.938763 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1018/2046] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:57.950322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-plugged", "status": "completed", "tag": "047174a4-38c6-46c4-a684-788b6ab58d06"}, {"server_uuid": "103d200a-8c8d-49ed-871e-9916ea9a2163", "name": "network-vif-plugged", "status": "completed", "tag": "c1d2dc31-6685-4faa-9b41-efc52d9cbf8c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:57.994476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:57.994928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:57.999896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.035924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Creating event network-vif-plugged:047174a4-38c6-46c4-a684-788b6ab58d06 for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:58:58.051871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] Creating event network-vif-plugged:c1d2dc31-6685-4faa-9b41-efc52d9cbf8c for instance 103d200a-8c8d-49ed-871e-9916ea9a2163 on n-h2-855649-4 Nov 02 11:58:58.062356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-22ca6ffb-68b5-421f-a988-1cf891b465ea req-cb172d90-45f2-4ff1-af1d-7e8ec8d6ba45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122879 Nov 02 11:58:58.064285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1019/2047] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:58:58.084768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:58.085980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:58.093767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.094681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.095416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.096399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.097084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.098325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.669449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:58.691056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:58.696475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:58.704781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1394c342-15d8-4493-ba62-1b7baf540c82 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1265 microversion: 2.25 time: 0.630389 Nov 02 11:58:58.706123 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1020/2048] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:58 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1265 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:58:58.713313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:58.717521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:58.725067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.726325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.727116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.728192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.729016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.729901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.791101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:58.799925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32aeb2ba-ac8a-46d2-9ca9-77e90464410f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 1.499867 Nov 02 11:58:58.805082 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1029/2049] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:57 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:58.824845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:58.825751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:58.838412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.838920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.839396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:58.840111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:58.840775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:58.843561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:59.073069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:59.083281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ecbefd2-95f3-46b2-8941-e5afd3613ff4 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.375190 Nov 02 11:58:59.099532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1021/2050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:58 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:59.109387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7294f55f-1b8b-4e3b-9260-385fe4113cdd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3282280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:59.150544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:58:59.168329 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a95fdf7d-ef66-4c65-8d65-f4c975a35965 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.355205 Nov 02 11:58:59.169161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1030/2051] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:58:58 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:59.209937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7294f55f-1b8b-4e3b-9260-385fe4113cdd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.108816 Nov 02 11:58:59.225265 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1022/2052] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:58:59 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:58:59.735063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:58:59.735967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:59.748077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:59.748879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:59.749505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:59.753102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:59.753904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:59.756574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:59.783231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f427b60-e5ad-40ce-8be2-702df81bf4f6"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:58:59.785797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:58:59.805933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:59.808403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:59.808944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:58:59.811123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:58:59.811873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:58:59.812568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.002412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:00.024962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:00.028905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:00.032476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8014ecd5-5685-4eff-9254-e3e7c0a1001c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 200 len: 1265 microversion: 2.25 time: 0.300538 Nov 02 11:59:00.045511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1031/2053] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:58:59 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:00.059335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:00.060517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:00.072374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:00.073282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:00.073892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.075344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:00.075988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:00.078958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.596840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:00.607243 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2b492ea-8184-4ee4-a629-de89fcb16206 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.560224 Nov 02 11:59:00.610165 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1032/2054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:00 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:00.619111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-plugged", "status": "completed", "tag": "d1bd83fd-f730-4593-ab99-f51e250875eb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:00.647540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:00.648317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:00.649109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.677626 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] Creating event network-vif-plugged:d1bd83fd-f730-4593-ab99-f51e250875eb for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:00.691401 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9bd3c079-4cbb-4bfb-a981-72af6b0a4557 req-b9b9759e-e297-41f9-9894-c2dd7859cc44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077713 Nov 02 11:59:00.692577 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1033/2055] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:00.702205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:00.712149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:00.729807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:00.730327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:00.730753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.731501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:00.731964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:00.736757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:00.978490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83c79bbe-f448-4a94-a7c1-a7544c8e1d00 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "POST /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201411 Nov 02 11:59:00.999310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1023/2056] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 11:58:59 2022] POST /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 194 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:59:01.013962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:01.022070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:01.035017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.035842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.036500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:01.039631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.041587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.042221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:01.287953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:01.299443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cc06b3c-9d38-47e0-a395-341ba9a766ab tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.605380 Nov 02 11:59:01.300649 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1034/2057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:00 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:01.306015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4aa8d74e-b74d-4f30-9159-527e04e17770 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbab9ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:01.365120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:01.373015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a2a1ebb-342d-4724-a061-b2152091c1a0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.371962 Nov 02 11:59:01.373593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1024/2058] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:00 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:01.383420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:01.392196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: c1c98427-f8a4-4a54-bd49-2beb66cc6c65] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:01.404808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:01.406711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.416610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4aa8d74e-b74d-4f30-9159-527e04e17770 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.113446 Nov 02 11:59:01.416821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.416985 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1035/2059] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:01 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:01.424634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:01.425729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.426744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.427948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:01.458484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] HTTP exception thrown: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Request method failure captured: Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 HTTP/1.1 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlmh1kZAnyqdYSzijZCDW_yYfi0Djnsrt6bxJEeFoEBGQ9sAp2CuLg4WNNxJopk5TdpmBjUEZ3r0XXd0OzMn9eTtX53vQ4U-mIfguDlpb_CbDwiL_vOYPkdkxMO3F3Sua5xYOets9mUmkugUdsZGDqylm7EHVQfmsFhTIti9m3AS8ug Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b4127e1b3c0429690c7d1905258e750", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7827c83ee4674362bab55ca9c40d16fb Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c1c98427-f8a4-4a54-bd49-2beb66cc6c65'} Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. Nov 02 11:59:01.469728 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Returning 404 to user: Instance c1c98427-f8a4-4a54-bd49-2beb66cc6c65 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:01.476933 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf1a1f47-3e84-4912-9724-65524938a353 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65" status: 404 len: 111 microversion: 2.25 time: 0.091708 Nov 02 11:59:01.478456 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1025/2060] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:01 2022] GET /compute/v2.1/servers/c1c98427-f8a4-4a54-bd49-2beb66cc6c65 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:01.650306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:01.653309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:01.667130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:01.671101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.671978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.672703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:01.674038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:01.674725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:01.675434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:02.036372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:02.053391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83e4b2b6-750c-46d2-addf-40bd051d2cb3 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.416572 Nov 02 11:59:02.058556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1036/2061] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:01 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:02.333823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:02.334462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:02.347522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:02.348026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:02.348480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:02.349223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:02.349699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:02.350137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:02.398346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:02.399806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:02.419242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:02.420703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:02.421508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:02.426400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:02.431757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:02.435435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:02.945562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:02.970603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47b4368a-6aac-4016-a1ab-dd008025f3f7 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.642330 Nov 02 11:59:02.987470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1026/2062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:02 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:03.003448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edc59222-6d4c-4e77-95ee-b64897650054 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3108550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:03.091357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edc59222-6d4c-4e77-95ee-b64897650054 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.102247 Nov 02 11:59:03.092404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1027/2063] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:02 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:03.094872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:03.099473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e", "name": "network-vif-plugged", "status": "completed", "tag": "23722e01-5597-4a20-bbbe-10a0d06cf1e2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:03.106411 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91b8ce34-f9c2-4c66-930f-aca0314550f1 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.712907 Nov 02 11:59:03.132679 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1037/2064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:02 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:03.144595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:03.145547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:03.165542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:03.167056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:03.167767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:03.179234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:03.180054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:03.180688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:03.191735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:03.196315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:03.198862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:03.230632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] Creating event network-vif-plugged:23722e01-5597-4a20-bbbe-10a0d06cf1e2 for instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e on n-h1-855649-4 Nov 02 11:59:03.245917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-611e963f-85b0-444b-96ef-82c2a5f3d1a5 req-93531da0-5142-4cd7-bffe-3857132fea1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152082 Nov 02 11:59:03.253142 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1028/2065] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:03.845521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:03.845521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8731a57-d813-4d6a-8d3e-ba27b8480b31 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1355 microversion: 2.1 time: 0.642860 Nov 02 11:59:03.845521 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1038/2066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:03 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1355 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:03.995008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:03.996530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:04.005618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.006567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.007468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:04.008425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.009114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.009802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:04.108445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-854d47a0-3a4a-4011-a834-63ea49d027b7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb8fee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:04.172909 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-854d47a0-3a4a-4011-a834-63ea49d027b7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.068172 Nov 02 11:59:04.173808 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1039/2067] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:04 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:04.188674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:04.189347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:04.209147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.210028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.210755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:04.211812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.219724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.220600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:04.539000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:04.556456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca4e4d74-764e-45fc-a60a-619bb49900a2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1324 microversion: 2.1 time: 0.565653 Nov 02 11:59:04.561401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1029/2068] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:03 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:04.669373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:04.680552 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bb51b26-b2cb-4d0e-9555-9ea8f99dd8ca tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.505597 Nov 02 11:59:04.694759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1040/2069] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:04 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:04.857940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.083745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:05.097637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4aa8c86-eaec-4026-abb1-c1518e902a30 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1804 microversion: 2.1 time: 0.286839 Nov 02 11:59:05.115327 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1030/2070] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:04 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1804 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:05.122602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:05.123785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:05.132977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.133765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.134551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.136686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.137395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.137994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.198651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05144e5a-7968-47ef-ba45-d9d78136df12 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b31b9b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:05.198779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8953960f-d372-42d7-bd55-3960ecce72b6 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4/ips" status: 200 len: 217 microversion: 2.1 time: 0.071215 Nov 02 11:59:05.211183 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1041/2071] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 11:59:05 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4/ips => generated 217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:05.227244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:05.232020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:05.242622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.262016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.262016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.263298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.268033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.268969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.289492 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05144e5a-7968-47ef-ba45-d9d78136df12 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.103810 Nov 02 11:59:05.300803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1031/2072] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:05 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:05.316369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7a1536-03df-4eea-853a-4e5194a6a76e", "name": "network-vif-plugged", "status": "completed", "tag": "1e497207-4dfa-45c1-9663-609655a95e2a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:05.363612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.364298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.366873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.397464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:05.401260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] Creating event network-vif-plugged:1e497207-4dfa-45c1-9663-609655a95e2a for instance cf7a1536-03df-4eea-853a-4e5194a6a76e on n-h1-855649-4 Nov 02 11:59:05.412053 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6c63eb56-e164-4729-b0ee-5aa69cc540db req-829ded81-6797-41eb-8ac4-1c974bca59ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108633 Nov 02 11:59:05.413089 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1032/2073] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:05.612145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:05.613174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:05.634957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.636884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.641797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.646228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:05.646647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:05.648851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:05.957605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:05.969207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d93be3e-9ee4-43f2-9d5e-a1219ac66572 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1519 microversion: 2.1 time: 0.367722 Nov 02 11:59:05.969802 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1033/2074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:05 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1519 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:05.988072 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-208346ea-a188-48f3-841e-e8252b9564dc tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "DELETE /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 204 len: 0 microversion: 2.1 time: 0.771631 Nov 02 11:59:05.989291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1042/2075] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:59:05 2022] DELETE /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:59:06.003743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:06.004714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:06.009276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:06.014142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:06.049500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:06.049994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:06.050433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:06.051181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:06.051640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:06.052066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:06.068211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:06.068722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:06.069181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:06.069910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:06.070481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:06.070913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:06.562098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:06.575146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d24066c-6062-4748-b0bb-1b727fe9c329 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1324 microversion: 2.1 time: 0.590732 Nov 02 11:59:06.579535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1034/2076] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:05 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1324 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:06.590408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28b1ad6e-4920-4c55-b72d-275a73fa3d9e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1194131235", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28b1ad6e-4920-4c55-b72d-275a73fa3d9e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 243 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1194131235", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1194131235', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3dac2e1c-0801-4b9c-8a30-713718193355'}]}}} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:06.600674 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.607680 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.609696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:06.615006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28b1ad6e-4920-4c55-b72d-275a73fa3d9e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:06.616298 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28b1ad6e-4920-4c55-b72d-275a73fa3d9e tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.034983 Nov 02 11:59:06.617785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-573a06a1-4934-44b3-ac0b-cf0e4af3ecd9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1810 microversion: 2.1 time: 0.621964 Nov 02 11:59:06.619617 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1035/2077] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:06 2022] POST /compute/v2.1/servers => generated 175 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:06.627887 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1043/2078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:05 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1810 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:06.631081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b35321a-87b6-46a0-a549-0b4fced11fa5 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3beb8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:06.680106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:06.682172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: ebd96033-57bf-4973-993e-cde4eb8269a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:06.699373 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] HTTP exception thrown: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ebd96033-57bf-4973-993e-cde4eb8269a5/metadata HTTP/1.1 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': 'ebd96033-57bf-4973-993e-cde4eb8269a5'} Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.725643 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.730504 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:06.730504 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:06.730504 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. Nov 02 11:59:06.730504 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.733519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 404 to user: Instance ebd96033-57bf-4973-993e-cde4eb8269a5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:06.737295 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b35321a-87b6-46a0-a549-0b4fced11fa5 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.116286 Nov 02 11:59:06.738528 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07ee1c8c-ee26-4dfb-9e5f-6cfb5c54b9f1 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/ebd96033-57bf-4973-993e-cde4eb8269a5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.077270 Nov 02 11:59:06.739741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1044/2079] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:59:06 2022] GET /compute/v2.1/servers/ebd96033-57bf-4973-993e-cde4eb8269a5/metadata => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:59:06.749663 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1036/2080] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:06 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:06.817749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cb0d088-84b1-4397-aaed-58324b403eb0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-366187189", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cb0d088-84b1-4397-aaed-58324b403eb0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 498 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-366187189", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-366187189', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3dac2e1c-0801-4b9c-8a30-713718193355'}]}}} Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:59:06.830745 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cb0d088-84b1-4397-aaed-58324b403eb0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cb0d088-84b1-4397-aaed-58324b403eb0 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.019440 Nov 02 11:59:06.847154 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1045/2081] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:06 2022] POST /compute/v2.1/servers => generated 687 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:06.933815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f5f6856-96eb-4dbb-a30a-4f6ca7bafeda tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-364824697", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f5f6856-96eb-4dbb-a30a-4f6ca7bafeda tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 499 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-364824697", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-364824697', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3dac2e1c-0801-4b9c-8a30-713718193355'}]}}} Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:59:06.946545 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f5f6856-96eb-4dbb-a30a-4f6ca7bafeda tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f5f6856-96eb-4dbb-a30a-4f6ca7bafeda tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.023214 Nov 02 11:59:06.963293 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1037/2082] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:06 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:07.032446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ec8ec1-50f1-4567-9c95-e49df98bce20 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-104021891", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ec8ec1-50f1-4567-9c95-e49df98bce20 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 753 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-104021891", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-104021891', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3dac2e1c-0801-4b9c-8a30-713718193355'}]}}} Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:59:07.052575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:59:07.067593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:59:07.074356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.074356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.074356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ec8ec1-50f1-4567-9c95-e49df98bce20 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:07.074356 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94ec8ec1-50f1-4567-9c95-e49df98bce20 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.028512 Nov 02 11:59:07.074356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1046/2083] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:07 2022] POST /compute/v2.1/servers => generated 1197 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 11:59:07.174889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3061cd95-94f8-4782-858c-e478f96a654c tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-701796393", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3061cd95-94f8-4782-858c-e478f96a654c tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 1265 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-701796393", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3dac2e1c-0801-4b9c-8a30-713718193355"}]}} Nov 02 11:59:07.180474 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-701796393', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3dac2e1c-0801-4b9c-8a30-713718193355'}]}}} Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.182917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 11:59:07.184495 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 11:59:07.186934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 11:59:07.186934 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.186934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3061cd95-94f8-4782-858c-e478f96a654c tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:07.190744 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3061cd95-94f8-4782-858c-e478f96a654c tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022543 Nov 02 11:59:07.201036 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1038/2084] 10.222.0.48 () {60 vars in 1148 bytes} [Wed Nov 2 11:59:07 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 11:59:07.207469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:07.208131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 9d06dd08-3be2-4acf-a05e-9d762dd90506] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:07.223280 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] HTTP exception thrown: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9d06dd08-3be2-4acf-a05e-9d762dd90506/metadata/test2 HTTP/1.1 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '9d06dd08-3be2-4acf-a05e-9d762dd90506', 'id': 'test2'} Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:07.225013 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 404 to user: Instance 9d06dd08-3be2-4acf-a05e-9d762dd90506 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3d5c0c6-7e09-4eca-b033-54a863a576f6 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/9d06dd08-3be2-4acf-a05e-9d762dd90506/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024151 Nov 02 11:59:07.229543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1047/2085] 10.222.0.48 () {58 vars in 1281 bytes} [Wed Nov 2 11:59:07 2022] GET /compute/v2.1/servers/9d06dd08-3be2-4acf-a05e-9d762dd90506/metadata/test2 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:59:07.245218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:07.246160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:07.257359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.261314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.264673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:07.268373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.271942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.272989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:07.357562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:07.506316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:07.507635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:07.523582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.524402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.525034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:07.526053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.528506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.532265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:07.596243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:07.834322 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24f27f90-5c60-4200-afd1-033d6e9e707b tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 204 len: 0 microversion: 2.1 time: 0.592893 Nov 02 11:59:07.835306 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1039/2086] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:59:07 2022] DELETE /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:59:07.843966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:07.847317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:07.864827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:07.880535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.881053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.881511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:07.882265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:07.882747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:07.889827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.046437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e16b6d63-a574-4ea9-8f29-05664b0ca652 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 204 len: 0 microversion: 2.25 time: 0.543593 Nov 02 11:59:08.047756 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1048/2087] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:59:07 2022] DELETE /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:59:08.066281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:08.070892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:08.083839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.085117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.085757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.090477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.091365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.092005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.367974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:08.399655 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-651f0920-4ab1-4c39-b443-2f49f50b7fe3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1522 microversion: 2.1 time: 0.562904 Nov 02 11:59:08.402776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1040/2088] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:07 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:08.410685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1055ab6-f4cf-45eb-b42b-f2144e8d29d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3a60670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:08.521696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:08.530441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e10c1531-4de5-4b71-8bca-aef36551112a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1810 microversion: 2.1 time: 0.481377 Nov 02 11:59:08.531061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1049/2089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:08 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1810 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:08.531206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1055ab6-f4cf-45eb-b42b-f2144e8d29d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.125309 Nov 02 11:59:08.532206 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1041/2090] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:08 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:08.543657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:08.544402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:08.561230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:08.562029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:08.573154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.574191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.574898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.575940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.576633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.577334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.581441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.581441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.582286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:08.582714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:08.583220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:08.583658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:09.240380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:09.258216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:09.279084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:09.280950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93d22653-bf0d-4476-8bbe-e2faf175c84d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1730 microversion: 2.25 time: 0.737904 Nov 02 11:59:09.286294 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1042/2091] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:08 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1730 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:09.309612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:09.315183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:09.330928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:09.335966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:09.336799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:09.337761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:09.338495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:09.339137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:09.344387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:09.730671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:09.747035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08bfba52-0abf-4d44-8483-da44e5d7d514 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1525 microversion: 2.1 time: 1.209914 Nov 02 11:59:09.747635 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1050/2092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:08 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1525 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:09.777998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ed24ee8-fdea-4022-b3a1-8a22ac5db917 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbaae8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:09.850898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ed24ee8-fdea-4022-b3a1-8a22ac5db917 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.078417 Nov 02 11:59:09.860029 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1051/2093] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:09 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:09.866830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:09.868092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:09.876717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:09.877608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:09.878267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:09.879472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:09.880152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:09.880805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:10.159312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:10.169728 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49f0e5c0-4134-489c-ba46-f1b0a1608ad7 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1522 microversion: 2.1 time: 0.879902 Nov 02 11:59:10.170314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1043/2094] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:09 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1522 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:10.175363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-deleted", "tag": "d1bd83fd-f730-4593-ab99-f51e250875eb"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:10.201004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:10.201469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:10.201955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:10.230681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] Creating event network-vif-deleted:d1bd83fd-f730-4593-ab99-f51e250875eb for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:10.243099 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-03242b21-8541-490f-9252-2fb667f093d3 req-01fba6b8-cf81-435a-98ff-f0d93b0b5f3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069248 Nov 02 11:59:10.245093 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1044/2095] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:10.251320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1373461734"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:10.256265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:10.268594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:10.270418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:10.272022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:10.272898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:10.273494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:10.273988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:10.895874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1508601c-14cc-4c29-bc5e-90b06726205a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e/action" status: 202 len: 0 microversion: 2.1 time: 0.643861 Nov 02 11:59:10.896613 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1045/2096] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:59:10 2022] POST /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:59:10.930649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:10.932426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:10.957763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:10.958365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:10.958822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:10.959614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:10.972829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:10.973672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:11.000464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:11.019675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c78faf4-b0b1-48a3-950e-cdf39eced0db tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1789 microversion: 2.1 time: 1.155409 Nov 02 11:59:11.020611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1052/2097] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:09 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1789 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:11.045972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:11.052973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:11.073823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:11.076600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:11.077294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:11.078254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:11.082958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:11.083721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:11.715960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:11.730090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:11.732354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:11.733874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26512bf6-2a12-4f6b-ac3b-1e8c82cb5d99 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1730 microversion: 2.25 time: 0.831805 Nov 02 11:59:11.736814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:11.754043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1046/2098] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:10 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1730 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:11.760462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa1265d1-5437-458b-ad7b-d77e59ee3325 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b302b0d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:11.763407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52156027-d9c8-4470-be3b-cb1b7f16d949 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1525 microversion: 2.1 time: 0.737200 Nov 02 11:59:11.769265 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1053/2099] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:11 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1525 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:11.775217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da4336da-171f-4484-b8f9-7bbbffdadfa3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1bbad65e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.107342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da4336da-171f-4484-b8f9-7bbbffdadfa3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be" status: 204 len: 0 microversion: 2.1 time: 0.336199 Nov 02 11:59:12.108053 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1054/2100] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:11 2022] DELETE /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:59:12.126350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-unplugged", "status": "completed", "tag": "12af01b0-1c02-4ac7-ac2d-5518c3f0859d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:12.129014 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa1265d1-5437-458b-ad7b-d77e59ee3325 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.373627 Nov 02 11:59:12.134599 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1047/2101] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:11 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:12.135626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.136722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:12.148487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.149269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.149850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.150096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.150326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.151203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.151962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.152590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.154352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.188945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] Creating event network-vif-unplugged:12af01b0-1c02-4ac7-ac2d-5518c3f0859d for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:12.196863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7055ca54-162d-4c66-a3c2-8ae16e5a9c88 req-c10d7adc-5180-4572-9274-a12473bcb57c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086506 Nov 02 11:59:12.203957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1055/2102] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:12.210947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42437d3c-8f8d-4e39-94d9-f950403abe11 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1bbb765e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.260387 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-42437d3c-8f8d-4e39-94d9-f950403abe11 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Image not found. Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42437d3c-8f8d-4e39-94d9-f950403abe11 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be HTTP/1.1 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'a175770b-e6be-439f-82dd-98fd67f711be'} Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a175770b-e6be-439f-82dd-98fd67f711be Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 11:59:12.262603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a175770b-e6be-439f-82dd-98fd67f711be could not be found. Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:12.268564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42437d3c-8f8d-4e39-94d9-f950403abe11 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:12.291139 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42437d3c-8f8d-4e39-94d9-f950403abe11 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be" status: 404 len: 62 microversion: 2.1 time: 0.085728 Nov 02 11:59:12.301897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1056/2103] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:12 2022] GET /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 11:59:12.330958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.332752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:12.358091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.359285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.360048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.361168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.362068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.362889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.907345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:12.919229 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fdd4407f-cc0d-4b07-87cd-e21651aa0da1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1654 microversion: 2.1 time: 0.787925 Nov 02 11:59:12.919646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:12.920772 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1048/2104] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:12 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1654 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:12.927499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e", "name": "network-vif-deleted", "tag": "23722e01-5597-4a20-bbbe-10a0d06cf1e2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:12.941592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.943961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.943961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.944199 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b043b60-8fc3-42f5-95e0-e937d1a57b4a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1534 microversion: 2.1 time: 0.639451 Nov 02 11:59:12.944751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1057/2105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:12 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1534 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:12.949693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.950338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:12.961929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.962460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.962860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.965725 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] Creating event network-vif-deleted:23722e01-5597-4a20-bbbe-10a0d06cf1e2 for instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e on n-h1-855649-4 Nov 02 11:59:12.969688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.970187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.970632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.975659 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9220eb82-5775-4166-b13b-1738cd639c5d req-8cb1df2f-f07a-428b-a447-d9911dffa6ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052523 Nov 02 11:59:12.976837 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1049/2106] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:12.986290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:12.987354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:12.996167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.997165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:12.997815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:12.998892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:12.999731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:13.000375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:13.060932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:13.061906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:13.062828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:13.064325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lazy-loading 'fault' on Instance uuid 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:13.164005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:13.173316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:13.181423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:13.185336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:13.187028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73449301-c9b6-4857-b6d5-42023e2ab856 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1314 microversion: 2.1 time: 0.208709 Nov 02 11:59:13.187927 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1050/2107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:12 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:13.200481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd21c792-fdc8-4f58-865c-0525c36bcf09 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3a1d940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:13.208475 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36757533-456c-4c19-ae55-d38d4acc3aaf tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1662 microversion: 2.25 time: 0.262568 Nov 02 11:59:13.224243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1058/2108] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:12 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:13.279552 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd21c792-fdc8-4f58-865c-0525c36bcf09 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.085006 Nov 02 11:59:13.280729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1051/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:13 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:13.949937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:13.951032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:13.966082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:13.967019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:13.969919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:13.973644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:13.974582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:13.975308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:13.991431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:13.993002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:14.018170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.024197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.024997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.025963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.030310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.030812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.272435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.283326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbb7a133-4f13-4d83-bbbf-1b32298b1268 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1298 microversion: 2.1 time: 0.339191 Nov 02 11:59:14.321059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1059/2110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:13 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1298 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:14.332799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:14.335516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:14.346072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.346777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.347374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.348505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.359026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.361440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.437207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.437833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.438561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.439364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.440057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lazy-loading 'fault' on Instance uuid 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:14.450366 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30513f01-41ba-44ea-ae44-4b81a17595f0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1540 microversion: 2.1 time: 0.469223 Nov 02 11:59:14.455748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1052/2111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:13 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1540 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:14.475655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:14.476646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:14.496333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.497114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.497777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.498692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.499346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.499979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.524775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f1f1a2a69f34710a07ccb4313b70458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8724dfbe8944a3b205d92eb2cb715d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.550080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.550854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.551499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.551636 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec858a1c-ef59-4a03-b76d-2d89b2291ab2 tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 200 len: 1314 microversion: 2.1 time: 0.227854 Nov 02 11:59:14.552246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lazy-loading 'fault' on Instance uuid a1257e6a-a630-4e4b-9a48-e76d9042876b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:14.552418 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1060/2112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:14 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:14.567724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-unplugged", "status": "completed", "tag": "047174a4-38c6-46c4-a684-788b6ab58d06"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:14.594100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:14.595021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:14.595652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:14.618099 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] Creating event network-vif-unplugged:047174a4-38c6-46c4-a684-788b6ab58d06 for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:14.624698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1e12a986-439f-4e04-8f08-8051182cb89f req-07397eb0-6613-4fe0-b915-ce6294ba1388 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070018 Nov 02 11:59:14.627129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1061/2113] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:14.636800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd1fc187-83c5-433d-a055-0b60fc666ad9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb8fdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:14.641918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.651465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.652965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:14.654288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ab355da-cd40-42f8-8508-0a3aa82b3e38 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 200 len: 1374 microversion: 2.25 time: 0.201517 Nov 02 11:59:14.658750 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1053/2114] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:14 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:14.715992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd1fc187-83c5-433d-a055-0b60fc666ad9 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.087289 Nov 02 11:59:14.726656 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1062/2115] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:14 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:15.005855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-deleted", "tag": "047174a4-38c6-46c4-a684-788b6ab58d06"}, {"server_uuid": "a1257e6a-a630-4e4b-9a48-e76d9042876b", "name": "network-vif-deleted", "tag": "35f64bb5-f9b4-407d-9f35-daa6ba152504"}, {"server_uuid": "293027c8-9e90-4111-baf0-1eacf0e12fc4", "name": "network-vif-deleted", "tag": "12af01b0-1c02-4ac7-ac2d-5518c3f0859d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:15.033396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.034047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.034492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.059829 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Creating event network-vif-deleted:047174a4-38c6-46c4-a684-788b6ab58d06 for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:15.060672 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Creating event network-vif-deleted:35f64bb5-f9b4-407d-9f35-daa6ba152504 for instance a1257e6a-a630-4e4b-9a48-e76d9042876b on n-h2-855649-4 Nov 02 11:59:15.061381 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] Creating event network-vif-deleted:12af01b0-1c02-4ac7-ac2d-5518c3f0859d for instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 on n-h2-855649-4 Nov 02 11:59:15.069147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-57266959-3f5b-4c3f-93d2-742872bf2a76 req-a35529e2-4cd8-4657-a6ff-4926c3a9e7f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.070822 Nov 02 11:59:15.075481 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1054/2116] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:15.314166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:15.315007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:15.324531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.325020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.325678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.326446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.326895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.327377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.369477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.369970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.370411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.370867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lazy-loading 'fault' on Instance uuid 293027c8-9e90-4111-baf0-1eacf0e12fc4 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:15.438039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:15.447513 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1839c5ca-44ed-4180-94cf-78ae6ebc15cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 200 len: 1303 microversion: 2.1 time: 0.136983 Nov 02 11:59:15.451300 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1063/2117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:15 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:15.482085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:15.485654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:15.499382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.503662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.503662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.503662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.503662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.503662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.581574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:15.582425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] [instance: 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:15.589187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.590228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.591032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.591856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.592418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.592954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.609853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] HTTP exception thrown: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Request method failure captured: Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e HTTP/1.1 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltzHL_ZN_AFR6bT7ukaVtcZGeHg17WWCdWlmhiNxXjJBq853LpwhTas7JA0_dzRGAoFeSdMMK5jun9xuMG1snHmvyHxRXcFprVMVp34BoDb_xRwRVUxnBfytaD0QonrbbUAq2lISeRsXjCHXfwOJhIpcpQ43TmQKHFosMopYY7EbHQ Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b8724dfbe8944a3b205d92eb2cb715d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b8724dfbe8944a3b205d92eb2cb715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b8724dfbe8944a3b205d92eb2cb715d Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1357579301 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f1f1a2a69f34710a07ccb4313b70458 Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1357579301-project Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e'} Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.612584 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. Nov 02 11:59:15.617760 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.625760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] Returning 404 to user: Instance 85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:15.625760 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dea876b5-e6fa-4f06-86ee-24e91e788ada tempest-ServerMetadataNegativeTestJSON-1357579301 tempest-ServerMetadataNegativeTestJSON-1357579301-project] 10.222.0.48 "GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e" status: 404 len: 111 microversion: 2.1 time: 0.045238 Nov 02 11:59:15.637817 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1064/2118] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:15 2022] GET /compute/v2.1/servers/85b3c1a1-dc8b-4a5a-86ee-6e8124f57a3e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 11:59:15.689993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:15.692985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: a1257e6a-a630-4e4b-9a48-e76d9042876b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:15.698602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.699559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.700357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.702762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:15.704649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:15.706029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:15.761221 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] HTTP exception thrown: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Request method failure captured: Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b HTTP/1.1 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmh1kZAnyqdYSzijZCDW_yYfi0Djnsrt6bxJEeFoEBGQ9sAp2CuLg4WNNxJopk5TdpmBjUEZ3r0XXd0OzMn9eTtX53vQ4U-mIfguDlpb_CbDwiL_vOYPkdkxMO3F3Sua5xYOets9mUmkugUdsZGDqylm7EHVQfmsFhTIti9m3AS8ug Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b4127e1b3c0429690c7d1905258e750", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7827c83ee4674362bab55ca9c40d16fb Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'a1257e6a-a630-4e4b-9a48-e76d9042876b'} Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. Nov 02 11:59:15.763742 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:15.769697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Returning 404 to user: Instance a1257e6a-a630-4e4b-9a48-e76d9042876b could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:15.771116 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9ac21ec-2f97-4dea-b85c-8da3ec6d0dc6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b" status: 404 len: 111 microversion: 2.25 time: 0.084499 Nov 02 11:59:15.775810 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1065/2119] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:15 2022] GET /compute/v2.1/servers/a1257e6a-a630-4e4b-9a48-e76d9042876b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 11:59:15.781796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ba94f8b-01ee-422f-b6da-1ee89b150010 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbabf9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:15.842533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:15.881932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ba94f8b-01ee-422f-b6da-1ee89b150010 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.104389 Nov 02 11:59:15.886020 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ce13c45-6df5-4aae-9974-823472042229 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1535 microversion: 2.1 time: 0.411849 Nov 02 11:59:15.888525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1066/2120] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:15 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:15.897742 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1055/2121] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:15 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1535 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:15.899371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c51aa63-1b47-45a2-8a3a-79de82cd7915 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '.version_select at 0x7ff1bbaeb430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:16.006132 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c51aa63-1b47-45a2-8a3a-79de82cd7915 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659397333" status: 204 len: 0 microversion: 2.25 time: 0.113870 Nov 02 11:59:16.010674 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1067/2122] 10.222.0.48 () {60 vars in 1259 bytes} [Wed Nov 2 11:59:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659397333 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:59:16.474575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:16.475679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:16.487955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:16.495109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:16.495109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:16.495109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:16.495109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:16.495109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:16.520706 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 HTTP/1.1 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '293027c8-9e90-4111-baf0-1eacf0e12fc4'} Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:16.522950 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 11:59:16.528536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:16.530676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:16.531933 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-416aa184-21a3-4fc7-8b60-bd0d111c6ade tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 404 len: 111 microversion: 2.1 time: 0.061652 Nov 02 11:59:16.532730 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1056/2123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:16 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:59:16.646882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7a1536-03df-4eea-853a-4e5194a6a76e", "name": "network-vif-plugged", "status": "completed", "tag": "1e497207-4dfa-45c1-9663-609655a95e2a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:16.658517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:16.659443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:16.659956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:16.675869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] Creating event network-vif-plugged:1e497207-4dfa-45c1-9663-609655a95e2a for instance cf7a1536-03df-4eea-853a-4e5194a6a76e on n-h1-855649-4 Nov 02 11:59:16.681853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0a68e82c-1601-4292-bcc0-967015c66c2e req-f90d8a84-8b13-4585-aa3e-082df3e113f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038546 Nov 02 11:59:16.682878 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1068/2124] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:59:16.909154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9a72c07-a8a1-4ca1-810f-e0ee4def2246 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3cfb550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:16.939603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:16.940580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:16.954881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:16.956487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:16.958125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:16.960187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:16.960703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:16.966216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:16.990823 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9a72c07-a8a1-4ca1-810f-e0ee4def2246 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.088855 Nov 02 11:59:17.001231 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1057/2125] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:16 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:17.189172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:17.199401 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cbbdaa9-c35f-469e-864b-8fa0c32eab8b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1522 microversion: 2.1 time: 0.282344 Nov 02 11:59:17.202178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1069/2126] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:16 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:17.229284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:17.229799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:17.241934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.249236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.256497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:17.256497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.256497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.256497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:17.325985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:17.540150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:17.540150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:17.557494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.558007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.561797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:17.564538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.565433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.565899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:17.663070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:17.808026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6aa38a3f-9342-45fc-b98c-4c9f525bf78f tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 204 len: 0 microversion: 2.1 time: 0.582596 Nov 02 11:59:17.808942 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1058/2127] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:59:17 2022] DELETE /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:59:17.818686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:17.819452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:17.834095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.834606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.835091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:17.835834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:17.836289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:17.839425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.035954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:18.046707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bf3d88f-28c1-464a-8ec5-3bc645d36873 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1528 microversion: 2.1 time: 0.232771 Nov 02 11:59:18.048331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1059/2128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:17 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1528 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:18.053628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-269aa756-cbfc-46d9-95bc-2edafe66f9d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3570dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:18.124139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-269aa756-cbfc-46d9-95bc-2edafe66f9d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1439 microversion: 2.1 time: 0.064423 Nov 02 11:59:18.124139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1060/2129] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:18 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1439 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:18.204417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43535ff6-b87c-41cb-b4c9-b4bf4c23bbb9 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 204 len: 0 microversion: 2.25 time: 0.672042 Nov 02 11:59:18.205985 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1070/2130] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:59:17 2022] DELETE /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 11:59:18.215008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:18.216100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:18.233256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.233256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.233559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.234529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.235266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.235976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.293013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "01194780-a28b-4395-b002-42a5f061cfb5"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:18.303228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:18.317634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.324357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.324964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.325809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.326472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.326911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.480192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] HTTP exception thrown: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Request method failure captured: Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments/4f427b60-e5ad-40ce-8be2-702df81bf4f6 HTTP/1.1 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 74 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswx5L7NvwtWz0Ju45coDxMNxBcwFKUtI7q8-pl-NgYv1aaH--m6WjlKYqXGJ7MGMAQyKCxEL9gZm2SnPpoZHdRR7SXyKm6K1Lx54X_stVWAsTCCtvntoSmxr_IebJc-m-DyoMWO2GatqAVy8ICqLbdeQFFlpzoNOrIPIKbutURd_4 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dd24a539bbc842ff9769e147b3340590 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd24a539bbc842ff9769e147b3340590", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dd24a539bbc842ff9769e147b3340590 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesAdminNegativeTest-1778111623-project-admin Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8db5287479c54c18bab8f9a42d00a7cb Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesAdminNegativeTest-1778111623-project-admin Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: {"volumeAttachment": {"volumeId": "01194780-a28b-4395-b002-42a5f061cfb5"}} Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: exception: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '28c859a0-5be4-47cb-a1d3-5d54a5edfa31', 'id': '4f427b60-e5ad-40ce-8be2-702df81bf4f6', 'body': {'volumeAttachment': {'volumeId': '01194780-a28b-4395-b002-42a5f061cfb5'}}} Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. (HTTP 404) (Request-ID: req-0a957967-d438-4222-b5b2-6d15f0a29297) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 11:59:18.506623 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. Nov 02 11:59:18.512354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 11:59:18.522364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Returning 400 to user: Volume 01194780-a28b-4395-b002-42a5f061cfb5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:18.522364 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b876b44e-c1f3-45a1-bb96-69610e4eb6d8 tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments/4f427b60-e5ad-40ce-8be2-702df81bf4f6" status: 400 len: 107 microversion: 2.1 time: 0.397839 Nov 02 11:59:18.522364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1061/2131] 10.222.0.48 () {60 vars in 1433 bytes} [Wed Nov 2 11:59:18 2022] PUT /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments/4f427b60-e5ad-40ce-8be2-702df81bf4f6 => generated 107 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:18.542373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:18.561607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:18.564328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:18.568000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dc3caa9-6d2b-4e1f-964b-133d308586b6 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1547 microversion: 2.25 time: 0.357367 Nov 02 11:59:18.572152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1071/2132] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:18 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1547 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:18.655026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:18.656073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:18.663931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.669401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.669401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.669401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.669401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.669401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.731978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7a1536-03df-4eea-853a-4e5194a6a76e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e497207-4dfa-45c1-9663-609655a95e2a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:18.756747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:18.759117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:18.760925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:18.778292 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] Creating event network-vif-unplugged:1e497207-4dfa-45c1-9663-609655a95e2a for instance cf7a1536-03df-4eea-853a-4e5194a6a76e on n-h1-855649-4 Nov 02 11:59:18.786488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-adcb79fd-a753-4275-bd92-eb37ef15b987 req-4cd38802-362d-48f9-863b-7d9bb9159985 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059017 Nov 02 11:59:18.787782 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1072/2133] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:59:18.802734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lazy-loading 'services' on Instance uuid 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:18.806971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:19.236683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:19.277420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6750be5c-26f6-432b-a71e-263b686ca115 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments/4f427b60-e5ad-40ce-8be2-702df81bf4f6" status: 202 len: 0 microversion: 2.1 time: 0.627574 Nov 02 11:59:19.278139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1062/2134] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 11:59:18 2022] DELETE /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments/4f427b60-e5ad-40ce-8be2-702df81bf4f6 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:59:19.285696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9945675c-5c71-459f-9bbd-e96884f324bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3aba310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.370130 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9945675c-5c71-459f-9bbd-e96884f324bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1448 microversion: 2.1 time: 0.090537 Nov 02 11:59:19.370952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1063/2135] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:19 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1448 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:19.379273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.383620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:19.392817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.393660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.394118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:19.394878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.396114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.396569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:19.458339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb0813f8-e4ee-4554-9839-5784b2d4fd23 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085908 Nov 02 11:59:19.467278 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1064/2136] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:19 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:19.469182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c00b4899-eb5c-4ef0-9b4d-46d755b2a369 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b39a4dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.539656 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c00b4899-eb5c-4ef0-9b4d-46d755b2a369 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 200 len: 1448 microversion: 2.1 time: 0.074600 Nov 02 11:59:19.540614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1065/2137] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:19 2022] GET /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 1448 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:19.541137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:19.558819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c7f42b1-7095-4b65-87db-4c5350a6bbc2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3a528b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.562255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64d12ec8-968a-4e90-b7b7-91ca5ace6aae tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1528 microversion: 2.1 time: 0.487726 Nov 02 11:59:19.563458 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1073/2138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:19 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1528 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:19.601988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:19.602607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:19.617464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.625401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.625401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:19.625401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:19.625401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:19.625401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:20.468193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:20.482387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:20.483910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:20.485148 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-113eb48d-9770-440f-a809-d1de5f07ad9d tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1547 microversion: 2.25 time: 0.887616 Nov 02 11:59:20.485713 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1074/2139] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:19 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1547 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:20.502378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:20.504974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:20.514580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:20.519857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:20.520469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:20.521440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:20.521908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:20.522342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:20.575017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8475d26b-0758-4bcd-ad2d-dd5f231ad361 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088153 Nov 02 11:59:20.580423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1075/2140] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:20 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:20.601853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:20.603567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:20.624097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:20.627022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:20.627765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:20.628868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:20.629563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:20.630185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.077565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:21.090902 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce5b243c-5438-4de1-9926-d7bb392721c5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1528 microversion: 2.1 time: 0.493342 Nov 02 11:59:21.095291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1076/2141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:20 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1528 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:21.105417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18db3627-ff2f-4019-99bb-df0825aa445c", "name": "network-vif-deleted", "tag": "b5f6e97f-b902-4010-84d3-8c4f71e844d8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:21.121622 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c7f42b1-7095-4b65-87db-4c5350a6bbc2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 204 len: 0 microversion: 2.1 time: 1.564903 Nov 02 11:59:21.122339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1066/2142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:19 2022] DELETE /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 0 bytes in 1571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 11:59:21.128137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.129008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.130957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.131389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:21.132071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:21.147396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.149759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.151407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.153883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.158876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.159572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.177798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] Creating event network-vif-deleted:b5f6e97f-b902-4010-84d3-8c4f71e844d8 for instance 18db3627-ff2f-4019-99bb-df0825aa445c on n-h2-855649-4 Nov 02 11:59:21.188020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-652006ae-d8f3-4a97-9669-b122a8d4f608 req-88eeeac0-791d-4678-8640-1d3526947339 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090351 Nov 02 11:59:21.189477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1077/2143] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:21.216604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:21.514951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:21.516885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:21.530081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.534076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.538011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.539107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.539811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.540470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.661934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d345e5c-1210-4835-a956-52c4ccf577a2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 204 len: 0 microversion: 2.1 time: 0.529629 Nov 02 11:59:21.661934 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1067/2144] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:59:21 2022] DELETE /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 11:59:21.672136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:21.674799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:21.691857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.692970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.696315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.698352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.699534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:21.702427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.702928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.704101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:21.704861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:21.706760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lazy-loading 'fault' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:21.780216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71216a88-7368-49bb-9f20-be4463c6ab30 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117173 Nov 02 11:59:21.781301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:21.786012 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1068/2145] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:21 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:21.798873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:21.800634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:21.806537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9807ca35-9f6b-4a52-9792-bfc936690973 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1351 microversion: 2.25 time: 0.297126 Nov 02 11:59:21.819801 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1078/2146] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:21 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1351 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:21.888095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1065394168", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:21.986739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:59:22.119104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:22.120037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:22.131488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.131999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.132447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.133181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.133646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.134075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.288487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:22.302879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-980c77df-df47-4188-9945-96acfc266f99 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1486 microversion: 2.1 time: 0.187571 Nov 02 11:59:22.303518 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1079/2147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:22 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1486 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:22.793686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:22.795967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:22.804634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.805403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.806056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.806844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.807551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.808045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.835538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:22.836795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:22.837569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:22.838214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:22.838712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.863433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.874350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8e7220b-199e-4a43-86ec-fb9d6c6c972d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084564 Nov 02 11:59:22.875411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1080/2148] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:22 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:22.885205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:22.889206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:22.891372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:22.897020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.897538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.897983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.898726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.899217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.899905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.904359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:59:22.914270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:59:22.933671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:59:22.935326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:59:22.940265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:22.941158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:22.941893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:22.942728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lazy-loading 'fault' on Instance uuid 18db3627-ff2f-4019-99bb-df0825aa445c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:23.073931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:23.094898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:23.097013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:23.099948 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68d0c494-3013-4b85-ae2d-975f1838ac56 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 200 len: 1351 microversion: 2.25 time: 0.223148 Nov 02 11:59:23.113054 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1081/2149] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:22 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 1351 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:23.221422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d200a-8c8d-49ed-871e-9916ea9a2163", "name": "network-vif-unplugged", "status": "completed", "tag": "c1d2dc31-6685-4faa-9b41-efc52d9cbf8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:23.235983 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d865a0b-ead3-4840-9423-2e039cb3c629 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351694 Nov 02 11:59:23.238459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.245928 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1069/2150] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:59:23.251454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7a1536-03df-4eea-853a-4e5194a6a76e", "name": "network-vif-deleted", "tag": "1e497207-4dfa-45c1-9663-609655a95e2a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:23.252511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.253195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.275019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.275401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.276410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.292724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] Creating event network-vif-deleted:1e497207-4dfa-45c1-9663-609655a95e2a for instance cf7a1536-03df-4eea-853a-4e5194a6a76e on n-h1-855649-4 Nov 02 11:59:23.303940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e5b8734d-baad-4139-8478-645ee365a085 req-12cc239f-6adb-4be6-83f0-e8daa5673352 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053097 Nov 02 11:59:23.305313 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1070/2151] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:23.312827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-543bebd0-e117-4d7e-b385-8c7d3178867c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:23.313827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-543bebd0-e117-4d7e-b385-8c7d3178867c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:23.321163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:23.322235 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] Creating event network-vif-unplugged:c1d2dc31-6685-4faa-9b41-efc52d9cbf8c for instance 103d200a-8c8d-49ed-871e-9916ea9a2163 on n-h2-855649-4 Nov 02 11:59:23.334942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-34db858e-f935-4db7-80d7-ce7b32efd78e req-054670dc-0b1b-4a89-8ef7-a86f06b8647c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125789 Nov 02 11:59:23.337241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1082/2152] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:23.345919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:23.352457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:23.367060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.367879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.368333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.369109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.369563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.369985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.405862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-543bebd0-e117-4d7e-b385-8c7d3178867c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:23.422063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-543bebd0-e117-4d7e-b385-8c7d3178867c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1208 microversion: 2.1 time: 0.113369 Nov 02 11:59:23.426404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1071/2153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:23 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:23.473791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.474253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.476334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.476994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lazy-loading 'fault' on Instance uuid cf7a1536-03df-4eea-853a-4e5194a6a76e {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:23.543039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:23.558655 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a82e130-ff11-4ed4-a4df-7e10f4700c75 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 200 len: 1314 microversion: 2.1 time: 0.217588 Nov 02 11:59:23.572914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1083/2154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:23 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:23.890805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:23.894425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:23.909925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.910530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.915568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.916743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:23.917456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:23.918120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:23.960496 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6da1311b-11a5-4764-b5a0-e2a4ecd82072 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076508 Nov 02 11:59:23.965308 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1072/2155] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:23 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:24.128317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.129022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 18db3627-ff2f-4019-99bb-df0825aa445c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.140177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.140621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.141059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.141772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.142226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.142646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.176460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] HTTP exception thrown: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Request method failure captured: Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c HTTP/1.1 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmh1kZAnyqdYSzijZCDW_yYfi0Djnsrt6bxJEeFoEBGQ9sAp2CuLg4WNNxJopk5TdpmBjUEZ3r0XXd0OzMn9eTtX53vQ4U-mIfguDlpb_CbDwiL_vOYPkdkxMO3F3Sua5xYOets9mUmkugUdsZGDqylm7EHVQfmsFhTIti9m3AS8ug Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b4127e1b3c0429690c7d1905258e750", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7827c83ee4674362bab55ca9c40d16fb Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '18db3627-ff2f-4019-99bb-df0825aa445c'} Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. Nov 02 11:59:24.178357 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Returning 404 to user: Instance 18db3627-ff2f-4019-99bb-df0825aa445c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:24.188460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-884f6e7a-bae5-4e81-8ad1-92af9608738b tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c" status: 404 len: 111 microversion: 2.25 time: 0.057162 Nov 02 11:59:24.190407 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1084/2156] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:24 2022] GET /compute/v2.1/servers/18db3627-ff2f-4019-99bb-df0825aa445c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:24.191705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.192231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.204495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.206470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.207739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.214378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.214378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.214378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.280680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 11:59:24.448516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-543e3165-8635-44a4-a7ba-7884b5a1cabb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.449534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-543e3165-8635-44a4-a7ba-7884b5a1cabb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.699543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-543e3165-8635-44a4-a7ba-7884b5a1cabb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:24.716553 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-543e3165-8635-44a4-a7ba-7884b5a1cabb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1208 microversion: 2.1 time: 0.273116 Nov 02 11:59:24.717881 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1085/2157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:24 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1208 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:24.729046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.729730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.745901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.746434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.746867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.750027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.752621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.753264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.773747 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9297ff61-6a05-4378-9cbc-96bd6565625c tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 204 len: 0 microversion: 2.25 time: 0.587540 Nov 02 11:59:24.774597 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1073/2158] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 11:59:24 2022] DELETE /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 11:59:24.783989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.784702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.804071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.804830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.805939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.806850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.807510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.808599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.810006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e HTTP/1.1 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'cf7a1536-03df-4eea-853a-4e5194a6a76e'} Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.817748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd15912a-a7e8-4305-957b-26fd727788fb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 404 len: 111 microversion: 2.1 time: 0.102075 Nov 02 11:59:24.830704 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1086/2159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:24 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 11:59:24.975586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:24.977145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:24.989005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.989502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.989954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:24.990657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:24.993486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:24.994212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:25.050075 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7049c6d-5a05-4f3b-a077-55ca272c3bc7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080519 Nov 02 11:59:25.051718 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1087/2160] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:24 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:59:25.062538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1175330786", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:25.195719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] validate_networks() for [('34d7f901-5e5b-4df2-9ee6-5f746868b4a2', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:59:25.293474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:25.314330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:25.320350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:25.326333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae622266-bed9-4a11-91db-b7c8b7a07b12 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1564 microversion: 2.25 time: 0.546407 Nov 02 11:59:25.327054 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1074/2161] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:24 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1564 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:25.392065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103d200a-8c8d-49ed-871e-9916ea9a2163", "name": "network-vif-deleted", "tag": "c1d2dc31-6685-4faa-9b41-efc52d9cbf8c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:25.439786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:25.439786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:25.451155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:25.502722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] Creating event network-vif-deleted:c1d2dc31-6685-4faa-9b41-efc52d9cbf8c for instance 103d200a-8c8d-49ed-871e-9916ea9a2163 on n-h2-855649-4 Nov 02 11:59:25.514061 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e226ed04-9028-4ddc-a110-4fcd98a97633 req-b5b067e0-0763-4ac0-a33a-96ccbe4dc3f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122736 Nov 02 11:59:25.516266 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1075/2162] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 11:59:25.743991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:25.744953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:25.784820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:25.791163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:25.791163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:25.791163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:25.791163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:25.791163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.164131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:26.174200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-138c9fc1-6298-4036-a00d-d1b9a6591622 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1260 microversion: 2.1 time: 0.434367 Nov 02 11:59:26.191732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1076/2163] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:25 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:26.224700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:26.245059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:26.262909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.263500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.264154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.267880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.268622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.269245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.400304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9f00aab-2426-41cb-8481-a6032f3a6403 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206779 Nov 02 11:59:26.411316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1077/2164] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:26 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:26.424452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:26.425845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:26.438288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.439432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.440407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.442524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.443308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.444049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.532625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:26.534179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:26.535147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:26.535947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:26.536767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:26.560338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.562033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.563827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.565637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:26.568111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:26.575220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:26.632281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:59:26.645788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Getting quotas for user 0ddce8ede1194d26a83ed481de2a3db5 and project 800e17a4635e409bb8094879d36c155a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:59:26.677047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:59:26.679927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:59:26.845143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dccf0d9b-c939-43e8-80cc-260376cf7d0c tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.791633 Nov 02 11:59:26.846666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1088/2165] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:59:27.131869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:27.144245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-718358247", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:27.144460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:27.150045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:27.151877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40e6b1c0-7e4d-4b99-b4bc-a372d0b986af tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1564 microversion: 2.25 time: 0.738159 Nov 02 11:59:27.162273 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1078/2166] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:26 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1564 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:27.182968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1586529570", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "91d24b79-7f1a-48cd-95c2-235ae00accbe"}, {"uuid": "cc5d5056-9555-417d-84ab-572a77a92896"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:27.257144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:27.257743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:27.258319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:27.258901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:27.260722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:27.283929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:27.284598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:27.285130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:27.285963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:27.286541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:27.289277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:27.337576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] validate_networks() for [('91d24b79-7f1a-48cd-95c2-235ae00accbe', None, None, None, None, None), ('cc5d5056-9555-417d-84ab-572a77a92896', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:59:27.345939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Getting quotas for project 2f557139b34d490d8e644aaa98d87ce1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:59:27.376099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Getting quotas for user 6d0b2ee812db4495b5a5ef47fa085818 and project 2f557139b34d490d8e644aaa98d87ce1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:59:27.411851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:59:27.422307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:59:27.641740 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf313c43-ea2d-4ce1-9ba9-eddc95a2ca38 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.792908 Nov 02 11:59:27.643640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1089/2167] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 11:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 11:59:27.649176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbd8bc66-10dd-434a-975f-23949afe2f96 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:27.650112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbd8bc66-10dd-434a-975f-23949afe2f96 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:27.824934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbd8bc66-10dd-434a-975f-23949afe2f96 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:27.833466 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbd8bc66-10dd-434a-975f-23949afe2f96 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1225 microversion: 2.1 time: 0.188178 Nov 02 11:59:27.835449 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1090/2168] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:27 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1225 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:27.849469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:27.850096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:27.858694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:27.859664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:27.860982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:27.861910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:27.862717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:27.863318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:28.211499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:28.228697 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7edda659-5fee-4b11-a20f-bd3c4deb50af tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1266 microversion: 2.1 time: 0.389900 Nov 02 11:59:28.244436 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1091/2169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:27 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:28.251938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:28.254476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:28.264838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:28.265659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:28.266520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:28.267556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:28.269918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:28.270572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:28.332407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-877109fa-33b5-4132-81c8-f003e213a869 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079084 Nov 02 11:59:28.333733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1092/2170] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:28 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:28.342303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:28.343303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:28.494075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:28.504020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:28.506092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:28.508074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39c7e7a0-fe5d-4b21-8e76-21d9f15d1577 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1277 microversion: 2.57 time: 0.172762 Nov 02 11:59:28.508927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1093/2171] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:28 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:28.533983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:28.534820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:28.541624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:28.542411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:28.542898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:28.543870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:28.544524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:28.545139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.029452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:29.045687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:29.051922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:29.054647 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c080ca4-c041-4c9a-897d-e8024a804b2a tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1564 microversion: 2.25 time: 0.533180 Nov 02 11:59:29.069036 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1094/2172] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:28 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1564 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:29.069036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:29.069036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:29.071264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.072226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.072935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.073967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.074680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.082601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.233536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:29.241113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:29.246773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b85be33-3707-4c61-95ec-36e07a63019a tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1221 microversion: 2.1 time: 0.188457 Nov 02 11:59:29.264372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1095/2173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:29 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:29.271894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8c470f5-a121-465a-b8d7-e32338328c88"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:29.274695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:29.281549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.282028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.282470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.283212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.283665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.284091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.836589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:29.837598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:29.838291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:29.838719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:29.839186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:29.857516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.858034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.858493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.859329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:29.859993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:29.860762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:29.894735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Getting quotas for project 14c077c616bb4ade937d69a58dc21bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:59:29.902561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Getting quotas for user 2bc8e86ed3c244618a5f331ac316a968 and project 14c077c616bb4ade937d69a58dc21bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:59:29.938016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:59:29.943768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:59:30.125199 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a359bf25-4be8-414c-9bfe-ff0eee342948 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.955109 Nov 02 11:59:30.135317 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1079/2174] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:59:30.141401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408f05d1-a900-4540-9036-a4133f010764", "name": "network-vif-deleted", "tag": "07d1b73b-9b5c-41c5-8d81-328873c6d107"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:30.159765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.159765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.159765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.187733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] Creating event network-vif-deleted:07d1b73b-9b5c-41c5-8d81-328873c6d107 for instance 408f05d1-a900-4540-9036-a4133f010764 on n-h2-855649-4 Nov 02 11:59:30.195925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6728d80b-0ccb-4c10-aec5-c601f26569d5 req-288bc096-0de8-4935-862f-e6ecca948993 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059496 Nov 02 11:59:30.199956 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1080/2175] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:30.213090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:30.222864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:30.230473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.237613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.237613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.237613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.237613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.237613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.424073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3da3d7e-d4a2-4a96-9f8e-5c05af709b74 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "POST /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158227 Nov 02 11:59:30.425324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1096/2176] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 11:59:29 2022] POST /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:30.438739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:30.445027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:30.458390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.465228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.465228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.465228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.465228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.465228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.499736 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14a5e691-2204-4e93-a44f-b3d9d689231f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072900 Nov 02 11:59:30.512997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1097/2177] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:30 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:59:30.543126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:30.544036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:30.568581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.569312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.570703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.571838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.572327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.572798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.808079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:30.818028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:30.819510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:30.820933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afec10b8-3c8f-4aba-9ed6-d218b94cb959 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1273 microversion: 2.57 time: 0.305969 Nov 02 11:59:30.821502 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1098/2178] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:30 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1273 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:30.827082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:30.850330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:30.860474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:30.871683 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bfa5ace-79e1-4766-80fd-87f7838a63e7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.670125 Nov 02 11:59:30.874135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1081/2179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:30 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:30.878043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.879348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.880138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.881353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.885519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.886281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.892126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cde153d2-bb11-4b5b-89d9-8726311f9e77 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:30.896620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cde153d2-bb11-4b5b-89d9-8726311f9e77 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:30.959609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:30.961002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:30.961563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:30.962264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lazy-loading 'fault' on Instance uuid 408f05d1-a900-4540-9036-a4133f010764 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:31.059713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:31.076442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:31.079306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7827c83ee4674362bab55ca9c40d16fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4127e1b3c0429690c7d1905258e750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:31.098935 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8fafca23-1e8f-4098-a904-89a4522dcbc5 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 200 len: 1352 microversion: 2.25 time: 0.265176 Nov 02 11:59:31.099572 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1099/2180] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:30 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 1352 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:31.117071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:31.118152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:31.134485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cde153d2-bb11-4b5b-89d9-8726311f9e77 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:31.137995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:31.142105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:31.142969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:31.145338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:31.147991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cde153d2-bb11-4b5b-89d9-8726311f9e77 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1213 microversion: 2.1 time: 0.268689 Nov 02 11:59:31.148887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:31.149344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:31.152770 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1082/2181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:30 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1213 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:31.164410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-174913483", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "fc34eb09-c1a5-4b74-a421-ca48a9800d8e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:31.269783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] validate_networks() for [('fc34eb09-c1a5-4b74-a421-ca48a9800d8e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 11:59:31.334758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:31.349920 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc947cec-b430-4a4f-95b5-c57ec1d08ba9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1295 microversion: 2.1 time: 0.248972 Nov 02 11:59:31.350528 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1100/2182] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:31 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1295 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:31.854442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:31.855147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:31.862462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:31.862972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:31.863483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:31.864401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:31.865206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:31.865928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.039777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:32.051488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:32.053297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:32.054745 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-230f3e7b-185a-4e40-89da-d40d047b4f62 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1329 microversion: 2.57 time: 0.204693 Nov 02 11:59:32.069824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1101/2183] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:31 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1329 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:32.069824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:32.069824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:32.088152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.088669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.089153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.094955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.096435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.097315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.268168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:32.269740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:32.270096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:32.270753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:32.271277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:32.321909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.328129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.331772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.332993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.337820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.338665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.373815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 11:59:32.382250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Getting quotas for user aa7142c46289437f9c9e74b11d27e5e5 and project b32d0c67e2d04664b25fb11d43b6c9e4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 11:59:32.403878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 11:59:32.407509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 11:59:32.759844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:32.769250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0bb68c3-2a2d-4d1c-9a08-2ebeaaddff1c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.712169 Nov 02 11:59:32.769862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1102/2184] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:32 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:32.774839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:32.775544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] [instance: 408f05d1-a900-4540-9036-a4133f010764] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:32.783509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.784005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.784447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.785196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.785649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.786083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.802157 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] HTTP exception thrown: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Request method failure captured: Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 HTTP/1.1 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlmh1kZAnyqdYSzijZCDW_yYfi0Djnsrt6bxJEeFoEBGQ9sAp2CuLg4WNNxJopk5TdpmBjUEZ3r0XXd0OzMn9eTtX53vQ4U-mIfguDlpb_CbDwiL_vOYPkdkxMO3F3Sua5xYOets9mUmkugUdsZGDqylm7EHVQfmsFhTIti9m3AS8ug Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b4127e1b3c0429690c7d1905258e750", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b4127e1b3c0429690c7d1905258e750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7b4127e1b3c0429690c7d1905258e750 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-560730347 Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7827c83ee4674362bab55ca9c40d16fb Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-560730347-project Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '408f05d1-a900-4540-9036-a4133f010764'} Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. Nov 02 11:59:32.804050 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] Returning 404 to user: Instance 408f05d1-a900-4540-9036-a4133f010764 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 11:59:32.808881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62403817-8090-4216-a318-ee0d539259a4 tempest-LiveAutoBlockMigrationV225Test-560730347 tempest-LiveAutoBlockMigrationV225Test-560730347-project] 10.222.0.48 "GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764" status: 404 len: 111 microversion: 2.25 time: 0.034758 Nov 02 11:59:32.810600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1103/2185] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:32 2022] GET /compute/v2.1/servers/408f05d1-a900-4540-9036-a4133f010764 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 11:59:32.815257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:32.816599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:32.823469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.824087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.824398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.825111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.825571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.825999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.858710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-331429aa-980a-49a3-a572-cab8c586baa1 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.704500 Nov 02 11:59:32.864411 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1083/2186] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 11:59:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 11:59:32.877668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:32.881060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:32.893666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.898854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.901999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:32.904874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:32.906334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:32.907696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:33.248646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:33.266924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54a64224-ed29-473c-88c7-c9ff1f23cbff tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1265 microversion: 2.1 time: 0.455554 Nov 02 11:59:33.271084 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1104/2187] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:32 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:33.282474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:33.283032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:33.317910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:33.318419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:33.318847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:33.319601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:33.320070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:33.320541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:33.549247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:33.553273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:33.566357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c4f50f5-1c86-463c-a104-b3740c417d1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.698764 Nov 02 11:59:33.571858 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1084/2188] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:32 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:33.590883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4034406c-4dfd-4057-a6c8-bb267be32a98 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:33.591931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4034406c-4dfd-4057-a6c8-bb267be32a98 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:33.914152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4034406c-4dfd-4057-a6c8-bb267be32a98 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:33.930220 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4034406c-4dfd-4057-a6c8-bb267be32a98 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1217 microversion: 2.1 time: 0.356071 Nov 02 11:59:33.932825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1085/2189] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:33 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:33.948820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:33.952490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:33.961323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:33.963788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:33.964686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:33.965884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:33.966761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:33.968942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.190649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:34.202891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:34.205292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:34.206956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e365db1-8b5e-47be-ac06-0c509ff77106 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1335 microversion: 2.57 time: 0.269259 Nov 02 11:59:34.207787 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1086/2190] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:33 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1335 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:34.213807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72b0e6d-8452-43e4-b6ad-621421f93b1c", "tag": "6872d731-1d13-4132-8f76-a5ff864f7db7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:34.226072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.227021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.227707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.242646 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] Creating event network-changed:6872d731-1d13-4132-8f76-a5ff864f7db7 for instance d72b0e6d-8452-43e4-b6ad-621421f93b1c on n-h1-855649-4 Nov 02 11:59:34.248325 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-020749f5-54a3-4f82-b797-ceff36b563d3 req-881262b8-513e-4603-ac05-6f0ba43c75b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039164 Nov 02 11:59:34.250773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1087/2191] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:34.258452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:34.259743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:34.269415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.270163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.272224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.274202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.276578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.277280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.290900 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92db7596-d1ce-4844-972c-7a0cd6ef75d1 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1813 microversion: 2.1 time: 1.016803 Nov 02 11:59:34.295920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1105/2192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:33 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1813 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:34.306919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:34.309246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:34.326461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.328037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.328483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.329241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.329701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.330739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.472167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:34.490401 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1111bef-594c-4730-b940-d153cae02e1f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1271 microversion: 2.1 time: 0.192711 Nov 02 11:59:34.491644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1106/2193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:34 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:34.499263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:34.519083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.519676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.520160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.522283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.523088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.523538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.562921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-249ed8bc-b6c6-481f-a35f-25a0b23c936a tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068510 Nov 02 11:59:34.564465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1107/2194] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 11:59:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:34.596362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:34.597151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:34.605759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.606264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.607432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.608155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.608801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.609303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.735941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:34.746624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63fd14d4-9607-4fb7-bc4d-fa1961b0ee66 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.493364 Nov 02 11:59:34.764369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1088/2195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:34 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:34.956261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:34.956978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:34.980534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.981040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.981487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:34.982282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:34.995882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:34.999668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.021834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.036646 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e592cdee-b711-4f77-9066-9df440cb43b2 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.445808 Nov 02 11:59:35.037969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1108/2196] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:34 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:35.237614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:35.239414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:35.248808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.253064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.254327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.255592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.256349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.256974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.615537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.631371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4bb48a64-70bc-4d10-a279-ae4f570745fa tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1221 microversion: 2.1 time: 0.680546 Nov 02 11:59:35.649233 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1089/2197] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:34 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1221 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:35.662302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:35.662833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:35.673746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.674433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.675271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.677100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.677776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.678503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.686478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.706686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.712932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.716107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76f164f8-637d-439f-9017-35b7771ad5d7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1335 microversion: 2.57 time: 0.485077 Nov 02 11:59:35.719894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1109/2198] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:35 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1335 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:35.773326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:35.774357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:35.776697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:35.785073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:35.788039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.788814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.789435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.790325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:35.792888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:35.793570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:35.801988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bac29049-7a71-4e1c-ba04-d7e8f1ccc35b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1271 microversion: 2.1 time: 0.165805 Nov 02 11:59:35.803141 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1090/2199] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:35 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:36.070708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:36.071540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:36.084033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.091251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.091936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:36.092774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.095853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.096697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:36.156372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:36.168594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12ccf47e-fd5e-411a-8fec-02f2325d728a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.398039 Nov 02 11:59:36.177875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1110/2200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:35 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:36.472103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:36.491735 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25d63e28-6c47-4077-b1d0-afa306b970bf tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.424761 Nov 02 11:59:36.519039 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1091/2201] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:36 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:36.668466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:36.673477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:36.692634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.694836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.695854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:36.698580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.703467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.707623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:36.772850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:36.775684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:36.787433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.788120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.788388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:36.789129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:36.789615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:36.790041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.093450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:37.110268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:37.113182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:37.119227 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06395742-a924-4330-b5a8-5da6f98a53c9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1335 microversion: 2.57 time: 0.350035 Nov 02 11:59:37.122337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1092/2202] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:36 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1335 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:37.137673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:37.141240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:37.154210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.156512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.159311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.160608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.162165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.163576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.349560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:37.392594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6695ce7d-be91-4d31-a93f-d451df0dd4a2 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1221 microversion: 2.1 time: 0.721195 Nov 02 11:59:37.395882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1111/2203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:36 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1221 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:37.412664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:37.414690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:37.447417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.448400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.449023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.451549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.452669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.453940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.460861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:37.937248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:37.947759 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f9b21af-1302-47b7-ae24-1e1264678045 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1313 microversion: 2.1 time: 0.822465 Nov 02 11:59:37.947759 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1093/2204] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:37 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:37.952945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:37.960672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:37.973464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.973974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.974421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:37.975185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:37.979448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:37.980022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.043872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.053607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0bd1ca4-8ce5-4fe3-90d4-f13716178601 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.655606 Nov 02 11:59:38.079275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1112/2205] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:37 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:38.159702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:38.161611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:38.181088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.182068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.182743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.186517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.187409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.187957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.426380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.438694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.440559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.442136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35236891-726e-46c7-8d1d-cadef67d428c tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1335 microversion: 2.57 time: 0.290512 Nov 02 11:59:38.443545 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1113/2206] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:38 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1335 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:38.453715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:38.463455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:38.466579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.469213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.470822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.479771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.481051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.481815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.525342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:38.640600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.663325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f165080-36f3-4ca9-bfca-fda96f963177 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1269 microversion: 2.1 time: 0.214351 Nov 02 11:59:38.664772 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1114/2207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:38 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:38.882422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:38.898558 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87566748-d318-4656-8ec7-7f5057470aa0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.949991 Nov 02 11:59:38.899967 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1094/2208] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:37 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:38.955101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c69a747-66a0-48fe-9d72-c9ff607d8bec", "device": "/dev/xvdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:38.958686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:38.970911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.971913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.972660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.973562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.974257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.975614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:38.976304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.977634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:38.987071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:38.993996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:38.996361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:38.997377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:39.002329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:39.003100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:39.501939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:39.515378 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01e3e029-d8c4-462a-b972-43d41724f86a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1313 microversion: 2.1 time: 0.544295 Nov 02 11:59:39.516571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1095/2209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:38 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:39.522474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:39.523342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:39.533221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:39.534374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:39.535364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:39.536537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:39.542351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:39.542351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:39.981250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:39.992604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27a5efc2-981c-4d67-be9f-5ba3e7c0809e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 0.474599 Nov 02 11:59:40.003836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1096/2210] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:39 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:40.010952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:40.011682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:40.019837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.020361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.020815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.022249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.022564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.023101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.170532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:40.191860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ef3e386-3ce8-4b86-9947-82a65d165cdb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232171 Nov 02 11:59:40.193938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1115/2211] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 11:59:38 2022] POST /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 194 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:40.196346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:40.198059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:40.199402 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0116d9dd-2f98-4261-a3ad-2a6db9dfa938 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1356 microversion: 2.57 time: 0.193014 Nov 02 11:59:40.200239 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1097/2212] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:40 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:40.203470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:40.205313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:40.205578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:40.206208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:40.215028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.217524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.218695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.219874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.220515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.221191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.224324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.224842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.225268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.226079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.226540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.226970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.455281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:40.468899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df6503df-0165-4bd5-b61d-b30dc74d1e1f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1275 microversion: 2.1 time: 0.270560 Nov 02 11:59:40.475224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1116/2213] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:40 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:40.487064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:40.492833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:40.511582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.513855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.515902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.517206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.518569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.519121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.658617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 11:59:40.659076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 11:59:40.663068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 11:59:40.665610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 11:59:40.666775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 11:59:40.910473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:40.939469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.940260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.941465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:40.942869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:40.944055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:40.944940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.009169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-081784ef-a93a-4a8d-b322-2e78331b78c7 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "POST /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654/action" status: 202 len: 1137 microversion: 2.57 time: 0.532102 Nov 02 11:59:41.010599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1117/2214] 10.222.0.48 () {62 vars in 1320 bytes} [Wed Nov 2 11:59:40 2022] POST /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654/action => generated 1137 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 11:59:41.018006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72b0e6d-8452-43e4-b6ad-621421f93b1c", "name": "network-vif-plugged", "status": "completed", "tag": "6872d731-1d13-4132-8f76-a5ff864f7db7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:41.029988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.030504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.030971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.043723 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] Creating event network-vif-plugged:6872d731-1d13-4132-8f76-a5ff864f7db7 for instance d72b0e6d-8452-43e4-b6ad-621421f93b1c on n-h1-855649-4 Nov 02 11:59:41.049582 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6ab82a35-3e61-4edc-ac31-7b2d9f1b2c80 req-0027fc72-85ad-42e7-955e-211ac1061315 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037341 Nov 02 11:59:41.050725 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1118/2215] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:41.058428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:41.059751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:41.068753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.070502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.071171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.072169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.073067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.073713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.387500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:41.399806 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68135d69-4621-4855-9283-e35a8b605d18 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 1.198233 Nov 02 11:59:41.415593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1098/2216] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:40 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:41.423318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:41.425449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:41.432727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.433591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.434713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.448136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.452437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.466453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.800875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:41.811699 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18a6202e-5243-4396-929d-32e447f69238 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.759385 Nov 02 11:59:41.829048 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1119/2217] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:41 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:41.836373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:41.837354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:41.845115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.846023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.846727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:41.847717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:41.848428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:41.849240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.117195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:42.136993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:42.138805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:42.140675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bea8a1c2-8775-466a-b414-e7cd9f812e04 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.309999 Nov 02 11:59:42.141457 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1120/2218] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:41 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:42.149784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:42.149784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:42.176994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:42.177497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:42.177934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.178658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:42.180891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:42.181611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.357256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:42.459724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:42.472917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d129772-959c-41c6-93f6-b6aabddb6df1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1308 microversion: 2.1 time: 1.055761 Nov 02 11:59:42.473844 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1099/2219] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:41 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1308 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:42.485938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:42.490606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:42.501470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:42.502553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:42.503800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.505193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:42.506194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:42.507100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.877374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:42.887784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efd64494-91bf-402b-a879-62e5821423a7 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.744189 Nov 02 11:59:42.887784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1121/2220] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:42 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:42.903820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb", "tag": "5a04b563-aef1-41d3-a3dd-4c5cad76f50b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:42.923943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:42.924507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:42.924945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:42.969039 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] Creating event network-changed:5a04b563-aef1-41d3-a3dd-4c5cad76f50b for instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb on n-h2-855649-4 Nov 02 11:59:42.994411 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9edd9f24-bed0-47b9-b01d-77440771e098 req-ce5a32e1-98a0-42e9-94b8-22d0c2f92a8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099609 Nov 02 11:59:42.995425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1122/2221] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:43.005267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:43.010445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:43.030232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.034347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.035235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.043336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.043336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.043336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.250182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:43.260196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5441656-e17e-4688-8622-fb34afb5bc5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.784389 Nov 02 11:59:43.260893 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1100/2222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:42 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:43.293279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:43.297989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:43.308437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:43.313908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.315527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.317506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.320841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.321657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.338198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.667892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:43.709855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:43.726112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:43.730014 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de56041f-25df-48d1-affc-75a022f7af89 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.465643 Nov 02 11:59:43.744893 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1101/2223] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:43 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:43.773817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:43.775020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:43.790119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.794322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.794322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.794322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.795529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.797197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.928739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=24 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:43.957239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:43.967109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff5d02b8-3401-444b-8df6-2c01ece96e07 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.969322 Nov 02 11:59:43.968174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1123/2224] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:42 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:43.973836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:43.974713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:43.982202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.983271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.984044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:43.985077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:43.985884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:43.986687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:44.323832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:44.334596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f5d45db-ca27-48ae-9a12-344b71f601ed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 200 len: 1488 microversion: 2.1 time: 0.587867 Nov 02 11:59:44.347316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1102/2225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:43 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 1488 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:44.361272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:44.362171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:44.371168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:44.371856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:44.372546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:44.373486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:44.374143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:44.374784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:44.380731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:44.496360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:44.510315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc03bec9-6c52-4ebb-ad23-a8a042335f50 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.540794 Nov 02 11:59:44.513445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1124/2226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:43 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:44.552626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-603402032"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:44.559664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:44.582127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:44.585649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:44.594650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:44.594650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:44.596089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:44.596660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:44.597136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:44.894633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:44.925209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07a643c3-d896-4f93-a4b2-0e8cebc785c3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.576344 Nov 02 11:59:44.940691 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1103/2227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:44 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:44.976212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:44.977867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:44.997111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.000852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.001540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.002633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.006060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.006767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.054327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-547934b8-25b0-4046-a332-a3103116676a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.290104 Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1104/2228] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:44 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.354078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.359896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.359896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eea25d8-48f4-4afa-a7ac-503284125f25 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c/action" status: 202 len: 0 microversion: 2.1 time: 0.764487 Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1125/2229] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:59:44 2022] POST /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "tag": "3e3174da-1771-48d3-b90f-1313536b60ba"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.360204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.366942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] Creating event network-changed:3e3174da-1771-48d3-b90f-1313536b60ba for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 11:59:45.375594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b6cbdc1-64a5-4386-8721-c20f1abfc01f req-fd6a07e0-8112-4716-9080-edde2d2add3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064403 Nov 02 11:59:45.376221 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1126/2230] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:45.382827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52a14bc2-c59f-4c61-9250-5de28055d212 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbaebd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:45.472094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52a14bc2-c59f-4c61-9250-5de28055d212 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.093308 Nov 02 11:59:45.474129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1127/2231] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:45 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:45.537804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:45.538653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:45.549495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.550061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.551745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.553310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.553799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.554226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.910328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:45.921576 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-223b66f6-bc6d-43dc-9b0a-57b09c1fc114 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.680107 Nov 02 11:59:45.922468 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1105/2232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:45 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:45.942580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:45.945786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:45.964629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.965547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.966370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:45.967419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:45.968058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:45.969916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.027355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3af1a723-c6c9-435c-9768-56f9d732fe86 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089381 Nov 02 11:59:46.028194 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1106/2233] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:45 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:46.039675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:46.040318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:46.047008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.047600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.048114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.048881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.049352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.049788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.428978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:46.438734 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-801ae8e1-4eb2-4498-8610-57a390991743 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.905294 Nov 02 11:59:46.461977 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1128/2234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:45 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:46.472616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:46.473370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:46.485392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.486789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.487474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.488652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.489262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.489914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.675121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lazy-loading 'services' on Instance uuid fc3c29ab-6131-49b6-a145-1710d75bfe90 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:46.702944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:46.721739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03d7020e-5ffd-4c16-9ea9-9db29b153937 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.686070 Nov 02 11:59:46.722348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1107/2235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:46 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:46.739060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:46.739890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:46.746416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.755290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.756800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.758154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:46.764239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:46.764239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:46.856334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:46.866272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:46.867771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:46.868957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a05a57c-c40d-42d9-993f-b3c287cbaeba tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.145672 Nov 02 11:59:46.871351 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1108/2236] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:46 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:46.884491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de729da1-d243-409a-a811-e902da61d3d1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b344d8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:46.983225 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de729da1-d243-409a-a811-e902da61d3d1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.109922 Nov 02 11:59:46.986184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1109/2237] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:46 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:46.995273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:46.996643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:47.004488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.005596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.008361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.008361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.008361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.008361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.060208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95ca3491-ae78-4496-b06a-2db840f2302c tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments/b8c470f5-a121-465a-b8d7-e32338328c88" status: 202 len: 0 microversion: 2.1 time: 0.596683 Nov 02 11:59:47.064291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1129/2238] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 11:59:46 2022] DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments/b8c470f5-a121-465a-b8d7-e32338328c88 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:59:47.330606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:47.338663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8e1517a-aaa8-4b37-8a96-30c3b11c7f12 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.350621 Nov 02 11:59:47.351257 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1110/2239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:46 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:47.408155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbddce87-28c6-4843-9e05-f7751f5a6116", "tag": "ebfa61a6-d5a1-4a29-b30e-733fd299b973"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:47.420476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.421461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.422137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.435001 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] Creating event network-changed:ebfa61a6-d5a1-4a29-b30e-733fd299b973 for instance bbddce87-28c6-4843-9e05-f7751f5a6116 on n-h2-855649-4 Nov 02 11:59:47.440585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c748c76f-60e6-4633-95b8-b280f97a0d47 req-bba80f91-1971-4218-a657-969f6de8bcca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039626 Nov 02 11:59:47.441381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1130/2240] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:47.475165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:47.475851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:47.483535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.486769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.486769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.486769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.486769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.486769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.714383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:47.722635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc830713-d5ec-4bff-bd02-e906c86e9e7d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.252807 Nov 02 11:59:47.723264 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1111/2241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:47 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:47.755569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:47.756617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:47.770525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.772883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.775771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.776718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.778456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.778912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.895621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:47.896458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:47.903103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.903597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.905248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:47.905248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:47.905429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:47.905704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:48.002940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:48.012326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:48.014027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:48.015489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00bc2c8b-5197-472a-ba11-c4df538321b9 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.124268 Nov 02 11:59:48.016074 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1112/2242] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:47 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:48.023179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-790acf42-fe95-424f-b2f1-afaf8d0ab2c2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3216160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:48.035940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:48.046785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93e313bd-7234-466e-a4cf-fece18b79eb5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.295738 Nov 02 11:59:48.047424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1131/2243] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:47 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:48.094445 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-790acf42-fe95-424f-b2f1-afaf8d0ab2c2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.077155 Nov 02 11:59:48.104453 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1113/2244] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:48 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:48.363609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:48.364242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:48.370401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:48.370896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:48.371608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:48.372380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:48.372845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:48.373278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:48.600747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:48.612268 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abb77694-7b37-45cd-96ee-eb683f3db9cb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.252855 Nov 02 11:59:48.612858 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1132/2245] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:48 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:48.749231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:48.749934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:48.757124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:48.757401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:48.758046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:48.758772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:48.759411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:48.760002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.046856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:49.047761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:49.055003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.055603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.056051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.056773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.057263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.057871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.103348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:49.113845 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b82721c2-62de-40b2-97cd-7eefb5a2a7b5 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.369793 Nov 02 11:59:49.114559 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1114/2246] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:48 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:49.119766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:49.120616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:49.127195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.127690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.128136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.128855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.129351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.129789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.158666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:49.168556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:49.170023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:49.172013 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cac6359b-7186-4773-b017-03fe91141ab2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.130635 Nov 02 11:59:49.172630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1133/2247] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:49 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:49.177195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9ce73d9-ff31-41a5-9603-cd4cd4f7f061 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbab9d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:49.236797 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9ce73d9-ff31-41a5-9603-cd4cd4f7f061 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.063012 Nov 02 11:59:49.246105 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1134/2248] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:49 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:49.296685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:49.305159 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8228563-75ce-44e4-a4e0-93a2cd974257 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.189501 Nov 02 11:59:49.305799 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1115/2249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:49 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:49.515535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "tag": "13a1c44e-a00d-4e4d-88b2-3817921fb812"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:49.541234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.541969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.542769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.554175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] Creating event network-changed:13a1c44e-a00d-4e4d-88b2-3817921fb812 for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 11:59:49.559653 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6c5303b1-17fb-465f-95af-1821886bd7dd req-0af7ec7c-76af-4e71-80d0-4af99e486139 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052900 Nov 02 11:59:49.560255 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1135/2250] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:49.638615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:49.640118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:49.648453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.649127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.649741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:49.650633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:49.651414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:49.652035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.022479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:50.030647 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-544d3b31-5c4b-4949-a368-adee8bc23fbb tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.397606 Nov 02 11:59:50.041746 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1116/2251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:49 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:50.148985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:50.151896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:50.173716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.175769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.178180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.180861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.181718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.182433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.198682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:50.200006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:50.215478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.216014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.216637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.217534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.218135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.218701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.425800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:50.438357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:50.439864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:50.441151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a8fe517-803b-46a3-af43-9c1906167104 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.247168 Nov 02 11:59:50.442146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1117/2252] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:50 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 11:59:50.458028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f935c39-0bac-4c48-98f5-cfbd8ad274b0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b39a4ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:50.552208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f935c39-0bac-4c48-98f5-cfbd8ad274b0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.108687 Nov 02 11:59:50.553289 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1118/2253] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:50 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:50.566590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:50.568494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:50.583213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.588068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.588788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.592282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:50.593662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:50.594831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:50.649366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:50.659365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f66879f5-9d59-426b-8651-a33eb0132dee tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.525901 Nov 02 11:59:50.671938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1136/2254] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:50 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:50.912879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efa9ae20-9324-4e6a-a52f-b1f855d317d4 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1bba7aa60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:50.988928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efa9ae20-9324-4e6a-a52f-b1f855d317d4 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8" status: 200 len: 371 microversion: 2.1 time: 0.315470 Nov 02 11:59:50.989762 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1137/2255] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 11:59:50 2022] GET /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8 => generated 371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:50.994992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72b0e6d-8452-43e4-b6ad-621421f93b1c", "name": "network-vif-plugged", "status": "completed", "tag": "6872d731-1d13-4132-8f76-a5ff864f7db7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:51.009412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.010080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.010669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.038829 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] Creating event network-vif-plugged:6872d731-1d13-4132-8f76-a5ff864f7db7 for instance d72b0e6d-8452-43e4-b6ad-621421f93b1c on n-h1-855649-4 Nov 02 11:59:51.044776 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c9a8e843-9176-4caa-b854-f6ee19375423 req-01a1361c-b724-4312-a03f-1a3186261efa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053466 Nov 02 11:59:51.046310 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1138/2256] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:51.053583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbabfca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:51.191879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.193155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.193763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.195487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.196155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.196769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.302644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:51.314313 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24e19c76-ba2f-45d5-8be0-10336ca203e6 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.758779 Nov 02 11:59:51.315013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1119/2257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:50 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:51.334815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.335797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:51.345444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.346413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.348493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.349494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.351440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.351816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb7cc98b-5a2c-4e15-9d02-a5365af8b021 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8" status: 200 len: 328 microversion: 2.1 time: 0.303932 Nov 02 11:59:51.352218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.360469 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1139/2258] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:59:51 2022] PUT /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8 => generated 328 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:51.366882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8ff58e2-1432-480d-996a-6347befc86fe tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.555861 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8ff58e2-1432-480d-996a-6347befc86fe tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8" status: 202 len: 0 microversion: 2.1 time: 0.193436 Nov 02 11:59:51.556934 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1140/2259] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 11:59:51 2022] DELETE /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:59:51.572798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.581097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:51.604684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.606918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.607602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.610078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:51.613586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.615176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.617834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.620951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e00efa5-4d05-4254-87ab-80425f8d9193 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.304515 Nov 02 11:59:51.621567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1120/2260] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:51 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:51.634287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6b43db9-6445-4e50-b81d-2124c7543fef tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1b350c1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.779807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6b43db9-6445-4e50-b81d-2124c7543fef tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8" status: 200 len: 371 microversion: 2.1 time: 0.153469 Nov 02 11:59:51.788586 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1121/2261] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 11:59:51 2022] GET /compute/v2.1/os-quota-sets/01c0170b02884ca694ad5e8b9ee1e4b8 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:51.794439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5427d76-7b9c-415b-b949-49080a53f444 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b334e280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.861237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:51.870630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:51.874516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5427d76-7b9c-415b-b949-49080a53f444 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.081128 Nov 02 11:59:51.875825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1122/2262] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:51 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:51.877056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:51.879792 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b73ef5d-734b-4b84-ba8a-d1be08c63232 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.321382 Nov 02 11:59:51.880879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1141/2263] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:51 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:51.883531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:51.886668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:51.904755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.906173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.906836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:51.907848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:51.909262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:51.912393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:52.198822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:52.211663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec191ac3-20a6-4ebb-9809-5fd67e6e36e9 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.334382 Nov 02 11:59:52.213144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1123/2264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:51 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:52.234565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b049eee3-5eca-4bc4-ac7f-09badaeee38a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1bba46700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:52.338350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:52.338993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:52.353361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:52.353862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:52.354479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:52.355388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:52.355998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:52.356579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:52.553895 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b049eee3-5eca-4bc4-ac7f-09badaeee38a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af/defaults" status: 200 len: 371 microversion: 2.1 time: 0.323750 Nov 02 11:59:52.558416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1142/2265] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 11:59:52 2022] GET /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af/defaults => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:52.619892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:52.624783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:52.648810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:52.649456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:52.652469 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6da2a6e5-e719-4eb1-a78b-980f48666787 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.317931 Nov 02 11:59:52.653696 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1124/2266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:52 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:52.668963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:52.669474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:52.669924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:52.670754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:52.671250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:52.671686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:52.913872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d7e98da-c2dc-4486-9305-62bd3deb747c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b33971f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:52.957648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:52.970499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3919aa1-1ad2-4e34-9b0e-8557b1069165 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.325624 Nov 02 11:59:52.989866 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1143/2267] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:52 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:52.996191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:52.997559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:53.009949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d7e98da-c2dc-4486-9305-62bd3deb747c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.124071 Nov 02 11:59:53.010660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1125/2268] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:52 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:53.011193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.012202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.012663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.013566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.014049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.014570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.078349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b344d940>, body: {"quota_set": {"ram": "5120"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:53.133229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:53.146107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:53.147955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:53.150436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c82ad976-0cc4-4afa-9d52-26794ea24141 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.159219 Nov 02 11:59:53.151667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1144/2269] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:52 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:53.237988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:53.238623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:53.252721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.253226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.253679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.254816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.255529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.256941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.338161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.342348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.343909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.344955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.345675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.346258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.448021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:53.477258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e0a5ecb-f31b-4c36-9b1a-eb2c2f9ad00c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.240825 Nov 02 11:59:53.489558 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1145/2270] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:53 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 11:59:53.489750 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a93a790-cfc2-493b-9ffd-da495d03bd7a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1" status: 200 len: 328 microversion: 2.1 time: 0.413119 Nov 02 11:59:53.492219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1126/2271] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 11:59:53 2022] PUT /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1 => generated 328 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:53.496179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1b35b09d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:53.596740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.597723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.610154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.613114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.616036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.616751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.652916 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e929fda8-7595-423d-9706-51faf312533a tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1/detail" status: 200 len: 916 microversion: 2.1 time: 0.160253 Nov 02 11:59:53.654376 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1146/2272] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 11:59:53 2022] GET /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1/detail => generated 916 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:53.690968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:53.691957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:53.722407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.723940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.724655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.725693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:53.726376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:53.727198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:53.999523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:54.000189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:54.008612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:54.010139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.014501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.017370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.018213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.023804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.024568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.051388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18462e6c-fd13-47a2-a47e-8f5d1c14a262 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.354944 Nov 02 11:59:54.077300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1127/2273] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:53 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:54.106673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06949a4d-1f67-49bc-8113-d70522a1f397 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b348daf0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:54.385879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06949a4d-1f67-49bc-8113-d70522a1f397 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.305126 Nov 02 11:59:54.389123 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1128/2274] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:54 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:54.396649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:54.401976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:54.420484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.423892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.427727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.429570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.430215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.430805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.474096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:54.506217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23a60760-65c7-4ec6-94e5-334398e5c9e4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.510938 Nov 02 11:59:54.508226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1147/2275] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:53 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:54.528914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bba469d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:54.725957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:54.748398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:54.752374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:54.757749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a778431-5ea4-4994-90ec-6c3853bb19d2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.366455 Nov 02 11:59:54.763570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.764260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.764470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1129/2276] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:54 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:54.765354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.771523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.777425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.780140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:54.781100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.781231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:54.792908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.796621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.797285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.809237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.810111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.810708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.847106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:54.909096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.909922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.910524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:54.911480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:54.912105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:54.912694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.028481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:55.038035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3afa8e0-f468-4433-b6a6-5b8c7a2a1367 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.271478 Nov 02 11:59:55.039254 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1130/2277] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:54 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:55.044422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:55.045361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:55.057980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.058631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.059187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.060143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.060795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.061492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.180504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bcd89a1d-6fea-4588-9664-ce87912d4c05 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1?user_id=4dc35ddf40f049de9b1292fa2ba47fdb" status: 200 len: 328 microversion: 2.1 time: 0.670141 Nov 02 11:59:55.189242 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1148/2278] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 11:59:54 2022] PUT /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1?user_id=4dc35ddf40f049de9b1292fa2ba47fdb => generated 328 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:55.195652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb", "name": "network-vif-plugged", "status": "completed", "tag": "5a04b563-aef1-41d3-a3dd-4c5cad76f50b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:55.207211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.209354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.210383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.232611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] Creating event network-vif-plugged:5a04b563-aef1-41d3-a3dd-4c5cad76f50b for instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb on n-h2-855649-4 Nov 02 11:59:55.239880 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-69e38ce9-4ae5-4c59-9e58-3c68fc018d29 req-ba1b3bae-a4b4-4d52-9c79-b88756519bf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048289 Nov 02 11:59:55.247730 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1149/2279] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:55.274111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:55.275206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:55.297183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.299452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.302256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.303806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.304487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.305115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.322121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-044a292b-3da5-4c12-bef8-ed15e59987b4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1859 microversion: 2.1 time: 0.281478 Nov 02 11:59:55.331582 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1131/2280] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:55 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1859 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:55.348550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ca525f6-3787-4a2c-9dd7-fe57eb6e0c76 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1b34b1160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:55.502563 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ca525f6-3787-4a2c-9dd7-fe57eb6e0c76 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1?user_id=4dc35ddf40f049de9b1292fa2ba47fdb" status: 200 len: 370 microversion: 2.1 time: 0.169242 Nov 02 11:59:55.503963 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1132/2281] 10.222.0.48 () {58 vars in 1323 bytes} [Wed Nov 2 11:59:55 2022] GET /compute/v2.1/os-quota-sets/5927b9b99db94faa9ed839fd1a8dc0a1?user_id=4dc35ddf40f049de9b1292fa2ba47fdb => generated 370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:55.524310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": true, "disk_over_commit": false}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:55.528760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:55.543765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.549987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.553263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.557220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.559387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.564190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.606848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:55.617690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b315aff-845d-49c6-a3d7-13a75a631152 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.368109 Nov 02 11:59:55.619087 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1150/2282] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:55 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:55.624299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-119b1a68-d15e-40eb-bd8f-15ae65c46d71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bba461f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:55.650885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lazy-loading 'flavor' on Instance uuid 10f47a4b-0e54-4791-900d-e94df091634f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 11:59:55.677999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 11:59:55.720329 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-119b1a68-d15e-40eb-bd8f-15ae65c46d71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.099936 Nov 02 11:59:55.730930 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1151/2283] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:55 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:55.732640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:55.735914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:55.750740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.750740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.751366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.751987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:55.752561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:55.753045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:55.775797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 11:59:56.074891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.089838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d89164d-e611-43f7-88c0-91f9b8e9a424 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.365042 Nov 02 11:59:56.091200 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1152/2284] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:55 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:56.106420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:56.107990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:56.121710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.123081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.123780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.125296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.125946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.126625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.243634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.255760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.257852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.259991 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9719c864-794d-47d3-8ee6-368c73cae678 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.166782 Nov 02 11:59:56.272515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1153/2285] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:56 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:56.286696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:56.287423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:56.295398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.296448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.296894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.297692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.298237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.298685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.532748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.555357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3edfe56-8566-4b30-94f1-ddb1ec9beb0d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.281420 Nov 02 11:59:56.557324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1154/2286] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:56 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:56.652855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:56.712579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:56.845330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:56.863073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87542bde-f385-464b-971c-339dbcc8fc40 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1325 microversion: 2.1 time: 0.212868 Nov 02 11:59:56.864584 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1155/2287] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:56 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:56.884055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f907d296-6a0b-4d6a-a803-43a31c0a1afc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bba7a0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:56.947950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f907d296-6a0b-4d6a-a803-43a31c0a1afc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.081507 Nov 02 11:59:56.948543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1156/2288] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:56 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:56.953674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb09aee6-9de3-46cb-9fb3-b4e1e3c137e9 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Calling method '.version_select at 0x7ff1bba623a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:57.160468 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb09aee6-9de3-46cb-9fb3-b4e1e3c137e9 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af/defaults" status: 200 len: 371 microversion: 2.1 time: 0.210655 Nov 02 11:59:57.160975 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1157/2289] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 11:59:56 2022] GET /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af/defaults => generated 371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:57.166541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:57.168888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:57.177013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.177538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.178002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:57.178731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.179218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.179669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:57.210580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51b2dcc7-b036-4511-b1d9-7ccb7fa7de97 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048460 Nov 02 11:59:57.211333 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1158/2290] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:57 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:59:57.215917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:57.216524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:57.223438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.223930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.224366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:57.225150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.225604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.226030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:57.383020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:57.391322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7bbc6292-057e-4fbf-8ba7-dd92ae03c24b tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.178845 Nov 02 11:59:57.391900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1159/2291] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:57 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:57.396469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bba623a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:57.471822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.472241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.472677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:57.473405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:57.473855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:57.474286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.064612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f89b28e4-b892-4524-888e-c8215a4551b5 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af" status: 200 len: 329 microversion: 2.1 time: 1.671611 Nov 02 11:59:59.066362 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1160/2292] 10.222.0.48 () {60 vars in 1263 bytes} [Wed Nov 2 11:59:57 2022] PUT /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af => generated 329 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:59.072391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "name": "network-vif-plugged", "status": "completed", "tag": "13a1c44e-a00d-4e4d-88b2-3817921fb812"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:59.083409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.083904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.084319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.110939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] Creating event network-vif-plugged:13a1c44e-a00d-4e4d-88b2-3817921fb812 for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 11:59:59.116492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-896b84ec-a071-4530-8ae6-c0c643b7f148 req-3800555b-aa0c-4944-a918-12f45d75375f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048440 Nov 02 11:59:59.117380 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1161/2293] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 11:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 11:59:59.122789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.126895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:59.136036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.136526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.136963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.137793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.138328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.138755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.176462 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94874b17-fc95-430e-8d4a-54668e015f18 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057953 Nov 02 11:59:59.177090 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1162/2294] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 11:59:59.183525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.184455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:59.191893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.192667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.193115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.193911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.194412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.194847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.278099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.287630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.289183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.290415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b0fb3df-9180-4cdc-b14e-02fc7514ddb0 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.112385 Nov 02 11:59:59.303367 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1163/2295] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 11:59:59.312830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.312830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:59.317164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.317661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.318098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.318818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.319307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.319921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.516833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.528534 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75ec3654-97bb-401e-bc8e-c8da2210bd36 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.236252 Nov 02 11:59:59.529488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1164/2296] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:59.535160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.535765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:59.549809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.554860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.554860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.554860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.554860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.554860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.578796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d410611e-f21b-421c-b166-b86a7e6b70d7 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/action" status: 202 len: 0 microversion: 2.1 time: 4.073281 Nov 02 11:59:59.581338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1133/2297] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 11:59:55 2022] POST /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/action => generated 0 bytes in 4077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 11:59:59.590564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42bffc56-097d-4836-9475-17dea64c95c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3ef1040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.661848 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42bffc56-097d-4836-9475-17dea64c95c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.078164 Nov 02 11:59:59.674178 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1134/2298] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:59.679241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.680102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 11:59:59.690152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.691287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.691960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.693472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.694226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.695188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.776179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.788476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11920453-d235-4e60-9ca8-654060c77d5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1523 microversion: 2.1 time: 0.256980 Nov 02 11:59:59.803015 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1165/2299] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:59.803015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbab93a0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 11:59:59.908651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.909828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.910665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.911633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 11:59:59.912209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 11:59:59.912894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 11:59:59.916997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 11:59:59.947023 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b66a1470-48d0-4ce2-afe5-59fdb43cd83a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.277618 Nov 02 11:59:59.949675 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1135/2300] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 11:59:59 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 11:59:59.962784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 11:59:59.963730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:00.001422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.002941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.004208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.005846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.006664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.007517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.063054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:00.118671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=17,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:00.489188 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69ff6f3e-8bdd-46c9-ac39-93ea88232d80 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 204 len: 0 microversion: 2.1 time: 0.536738 Nov 02 12:00:00.493262 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1136/2301] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 11:59:59 2022] DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:00.504370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:00.507439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:00.512342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.512838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.513441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.514321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.514780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.515240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.706964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:00.717378 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e80fec9c-00b5-4489-8c5c-e1190fb0c596 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.225333 Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1137/2302] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:00 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:00.735110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:00.761892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:01.475831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1d4abc0-362d-4256-bce8-bcb924272ef0 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 204 len: 0 microversion: 2.1 time: 0.756281 Nov 02 12:00:01.483363 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1138/2303] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:00 2022] DELETE /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:01.486575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:01.487456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:01.493806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.494300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.494739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:01.495585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.496083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.496515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:01.578338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:01.588367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:01.589979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:01.591546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f02808b-c14c-476a-b542-183efc92d5fb tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.109632 Nov 02 12:00:01.592318 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1139/2304] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:01 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:01.611904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:01.613025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:01.620187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.620687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.621297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:01.622176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.622843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.623316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:01.831019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:01.834944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:01.839720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57347f1c-9e4e-4e99-93fe-bde587af9b11 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1682 microversion: 2.1 time: 0.246181 Nov 02 12:00:01.840310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1140/2305] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:01 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:01.848071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:01.848906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:01.855324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.856049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.856674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:01.857584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:01.858241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:01.858828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.080076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:02.088704 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca1f4eba-8c9e-4b0a-9dc2-7e130a406bef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.247310 Nov 02 12:00:02.089662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1141/2306] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:01 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:02.097955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-500e1301-a143-4436-9c7d-acfcbe2e1f4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b33a8dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.160578 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-500e1301-a143-4436-9c7d-acfcbe2e1f4d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.068844 Nov 02 12:00:02.161777 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1142/2307] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:02.169383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.169383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:02.177200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:02.179780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.180707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.181257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.182223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.182753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.183287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.371936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:02.388383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90ef39ba-d8fb-4be6-be60-4e53e0683b7c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.225564 Nov 02 12:00:02.389203 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1143/2308] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:02.396400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "name": "network-vif-plugged", "status": "completed", "tag": "3e3174da-1771-48d3-b90f-1313536b60ba"}, {"server_uuid": "bbddce87-28c6-4843-9e05-f7751f5a6116", "name": "network-vif-plugged", "status": "completed", "tag": "ebfa61a6-d5a1-4a29-b30e-733fd299b973"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:02.411308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.411980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.412526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.429185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Creating event network-vif-plugged:3e3174da-1771-48d3-b90f-1313536b60ba for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 12:00:02.429798 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] Creating event network-vif-plugged:ebfa61a6-d5a1-4a29-b30e-733fd299b973 for instance bbddce87-28c6-4843-9e05-f7751f5a6116 on n-h2-855649-4 Nov 02 12:00:02.455417 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1835b16a-8cab-4f7b-8b3f-e3bf4c318811 req-b892af0a-9194-45a0-9c70-a1b2bd6a9bbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064470 Nov 02 12:00:02.459636 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1144/2309] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:02.466395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.470267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:02.480838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-258c4783-20e2-4828-8870-7a409f8ffa26 tempest-QuotasAdminTestJSON-502989118 tempest-QuotasAdminTestJSON-502989118-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af" status: 200 len: 329 microversion: 2.1 time: 2.688091 Nov 02 12:00:02.481515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.481799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.482322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.484032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1166/2310] 10.222.0.48 () {60 vars in 1263 bytes} [Wed Nov 2 11:59:59 2022] PUT /compute/v2.1/os-quota-sets/118d7a10e05a44b5b8f50c2f9fb4d4af => generated 329 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:02.489113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.489746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:02.491980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.494366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.495254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.521203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.521203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.523404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.525119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.526021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.526706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.891224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:02.903175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d88f4b3-2c39-499b-b1b6-831807e51557 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1529 microversion: 2.1 time: 0.441436 Nov 02 12:00:02.907698 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1145/2311] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1529 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:02.928470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.929449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.940390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.947496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:02.978013 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a46b62a7-7578-4106-8475-cf7bce92a1ea tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.492705 Nov 02 12:00:02.987889 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1167/2312] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:02.987889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:02.987889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:02.994478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.995208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.995790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:02.996671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:02.997271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:02.998104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.048623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:03.069515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:03.083268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:03.098191 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d47b01f-c996-4863-adc7-6d1e89e9a170 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.160641 Nov 02 12:00:03.098191 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1146/2313] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:03.118457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:03.119186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:03.127888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.128490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.129146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.130028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.131934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.132579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.357735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:03.468651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:03.491042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8109eb6-6123-4218-b06e-828160220078 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1682 microversion: 2.1 time: 0.505317 Nov 02 12:00:03.509670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1168/2314] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:02 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1682 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:03.524937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-915f946a-90eb-4a0a-8c8d-fc8e36cdcc9a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b83f3ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:03.598375 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-915f946a-90eb-4a0a-8c8d-fc8e36cdcc9a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.080770 Nov 02 12:00:03.599854 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1169/2315] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:00:03 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:03.606725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:03.607924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:03.617187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.618143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.618797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.619762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.620429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.621094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.679446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:03.707541 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-217e6610-c78d-481d-8916-fc5041a8ab3d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.590020 Nov 02 12:00:03.708542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1147/2316] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:03 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:03.944624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:03.946827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:03.980012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.980805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.981280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:03.982052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:03.982529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:03.992878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.137402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:04.154317 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cab6d488-9dea-47e4-8687-cedddc2ca1a9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1334 microversion: 2.1 time: 0.552946 Nov 02 12:00:04.155699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1170/2317] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:03 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1334 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:04.175737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:04.176374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:04.190785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.191268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.191723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.192651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.193122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.193561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.778668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:04.802453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:04.810823 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5efa48b0-3e71-45d4-8c3e-a8998d8658eb tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1529 microversion: 2.1 time: 0.883582 Nov 02 12:00:04.811112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89c38a71-45eb-4901-acc0-cdf2b027dbbb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.654238 Nov 02 12:00:04.811611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1171/2318] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:04 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:04.876111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:04.876111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:04.876677 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1148/2319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:03 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1529 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:04.876772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.876772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.876772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.876772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.876772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.877112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:04.877112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:04.877260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:04.877336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:05.357184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:05.372237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:05.373744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:05.374962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74388895-d78e-4c49-bfe6-08d6824e01b2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.562088 Nov 02 12:00:05.390216 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1172/2320] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:04 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:05.395168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af095f0c-43d7-448a-941b-ad5a7afd9d3a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3864ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:05.484324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af095f0c-43d7-448a-941b-ad5a7afd9d3a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1413 microversion: 2.1 time: 0.103945 Nov 02 12:00:05.485245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1173/2321] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:00:05 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:05.490238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:05.490870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:05.493781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:05.497366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:05.497870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:05.498333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:05.504415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:05.504957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:05.505412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.154669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:06.174047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0e93238-ad51-493d-b25a-c5dd4a012024 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1682 microversion: 2.1 time: 1.347354 Nov 02 12:00:06.177772 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1149/2322] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:04 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1682 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:06.196782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:06.199392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:06.216138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.219586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.220117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.223025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.225473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.227911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.296618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:06.314888 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-627f3faa-e594-4fbd-a30d-7b7f0335eb90 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1317 microversion: 2.1 time: 0.825820 Nov 02 12:00:06.320568 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1174/2323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:05 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:06.346189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:06.350772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:06.381636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.383095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.383862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.384775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.385587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.386264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.456828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:06.762016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:06.770688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ee7e904-d4ab-4d0b-b8d9-2cea1299a473 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1669 microversion: 2.1 time: 0.591239 Nov 02 12:00:06.786995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1150/2324] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:06 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:06.786995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:06.790815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:06.802526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.802951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.808883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.809933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:06.810421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:06.811753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:06.943068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:06.946804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:06.978851 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4ec9d1a-71e5-49a8-83d4-ef8dcce9decf tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.655230 Nov 02 12:00:06.979751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63d76771-324a-4206-ac17-092439de5534 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1487 microversion: 2.1 time: 0.195364 Nov 02 12:00:06.998818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1175/2325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:06 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:06.999379 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1151/2326] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:06 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1487 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:07.018074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb03d7f2-b178-49fe-a42f-46d938ff87c2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b348dca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.019579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.024032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.040201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.044626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.045500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.048825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.049326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.049769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.100717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb03d7f2-b178-49fe-a42f-46d938ff87c2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1422 microversion: 2.1 time: 0.098258 Nov 02 12:00:07.102311 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1152/2327] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:00:06 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:07.116467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb", "name": "network-vif-deleted", "tag": "5a04b563-aef1-41d3-a3dd-4c5cad76f50b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:07.134397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.135105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.135759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.147618 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] Creating event network-vif-deleted:5a04b563-aef1-41d3-a3dd-4c5cad76f50b for instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb on n-h2-855649-4 Nov 02 12:00:07.152963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1bdf981b-bbb5-4d0d-82d8-eb69f85f672d req-8d050922-e580-4873-8197-8f2794eada0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049441 Nov 02 12:00:07.153950 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1153/2328] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:07.168029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.169069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.177750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.177949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.178664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.179606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.180352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.180982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.227797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:07.235459 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fa39fba-8249-4965-bfb6-45590bded6e1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436/ips" status: 200 len: 179 microversion: 2.1 time: 0.079135 Nov 02 12:00:07.236076 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1154/2329] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:00:07 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436/ips => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:07.258423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:07.268651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:07.273982 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef0fe5be-d94b-447b-8998-230adb16adc2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.269037 Nov 02 12:00:07.275582 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1176/2330] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:06 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:07.287239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a604264-a956-4833-9299-35f3a20e37f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b334ef70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.299250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.299881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.318399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.318399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.318399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.318399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.318726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.318841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.384430 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a604264-a956-4833-9299-35f3a20e37f8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 200 len: 1422 microversion: 2.1 time: 0.112725 Nov 02 12:00:07.388141 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1155/2331] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:00:07 2022] GET /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 1422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:07.400699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.401410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.421216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.422147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.423098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.424421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.425605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.426612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.471957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:07.546820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:07.561657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4a5373d-a3b5-4c1b-8f59-0487e1fb52aa tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1614 microversion: 2.1 time: 0.282602 Nov 02 12:00:07.562616 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1177/2332] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:07 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1614 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:07.605090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.605902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.613676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.614328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.615595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.616451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.617009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.617521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.883566 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9f1218f-d9b8-469f-8353-e75646b60d72 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 204 len: 0 microversion: 2.1 time: 0.493838 Nov 02 12:00:07.884984 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1156/2333] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:07 2022] DELETE /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:07.894021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1740082171", "imageRef": "ceb7f608-6375-4230-82e8-475823b14502", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:07.917497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:07.929589 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3b959ac-2529-4a8d-8ea6-7ce669150723 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1507 microversion: 2.1 time: 0.364573 Nov 02 12:00:07.941299 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1178/2334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:07 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:07.953970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:07.956996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:07.964721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.966075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.966529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.967508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:07.968116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:07.968561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:07.985788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:00:08.282690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:08.309889 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9575c80b-b8a0-4592-b113-f61bcaceadab tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1675 microversion: 2.1 time: 0.366715 Nov 02 12:00:08.310510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1179/2335] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:07 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1675 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:08.333264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:08.333264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:08.348007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.348567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.348963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.352225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.352489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.352898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.440485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.442141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.442600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.443110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lazy-loading 'fault' on Instance uuid acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:08.537840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ddce8ede1194d26a83ed481de2a3db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800e17a4635e409bb8094879d36c155a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:08.551874 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2007f6ab-015e-4087-984a-18233128f82b tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 200 len: 1315 microversion: 2.1 time: 0.240284 Nov 02 12:00:08.552712 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1180/2336] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:08 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:08.562958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:08.564706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:08.574377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.574884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.575494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.576214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.576713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.577151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.883057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:08.896677 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d08d51e-016b-4a34-b1ed-572695716130 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.342679 Nov 02 12:00:08.898327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1181/2337] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:08 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:08.904731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:08.906637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:08.925060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:00:08.928769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:00:08.928769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:00:08.928769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:00:08.928769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:00:08.934422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.937157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.937853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.938629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.940894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.941512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.961978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.962475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.962921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:08.978108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:08.978568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:08.979051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.028373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:09.037056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:09.056277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:00:09.064505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ceb7f608-6375-4230-82e8-475823b14502',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:00:09.065292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:09.076463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:09.078383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:09.080436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4dbe4d9-cd84-4ec3-af25-906f4df77094 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.179928 Nov 02 12:00:09.081431 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1182/2338] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:08 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:09.087063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.087804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:09.095562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.096463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.097139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.098101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.098817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.099597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.136844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.137399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.138012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.138648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lazy-loading 'fault' on Instance uuid fc3c29ab-6131-49b6-a145-1710d75bfe90 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:09.213201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca67dc2c5a744fe9575a2fa01d4be58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362be4a089a242e9aed574854f849ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:09.227026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98950d53-57af-4b4a-8d81-fe612fdef01d tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 200 len: 1330 microversion: 2.1 time: 0.144268 Nov 02 12:00:09.232266 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1183/2339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:09.263639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3c29ab-6131-49b6-a145-1710d75bfe90", "name": "network-vif-deleted", "tag": "c422a904-e62f-491a-90bc-457d3531211a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:09.282679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b35d01a-6153-4411-a535-c0e37181bea0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392056 Nov 02 12:00:09.282679 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1157/2340] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:00:09.296196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.300897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.302076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.307137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-723aa523-c316-4a4a-96b9-ac1dd012b773 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.308188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-723aa523-c316-4a4a-96b9-ac1dd012b773 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:09.332208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] Creating event network-vif-deleted:c422a904-e62f-491a-90bc-457d3531211a for instance fc3c29ab-6131-49b6-a145-1710d75bfe90 on n-h2-855649-4 Nov 02 12:00:09.338443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b45fb13e-a582-4897-9b6b-e5863f9f6e2d req-923acd19-97dc-42a9-98b0-f93791adb8f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104771 Nov 02 12:00:09.339690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1184/2341] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:09.351070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.352756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:09.361897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.363074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.363715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.364775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.365438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.366370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.630004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-723aa523-c316-4a4a-96b9-ac1dd012b773 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:09.646170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-723aa523-c316-4a4a-96b9-ac1dd012b773 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1208 microversion: 2.1 time: 0.356009 Nov 02 12:00:09.648494 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1158/2342] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1208 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:09.667475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.679713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:09.693261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.693895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.694470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.696518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.697080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.697612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.738265 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb HTTP/1.1 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb'} Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.738540 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. Nov 02 12:00:09.742021 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.746074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:09.750902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c366856e-80f7-4318-9d62-d5ff7c6d4eb3 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb" status: 404 len: 111 microversion: 2.1 time: 0.096363 Nov 02 12:00:09.751987 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1159/2343] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] GET /compute/v2.1/servers/acfe09c6-5d63-452a-8ba3-7ad23cbaa5fb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:09.789709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7dd6b063-d854-4784-a832-1d8d90845a1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1b34e1430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.860307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7dd6b063-d854-4784-a832-1d8d90845a1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Image not found. Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7dd6b063-d854-4784-a832-1d8d90845a1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be HTTP/1.1 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a175770b-e6be-439f-82dd-98fd67f711be'} Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a175770b-e6be-439f-82dd-98fd67f711be to delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a175770b-e6be-439f-82dd-98fd67f711be could not be found. Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.869811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:09.874544 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.879048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7dd6b063-d854-4784-a832-1d8d90845a1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:09.883437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7dd6b063-d854-4784-a832-1d8d90845a1d tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be" status: 404 len: 62 microversion: 2.1 time: 0.121244 Nov 02 12:00:09.884174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1160/2344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] DELETE /compute/v2.1/images/a175770b-e6be-439f-82dd-98fd67f711be => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:00:09.905596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.906354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:09.916256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.924246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=13 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:09.925817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.928311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.934815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:09.935414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:09.939269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:09.979489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e HTTP/1.1 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cf7a1536-03df-4eea-853a-4e5194a6a76e'} Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:09.989581 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b5e3fb3-55c0-476f-9335-81144959e4a9 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 404 len: 111 microversion: 2.1 time: 0.102220 Nov 02 12:00:09.993493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1161/2345] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:09 2022] DELETE /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:09.997802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:09.998437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:10.013811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.014600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.014928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:10.017322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.018301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.019241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.020386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.027938 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4be689ac-045c-43f7-9ce3-35d46be2add1 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1675 microversion: 2.1 time: 0.686867 Nov 02 12:00:10.029152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1185/2346] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1675 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:10.035201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.036104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: cf7a1536-03df-4eea-853a-4e5194a6a76e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:10.055257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.056304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.057011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.058101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.058942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.059703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.080492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e HTTP/1.1 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'cf7a1536-03df-4eea-853a-4e5194a6a76e'} Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.083095 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. Nov 02 12:00:10.086889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.089163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance cf7a1536-03df-4eea-853a-4e5194a6a76e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:10.090371 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8fe1c8d0-ea6c-4b96-b97a-7a1559db2847 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e" status: 404 len: 111 microversion: 2.1 time: 0.059488 Nov 02 12:00:10.091475 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1186/2347] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:10 2022] GET /compute/v2.1/servers/cf7a1536-03df-4eea-853a-4e5194a6a76e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:10.101494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe1abf80-28a9-446a-ac22-93c930db1bbd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1b39508b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.206398 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe1abf80-28a9-446a-ac22-93c930db1bbd tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-719767839" status: 202 len: 0 microversion: 2.1 time: 0.110062 Nov 02 12:00:10.208433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1187/2348] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-719767839 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:00:10.215816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.218228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:10.232508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.242071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.242071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.242071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.249238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.250137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.550864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:10.565575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:10.574072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:10.578368 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8aaec321-714c-4e86-89dd-815e9cffc3b4 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.367474 Nov 02 12:00:10.579703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1188/2349] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:10 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:10.584453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.585455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:10.591925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=74,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:10.594662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.595396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.596106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.597371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:10.598038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:10.599325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:10.617355 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] HTTP exception thrown: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Request method failure captured: Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 HTTP/1.1 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlrb4kZ7jxP7Zuw2SGlVe2WLngWl2yr0PVL9oD6_witK3of8zbmb5vI2vyjYItqa_J17l8GvvO3qitnPpsLliVa_3_viwhjVo1_4Cv6HeReCvVDNaJRVf8wmvK9geccOvdG4D64jRwtMrs5ah2KeuS6STw9-WdcncuOwUanlITL2_3I Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_362be4a089a242e9aed574854f849ee8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/362be4a089a242e9aed574854f849ee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: dca67dc2c5a744fe9575a2fa01d4be58 Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc3c29ab-6131-49b6-a145-1710d75bfe90'} Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:10.620352 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:10.623574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:10.626880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Returning 404 to user: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:10.628027 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a1d6df8-cd8c-4c26-9da2-11e7a96a8741 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 404 len: 111 microversion: 2.1 time: 0.047171 Nov 02 12:00:10.628843 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1189/2350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:10 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:10.656802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-834dc3ae-7edd-4bac-bd82-e137df0f0341 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '.version_select at 0x7ff1bbafa0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.668008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:10.686320 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dffaf756-d159-48da-be70-0783df8272ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.693259 Nov 02 12:00:10.689320 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1162/2351] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:09 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:10.702255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f16bd5b4-879e-458b-8d64-d35cf9bc0322 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:10.703163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f16bd5b4-879e-458b-8d64-d35cf9bc0322 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:10.788863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-834dc3ae-7edd-4bac-bd82-e137df0f0341 tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660485653" status: 202 len: 0 microversion: 2.1 time: 0.148297 Nov 02 12:00:10.801143 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1190/2352] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660485653 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:00:11.017597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f16bd5b4-879e-458b-8d64-d35cf9bc0322 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:11.045426 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f16bd5b4-879e-458b-8d64-d35cf9bc0322 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1208 microversion: 2.1 time: 0.354294 Nov 02 12:00:11.047829 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1163/2353] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:10 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1208 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:11.058249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.059161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:11.067563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.068073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.078777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.078777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.078777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.078777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.267719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.273275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.273988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.274531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.275404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.275961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.276506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.315939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b949190-b344-44eb-990a-5cbb80a38771 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.343936 Nov 02 12:00:11.315939 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1191/2354] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:00:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:11.331078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.344279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.348178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.348907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.349985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.352619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.353405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.390944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0e2a73a-2346-48a8-a4ae-da2770ec0905 tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-855649-4" status: 200 len: 578 microversion: 2.1 time: 0.064985 Nov 02 12:00:11.393546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1192/2355] 10.222.0.48 () {58 vars in 1172 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/os-services?host=n-d-855649-4 => generated 578 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:11.406463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.411296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.411804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.412327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.413410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.414285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.414733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.458750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed99bd0c-9c46-4f82-b32e-dede1ab739de tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057486 Nov 02 12:00:11.459434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1193/2356] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:00:11.479090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.486019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.486772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.487523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.488524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.489110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.489553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.497458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:11.509405 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d66892fe-03a8-4bc8-9171-576a7674df8f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1675 microversion: 2.1 time: 0.456331 Nov 02 12:00:11.510612 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1164/2357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1675 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:11.526940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fddaf91e-4c77-4693-9c4a-b8b058d5298b tempest-ServicesAdminTestJSON-2072718235 tempest-ServicesAdminTestJSON-2072718235-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.055824 Nov 02 12:00:11.528212 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1194/2358] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:11.616531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.617691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:11.634400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.635029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.635494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.636234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.636701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.637134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.668515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:11.697173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ad9ce97-7ba1-4ee7-8cdc-0b3195e4e658 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '.version_select at 0x7ff1b3df0550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.733902 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5ad9ce97-7ba1-4ee7-8cdc-0b3195e4e658 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Image not found. Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ad9ce97-7ba1-4ee7-8cdc-0b3195e4e658 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/b95f5735-11c3-40cb-88da-1e642722119e HTTP/1.1 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b95f5735-11c3-40cb-88da-1e642722119e'} Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b95f5735-11c3-40cb-88da-1e642722119e to delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b95f5735-11c3-40cb-88da-1e642722119e could not be found. Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:11.739985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:11.744208 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.745820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ad9ce97-7ba1-4ee7-8cdc-0b3195e4e658 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:11.747470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ad9ce97-7ba1-4ee7-8cdc-0b3195e4e658 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/images/b95f5735-11c3-40cb-88da-1e642722119e" status: 404 len: 62 microversion: 2.1 time: 0.057276 Nov 02 12:00:11.751346 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1195/2359] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:11 2022] DELETE /compute/v2.1/images/b95f5735-11c3-40cb-88da-1e642722119e => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:11.756165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.757616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:11.772498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.775567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.776380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.777399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.778036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.778698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.817845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:11.849510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:11.852408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:11.860277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5788ef2-03d0-4495-b325-b08a5cbe9419 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.250390 Nov 02 12:00:11.884301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1165/2360] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:11.904028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.906014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:11.917377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.918430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.919848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.920942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.921565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.922244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:11.946410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef HTTP/1.1 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef'} Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:11.948373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce87bc05-f2e4-49ce-8c1e-63c0e927dab5 tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 404 len: 111 microversion: 2.1 time: 0.062952 Nov 02 12:00:11.956534 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1166/2361] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:11 2022] DELETE /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:11.964407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:11.965259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] [instance: 276d7694-f2be-4aed-b4cc-720a7ced2aef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:11.997335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:11.998134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:11.999072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.000275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.001083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.001775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.023358 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] HTTP exception thrown: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Request method failure captured: Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef HTTP/1.1 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswxH_BDYW1Z47AOZVpAk3AsALzbC21rViu_r9Zj20wXN2uXR3Uf5bcZfHKdVnT6orlTapNXzmxRkfTv6AUe7i-RMHwAe4HUBYYtJZ4fYF7uobf6Uv6QcC8BWe8KF0OaYvt_1oW2hZfoOI8zWPfpBiitbHSGuIKVXmwu4AlG6uVei0 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_800e17a4635e409bb8094879d36c155a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/800e17a4635e409bb8094879d36c155a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/800e17a4635e409bb8094879d36c155a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 800e17a4635e409bb8094879d36c155a Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-808230611 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ddce8ede1194d26a83ed481de2a3db5 Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-808230611-project Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '276d7694-f2be-4aed-b4cc-720a7ced2aef'} Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.026703 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. Nov 02 12:00:12.031035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.035840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] Returning 404 to user: Instance 276d7694-f2be-4aed-b4cc-720a7ced2aef could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:12.037113 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f920ccb8-fc90-4064-a3cd-b0d6968ead5e tempest-ImagesOneServerNegativeTestJSON-808230611 tempest-ImagesOneServerNegativeTestJSON-808230611-project] 10.222.0.48 "GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef" status: 404 len: 111 microversion: 2.1 time: 0.078336 Nov 02 12:00:12.053391 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1167/2362] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/servers/276d7694-f2be-4aed-b4cc-720a7ced2aef => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:00:12.080381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:12.083862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:12.097833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.104892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.107094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.108304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.109702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.110509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.449221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=92 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:12.789810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:12.816587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b627bb7-2f27-4f7b-a858-f4570a03c65a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1260 microversion: 2.1 time: 0.744801 Nov 02 12:00:12.819078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1168/2363] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:12 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1260 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:12.827569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "name": "network-vif-deleted", "tag": "13a1c44e-a00d-4e4d-88b2-3817921fb812"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:12.843512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.844083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.844525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.857047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] Creating event network-vif-deleted:13a1c44e-a00d-4e4d-88b2-3817921fb812 for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 12:00:12.863308 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-beebc58b-4e65-4023-9f7c-8e20fcb1b26a req-a7b9b8bd-824e-4189-8180-a9de8f6bcf95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044133 Nov 02 12:00:12.864517 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1169/2364] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:12.871367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1a0759bc-4fe7-443d-b55f-3595ea4624b4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:12.874952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:12.882646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.883605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.884497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.885574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:12.886375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:12.887108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:12.951300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:12.971469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58d14a18-44bb-433d-aed3-c6e41924e5a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.221582 Nov 02 12:00:12.972073 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1196/2365] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:11 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:12.975075 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] HTTP exception thrown: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. Nov 02 12:00:12.976865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72b0e6d-8452-43e4-b6ad-621421f93b1c", "name": "network-vif-unplugged", "status": "completed", "tag": "6872d731-1d13-4132-8f76-a5ff864f7db7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Request method failure captured: Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116/os-volume_attachments/9d2e790c-484a-4942-a05f-94e1abcfa6b1 HTTP/1.1 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 74 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlswx5L7NvwtWz0Ju45coDxMNxBcwFKUtI7q8-pl-NgYv1aaH--m6WjlKYqXGJ7MGMAQyKCxEL9gZm2SnPpoZHdRR7SXyKm6K1Lx54X_stVWAsTCCtvntoSmxr_IebJc-m-DyoMWO2GatqAVy8ICqLbdeQFFlpzoNOrIPIKbutURd_4 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dd24a539bbc842ff9769e147b3340590 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd24a539bbc842ff9769e147b3340590", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd24a539bbc842ff9769e147b3340590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dd24a539bbc842ff9769e147b3340590 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1778111623 Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesAdminNegativeTest-1778111623-project-admin Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8db5287479c54c18bab8f9a42d00a7cb Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesAdminNegativeTest-1778111623-project-admin Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: {"volumeAttachment": {"volumeId": "1a0759bc-4fe7-443d-b55f-3595ea4624b4"}} Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: exception: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': 'bbddce87-28c6-4843-9e05-f7751f5a6116', 'id': '9d2e790c-484a-4942-a05f-94e1abcfa6b1', 'body': {'volumeAttachment': {'volumeId': '1a0759bc-4fe7-443d-b55f-3595ea4624b4'}}} Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. (HTTP 404) (Request-ID: req-4b99ef65-4e01-477a-af6c-90032d7846fa) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:00:12.978619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] Returning 404 to user: Volume 9d2e790c-484a-4942-a05f-94e1abcfa6b1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47328bd0-e77e-48c7-a104-69779924504e tempest-VolumesAdminNegativeTest-1778111623 tempest-VolumesAdminNegativeTest-1778111623-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116/os-volume_attachments/9d2e790c-484a-4942-a05f-94e1abcfa6b1" status: 404 len: 109 microversion: 2.1 time: 0.115005 Nov 02 12:00:12.982066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1170/2366] 10.222.0.48 () {60 vars in 1433 bytes} [Wed Nov 2 12:00:12 2022] PUT /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116/os-volume_attachments/9d2e790c-484a-4942-a05f-94e1abcfa6b1 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:13.000859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:13.003726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:13.017727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.017727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.018187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.028761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.029378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.030243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.031010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.031562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.031912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.065076 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] Creating event network-vif-unplugged:6872d731-1d13-4132-8f76-a5ff864f7db7 for instance d72b0e6d-8452-43e4-b6ad-621421f93b1c on n-h1-855649-4 Nov 02 12:00:13.075077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-23927b8b-a4f8-43cd-a5fc-f15ebba7d5a2 req-0032158d-e69a-4768-bac7-0c1d0a539998 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101426 Nov 02 12:00:13.078079 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1197/2367] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:13.084535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:13.085118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:13.094096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.094619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.095337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.096273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.097019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.097842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.435347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:13.451502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:13.455538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:13.459137 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b4dbbfd-0d33-43ff-8df1-18291fe21c1f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.377725 Nov 02 12:00:13.460342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1198/2368] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:13 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:13.846233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:13.847133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:13.899820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:13.902377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.903133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.903770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.904770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:13.905587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:13.906163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:13.914100 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-039c6651-6234-4eb8-9bc8-c2dc045a3426 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1497 microversion: 2.1 time: 0.929476 Nov 02 12:00:13.917267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1171/2369] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:12 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1497 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:13.949743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:14.009035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:14.009818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:14.017916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.018405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.018841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.019753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.020822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.021506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.055695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:14.078036 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8a4462f-ffb4-40f5-af03-d5521482dce1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1266 microversion: 2.1 time: 0.235918 Nov 02 12:00:14.078957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1199/2370] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:13 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:14.495726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:14.497192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:14.527300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.527300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.527930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.529407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.531026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.532029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.748307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:14.778710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:14.782489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:14.791054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-246794b2-9997-4274-aef4-dbb0e5d51fb6 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.307252 Nov 02 12:00:14.831291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1200/2371] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:14 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:00:14.941563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:14.942862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:14.973324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.974055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.978847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:14.979866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:14.980693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:14.981586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.272967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:15.301089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c23d543b-94e3-45a2-bd9d-45a74cebd998 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.303063 Nov 02 12:00:15.318285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1172/2372] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:13 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:15.331544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:15.332429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:15.344186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.348551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.349294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.350202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.350803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.351409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.696445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:15.723882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78e41248-0e4b-4f44-9e20-689559400d7a tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1455 microversion: 2.1 time: 0.787612 Nov 02 12:00:15.724512 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1201/2373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:14 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1455 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:15.740351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef90eda2-10bb-4110-8e10-44ebb1b50436", "name": "network-vif-deleted", "tag": "3e3174da-1771-48d3-b90f-1313536b60ba"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:15.775419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:15.777040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.780022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.780615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.805637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfd616be-6daf-4195-aec0-5769964e9d28 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1266 microversion: 2.1 time: 0.484313 Nov 02 12:00:15.807945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1173/2374] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:15 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:15.838592 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] Creating event network-vif-deleted:3e3174da-1771-48d3-b90f-1313536b60ba for instance ef90eda2-10bb-4110-8e10-44ebb1b50436 on n-h1-855649-4 Nov 02 12:00:15.847539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:15.848394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:15.853575 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-22bbcb6b-eeff-4261-80cb-5c6ea675b601 req-7ed43cb9-cc81-4d89-80e9-dd655a04d3b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125074 Nov 02 12:00:15.854369 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1202/2375] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:15.861641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.862957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.866432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:15.866432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:15.866432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:15.866432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.261447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:16.270958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:16.291531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:16.292970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b6cb84e-4997-4502-ae1b-bde69942dd72 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1365 microversion: 2.57 time: 0.449918 Nov 02 12:00:16.309456 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1174/2376] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:15 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1365 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:16.332565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:16.337358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:16.346701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.347458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.348104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.348955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.349550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.350432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.772428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:16.773454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:16.782250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.782958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.795968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.797018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:16.797660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:16.798254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:16.986100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:17.013467 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d5a13b6-d08b-4c9b-b33c-6304f2650b4e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.690316 Nov 02 12:00:17.019059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1203/2377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:16 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:17.037865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.043684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.044844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.047369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lazy-loading 'fault' on Instance uuid ef90eda2-10bb-4110-8e10-44ebb1b50436 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:17.580894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc8e86ed3c244618a5f331ac316a968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c077c616bb4ade937d69a58dc21bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:17.591886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f7c4319-5318-4d0d-a808-f0a1675648b9 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 200 len: 1303 microversion: 2.1 time: 0.823947 Nov 02 12:00:17.594845 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1175/2378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:16 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 1303 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:17.594845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:17.594845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:17.621475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:17.621475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:17.623133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.624605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.631522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.632750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.633592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.634430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.650368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.656991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.656991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:17.656991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:17.656991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:17.656991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.052934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:18.074876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:18.096490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:18.098420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7fc5dd79-22b2-4649-bdb3-b8133150d9b8 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1371 microversion: 2.57 time: 0.502428 Nov 02 12:00:18.120176 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1176/2379] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:17 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1371 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:18.130211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:18.131899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:18.143119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.144070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.145012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.148630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.149653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.150677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.198195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:18.625155 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-103016e6-3927-4608-b624-98ab493835fb tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 204 len: 0 microversion: 2.1 time: 0.503103 Nov 02 12:00:18.633223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1177/2380] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:18 2022] DELETE /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:18.634582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:18.635476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:18.649518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.653625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.654295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.655788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:18.656725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:18.657833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:18.994998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:19.466539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:19.479975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d147c954-89d4-4759-81b7-e867e057bd56 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 2.458968 Nov 02 12:00:19.483387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1204/2381] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:17 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:19.489546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:19.490401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:19.497841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:19.498813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:19.499420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:19.500514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:19.502367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:19.503325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.252517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.262810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a93d6a76-de7a-4bba-8710-0f88a2e33be4 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1513 microversion: 2.1 time: 0.778084 Nov 02 12:00:20.283439 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1205/2382] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:19 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1513 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:20.288861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.309198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4424438b-174d-497f-b814-b77c60fc9fe5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.680913 Nov 02 12:00:20.316035 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1178/2383] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:18 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:20.323089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:20.327925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:20.334516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:20.337973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:20.354275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.354792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.361508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.365885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.366798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.367152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.368198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.371478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.371478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.372954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.376879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.377354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.449404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 HTTP/1.1 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ef90eda2-10bb-4110-8e10-44ebb1b50436'} Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.453552 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:20.457514 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.464615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:20.473899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcb7281d-5baa-43a5-bdfa-fb8f74fd9a91 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 404 len: 111 microversion: 2.1 time: 0.181105 Nov 02 12:00:20.479840 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1206/2384] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:20 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:20.626241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3864040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:20.630573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.631134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.636421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.652211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.675927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.675927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:20.675927 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8ca75ff-c23b-405f-b97f-340c36988f3a tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1371 microversion: 2.57 time: 0.351161 Nov 02 12:00:20.681038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.681660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.685659 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1179/2385] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:20 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:20.690244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.701165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] HTTP exception thrown: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Request method failure captured: Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf HTTP/1.1 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 56 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvTznItoLoZblYpsop5WUDLuhdqLkPF1--S0rxbNgfVgjydDhQb1ZiFS5_FWGKr-8nELxhK_Q-KgXezvswaRZTdFd6B9C9zMFH6W4KamAYPVang56PhNoEGQFKvD6IzFw16WAcJZbnyqwNMW5DSXJktBDwcUS0zb61Ulxq-wnvxciM Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3cdbd495fb864975bc38bb68dc7dd631", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 51de14f3cf884b91818fea9e6d2c121c Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: exception: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '6be94933-d9f7-41b7-af9e-4cc3fe48d4bf', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:20.703810 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.708207 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.710721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Returning 404 to user: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:20.711893 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e446f90-015e-41a1-80cd-8a4989202edf tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf" status: 404 len: 110 microversion: 2.53 time: 0.230788 Nov 02 12:00:20.713203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1207/2386] 10.222.0.48 () {62 vars in 1309 bytes} [Wed Nov 2 12:00:20 2022] PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf => generated 110 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:00:20.720901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:20.722189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:20.731220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b3950040>, body: {"status": "disabled"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:20.739797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:20.757982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.761839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.764725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.771206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.773261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.775172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.779265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.783430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.783430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.784497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.785145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.787280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.812238 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] HTTP exception thrown: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Request method failure captured: Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf HTTP/1.1 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 22 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvTznItoLoZblYpsop5WUDLuhdqLkPF1--S0rxbNgfVgjydDhQb1ZiFS5_FWGKr-8nELxhK_Q-KgXezvswaRZTdFd6B9C9zMFH6W4KamAYPVang56PhNoEGQFKvD6IzFw16WAcJZbnyqwNMW5DSXJktBDwcUS0zb61Ulxq-wnvxciM Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3cdbd495fb864975bc38bb68dc7dd631", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 51de14f3cf884b91818fea9e6d2c121c Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: {"status": "disabled"} Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: exception: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '6be94933-d9f7-41b7-af9e-4cc3fe48d4bf', 'body': {'status': 'disabled'}} Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:20.818416 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.823684 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.827609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Returning 404 to user: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:20.829682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0ea7c51-012c-433d-9ceb-fbfab34687a0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf" status: 404 len: 110 microversion: 2.53 time: 0.103700 Nov 02 12:00:20.833920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1208/2387] 10.222.0.48 () {62 vars in 1309 bytes} [Wed Nov 2 12:00:20 2022] PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf => generated 110 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:00:20.849169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Action: 'update', calling method: .version_select at 0x7ff1b9043700>, body: {"status": "enabled"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:20.861888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.864550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.866774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.908851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.908851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.909203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] HTTP exception thrown: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Request method failure captured: Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf HTTP/1.1 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 21 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvTznItoLoZblYpsop5WUDLuhdqLkPF1--S0rxbNgfVgjydDhQb1ZiFS5_FWGKr-8nELxhK_Q-KgXezvswaRZTdFd6B9C9zMFH6W4KamAYPVang56PhNoEGQFKvD6IzFw16WAcJZbnyqwNMW5DSXJktBDwcUS0zb61Ulxq-wnvxciM Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3cdbd495fb864975bc38bb68dc7dd631", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3cdbd495fb864975bc38bb68dc7dd631"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3cdbd495fb864975bc38bb68dc7dd631 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174 Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 51de14f3cf884b91818fea9e6d2c121c Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: {"status": "enabled"} Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: exception: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '6be94933-d9f7-41b7-af9e-4cc3fe48d4bf', 'body': {'status': 'enabled'}} Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:20.927099 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:20.930924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Returning 404 to user: Service 6be94933-d9f7-41b7-af9e-4cc3fe48d4bf could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:20.959677 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89c55a62-0c59-4370-9302-805de82deb81 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf" status: 404 len: 110 microversion: 2.53 time: 0.087898 Nov 02 12:00:20.962872 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1209/2388] 10.222.0.48 () {62 vars in 1309 bytes} [Wed Nov 2 12:00:20 2022] PUT /compute/v2.1/os-services/6be94933-d9f7-41b7-af9e-4cc3fe48d4bf => generated 110 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:00:20.971069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:20.980621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:20.981110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:20.981554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.009401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.011365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.014555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.024018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:21.127362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc035ddf-4416-440d-a169-59a3a5589117 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.160427 Nov 02 12:00:21.131430 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1210/2389] 10.222.0.48 () {60 vars in 1178 bytes} [Wed Nov 2 12:00:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:21.167262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:21.174510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.176095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.176725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.177673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.178289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.178901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.228090 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9cb74e4-b929-4866-a0cc-32c6cafce3d8 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.077788 Nov 02 12:00:21.229572 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1211/2390] 10.222.0.48 () {60 vars in 1211 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:21.245472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:21.254098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.254675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.255295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.256342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.257231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.258175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.306221 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-274d4684-c532-4b67-96ea-5d5e6518c56c tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.065979 Nov 02 12:00:21.307682 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1212/2391] 10.222.0.48 () {60 vars in 1178 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:00:21.340634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe6f1d8-28d0-436b-9244-0bfead9616d5", "tag": "bebdd016-040f-4bb9-85e8-a3b845f6eb2e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:21.375800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.376648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.377305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.402419 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] Creating event network-changed:bebdd016-040f-4bb9-85e8-a3b845f6eb2e for instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 on n-h1-855649-4 Nov 02 12:00:21.408437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6e20dde4-dff2-454a-8173-fb69f1df3a46 req-490ed06c-ce1d-444e-beb9-06122e2160b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Nov 02 12:00:21.409875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1213/2392] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:21.417509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:21.418600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.431783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.840325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:21.857720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b94d62b2-9d5a-46ea-a5a2-35e369395c64 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 1.154270 Nov 02 12:00:21.861797 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1180/2393] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:20 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:21.887518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:21.898267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.904157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.905441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.906902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:21.907554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:21.908115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:21.984222 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae66b271-9da8-4dfc-8fac-7c299bba63ae tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-855649-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.107508 Nov 02 12:00:21.985423 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1181/2394] 10.222.0.48 () {60 vars in 1235 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/os-services?host=n-d-855649-4&binary=xxx => generated 16 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:22.013331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:22.014470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:22.029172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.030566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.031281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.032416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.033111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.033856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.358681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:22.373341 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6e6f349-3eac-4bff-ac82-c81bce7c484c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.386398 Nov 02 12:00:22.374336 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1182/2395] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:22.394180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:22.401671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:22.417725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.421044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.421792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.423831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.425877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.428513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.512240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:22.809284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:22.825892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:22.836495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:22.838471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fda6af0-92d0-4c04-a3a3-338b1b51763f tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1371 microversion: 2.57 time: 0.456027 Nov 02 12:00:22.841099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1183/2396] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:22 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:22.856458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:22.871588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.872494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.873332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.875110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:22.875986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:22.876908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:22.968064 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8460bf2-f469-447e-9d30-1c6644d6c0ea tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.120662 Nov 02 12:00:22.977470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1184/2397] 10.222.0.48 () {60 vars in 1178 bytes} [Wed Nov 2 12:00:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:22.983948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:22.995229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:23.003770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.007700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.008349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.009197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.013766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.017723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.056909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:23.078175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74e503c8-f85e-4782-8f35-43a6a4da0c32 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1513 microversion: 2.1 time: 1.666159 Nov 02 12:00:23.083131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1214/2398] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:21 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1513 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:23.116453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:23.132196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.136865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.136865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.136865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.136865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.136865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.203179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2b89855-5b69-4357-88c5-f2581a98b1f0 tempest-ServicesAdminNegativeV253TestJSON-337026174 tempest-ServicesAdminNegativeV253TestJSON-337026174-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.117475 Nov 02 12:00:23.208780 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1215/2399] 10.222.0.48 () {60 vars in 1239 bytes} [Wed Nov 2 12:00:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:23.596656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d87745cb-c44a-4948-a8a6-89dd262770e1 tempest-ServicesAdminNegativeV253TestJSON-1138101269 tempest-ServicesAdminNegativeV253TestJSON-1138101269-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:23.635868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d87745cb-c44a-4948-a8a6-89dd262770e1 tempest-ServicesAdminNegativeV253TestJSON-1138101269 tempest-ServicesAdminNegativeV253TestJSON-1138101269-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '10adffbc83cf4164a0d07865c9c80604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9110aa7f756c4368a9a016b65ff90a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d87745cb-c44a-4948-a8a6-89dd262770e1 tempest-ServicesAdminNegativeV253TestJSON-1138101269 tempest-ServicesAdminNegativeV253TestJSON-1138101269-project] Request method failure captured: Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvR5Xf-tmSZOJEzJw8PkR_rQVO8JCAXr-X9EK9yy3quTI9_B2Ts33qCN18ZKnDayL51B6uppWRq_5wJicMaS3AY9yrAnuFs0Bl1wCqWc2yzFYE0BrYGyT5TJdFMNxCorbl3AoRvlV_UPROOHecb3hoE0AJtn0KqYfYhewkGPdqG_OY Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9110aa7f756c4368a9a016b65ff90a7a Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1138101269 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9110aa7f756c4368a9a016b65ff90a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9110aa7f756c4368a9a016b65ff90a7a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9110aa7f756c4368a9a016b65ff90a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9110aa7f756c4368a9a016b65ff90a7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1138101269 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9110aa7f756c4368a9a016b65ff90a7a Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1138101269 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1138101269-project Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 10adffbc83cf4164a0d07865c9c80604 Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1138101269-project Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:00:23.639814 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:00:23.644065 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:23.667444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d87745cb-c44a-4948-a8a6-89dd262770e1 tempest-ServicesAdminNegativeV253TestJSON-1138101269 tempest-ServicesAdminNegativeV253TestJSON-1138101269-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:23.669011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d87745cb-c44a-4948-a8a6-89dd262770e1 tempest-ServicesAdminNegativeV253TestJSON-1138101269 tempest-ServicesAdminNegativeV253TestJSON-1138101269-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.449339 Nov 02 12:00:23.671688 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1216/2400] 10.222.0.48 () {60 vars in 1178 bytes} [Wed Nov 2 12:00:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:00:23.707522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:23.709763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:23.744698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.748935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.758486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:23.759662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:23.764725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:23.765793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.513633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:24.529628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60ee6438-75f9-4a0f-8be4-ad39c51455b2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 1.550622 Nov 02 12:00:24.530613 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1185/2401] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:22 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:24.547798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:24.549340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:24.561803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.563589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.564336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.568916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.569724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.570341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.805129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:24.825723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:24.827565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:24.828869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c64c628a-398e-400c-a207-c1326ce6a976 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1356 microversion: 2.57 time: 0.297069 Nov 02 12:00:24.829691 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1186/2402] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:24 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1356 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:24.843687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:24.844577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:24.864520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.871600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.872323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.873311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.874658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.875369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:24.884916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:24.897923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80f65b42-5561-418a-a5fc-9323c2a00c7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.217735 Nov 02 12:00:24.919811 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1217/2403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:23 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:24.925646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "name": "network-vif-unplugged", "status": "completed", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:24.982457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:24.986259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:24.986259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.021242 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] Creating event network-vif-unplugged:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h1-855649-4 Nov 02 12:00:25.028832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2919181f-1bad-4295-a76a-783215b60f76 req-99151fcb-d373-4c42-bfe8-2ff5a40a4439 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106967 Nov 02 12:00:25.036570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1218/2404] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:25.044805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:25.044805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:25.058378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.066367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.068445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.072117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.074320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.074782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.152477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:25.578145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b4e23e1-5cda-41b8-aa25-9a75a4164477 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 204 len: 0 microversion: 2.57 time: 0.539947 Nov 02 12:00:25.579114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1219/2405] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:00:25 2022] DELETE /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:00:25.604320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:25.604941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:25.626371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.627263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.627784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.628730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.629059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.629502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.670069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] HTTP exception thrown: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Request method failure captured: Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 HTTP/1.1 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlrb4kZ7jxP7Zuw2SGlVe2WLngWl2yr0PVL9oD6_witK3of8zbmb5vI2vyjYItqa_J17l8GvvO3qitnPpsLliVa_3_viwhjVo1_4Cv6HeReCvVDNaJRVf8wmvK9geccOvdG4D64jRwtMrs5ah2KeuS6STw9-WdcncuOwUanlITL2_3I Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_362be4a089a242e9aed574854f849ee8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/362be4a089a242e9aed574854f849ee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: dca67dc2c5a744fe9575a2fa01d4be58 Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc3c29ab-6131-49b6-a145-1710d75bfe90'} Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:25.672544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:25.676198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Returning 404 to user: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:25.677237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc6a8716-cd64-4427-91ca-c4368eee59de tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 404 len: 111 microversion: 2.1 time: 0.096125 Nov 02 12:00:25.681925 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1220/2406] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:25 2022] DELETE /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:25.696803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:25.702187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:25.716664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.717467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.718016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:25.718888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:25.719500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:25.720206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:26.980739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:26.996310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c879472-8032-4fc8-b174-d0dcdad2d17c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 1.311291 Nov 02 12:00:26.999048 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1221/2407] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:25 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:27.025831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:27.028316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:27.042202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.043197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.043842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.044798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.046147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.046819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.169596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:27.186127 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c02cd70-92e5-40ff-b9d8-e6366932db2c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1513 microversion: 2.1 time: 2.348072 Nov 02 12:00:27.190514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1187/2408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:24 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1513 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:27.195962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:27.199758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] [instance: fc3c29ab-6131-49b6-a145-1710d75bfe90] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:27.219583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.220138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.220778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.221682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.222281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.222850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.234408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:27.249717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:27.256318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:27.257789 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] HTTP exception thrown: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:27.259248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf954530-e43d-401f-ab12-ad7ffeab9ce1 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1362 microversion: 2.57 time: 0.254791 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Request method failure captured: Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 HTTP/1.1 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlrb4kZ7jxP7Zuw2SGlVe2WLngWl2yr0PVL9oD6_witK3of8zbmb5vI2vyjYItqa_J17l8GvvO3qitnPpsLliVa_3_viwhjVo1_4Cv6HeReCvVDNaJRVf8wmvK9geccOvdG4D64jRwtMrs5ah2KeuS6STw9-WdcncuOwUanlITL2_3I Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_362be4a089a242e9aed574854f849ee8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/362be4a089a242e9aed574854f849ee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/362be4a089a242e9aed574854f849ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 362be4a089a242e9aed574854f849ee8 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1945705794 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: dca67dc2c5a744fe9575a2fa01d4be58 Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1945705794-project Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'fc3c29ab-6131-49b6-a145-1710d75bfe90'} Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:27.259541 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] Returning 404 to user: Instance fc3c29ab-6131-49b6-a145-1710d75bfe90 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:27.262999 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-352b50ba-1683-409d-9547-553ae0e739ca tempest-AttachSCSIVolumeTestJSON-1945705794 tempest-AttachSCSIVolumeTestJSON-1945705794-project] 10.222.0.48 "GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90" status: 404 len: 111 microversion: 2.1 time: 0.069124 Nov 02 12:00:27.264245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1222/2409] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:27 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:27.278245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:27.278245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:27.278444 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1188/2410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:27 2022] GET /compute/v2.1/servers/fc3c29ab-6131-49b6-a145-1710d75bfe90 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:27.300545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.305090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.305090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.305090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.305758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbddce87-28c6-4843-9e05-f7751f5a6116", "name": "network-vif-unplugged", "status": "completed", "tag": "ebfa61a6-d5a1-4a29-b30e-733fd299b973"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:27.306556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.307760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.339210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.347324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.348266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.352769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:27.365248 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] Creating event network-vif-unplugged:ebfa61a6-d5a1-4a29-b30e-733fd299b973 for instance bbddce87-28c6-4843-9e05-f7751f5a6116 on n-h2-855649-4 Nov 02 12:00:27.389046 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6651f9e3-a273-40a9-82e2-8e1e8e180025 req-f3205d97-2667-4036-9efa-2da6e4edae08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109215 Nov 02 12:00:27.391673 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1189/2411] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:27.892190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbddce87-28c6-4843-9e05-f7751f5a6116", "name": "network-vif-deleted", "tag": "ebfa61a6-d5a1-4a29-b30e-733fd299b973"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:27.923621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:27.924440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:27.925672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:27.944083 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] Creating event network-vif-deleted:ebfa61a6-d5a1-4a29-b30e-733fd299b973 for instance bbddce87-28c6-4843-9e05-f7751f5a6116 on n-h2-855649-4 Nov 02 12:00:28.023123 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-afd53e69-c619-48f6-a979-5cd11c1ad06e req-3519f683-7315-4e7b-9d96-1a56dff873cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137997 Nov 02 12:00:28.024425 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1190/2412] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:00:28.047157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.048316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.065259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.066183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.067731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.072666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.073608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.074499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.136424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.149056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9750dcf7-3e41-4d64-ab10-f64e6aa25d21 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.882936 Nov 02 12:00:28.153023 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1223/2413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:27 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:28.211815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.213382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.225458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.230052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.230713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.231680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.234557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.235295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-651fab43-a6ef-4004-ab7e-bb09239b7c4c tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1471 microversion: 2.1 time: 0.214428 Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1224/2414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.624923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.631524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.648519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.648942 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ace15cc-571d-4ea4-a902-cf284d8b155e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.622588 Nov 02 12:00:28.650484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:28.652022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f86a39e-7fa5-46f5-ac16-039be0cc1af2 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1362 microversion: 2.57 time: 0.226386 Nov 02 12:00:28.656560 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1191/2415] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:28.689532 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1225/2416] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:28.695503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.696404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.705405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.707180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.707902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.708912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.709614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.710411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.732547 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 HTTP/1.1 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ef90eda2-10bb-4110-8e10-44ebb1b50436'} Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:28.735969 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.740191 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.745318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:28.746544 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8053dfc6-862e-448c-b719-e33675b69e8c tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 404 len: 111 microversion: 2.1 time: 0.088659 Nov 02 12:00:28.747435 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1192/2417] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:28 2022] DELETE /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:28.757408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.758185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: ef90eda2-10bb-4110-8e10-44ebb1b50436] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.775797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.776347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.776780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.777700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.778461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.779379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.796024 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 HTTP/1.1 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ef90eda2-10bb-4110-8e10-44ebb1b50436'} Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.798032 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. Nov 02 12:00:28.801886 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.804615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance ef90eda2-10bb-4110-8e10-44ebb1b50436 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:28.805687 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfd6f159-935e-4581-8e77-69add03982f4 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436" status: 404 len: 111 microversion: 2.1 time: 0.052864 Nov 02 12:00:28.821556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1226/2418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/ef90eda2-10bb-4110-8e10-44ebb1b50436 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:28.829609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.830129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.837900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.838571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.839263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.840203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.840980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.842494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.883413 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 HTTP/1.1 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '293027c8-9e90-4111-baf0-1eacf0e12fc4'} Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:28.885415 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b587efa-301a-4b56-8369-33fd5e4ff6f5 tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "DELETE /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 404 len: 111 microversion: 2.1 time: 0.062186 Nov 02 12:00:28.889670 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1193/2419] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:28 2022] DELETE /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:28.896170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:28.896799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] [instance: 293027c8-9e90-4111-baf0-1eacf0e12fc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:28.903234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.903736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.904234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.905096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:28.905556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:28.906159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:28.943718 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] HTTP exception thrown: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Request method failure captured: Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 HTTP/1.1 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYltQhDvqVnN-2nnkWnUH5N1pVMk-gfOqrbAVbs_wE3xQXh9_1SXsbMKETr5lSPhGSCGZOkq7x3-m7wWyKD1c7EcVcwTM8vMonZNoC0rMnEMmhAKQKopsXvQd6JCsrigKxxU_G1nSmV2eGr8qmMhL4RcsEELQv4mhqZ493FbG_ae_yAk Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14c077c616bb4ade937d69a58dc21bcf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14c077c616bb4ade937d69a58dc21bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 14c077c616bb4ade937d69a58dc21bcf Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestMultiNic-1254653769 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2bc8e86ed3c244618a5f331ac316a968 Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestMultiNic-1254653769-project Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '293027c8-9e90-4111-baf0-1eacf0e12fc4'} Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:28.970431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] Returning 404 to user: Instance 293027c8-9e90-4111-baf0-1eacf0e12fc4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f7c703f-2a6b-484a-90da-b96c05c2ab5f tempest-ServersTestMultiNic-1254653769 tempest-ServersTestMultiNic-1254653769-project] 10.222.0.48 "GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4" status: 404 len: 111 microversion: 2.1 time: 0.080765 Nov 02 12:00:28.981325 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1227/2420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:28 2022] GET /compute/v2.1/servers/293027c8-9e90-4111-baf0-1eacf0e12fc4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:29.180843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:29.181885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:29.191239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.192049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.192756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.193826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.194487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.195127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.454080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.470526 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c9a26e0-f983-4229-b692-9c3423272505 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.293002 Nov 02 12:00:29.479053 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1194/2421] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:29 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:29.538800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:29.561975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:29.581853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.585817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.585817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.585817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.585817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.587324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.635332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.636430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.637146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.647378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lazy-loading 'fault' on Instance uuid bbddce87-28c6-4843-9e05-f7751f5a6116 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:29.683804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:29.685091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:29.691876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.692709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.693397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.694181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.694745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.695429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.708729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.720157 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-601aa092-4a71-4ab6-9ab6-08c56e3e46ef tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 200 len: 1307 microversion: 2.1 time: 0.186869 Nov 02 12:00:29.736392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1228/2422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:29 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 1307 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:29.736392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:29.736392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:29.736835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.737518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.738487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.739778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.740320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.740767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.786513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:29.787054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:29.787590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:29.788360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lazy-loading 'fault' on Instance uuid 4ff0e979-0905-4f83-b324-859ec75b6654 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:29.866103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.875939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.877819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d0b2ee812db4495b5a5ef47fa085818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f557139b34d490d8e644aaa98d87ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.880134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc437e7c-f3d9-422e-8fba-89cc8525b126 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 200 len: 1367 microversion: 2.57 time: 0.156898 Nov 02 12:00:29.883131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1229/2423] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:29 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:00:29.912899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:29.922284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-526e0cad-be48-4b41-aa54-e36cf73ace5d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.242491 Nov 02 12:00:29.923463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1195/2424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:29 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:30.052557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:30.080501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:30.090162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.090748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.091912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.110346 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] Creating event network-changed:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h1-855649-4 Nov 02 12:00:30.117593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-decbaf98-ecc5-4006-814f-756f5e77d92b req-d9c0543b-0c74-45f6-8972-0f462631677c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072875 Nov 02 12:00:30.118735 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1230/2425] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:00:30.507945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:30.510087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:30.520987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.522196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.523726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.524996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.528274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.528274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.751792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:30.752841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: bbddce87-28c6-4843-9e05-f7751f5a6116] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:30.769919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.771483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.775429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.776325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.778752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.782656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.807820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] HTTP exception thrown: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Request method failure captured: Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 HTTP/1.1 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlsXJ4deyMMb0HYy_1kf61iG1x03gjstr6oWJBjckFzh6sORkEAy0GoCVBdmTxmlDgpiMup53gUvGfSbPwvyjNKTxKqoSUkflEhYTErZYQ22iSWmN-bSdWAPIec5jkYGd-5ddskp_SaO21hnhmAv9zugIrwbHnFxGIpIb3bsb8U66O8 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b32d0c67e2d04664b25fb11d43b6c9e4 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b32d0c67e2d04664b25fb11d43b6c9e4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b32d0c67e2d04664b25fb11d43b6c9e4 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesAdminNegativeTest-514621263-project Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: aa7142c46289437f9c9e74b11d27e5e5 Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesAdminNegativeTest-514621263-project Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'bbddce87-28c6-4843-9e05-f7751f5a6116'} Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:30.809976 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. Nov 02 12:00:30.815963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.817475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Returning 404 to user: Instance bbddce87-28c6-4843-9e05-f7751f5a6116 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:30.818385 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b398d8d-ef8d-43dc-9025-9a4adc6c67bf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116" status: 404 len: 111 microversion: 2.1 time: 0.073401 Nov 02 12:00:30.819116 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1231/2426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:30 2022] GET /compute/v2.1/servers/bbddce87-28c6-4843-9e05-f7751f5a6116 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:30.836649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:30.852273 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4cd919e-8380-4aa6-9c36-18b44e610614 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.357830 Nov 02 12:00:30.852906 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1196/2427] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:30 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:30.910939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:30.911974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] [instance: 4ff0e979-0905-4f83-b324-859ec75b6654] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:30.921483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.926549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.932356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.933520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.934235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.934929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.945812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:30.947666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:30.959725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.960631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.961300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.962318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:30.965240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:30.966111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:30.989366 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] HTTP exception thrown: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Request method failure captured: Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 HTTP/1.1 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlue2oqDRAC9hY1E2eUWzklCjL99YYMu_y3NCBuYWOeqqV0HrGIoNGM1hfXPwXWQtiUZlOwhhzJEaYOtrW7tRmg0E9L5YOCZmtZqYIhbV1fM1LGG5-RBYtHgpCv9dYrXaHYRY2rUv3fEGdC3OP_I6hgusHemYdlVkc48Re5VSDwsUZ8 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2f557139b34d490d8e644aaa98d87ce1 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerShowV257Test-1764121067 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f557139b34d490d8e644aaa98d87ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2f557139b34d490d8e644aaa98d87ce1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2f557139b34d490d8e644aaa98d87ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2f557139b34d490d8e644aaa98d87ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerShowV257Test-1764121067 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2f557139b34d490d8e644aaa98d87ce1 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerShowV257Test-1764121067 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerShowV257Test-1764121067-project Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 6d0b2ee812db4495b5a5ef47fa085818 Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerShowV257Test-1764121067-project Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4ff0e979-0905-4f83-b324-859ec75b6654'} Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:30.989913 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. Nov 02 12:00:30.993351 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:30.996488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] Returning 404 to user: Instance 4ff0e979-0905-4f83-b324-859ec75b6654 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:30.997589 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b1ac06f-c894-432e-bcbf-52c4d25c4962 tempest-ServerShowV257Test-1764121067 tempest-ServerShowV257Test-1764121067-project] 10.222.0.48 "GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654" status: 404 len: 111 microversion: 2.57 time: 0.091053 Nov 02 12:00:30.998387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1232/2428] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:00:30 2022] GET /compute/v2.1/servers/4ff0e979-0905-4f83-b324-859ec75b6654 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:00:31.456461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:31.465455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43c39b40-c37c-4f93-a859-6aa69cddd46d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.523561 Nov 02 12:00:31.479654 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1197/2429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:30 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:31.881477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:31.882369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:31.896332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:31.896961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:31.899413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:31.899413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:31.899413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:31.903054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:32.242010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:32.253712 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d2ca533-1965-4a5f-acdd-5d00ceb9086f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.377952 Nov 02 12:00:32.257808 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1233/2430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:31 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:32.513073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:32.514288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:32.524898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:32.527597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:32.528267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:32.534358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:32.535183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:32.535819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:32.895580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:32.993569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:33.002735 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e35412ed-30eb-4078-99bc-dddc0263f81c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.493804 Nov 02 12:00:33.020066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1198/2431] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:32 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:33.282122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:33.284238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:33.293981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:33.299353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:33.299353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:33.299353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:33.305575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:33.307530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:33.308245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:33.708785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:33.725658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a99861c2-7f30-4296-957c-760bca1eb6c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.445997 Nov 02 12:00:33.726513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1234/2432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:33 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:34.037448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:34.038634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:34.048710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.051426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.053547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:34.055539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.055539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.055539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:34.639930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:34.652156 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7de7a3c8-746e-42a4-ac6b-451d157721bc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.618503 Nov 02 12:00:34.672009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1199/2433] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:34 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:34.756184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:34.757496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:34.777359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.780601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.781073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:34.783509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:34.785667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:34.792685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:35.833334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d938afc2-a705-4989-bbf8-e92c73d11b64 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A00%3A35.221338&end=2022-11-03T12%3A00%3A35.221338" status: 404 len: 112 microversion: - time: 0.608030 Nov 02 12:00:35.834295 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1200/2434] 10.222.0.48 () {58 vars in 1316 bytes} [Wed Nov 2 12:00:35 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A00%3A35.221338&end=2022-11-03T12%3A00%3A35.221338 => generated 112 bytes in 610 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:00:35.843976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe6f1d8-28d0-436b-9244-0bfead9616d5", "name": "network-vif-plugged", "status": "completed", "tag": "bebdd016-040f-4bb9-85e8-a3b845f6eb2e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:35.877869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:35.878271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:35.878716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:35.913595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] Creating event network-vif-plugged:bebdd016-040f-4bb9-85e8-a3b845f6eb2e for instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 on n-h1-855649-4 Nov 02 12:00:35.929072 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-32d3f151-041a-41db-85f7-ad1bcde304a6 req-bddb9ece-ee58-4a94-bddd-11b02b17681a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088551 Nov 02 12:00:35.929072 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1201/2435] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:35.961284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:35.962022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:35.976586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:35.979533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:35.980121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:35.981224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:35.987718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:35.988490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:36.311059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:36.327136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b70a3ea3-e187-4e70-a2a7-c3463455ce5d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.575974 Nov 02 12:00:36.329676 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1235/2436] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:34 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:36.335477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e785f1e5-fc72-48d3-8a97-613bc69f4ce4 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] Calling method '.version_select at 0x7ff1b824e820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:36.341452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e785f1e5-fc72-48d3-8a97-613bc69f4ce4 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e785f1e5-fc72-48d3-8a97-613bc69f4ce4 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] Request method failure captured: Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-simple-tenant-usage/bbc490603c7045b38cb9f2b9738730f1?start=2022-11-03T12%3A00%3A35.221338&end=2022-11-01T12%3A00%3A35.221338 HTTP/1.1 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlviUecYkS4EVx7bTT23sxYG8vUiUAT6-ufmcBo_LdKlRy87NARJmTWuX6Z0UPCLQ6vBuHXQldEHsNwhSeMKYplSyvUuzuvy7S1W6mqvMTOHYsp_d60ypQRZGfP06YmijDmIbax2IV-UyCaIaFFO1ULPXCRjERnZb9Wo1HFMCYy3KYs Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 4e3e1ad9a68746a0a29d45cb7b01f6c1 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-126158369 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e3e1ad9a68746a0a29d45cb7b01f6c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4e3e1ad9a68746a0a29d45cb7b01f6c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4e3e1ad9a68746a0a29d45cb7b01f6c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e3e1ad9a68746a0a29d45cb7b01f6c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-126158369 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 4e3e1ad9a68746a0a29d45cb7b01f6c1 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-126158369 Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TenantUsagesNegativeTestJSON-126158369-project-admin Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0f2d9b329cb44d0d974e197a7533452e Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-126158369-project-admin Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'bbc490603c7045b38cb9f2b9738730f1'} Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 12:00:36.347057 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.353443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e785f1e5-fc72-48d3-8a97-613bc69f4ce4 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:36.354588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e785f1e5-fc72-48d3-8a97-613bc69f4ce4 tempest-TenantUsagesNegativeTestJSON-126158369 tempest-TenantUsagesNegativeTestJSON-126158369-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/bbc490603c7045b38cb9f2b9738730f1?start=2022-11-03T12%3A00%3A35.221338&end=2022-11-01T12%3A00%3A35.221338" status: 400 len: 111 microversion: 2.1 time: 0.023681 Nov 02 12:00:36.356120 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1236/2437] 10.222.0.48 () {58 vars in 1412 bytes} [Wed Nov 2 12:00:36 2022] GET /compute/v2.1/os-simple-tenant-usage/bbc490603c7045b38cb9f2b9738730f1?start=2022-11-03T12%3A00%3A35.221338&end=2022-11-01T12%3A00%3A35.221338 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:00:36.382180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:36.406521 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3679d84b-06c3-469e-ab0a-87e4c4d133dc tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.474555 Nov 02 12:00:36.419018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1202/2438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:35 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:36.839300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220ce89e-68a2-48b0-ae7b-61eba0d704f1 tempest-TenantUsagesNegativeTestJSON-1658147940 tempest-TenantUsagesNegativeTestJSON-1658147940-project] Calling method '.version_select at 0x7ff1b3dd8790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:36.843427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-220ce89e-68a2-48b0-ae7b-61eba0d704f1 tempest-TenantUsagesNegativeTestJSON-1658147940 tempest-TenantUsagesNegativeTestJSON-1658147940-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'd17959287821407ca4a2676d22189134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc490603c7045b38cb9f2b9738730f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220ce89e-68a2-48b0-ae7b-61eba0d704f1 tempest-TenantUsagesNegativeTestJSON-1658147940 tempest-TenantUsagesNegativeTestJSON-1658147940-project] Request method failure captured: Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A00%3A35.221338&end=2022-11-03T12%3A00%3A35.221338&detailed=1 HTTP/1.1 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvgSvELA0MvMZP6FwQaPC-EH92dZarHvKoJ4BnxMGQr-kBvdxrlIPskm_5OmUE2ctA6L185hBcaSOP0POD-O4OMILS4WVTolbrMwqton5vOdUfW9PTEgwykig4_tSUEaZKKyNAl6UG1ZJrpHwqva2cxB3OsM6TpHRAvJPw0fAp_PGk Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: bbc490603c7045b38cb9f2b9738730f1 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1658147940 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbc490603c7045b38cb9f2b9738730f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bbc490603c7045b38cb9f2b9738730f1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bbc490603c7045b38cb9f2b9738730f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bbc490603c7045b38cb9f2b9738730f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1658147940 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: bbc490603c7045b38cb9f2b9738730f1 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1658147940 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TenantUsagesNegativeTestJSON-1658147940-project Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d17959287821407ca4a2676d22189134 Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1658147940-project Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:00:36.846181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220ce89e-68a2-48b0-ae7b-61eba0d704f1 tempest-TenantUsagesNegativeTestJSON-1658147940 tempest-TenantUsagesNegativeTestJSON-1658147940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:36.852137 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-220ce89e-68a2-48b0-ae7b-61eba0d704f1 tempest-TenantUsagesNegativeTestJSON-1658147940 tempest-TenantUsagesNegativeTestJSON-1658147940-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A00%3A35.221338&end=2022-11-03T12%3A00%3A35.221338&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.484972 Nov 02 12:00:36.854803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1237/2439] 10.222.0.48 () {58 vars in 1335 bytes} [Wed Nov 2 12:00:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A00%3A35.221338&end=2022-11-03T12%3A00%3A35.221338&detailed=1 => generated 123 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:37.356309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:37.356934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:37.370319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.370823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.371301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.372242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.372744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.373202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.433673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:37.434206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:37.453952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.454727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.456075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.456815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.457276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.457712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.837699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:37.869086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7346ff6c-b2ea-44d0-899f-770f1118911d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.501577 Nov 02 12:00:37.869086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1203/2440] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:37 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:37.917603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:37.918714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:37.940018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.940588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.940997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:37.941748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:37.942217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:37.942661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.002659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:38.012642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:38.048531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18ebaddf-9067-48f3-a100-6694525925d4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1308 microversion: 2.1 time: 0.618801 Nov 02 12:00:38.057158 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1238/2441] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:37 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:38.100028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:38.620693 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70886f91-04cd-4d61-8888-997e03e25796 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 204 len: 0 microversion: 2.1 time: 0.708993 Nov 02 12:00:38.621724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1204/2442] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:37 2022] DELETE /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:38.630335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:38.630968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:38.649792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.650461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.650922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.652002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.658992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.659600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.895719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:38.897554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:38.912934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.913854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.914890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:38.916533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:38.917361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:38.918255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.258225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:39.265289 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02563508-1898-48be-b217-7384c18ac787 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1681 microversion: 2.1 time: 0.639041 Nov 02 12:00:39.265852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1239/2443] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:38 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1681 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:39.274713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:39.284830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:39.299480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.300146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.303498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.303498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.303498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.303498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.359547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:39.374249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14e034a7-0ffd-4b5b-8c6b-d61971d332af tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.484537 Nov 02 12:00:39.375492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1205/2444] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:38 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:39.828657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:39.840380 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c99451f-5f2a-405b-a003-ee0c240fca30 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1487 microversion: 2.1 time: 0.568966 Nov 02 12:00:39.841927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1240/2445] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:39 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1487 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:39.872051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:39.874320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:39.914442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.914938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.925067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.927751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:39.928449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:39.928903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:39.994938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:40.309311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:40.310946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:40.323393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.324211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.325581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:40.327348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.328395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.329204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:40.505747 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d611debd-1eba-42b5-b7f8-edc6f9abb734 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 204 len: 0 microversion: 2.1 time: 0.641707 Nov 02 12:00:40.506838 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1206/2446] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:39 2022] DELETE /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:40.522091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:40.523216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:40.539088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.539921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.540600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:40.546060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:40.547843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:40.549404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:40.961162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:40.976441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53eaf27c-14ab-44a3-911c-f15378016298 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1681 microversion: 2.1 time: 0.680189 Nov 02 12:00:40.979497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1241/2447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:40 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1681 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:40.999935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:41.001146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:41.027499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:41.033866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:41.039504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:41.039504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:41.039504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:41.042332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:41.398041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:41.413548 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-137e37b6-cafc-4b8a-8ab7-88236f385db0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.905074 Nov 02 12:00:41.415416 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1207/2448] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:40 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:41.442916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:41.457263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbc4e6b0-6215-45ae-9769-1212303ffdab tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1493 microversion: 2.1 time: 0.474434 Nov 02 12:00:41.460512 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1242/2449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:40 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1493 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:42.002841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:42.003770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:42.018917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.021072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.022593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.025534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.026329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.029166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.445182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:42.446228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:42.470989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.471495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.478315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:42.478910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:42.479419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:42.479859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:43.701131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:43.710915 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f30ab20c-d230-41c2-b5ea-3f43099fa00f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.271978 Nov 02 12:00:43.724378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1243/2450] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:42 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:43.735148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:43.740307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:43.741534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:43.749926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:43.750709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:43.751411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:43.752396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:43.753079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:43.753584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:43.758761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17ad5f04-381f-4ec0-90fb-009053e4c413 tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1681 microversion: 2.1 time: 1.759701 Nov 02 12:00:43.759381 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1208/2451] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:41 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1681 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:44.742496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:44.748916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:44.750282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:44.751155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:44.765082 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-994f4ea2-7b6b-4c9b-9975-a70c30c7d3be tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1493 microversion: 2.1 time: 1.035933 Nov 02 12:00:44.765866 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1244/2452] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:43 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1493 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:44.771918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.772746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.773400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:44.775509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.777310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.780483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:44.822491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:44.828924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:44.841286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.841786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.842801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:44.847719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:44.848180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:44.853295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.133814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:45.167878 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52ce8f8f-1f94-4636-9ea5-19d18e65882f tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1613 microversion: 2.1 time: 0.354204 Nov 02 12:00:45.173070 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1245/2453] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:44 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1613 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:45.205449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe6f1d8-28d0-436b-9244-0bfead9616d5", "name": "network-vif-deleted", "tag": "bebdd016-040f-4bb9-85e8-a3b845f6eb2e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:45.274879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.283289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.284881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.362662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] Creating event network-vif-deleted:bebdd016-040f-4bb9-85e8-a3b845f6eb2e for instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 on n-h1-855649-4 Nov 02 12:00:45.387539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c2956378-7269-403e-9ac5-4ab97e4530ac req-e3f4ac22-03eb-4ab4-bc53-d03e54c4a047 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203952 Nov 02 12:00:45.390877 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1246/2454] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:45.473020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:45.485876 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b07e4426-75a8-48cd-bc46-901d8282d0d9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.750941 Nov 02 12:00:45.494506 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1209/2455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:44 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:45.794131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:45.794807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:45.818254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.818754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.834248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.835166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.835661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.836107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.983597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:45.984098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:45.984544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:45.985005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lazy-loading 'fault' on Instance uuid 8fe6f1d8-28d0-436b-9244-0bfead9616d5 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:46.032707 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-600595d1-017a-446a-ad14-1514a2ac85d8 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.508580 Nov 02 12:00:46.033949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1247/2456] 10.222.0.48 () {58 vars in 1128 bytes} [Wed Nov 2 12:00:45 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:00:46.061105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b44f913f-60a9-4a60-a60d-08a9bb62d636 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Calling method '.version_select at 0x7ff1b3e225e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.121078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b44f913f-60a9-4a60-a60d-08a9bb62d636 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] HTTP exception thrown: Image not found. Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b44f913f-60a9-4a60-a60d-08a9bb62d636 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Request method failure captured: Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvtcTqgd0Q85URSWPcYrs6lXZ9PYBxtT0DG0T-GXJRRQXJcKpeuD-BXlquoFNq4JmeCLQ12qV9soIeJFm2c7vN-LLUTfNjIknc88o1c211J3s9jcByMLKsPq6UcqiTu29ptEU-fwzcdwQg68EvMusx1MC5pdioBLnSBzDNXm9emvng Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8c70a4340a1643d4b692523d644008ec", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4089a78b54aa458fb07cb658c92bcae8 Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '-1'} Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.123557 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:46.128565 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.133285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b44f913f-60a9-4a60-a60d-08a9bb62d636 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:46.136288 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b44f913f-60a9-4a60-a60d-08a9bb62d636 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.094547 Nov 02 12:00:46.144581 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1248/2457] 10.222.0.48 () {58 vars in 1134 bytes} [Wed Nov 2 12:00:46 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:46.159115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31db4d5b-6a29-4c99-8bf8-e61f7bd6a362 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Calling method '.version_select at 0x7ff1b3e225e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.199750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-31db4d5b-6a29-4c99-8bf8-e61f7bd6a362 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] HTTP exception thrown: Image not found. Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31db4d5b-6a29-4c99-8bf8-e61f7bd6a362 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Request method failure captured: Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/62d1659a-4039-4dbb-a926-7764f3e69b7j HTTP/1.1 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlvtcTqgd0Q85URSWPcYrs6lXZ9PYBxtT0DG0T-GXJRRQXJcKpeuD-BXlquoFNq4JmeCLQ12qV9soIeJFm2c7vN-LLUTfNjIknc88o1c211J3s9jcByMLKsPq6UcqiTu29ptEU-fwzcdwQg68EvMusx1MC5pdioBLnSBzDNXm9emvng Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8c70a4340a1643d4b692523d644008ec", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4089a78b54aa458fb07cb658c92bcae8 Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '62d1659a-4039-4dbb-a926-7764f3e69b7j'} Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62d1659a-4039-4dbb-a926-7764f3e69b7j to delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62d1659a-4039-4dbb-a926-7764f3e69b7j could not be found. Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.202815 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:46.207414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.212073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31db4d5b-6a29-4c99-8bf8-e61f7bd6a362 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:46.213174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31db4d5b-6a29-4c99-8bf8-e61f7bd6a362 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/62d1659a-4039-4dbb-a926-7764f3e69b7j" status: 404 len: 62 microversion: 2.1 time: 0.067453 Nov 02 12:00:46.219559 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1249/2458] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:46 2022] DELETE /compute/v2.1/images/62d1659a-4039-4dbb-a926-7764f3e69b7j => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:46.231419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.234042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:46.258076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.258561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.259291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.260448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.261291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.261963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.309244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.309945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.311227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.312138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lazy-loading 'fault' on Instance uuid 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:46.611163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:46.613116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7142c46289437f9c9e74b11d27e5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32d0c67e2d04664b25fb11d43b6c9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:46.624939 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c255f70a-abd7-4dff-a180-75124b5adbed tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 200 len: 1298 microversion: 2.1 time: 0.834220 Nov 02 12:00:46.642073 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1210/2459] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:45 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 1298 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:46.648352 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bc1064b-8528-4646-ac01-ab27d129974a tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 200 len: 1331 microversion: 2.1 time: 0.415285 Nov 02 12:00:46.659044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8d74e62-cb59-430e-9f0d-47b5d799d093 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Calling method '.version_select at 0x7ff1b32eaf70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.659321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1250/2460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:46 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 1331 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:46.679903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:46.680798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:46.699190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.699337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.699766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.700497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:46.700966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:46.709868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:46.710331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b8d74e62-cb59-430e-9f0d-47b5d799d093 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] HTTP exception thrown: Image not found. Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8d74e62-cb59-430e-9f0d-47b5d799d093 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Request method failure captured: Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/27b7c8ff-d389-48e0-aea8-bbf9df7d483c1 HTTP/1.1 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlvtcTqgd0Q85URSWPcYrs6lXZ9PYBxtT0DG0T-GXJRRQXJcKpeuD-BXlquoFNq4JmeCLQ12qV9soIeJFm2c7vN-LLUTfNjIknc88o1c211J3s9jcByMLKsPq6UcqiTu29ptEU-fwzcdwQg68EvMusx1MC5pdioBLnSBzDNXm9emvng Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8c70a4340a1643d4b692523d644008ec", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4089a78b54aa458fb07cb658c92bcae8 Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '27b7c8ff-d389-48e0-aea8-bbf9df7d483c1'} Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 27b7c8ff-d389-48e0-aea8-bbf9df7d483c1 to delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27b7c8ff-d389-48e0-aea8-bbf9df7d483c1 could not be found. Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.712665 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8d74e62-cb59-430e-9f0d-47b5d799d093 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8d74e62-cb59-430e-9f0d-47b5d799d093 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/27b7c8ff-d389-48e0-aea8-bbf9df7d483c1" status: 404 len: 62 microversion: 2.1 time: 0.074505 Nov 02 12:00:46.719784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1211/2461] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:46 2022] DELETE /compute/v2.1/images/27b7c8ff-d389-48e0-aea8-bbf9df7d483c1 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:47.110963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3fdc815-ac79-43d7-9cb4-1f70eb0d3010 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Action: 'create', calling method: .version_select at 0x7ff1b32464c0>, body: {"keypair": {"name": "tempest-keypair-1356986075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/HZOR0kBaCkmbDOrbhy5rbbZ8HOHQbERjmV1ewnwk8oUfOuRUfJuEEhkao9Mha/OtDrb7Fl3zYBx1J+oz3bhu4pW5kn1pnAM8xQcf80y6yI7CQkB0ay6R4ySKgfPFlRQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:47.155922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d3fdc815-ac79-43d7-9cb4-1f70eb0d3010 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for project 73c43a47405e4bc4ac64d005b5460bff. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:47.168389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d3fdc815-ac79-43d7-9cb4-1f70eb0d3010 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for user 21e344c30d8a47ccb3ba188c7a7ca5cf and project 73c43a47405e4bc4ac64d005b5460bff. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:47.339783 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3fdc815-ac79-43d7-9cb4-1f70eb0d3010 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.615255 Nov 02 12:00:47.340874 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1212/2462] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:00:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:47.374710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ec10544-8599-41b5-b1f1-827ca38d5ac6 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Calling method '.version_select at 0x7ff1bbb55700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-2ec10544-8599-41b5-b1f1-827ca38d5ac6 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] HTTP exception thrown: Image not found. Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ec10544-8599-41b5-b1f1-827ca38d5ac6 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Request method failure captured: Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/tempest-invalid-494858748 HTTP/1.1 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlvtcTqgd0Q85URSWPcYrs6lXZ9PYBxtT0DG0T-GXJRRQXJcKpeuD-BXlquoFNq4JmeCLQ12qV9soIeJFm2c7vN-LLUTfNjIknc88o1c211J3s9jcByMLKsPq6UcqiTu29ptEU-fwzcdwQg68EvMusx1MC5pdioBLnSBzDNXm9emvng Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8c70a4340a1643d4b692523d644008ec", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4089a78b54aa458fb07cb658c92bcae8 Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'tempest-invalid-494858748'} Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-494858748 to delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:47.434909 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-494858748 could not be found. Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ec10544-8599-41b5-b1f1-827ca38d5ac6 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ec10544-8599-41b5-b1f1-827ca38d5ac6 tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/tempest-invalid-494858748" status: 404 len: 62 microversion: 2.1 time: 0.077443 Nov 02 12:00:47.439139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1213/2463] 10.222.0.48 () {58 vars in 1203 bytes} [Wed Nov 2 12:00:47 2022] DELETE /compute/v2.1/images/tempest-invalid-494858748 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:47.454029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b52394-d28f-455e-8ad9-9daa7572b53d tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Calling method '.version_select at 0x7ff1bbb55d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:47.497409 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c5b52394-d28f-455e-8ad9-9daa7572b53d tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] HTTP exception thrown: Image not found. Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b52394-d28f-455e-8ad9-9daa7572b53d tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Request method failure captured: Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/0e141888-61a5-47d7-a12c-0704993bf0e3 HTTP/1.1 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlvtcTqgd0Q85URSWPcYrs6lXZ9PYBxtT0DG0T-GXJRRQXJcKpeuD-BXlquoFNq4JmeCLQ12qV9soIeJFm2c7vN-LLUTfNjIknc88o1c211J3s9jcByMLKsPq6UcqiTu29ptEU-fwzcdwQg68EvMusx1MC5pdioBLnSBzDNXm9emvng Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8c70a4340a1643d4b692523d644008ec", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8c70a4340a1643d4b692523d644008ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8c70a4340a1643d4b692523d644008ec Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4089a78b54aa458fb07cb658c92bcae8 Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1174593243-project Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '0e141888-61a5-47d7-a12c-0704993bf0e3'} Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0e141888-61a5-47d7-a12c-0704993bf0e3 to delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e141888-61a5-47d7-a12c-0704993bf0e3 could not be found. Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.500192 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:00:47.505484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.507881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b52394-d28f-455e-8ad9-9daa7572b53d tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:47.509252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5b52394-d28f-455e-8ad9-9daa7572b53d tempest-ImagesDeleteNegativeTestJSON-1174593243 tempest-ImagesDeleteNegativeTestJSON-1174593243-project] 10.222.0.48 "DELETE /compute/v2.1/images/0e141888-61a5-47d7-a12c-0704993bf0e3" status: 404 len: 62 microversion: 2.1 time: 0.066453 Nov 02 12:00:47.510413 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1214/2464] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:47 2022] DELETE /compute/v2.1/images/0e141888-61a5-47d7-a12c-0704993bf0e3 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:47.587703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c859a0-5be4-47cb-a1d3-5d54a5edfa31", "name": "network-vif-deleted", "tag": "4802d97c-ffe5-4b54-a1e2-512e7a006f7e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:47.616746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:47.617265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:47.617710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.653216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] Creating event network-vif-deleted:4802d97c-ffe5-4b54-a1e2-512e7a006f7e for instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 on n-h1-855649-4 Nov 02 12:00:47.662252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f16fc1f7-0522-4685-97ed-f9126280d65d req-58147981-d4ae-4311-a2b0-0dd5f253c39a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078522 Nov 02 12:00:47.663934 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1215/2465] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:47.677181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:47.677181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:47.681610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:47.683078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:47.684154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.685179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:47.685970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:47.686555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.709816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 HTTP/1.1 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '8fe6f1d8-28d0-436b-9244-0bfead9616d5'} Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.712373 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:00:47.718206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.740959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:47.741893 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f22d0158-933b-4240-94bd-0d96d63886e2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 404 len: 111 microversion: 2.1 time: 0.075802 Nov 02 12:00:47.744461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1216/2466] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:47 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:47.752709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:47.754382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] [instance: 28c859a0-5be4-47cb-a1d3-5d54a5edfa31] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:47.762660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:47.763702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:47.770062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.770062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:47.770062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:47.770062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:47.784308 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] HTTP exception thrown: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Request method failure captured: Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 HTTP/1.1 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlsXJ4deyMMb0HYy_1kf61iG1x03gjstr6oWJBjckFzh6sORkEAy0GoCVBdmTxmlDgpiMup53gUvGfSbPwvyjNKTxKqoSUkflEhYTErZYQ22iSWmN-bSdWAPIec5jkYGd-5ddskp_SaO21hnhmAv9zugIrwbHnFxGIpIb3bsb8U66O8 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b32d0c67e2d04664b25fb11d43b6c9e4 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b32d0c67e2d04664b25fb11d43b6c9e4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b32d0c67e2d04664b25fb11d43b6c9e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b32d0c67e2d04664b25fb11d43b6c9e4 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-514621263 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesAdminNegativeTest-514621263-project Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: aa7142c46289437f9c9e74b11d27e5e5 Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesAdminNegativeTest-514621263-project Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '28c859a0-5be4-47cb-a1d3-5d54a5edfa31'} Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:47.786303 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. Nov 02 12:00:47.792227 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:00:47.794436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Returning 404 to user: Instance 28c859a0-5be4-47cb-a1d3-5d54a5edfa31 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:47.796162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32d7a4fb-6784-4674-8f20-d4adabf6814d tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31" status: 404 len: 111 microversion: 2.1 time: 0.050391 Nov 02 12:00:47.796849 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1217/2467] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:47 2022] GET /compute/v2.1/servers/28c859a0-5be4-47cb-a1d3-5d54a5edfa31 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:00:47.802361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-761091f5-d401-4430-bd3c-c1dfbe45f603 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b8313160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:47.994321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:48.014186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64415e0a-7341-4dff-aac8-a87c143754ba tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 1.353288 Nov 02 12:00:48.030825 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1251/2468] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:46 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:48.059321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94c36d0a-5280-4db8-893e-fbfe7c246adf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] Calling method '.version_select at 0x7ff1b39a9700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:48.213510 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94c36d0a-5280-4db8-893e-fbfe7c246adf tempest-VolumesAdminNegativeTest-514621263 tempest-VolumesAdminNegativeTest-514621263-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511364844" status: 202 len: 0 microversion: 2.1 time: 0.184080 Nov 02 12:00:48.219667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1252/2469] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511364844 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:00:49.050833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:49.050833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:49.070808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:49.075869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:49.076520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:49.077407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:49.078019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:49.078593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:49.582659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:49.597432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b1db26d-c12e-45cb-bdee-b65d517a2ceb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.559458 Nov 02 12:00:49.599959 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1253/2470] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:49 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:50.363123 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-761091f5-d401-4430-bd3c-c1dfbe45f603 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 204 len: 0 microversion: 2.1 time: 2.564653 Nov 02 12:00:50.363782 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1218/2471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:47 2022] DELETE /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 0 bytes in 2566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:00:50.373605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:50.374868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:50.385058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.386457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.392815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:50.393595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.395613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.396652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:50.446466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:00:50.625025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:50.626014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:50.636928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.639054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.640228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:50.643078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:50.644632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:50.651201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:51.043645 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e2dbb92-ba0b-4a04-85b4-59172fc12231 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 204 len: 0 microversion: 2.1 time: 0.675243 Nov 02 12:00:51.044250 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1254/2472] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:00:50 2022] DELETE /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:00:51.335294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-926924597", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7d498bf5-9395-45ef-bbaa-4397e22c2c4c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:51.346782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:51.378463 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb6302a3-539e-4d7c-a55a-ddad7548c0ff tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1718 microversion: 2.1 time: 0.752001 Nov 02 12:00:51.388565 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1219/2473] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:50 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1718 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:51.440575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] validate_networks() for [('7d498bf5-9395-45ef-bbaa-4397e22c2c4c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:00:52.405293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:52.406686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:52.409827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:00:52.438734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:52.439317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:52.439816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:52.440550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:52.446139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:52.446861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:53.213342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:53.231009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-378d59b3-96e0-4a0e-a2ba-3100bd9faa8d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1708 microversion: 2.1 time: 0.831038 Nov 02 12:00:53.234762 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1220/2474] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:52 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1708 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:53.638122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:00:53.639252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:00:53.639770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:00:53.640197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:00:53.640884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:00:53.652455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:53.652990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:53.653482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:53.654406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:53.655624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:53.656079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:53.684564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:53.691808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Getting quotas for user 0ff679110552451bb279d504c9408303 and project 2157796c4e304204b6db4e2654d2b35d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:53.709896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:00:53.712912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:00:54.008212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Calling method '.version_select at 0x7ff1b3981040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:54.050396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.050954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.053640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.054444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.058729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.061733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.089713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa449bf2-13b5-44ab-8a93-20d3827bda55 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.758353 Nov 02 12:00:54.094473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1255/2475] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:00:54.110842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79071b10-45bc-4855-bcf9-906fe9b62cbe tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '.version_select at 0x7ff1b3ac8280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:54.124047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79071b10-45bc-4855-bcf9-906fe9b62cbe tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.124450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79071b10-45bc-4855-bcf9-906fe9b62cbe tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.124897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79071b10-45bc-4855-bcf9-906fe9b62cbe tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.143975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed71893d-a33d-4d68-8c54-1d27f427a801 tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.907708 Nov 02 12:00:54.155405 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1221/2476] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Nov 2 12:00:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:54.166364 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79071b10-45bc-4855-bcf9-906fe9b62cbe tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.068428 Nov 02 12:00:54.167045 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1256/2477] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 12:00:54 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:54.167776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0303befb-faf2-4e3a-8bcc-7e1835171b36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:54.170462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0303befb-faf2-4e3a-8bcc-7e1835171b36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:54.213249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:54.213878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:54.245123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.245626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.250159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.251054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:54.251548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:54.252052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:54.596847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0303befb-faf2-4e3a-8bcc-7e1835171b36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:54.608473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0303befb-faf2-4e3a-8bcc-7e1835171b36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1207 microversion: 2.1 time: 0.451867 Nov 02 12:00:54.611427 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1222/2478] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:54 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1207 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:54.625175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1000554653", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d2af2be6-b858-4236-970e-4ee7abb94e0b"}], "security_groups": [{"name": "tempest-securitygroup--849158570"}], "key_name": "tempest-keypair-1356986075", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:54.709089 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c18ffdc-5515-4823-a16e-ff3b596baa22 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1859 microversion: 2.1 time: 0.520043 Nov 02 12:00:54.714695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1257/2479] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:54 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1859 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:54.731855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-801153329", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:54.795095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] validate_networks() for [('d2af2be6-b858-4236-970e-4ee7abb94e0b', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:00:54.826819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:00:55.761463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Getting quotas for project 9f5ca46de62444fa99f03c33359eae79. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:55.802922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Getting quotas for user c8822799585d41388ec12da2f41740b9 and project 9f5ca46de62444fa99f03c33359eae79. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:55.865364 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Request method failure captured: Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 1751 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlv0HwPoE3VWL-5T8BkmOSjd6BBMXRyhanoKZQ_Oh0L6C5DcAr0kbrq-JaH-FgN-i7UCw8HHqiMU7BqrbQ2kdfNk3bY14VBNDIWg2be0Ev_KeFZasdswbTEYbO0bZOBOrrOES7uPN2vuwm25YWgwojhhY20xlBR_kms7rMZ6PZqjvnY Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9f5ca46de62444fa99f03c33359eae79 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1666488147 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f5ca46de62444fa99f03c33359eae79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f5ca46de62444fa99f03c33359eae79", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f5ca46de62444fa99f03c33359eae79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f5ca46de62444fa99f03c33359eae79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1666488147 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9f5ca46de62444fa99f03c33359eae79 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1666488147 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c8822799585d41388ec12da2f41740b9 Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-801153329", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:00:55.892852 n-d-855649-4 devstack@n-api.service[127567]: exception: Maximum number of metadata items exceeds 128 Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-801153329', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:55.895178 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 12:00:55.897877 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:00:55.900662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:00:55.901569 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a59cc66b-45bc-4fec-be79-f6192720678f tempest-AbsoluteLimitsNegativeTestJSON-1666488147 tempest-AbsoluteLimitsNegativeTestJSON-1666488147-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.190883 Nov 02 12:00:55.911129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1258/2480] 10.222.0.48 () {60 vars in 1148 bytes} [Wed Nov 2 12:00:54 2022] POST /compute/v2.1/servers => generated 87 bytes in 1194 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:00:55.927946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:55.928757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:55.952531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:55.954548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:55.957427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:55.958447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:55.960495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:55.961547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.315324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ffc60c2-4e41-4c41-86e0-9f96deb4df7b tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1859 microversion: 2.1 time: 0.402889 Nov 02 12:00:56.319562 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1259/2481] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:55 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1859 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:56.323892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72b0e6d-8452-43e4-b6ad-621421f93b1c", "name": "network-vif-deleted", "tag": "6872d731-1d13-4132-8f76-a5ff864f7db7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:00:56.342471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.342901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.343367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.348502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for project 73c43a47405e4bc4ac64d005b5460bff. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:56.363765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for user 21e344c30d8a47ccb3ba188c7a7ca5cf and project 73c43a47405e4bc4ac64d005b5460bff. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:56.371193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] Creating event network-vif-deleted:6872d731-1d13-4132-8f76-a5ff864f7db7 for instance d72b0e6d-8452-43e4-b6ad-621421f93b1c on n-h1-855649-4 Nov 02 12:00:56.387130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b371eea8-9d5d-4821-a7d7-0c6b316c0be5 req-da5ff460-93de-4af6-9535-98e58ffa3bb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066335 Nov 02 12:00:56.392546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1260/2482] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:56.393059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:00:56.393596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:00:56.394203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:00:56.394889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:00:56.395610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:00:56.399953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af422e29-4cbe-4b8e-b988-e36f7f90e44f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:56.400655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af422e29-4cbe-4b8e-b988-e36f7f90e44f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:56.427522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.430310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.431166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.433499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.434601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.436461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.471312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for project 73c43a47405e4bc4ac64d005b5460bff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:00:56.488225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Getting quotas for user 21e344c30d8a47ccb3ba188c7a7ca5cf and project 73c43a47405e4bc4ac64d005b5460bff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:00:56.492956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af422e29-4cbe-4b8e-b988-e36f7f90e44f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:56.501715 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af422e29-4cbe-4b8e-b988-e36f7f90e44f tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1207 microversion: 2.1 time: 0.107876 Nov 02 12:00:56.502781 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1261/2483] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:56 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:56.508790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:56.509642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:56.517393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.518545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:00:56.518749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.522206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.522206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:56.522206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:56.522206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:56.523174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:00:56.721848 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55775c2a-d564-4d28-99b6-9f7806450692 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.095210 Nov 02 12:00:56.724829 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1223/2484] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:00:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:00:56.728927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lazy-loading 'services' on Instance uuid 10f47a4b-0e54-4791-900d-e94df091634f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:00:56.750118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dfe7a4f-f8e5-4a4f-bbd7-a21aaacad364 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:56.751181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2dfe7a4f-f8e5-4a4f-bbd7-a21aaacad364 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:56.884955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2dfe7a4f-f8e5-4a4f-bbd7-a21aaacad364 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:56.901814 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2dfe7a4f-f8e5-4a4f-bbd7-a21aaacad364 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1278 microversion: 2.1 time: 0.175297 Nov 02 12:00:56.902436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1224/2485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:56 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:57.217562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb7ae81c-3261-4a68-a714-b7eebaced45b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments/9c69a747-66a0-48fe-9d72-c9ff607d8bec" status: 202 len: 0 microversion: 2.1 time: 0.712642 Nov 02 12:00:57.219497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1262/2486] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:00:56 2022] DELETE /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments/9c69a747-66a0-48fe-9d72-c9ff607d8bec => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:00:57.229978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:57.234123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:57.250784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.251752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.253086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:57.255570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.256233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.258802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:57.343665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-500c80a1-fe34-4e18-9739-d3bf7f052241 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117391 Nov 02 12:00:57.347302 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1225/2487] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:00:57 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:57.532187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:57.532896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:57.553839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.554445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.563717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:57.566414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:57.566414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:57.570461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:57.837487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:57.857876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d6d803f-c60b-4760-bef9-a6e5aa75383d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1259 microversion: 2.1 time: 0.331261 Nov 02 12:00:57.859302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1263/2488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:57 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:00:57.937193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7055ac43-62e6-40ee-bdec-f40b839761c7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:57.938549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7055ac43-62e6-40ee-bdec-f40b839761c7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:58.191553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7055ac43-62e6-40ee-bdec-f40b839761c7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:58.203274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7055ac43-62e6-40ee-bdec-f40b839761c7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1278 microversion: 2.1 time: 0.277069 Nov 02 12:00:58.210577 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1226/2489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:57 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1278 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:58.359805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:58.362754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:58.424839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:58.426813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:58.428188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:58.430910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:58.433075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:58.434212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:58.539803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4014028-164f-45b4-9c7b-d2935ed08169 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184343 Nov 02 12:00:58.541800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1264/2490] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:00:58 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:00:58.889221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:58.889861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:58.909123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:58.909676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:58.910135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:58.910873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:58.925071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:58.925563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.124994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:59.137794 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f28e603f-191f-47c2-b3e5-d69cd961cbd0 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1267 microversion: 2.1 time: 0.253294 Nov 02 12:00:59.139581 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1227/2491] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:58 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:59.227683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:59.228502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:59.240500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.243352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.243941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.246438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.249677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.251215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.434598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:00:59.445406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be7e809c-a38f-4655-a8f9-56544f6d6c4a tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1282 microversion: 2.1 time: 0.222937 Nov 02 12:00:59.449856 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1265/2492] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:00:59 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1282 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:00:59.561329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:00:59.565077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:00:59.655369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.657177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.657804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.660805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:00:59.661851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:00:59.662723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:00:59.762057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d868a585-2284-4a08-acc8-5444533ce4fa tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208837 Nov 02 12:00:59.770260 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1228/2493] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:00:59 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:00.170773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:00.170773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:00.201921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.212604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.214023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.221631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.225758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.233296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.475426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:00.476058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:00.490209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.490697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.491181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.491969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.492430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.500044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.700611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:00.715381 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eaf42985-5ebb-416a-9bfe-0667befeda71 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1265 microversion: 2.1 time: 0.552788 Nov 02 12:01:00.715984 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1266/2494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:00 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1265 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:00.783575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:00.786128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:00.799257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.803626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.805972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.808294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:00.810068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:00.813562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:00.848537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:00.888281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ebe595a-312d-4255-ab6e-c01cfd5be2c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110220 Nov 02 12:01:00.893236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1267/2495] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:00 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:00.915113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:00.919185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:00.925422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b478748-1d2c-44ff-96e6-4d6ff6ba007e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1330 microversion: 2.1 time: 0.453930 Nov 02 12:01:00.926502 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1229/2496] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:00 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1330 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:01.739238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:01.740914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:01.755618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.758883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.760739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:01.761943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.774484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.774484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:01.908203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:01.913807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:01.930341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.932455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.933866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:01.937765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:01.938401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:01.938956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.042820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f52e2b75-2f48-4237-b3f6-24f7b3423f9f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142086 Nov 02 12:01:02.047673 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1230/2497] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:01 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:02.060587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:02.062200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:02.079492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.086099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.086099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.086099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:02.086099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:02.086099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:02.419412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:02.442292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccd0b50b-2838-40ab-a28e-6d2ca126cb56 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1336 microversion: 2.1 time: 0.392138 Nov 02 12:01:02.455039 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1231/2498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:02 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1336 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:02.755061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:02.771889 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44e6df25-d894-4e46-b099-88bcfc3ade7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 1.033954 Nov 02 12:01:02.780411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1268/2499] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:01 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:03.062859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.080678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.088994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.089458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.089906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.101049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.101049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.101433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.172239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c18fc78-04a6-44fa-98ac-f94c2dac1492 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117192 Nov 02 12:01:03.183395 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1232/2500] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:03 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:03.488473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.489932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.499267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:03.536382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.536382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.536382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.539914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.544056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.553575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.672735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:03.801555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:03.802630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:03.822656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.823841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.825283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.827386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:03.828763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:03.830107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:03.986592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:04.011718 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f682d473-2c76-4168-a183-cd2070549ab8 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.537398 Nov 02 12:01:04.029890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1269/2501] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:03 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:04.184577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:04.187589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:04.204045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:04.205361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:04.206072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:04.207822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:04.208576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:04.209293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:04.287590 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9a2c08f-364e-4b84-a1a3-3b64dc1fe6ae tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102607 Nov 02 12:01:04.289997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1270/2502] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:04 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:04.844245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:04.861096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3862db5f-339c-47f7-a849-85c960e34109 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 1.067538 Nov 02 12:01:04.879491 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1233/2503] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:03 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:05.039347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:05.040550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:05.057721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.058769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.065184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.066220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.066858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.067475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.302135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:05.305405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:05.322898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.323620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.324366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.325309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.326633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.333149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.408983 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2415dfd9-5d80-4042-9dd5-a60342989ab8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111117 Nov 02 12:01:05.414158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1234/2504] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:05 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:05.550122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:05.565063 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e14ac2fd-6787-4926-bc6f-6088acddc098 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.524824 Nov 02 12:01:05.565063 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1271/2505] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:05 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:05.885916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:05.887478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:05.896656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.897158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.897610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.898334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.898801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.899274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:05.916216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91", "tag": "d2e2b938-0876-4017-9c30-d088f22e5107"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:05.944989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:05.945488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:05.945974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.014264 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] Creating event network-changed:d2e2b938-0876-4017-9c30-d088f22e5107 for instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 on n-h1-855649-4 Nov 02 12:01:06.031560 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ccb31e08-96d3-4bcf-b97b-97afe2113c85 req-d4cf16a5-39bb-410e-9574-9269d8937208 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119440 Nov 02 12:01:06.036126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1272/2506] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:06.426290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:06.432270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:06.460776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:06.472673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.473781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.474890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.479093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.479792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.484234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.537275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:06.562461 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdec8c50-31ba-4dbc-b483-78149189542d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144416 Nov 02 12:01:06.564188 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1273/2507] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:01:06 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:01:06.595621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:06.597711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:06.609696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.620507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.621553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.623523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:06.624251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:06.626242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:06.745849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:06.760949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-653e51b3-28e5-4bf4-93e7-d73fe514ab77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.878829 Nov 02 12:01:06.762026 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1235/2508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:05 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:07.433777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:07.447151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43a1e14b-9d4c-4697-bb04-46f01fe595d6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.864236 Nov 02 12:01:07.470357 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1274/2509] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:06 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:07.790165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:07.790847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:07.813205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:07.813705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:07.814149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:07.814965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:07.815451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:07.815883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.144263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2607e82a-cb59-420d-83ed-3e34febb4fe8", "tag": "86607663-ecc9-4afd-af9d-67c145899022"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:08.160585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:08.161758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:08.162968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.181924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] Creating event network-changed:86607663-ecc9-4afd-af9d-67c145899022 for instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 on n-h1-855649-4 Nov 02 12:01:08.189484 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a4f1d208-7bc8-46f8-961a-a04f4c889050 req-fb2041a7-657b-4ef8-893a-cd7a382a2a71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057292 Nov 02 12:01:08.190611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1275/2510] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:08.195780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:08.478154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:08.478806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:08.502049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:08.502937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:08.503656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.506203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:08.510381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:08.511078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:08.555039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:08.573122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbdc10a8-a77f-41ad-bb06-e9b8f86ad1fd tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.790197 Nov 02 12:01:08.574417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1236/2511] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:07 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:09.598852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:09.600268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:09.618476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:09.628221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:09.631602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:09.635724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:09.636531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:09.638648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:09.833840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:09.846785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-759a0424-7b99-4b6a-8bea-ae637c313ac4 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 1.376574 Nov 02 12:01:09.851515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1276/2512] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:08 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:10.138504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:10.153594 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7debb1f0-daac-4dc1-bc6e-fd91e75ed1bf tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.560080 Nov 02 12:01:10.157611 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1237/2513] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:09 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:10.880013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:10.881345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:10.910390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:10.913090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:10.913090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:10.917183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:10.921249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:10.921772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.186856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:11.187672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:11.207108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.210080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.210634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:11.218006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:11.218547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:11.219020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:12.029572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:12.043658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45e0d1ae-6aba-4918-8fe6-98e4036b53e9 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 1.172459 Nov 02 12:01:12.046405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1277/2514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:10 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:12.168982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:12.191610 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-939d78d2-de1b-4c25-bddf-18015c7ac7c7 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 1.015098 Nov 02 12:01:12.194912 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1238/2515] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:11 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:13.075575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:13.076243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:13.093879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:13.094317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:13.094768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:13.095547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:13.096018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:13.096456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:13.221204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:13.221825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:13.247758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:13.249761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:13.251211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:13.254533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:13.257083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:13.257847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:14.421043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:14.441074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-043c80fc-7c4f-4be7-a92a-9737b76cfc74 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 1.363441 Nov 02 12:01:14.445495 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1278/2516] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:13 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:14.499196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:14.510067 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f420c91c-0d1c-49f6-85df-9b1be1e82018 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 1.293317 Nov 02 12:01:14.514583 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1239/2517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:13 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:15.471957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.473255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.499432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.501903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.505762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.519399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.522402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.525606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.543448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:15.548719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:15.575004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.577306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.579762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:15.584646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:15.585625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:15.587356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:16.365442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:16.399795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70ba2e30-70e9-4939-848e-5c35616c3cd8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.851086 Nov 02 12:01:16.399795 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1240/2518] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:16.617247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:16.653603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63aa1fc3-0dbd-4525-a153-4e19735b0b5d tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 1.186440 Nov 02 12:01:16.656675 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1279/2519] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:15 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:17.426294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:17.427377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:17.443133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:17.443642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:17.444099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:17.444817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:17.445321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:17.445704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:17.687255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:17.688926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:17.713613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:17.715475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:17.718282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:17.723044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:17.724413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:17.727897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:18.169674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:18.187505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-186e1f47-f2bb-4431-bf9f-2cab1db5678c tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.765113 Nov 02 12:01:18.191364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1241/2520] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:17 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:18.248137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:18.256952 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3448e1b9-d35e-49ff-a757-1619f47a1ce1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.578488 Nov 02 12:01:18.259779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1280/2521] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:17 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:19.212813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:19.213444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:19.227034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:19.233059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:19.237752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:19.250492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:19.256931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:19.256931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:19.285411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:19.288542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:19.302118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:19.305714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:19.306645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:19.307748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:19.308780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:19.309798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:20.493557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:20.532551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:20.536958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d349bbe-2e94-46d3-a4bb-4f445be41672 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 1.258481 Nov 02 12:01:20.541031 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1281/2522] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:19 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:20.548184 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8b8db02-7a50-4ca0-a4c6-6d1aa21ddd2e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 1.339117 Nov 02 12:01:20.569013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1242/2523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:19 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:21.564741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:21.566231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:21.604443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:21.614719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:21.616101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:21.617188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:21.617848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:21.619527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:21.620711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:21.621431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:21.657879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:21.659100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:21.662720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:21.667323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:21.668454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:21.670825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:22.282016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:22.313288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-847dd2e5-79d5-43ca-a74c-1348ed4a0556 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.717863 Nov 02 12:01:22.317106 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1243/2524] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:21 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:22.352587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:22.367321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f4f9733-0860-4164-a8c2-f209111bae5c tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.807079 Nov 02 12:01:22.377942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1282/2525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:21 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:23.316447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91", "name": "network-vif-plugged", "status": "completed", "tag": "d2e2b938-0876-4017-9c30-d088f22e5107"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:23.364863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:23.368000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:23.373166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:23.424189 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] Creating event network-vif-plugged:d2e2b938-0876-4017-9c30-d088f22e5107 for instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 on n-h1-855649-4 Nov 02 12:01:23.445070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ea2daf08-2f2c-4330-b476-b9486bb502e6 req-09dae0e1-233f-4e77-9e6e-bfa0db28430b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.981794 Nov 02 12:01:23.457221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1244/2526] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:23.483059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:23.488003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:23.502601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:23.505232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:23.507414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:23.510221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:23.510934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:23.511565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:23.571430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf28beb7-99cb-4856-a55c-247a8451b82e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Calling method '.version_select at 0x7ff1b3989af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:23.769281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf28beb7-99cb-4856-a55c-247a8451b82e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.059953 Nov 02 12:01:23.770233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1283/2527] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:01:22 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:01:23.775752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:23.776589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:23.819716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:23.820490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:23.820937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:23.821662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:23.822124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:23.822556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:24.053265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:24.072348 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ecdaaa0-95bb-4380-8735-925ad727c1b8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.613121 Nov 02 12:01:24.081202 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1245/2528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:23 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:24.086174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5084d3f7-368c-460d-896d-0beaf3922a6e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Action: 'create', calling method: .version_select at 0x7ff1bbb041f0>, body: {"pool": "non_exist_pool"} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:24.206742 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5084d3f7-368c-460d-896d-0beaf3922a6e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] HTTP exception thrown: Floating IP pool not found. Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5084d3f7-368c-460d-896d-0beaf3922a6e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Request method failure captured: Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 26 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwSocGRMr58rDLD3U_Z6ldcViADgwGWNM8vAeb_huwzpJpz4_Uk9dPtnXtRLdUk1GT1pqZhmW6d4_pVQHcDFiuItUgETzmSyD0VM8CA9D19QTkgpOIYlx2ANjWfnmhNnY87GwWtaP8BKG-odvNBuW8eZSUGFCWETfjhH-Rm47akB9g Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 1c5d1b5f1934412399af667cf3dde826 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c5d1b5f1934412399af667cf3dde826", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 1c5d1b5f1934412399af667cf3dde826 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsNegativeTestJSON-1637376220-project Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a8ba7e6e4d7b4e67ad34b8f697ddf6fc Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1637376220-project Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: {"pool": "non_exist_pool"} Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP pool not found. Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:24.208626 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:24.212647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 12:01:24.212647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.215349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5084d3f7-368c-460d-896d-0beaf3922a6e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Returning 404 to user: Floating IP pool not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:24.217492 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5084d3f7-368c-460d-896d-0beaf3922a6e tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.141458 Nov 02 12:01:24.218433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1246/2529] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:01:24 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:24.230608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Calling method '.version_select at 0x7ff1bbaf2d30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:24.247434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:24.256412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9161fbde-6add-4800-9af4-b04ad24ccb21 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.484833 Nov 02 12:01:24.264394 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1284/2530] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:23 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:24.446581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 could not be found", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:01:24.448119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] HTTP exception thrown: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Request method failure captured: Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-floating-ips/4dbd80cc-c1c0-4123-b003-de1e5f677cd6 HTTP/1.1 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwSocGRMr58rDLD3U_Z6ldcViADgwGWNM8vAeb_huwzpJpz4_Uk9dPtnXtRLdUk1GT1pqZhmW6d4_pVQHcDFiuItUgETzmSyD0VM8CA9D19QTkgpOIYlx2ANjWfnmhNnY87GwWtaP8BKG-odvNBuW8eZSUGFCWETfjhH-Rm47akB9g Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 1c5d1b5f1934412399af667cf3dde826 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c5d1b5f1934412399af667cf3dde826", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c5d1b5f1934412399af667cf3dde826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 1c5d1b5f1934412399af667cf3dde826 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1637376220 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsNegativeTestJSON-1637376220-project Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a8ba7e6e4d7b4e67ad34b8f697ddf6fc Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1637376220-project Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '4dbd80cc-c1c0-4123-b003-de1e5f677cd6'} Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 could not be found Nov 02 12:01:24.451399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cfd6b66-51cb-4e42-9361-28b4031932d7'] Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6. Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 Nov 02 12:01:24.455396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:24.459826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] Returning 404 to user: Floating IP not found for ID 4dbd80cc-c1c0-4123-b003-de1e5f677cd6 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:24.461224 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcf283c1-6667-4304-b92a-2d908f281dec tempest-FloatingIPsNegativeTestJSON-1637376220 tempest-FloatingIPsNegativeTestJSON-1637376220-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/4dbd80cc-c1c0-4123-b003-de1e5f677cd6" status: 404 len: 111 microversion: 2.1 time: 0.235996 Nov 02 12:01:24.461816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1247/2531] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:01:24 2022] DELETE /compute/v2.1/os-floating-ips/4dbd80cc-c1c0-4123-b003-de1e5f677cd6 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:25.097725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:25.104711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:25.110063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:25.125846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:25.127068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:25.130261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:25.132526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:25.142721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:25.381105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:25.789889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:25.800001 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-651c048d-0254-4ba0-b2cd-3c38baf6b247 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1307 microversion: 2.1 time: 0.706013 Nov 02 12:01:25.801920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1285/2532] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:25 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1307 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:26.137327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:26.150243 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ca09889-99ab-4c42-b571-e8d000a373f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.865046 Nov 02 12:01:26.153348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1248/2533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:25 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:26.175485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2607e82a-cb59-420d-83ed-3e34febb4fe8", "name": "network-vif-plugged", "status": "completed", "tag": "86607663-ecc9-4afd-af9d-67c145899022"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:26.198647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:26.204542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:26.205029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:26.207950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:26.240409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:26.242994 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] Creating event network-vif-plugged:86607663-ecc9-4afd-af9d-67c145899022 for instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 on n-h1-855649-4 Nov 02 12:01:26.263890 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-108f21e0-92fb-48cc-876e-ef11e8782b0a req-268692c1-6da7-4e49-98e2-fef4139a6738 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107807 Nov 02 12:01:26.266555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1249/2534] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:26.594190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Calling method '.version_select at 0x7ff1b391c160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:26.829499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:26.830233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:26.847264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:26.847765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:26.848217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:26.848946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:26.849410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:26.849844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.231667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:01:27.232018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Neutron security group 2c28a402-2a18-4053-b17b-0fc2781c6071 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:01:27.232596 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] HTTP exception thrown: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.232596 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Request method failure captured: Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/2c28a402-2a18-4053-b17b-0fc2781c6071 HTTP/1.1 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwVcdiCgXYlYq9TfUxVOtj1HvPbmPiekAQVWO3T_9EWmgvZEhBmpY9NmjBD_3JzNscjHnG5N50Fl4Tj3xI9IkWVFUelhyBUHpMUw3ceYR4v-wZM9Bb5uh4ZUzMENoar7fJkz7pMGRPSgkPtLOnY5lhjae8nZ6ZBmnZnHOmJAa7OWq4 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_37cb43bb61874473831880956b6f512d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/37cb43bb61874473831880956b6f512d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f273b65dd28f440da8381f54233bc024 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '2c28a402-2a18-4053-b17b-0fc2781c6071'} Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:01:27.237147 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Returning 404 to user: Security group 2c28a402-2a18-4053-b17b-0fc2781c6071 does not exist Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-1b1c8a95-eb8a-4da2-987c-ef20ea5beff4'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd386bd8-abd7-404c-9fee-f1af666142f1 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/2c28a402-2a18-4053-b17b-0fc2781c6071" status: 404 len: 194 microversion: 2.1 time: 1.435314 Nov 02 12:01:27.241501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1286/2535] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:01:25 2022] DELETE /compute/v2.1/os-security-groups/2c28a402-2a18-4053-b17b-0fc2781c6071 => generated 194 bytes in 1437 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:27.250341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:27.251111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:27.257989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.262106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.262106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.262106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.262106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.262106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.278526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:27.506212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:27.525899 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa499573-c4cf-4620-a698-6b0b6defd9a8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1486 microversion: 2.1 time: 0.702628 Nov 02 12:01:27.527425 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1250/2536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:26 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1486 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:27.533315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6e5ca32-2d92-4985-9829-b93bfa59f533 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003966 Nov 02 12:01:27.538240 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1251/2537] 10.222.0.48 () {58 vars in 1164 bytes} [Wed Nov 2 12:01:27 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:01:27.543855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-731b9f49-b724-469f-9595-5463ee444172 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Calling method '.version_select at 0x7ff1bbaf2940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:27.815479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:27.845437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5889c9fe-f318-4b15-a7f3-ce66991ccac6 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1403 microversion: 2.1 time: 0.604479 Nov 02 12:01:27.850144 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1287/2538] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:27 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1403 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:27.867203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1565778935"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:27.871022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:27.889490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.890713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.892497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:27.894236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:27.907003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:27.907962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:28.043104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-731b9f49-b724-469f-9595-5463ee444172 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.503305 Nov 02 12:01:28.043728 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1252/2539] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 12:01:27 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:28.073303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Calling method '.version_select at 0x7ff1bbb55280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:28.824353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:01:28.825782 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 12:01:28.825782 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Request method failure captured: Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/91fa5bcf-9a3f-4a10-b5f1-2941686c7af4 HTTP/1.1 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwVcdiCgXYlYq9TfUxVOtj1HvPbmPiekAQVWO3T_9EWmgvZEhBmpY9NmjBD_3JzNscjHnG5N50Fl4Tj3xI9IkWVFUelhyBUHpMUw3ceYR4v-wZM9Bb5uh4ZUzMENoar7fJkz7pMGRPSgkPtLOnY5lhjae8nZ6ZBmnZnHOmJAa7OWq4 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_37cb43bb61874473831880956b6f512d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/37cb43bb61874473831880956b6f512d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f273b65dd28f440da8381f54233bc024 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: exception: Insufficient rights for removing default security group. Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '91fa5bcf-9a3f-4a10-b5f1-2941686c7af4'} Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:01:28.828344 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-2df52689-69da-49b2-bdc8-2dfaca68b582'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:28.832271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18001eba-93ab-4066-891e-f9922d28e4a2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/91fa5bcf-9a3f-4a10-b5f1-2941686c7af4" status: 400 len: 182 microversion: 2.1 time: 0.767725 Nov 02 12:01:28.844849 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1253/2540] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:01:28 2022] DELETE /compute/v2.1/os-security-groups/91fa5bcf-9a3f-4a10-b5f1-2941686c7af4 => generated 182 bytes in 783 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:01:28.858162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Calling method '.version_select at 0x7ff1b2f92ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.030567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:01:29.031720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Neutron security group 92d25604-0a83-44a7-8729-5b4094f74220 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:01:29.039979 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] HTTP exception thrown: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.039979 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Request method failure captured: Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/92d25604-0a83-44a7-8729-5b4094f74220 HTTP/1.1 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwVcdiCgXYlYq9TfUxVOtj1HvPbmPiekAQVWO3T_9EWmgvZEhBmpY9NmjBD_3JzNscjHnG5N50Fl4Tj3xI9IkWVFUelhyBUHpMUw3ceYR4v-wZM9Bb5uh4ZUzMENoar7fJkz7pMGRPSgkPtLOnY5lhjae8nZ6ZBmnZnHOmJAa7OWq4 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_37cb43bb61874473831880956b6f512d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/37cb43bb61874473831880956b6f512d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f273b65dd28f440da8381f54233bc024 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '92d25604-0a83-44a7-8729-5b4094f74220'} Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:01:29.059343 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Returning 404 to user: Security group 92d25604-0a83-44a7-8729-5b4094f74220 does not exist Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-8a143c08-f75b-42d9-8c1d-a34e63349877'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f2a4446-bc93-43a3-8b7e-061590bc4fa2 tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/92d25604-0a83-44a7-8729-5b4094f74220" status: 404 len: 194 microversion: 2.1 time: 0.212373 Nov 02 12:01:29.066819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1254/2541] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:01:28 2022] GET /compute/v2.1/os-security-groups/92d25604-0a83-44a7-8729-5b4094f74220 => generated 194 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:01:29.085880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.086537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:29.112209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.115666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.116107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:29.122818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.130288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.130755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:29.323937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31a1476f-e5fc-4909-a32d-1d38704dae18 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "POST /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91/action" status: 202 len: 0 microversion: 2.1 time: 1.471014 Nov 02 12:01:29.330127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1288/2542] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:01:27 2022] POST /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91/action => generated 0 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:01:29.340771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Action: 'update', calling method: .version_select at 0x7ff1b389bca0>, body: {"security_group": {"name": "tempest-sg-1875438666", "description": "tempest-description-405580933"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:29.463478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:01:29.464292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Neutron security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:01:29.464979 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] HTTP exception thrown: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.464979 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Request method failure captured: Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/os-security-groups/5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 HTTP/1.1 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 101 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwVcdiCgXYlYq9TfUxVOtj1HvPbmPiekAQVWO3T_9EWmgvZEhBmpY9NmjBD_3JzNscjHnG5N50Fl4Tj3xI9IkWVFUelhyBUHpMUw3ceYR4v-wZM9Bb5uh4ZUzMENoar7fJkz7pMGRPSgkPtLOnY5lhjae8nZ6ZBmnZnHOmJAa7OWq4 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_37cb43bb61874473831880956b6f512d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/37cb43bb61874473831880956b6f512d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/37cb43bb61874473831880956b6f512d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 37cb43bb61874473831880956b6f512d Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f273b65dd28f440da8381f54233bc024 Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1572767936-project Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: {"security_group": {"name": "tempest-sg-1875438666", "description": "tempest-description-405580933"}} Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6', 'body': {'security_group': {'name': 'tempest-sg-1875438666', 'description': 'tempest-description-405580933'}}} Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:01:29.467487 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] Nov 02 12:01:29.471002 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:29.475024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] Returning 404 to user: Security group 5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 does not exist Nov 02 12:01:29.475024 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7971e321-d931-46b4-bd64-c0f4e7a6fd0f'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:29.480871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c527801b-eee1-42bb-8c95-21135846dbaa tempest-SecurityGroupsNegativeTestJSON-1572767936 tempest-SecurityGroupsNegativeTestJSON-1572767936-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6" status: 404 len: 194 microversion: 2.1 time: 0.144508 Nov 02 12:01:29.480871 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1289/2543] 10.222.0.48 () {60 vars in 1290 bytes} [Wed Nov 2 12:01:29 2022] PUT /compute/v2.1/os-security-groups/5b5f8e53-450c-464f-aff4-ba5f9d0ed0e6 => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:29.485028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d6101a0-d984-4c0a-82a7-221c17064db4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b383b9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.662683 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d6101a0-d984-4c0a-82a7-221c17064db4 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930" status: 200 len: 1414 microversion: 2.1 time: 0.184196 Nov 02 12:01:29.663610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1290/2544] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:29 2022] GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 => generated 1414 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:29.678100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b5c6623-3eda-447c-bf1b-07660d5022d1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b389bca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.737505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:29.762763 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54d4589e-00ac-4d38-9084-5f0977dcb606 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1591 microversion: 2.1 time: 0.680769 Nov 02 12:01:29.762763 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1255/2545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:29 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1591 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:29.780038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:29.780578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:29.787984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.788509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.795023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:29.795023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:29.795023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:29.795023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:29.925963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85d63e51-5111-4eb8-a38e-b422178ecdda tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151602 Nov 02 12:01:29.926927 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1256/2546] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:01:29 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:30.192408 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b5c6623-3eda-447c-bf1b-07660d5022d1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930" status: 200 len: 1414 microversion: 2.1 time: 0.518247 Nov 02 12:01:30.193290 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1291/2547] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:29 2022] GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 => generated 1414 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:30.213587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d3bc0207-2872-41c8-8b99-531bd0260d36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b32ea670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:30.965286 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d3bc0207-2872-41c8-8b99-531bd0260d36 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930" status: 204 len: 0 microversion: 2.1 time: 0.751735 Nov 02 12:01:30.968965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1257/2548] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:30 2022] DELETE /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:01:30.991545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e91fb69-931d-4b98-84aa-8598ad042bf1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b36b2550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:31.274150 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8e91fb69-931d-4b98-84aa-8598ad042bf1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e91fb69-931d-4b98-84aa-8598ad042bf1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 HTTP/1.1 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd1f848ba-0362-45b1-906c-dfd9c5560930'} Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d1f848ba-0362-45b1-906c-dfd9c5560930 Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:01:31.282777 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1f848ba-0362-45b1-906c-dfd9c5560930 could not be found. Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:31.289252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e91fb69-931d-4b98-84aa-8598ad042bf1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:31.300697 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e91fb69-931d-4b98-84aa-8598ad042bf1 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930" status: 404 len: 62 microversion: 2.1 time: 0.318997 Nov 02 12:01:31.309152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1292/2549] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:30 2022] GET /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 => generated 62 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:31.317456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:31.318881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:31.328784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:31.329914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:31.331389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:31.332617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:31.333360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:31.334037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:32.642546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:32.657384 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d12e3ad-5465-4d47-80ae-d0d4e62f0252 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1504 microversion: 2.1 time: 1.343482 Nov 02 12:01:32.664072 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1258/2550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:31 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1504 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:33.687756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:33.688771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:33.703207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:33.704375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:33.722559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:33.722559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:33.722559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:33.722559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:34.506645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:34.526448 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bd6c510-2844-4388-9f2e-e4ee582e51d8 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1499 microversion: 2.1 time: 0.843318 Nov 02 12:01:34.527842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1293/2551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:33 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1499 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:35.097869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:35.098507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:35.109866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2607e82a-cb59-420d-83ed-3e34febb4fe8", "tag": "86607663-ecc9-4afd-af9d-67c145899022"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:35.146900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.155347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.158131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.175812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.176507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.176974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.182851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.189599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.205408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.215430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] Creating event network-changed:86607663-ecc9-4afd-af9d-67c145899022 for instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 on n-h1-855649-4 Nov 02 12:01:35.232156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-84fe0a00-74c6-4685-84b7-ddd5eca82abf req-3c34b67b-b8be-41a8-963c-6d1471abc61c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126809 Nov 02 12:01:35.240027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1294/2552] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:01:35.566528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:35.568825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:35.581616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.590166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.590911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:35.596880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:35.597547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:35.598179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:36.105738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:36.168050 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-478c1c41-e864-4582-a910-cc200bddf409 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1591 microversion: 2.1 time: 1.076317 Nov 02 12:01:36.168997 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1259/2553] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:35 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1591 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:36.248980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:36.267413 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b182022f-71c9-47de-b553-93e0e9bb8d4a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1486 microversion: 2.1 time: 0.705616 Nov 02 12:01:36.280941 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1295/2554] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:35 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1486 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:36.302342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:36.303122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:36.312497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:36.313009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:36.313454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:36.314203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:36.314684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:36.357660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:36.444825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:01:37.072968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-374c817b-0b37-4350-9855-fbe0196257df tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 204 len: 0 microversion: 2.1 time: 0.775189 Nov 02 12:01:37.073867 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1260/2555] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:36 2022] DELETE /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:01:37.088831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c474479a-685b-48b7-8add-0a4f85b3a07a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b3a10b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:37.128550 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c474479a-685b-48b7-8add-0a4f85b3a07a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c474479a-685b-48b7-8add-0a4f85b3a07a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 HTTP/1.1 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd1f848ba-0362-45b1-906c-dfd9c5560930'} Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1f848ba-0362-45b1-906c-dfd9c5560930 to delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1f848ba-0362-45b1-906c-dfd9c5560930 could not be found. Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.135062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c474479a-685b-48b7-8add-0a4f85b3a07a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c474479a-685b-48b7-8add-0a4f85b3a07a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930" status: 404 len: 62 microversion: 2.1 time: 0.052066 Nov 02 12:01:37.145043 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1296/2556] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:37 2022] DELETE /compute/v2.1/images/d1f848ba-0362-45b1-906c-dfd9c5560930 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:37.148859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:37.149479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:37.156943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.157455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.157956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.158679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.159200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.159692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.199714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:01:37.317658 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Instance is already in deleting state, ignoring this request Nov 02 12:01:37.318896 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0a4028f-73ad-4c29-aaa9-52f54cda1b69 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 204 len: 0 microversion: 2.1 time: 0.174711 Nov 02 12:01:37.331524 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1261/2557] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:37 2022] DELETE /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:01:37.343140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:37.343778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:37.356607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:37.360086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.363826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.364651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.369260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:37.370200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:37.372444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:37.919577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:37.941370 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87e7d82d-f6a5-42de-9488-53b96697186a tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1492 microversion: 2.1 time: 0.608130 Nov 02 12:01:37.942970 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1297/2558] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:37 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1492 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:38.972100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:38.972100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:38.985714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:38.986309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:38.986869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:38.987760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:38.988274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:38.993995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:40.088944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:40.114887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43bb619a-5ada-48bd-a6ce-8b27b9ea1a77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1492 microversion: 2.1 time: 1.154005 Nov 02 12:01:40.123150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1262/2559] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:38 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1492 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:41.143802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:41.144522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:41.159717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:41.168191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:41.168973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:41.170075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:41.170725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:41.171422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:42.472090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:42.489832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f06b8c37-c56e-449e-b263-71d09c616d46 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1492 microversion: 2.1 time: 1.350534 Nov 02 12:01:42.496551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1298/2560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:41 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1492 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:43.527391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:43.530033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:43.559035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.560673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.564650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.569428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.571475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.572857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.656797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91", "name": "network-vif-deleted", "tag": "d2e2b938-0876-4017-9c30-d088f22e5107"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:43.699404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.702013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.705092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.733217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] Creating event network-vif-deleted:d2e2b938-0876-4017-9c30-d088f22e5107 for instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 on n-h1-855649-4 Nov 02 12:01:43.761705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:43.761705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:43.762400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-469e00fb-1ecf-4a3f-a652-8375c9968317 req-fbb5c610-f093-49aa-8ca7-5e64cd713eb7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.137180 Nov 02 12:01:43.762501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:43.762501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lazy-loading 'fault' on Instance uuid bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:01:43.787073 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1263/2561] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:43.957129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ff679110552451bb279d504c9408303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2157796c4e304204b6db4e2654d2b35d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:43.975904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c2bd070-14d8-4e14-9923-5990fa4959ca tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 200 len: 1297 microversion: 2.1 time: 0.452496 Nov 02 12:01:43.977813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1299/2562] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:43 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 1297 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:45.003466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.004373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.019347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.023733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.036285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.037274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.038300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.038940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 HTTP/1.1 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91'} Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.064084 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.069016 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-371c4b40-6f5e-4359-868a-fc7978b877d2 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91" status: 404 len: 111 microversion: 2.1 time: 0.066531 Nov 02 12:01:45.078292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.079769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.083089 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1264/2563] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:44 2022] GET /compute/v2.1/servers/bb4a41af-033c-4cf3-b8f8-1f13b8cdcf91 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.095572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.096510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.097117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.098259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.098875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.099600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.129443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 HTTP/1.1 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8fe6f1d8-28d0-436b-9244-0bfead9616d5'} Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.131468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.139963 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1941943-7960-4810-890c-505f7b7ba0e6 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 404 len: 111 microversion: 2.1 time: 0.066878 Nov 02 12:01:45.140741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1300/2564] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.149207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.150012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 8fe6f1d8-28d0-436b-9244-0bfead9616d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.158637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.160735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.162026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.163606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.164684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.165831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.190348 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 HTTP/1.1 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '8fe6f1d8-28d0-436b-9244-0bfead9616d5'} Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.192241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. Nov 02 12:01:45.195764 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.198191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 8fe6f1d8-28d0-436b-9244-0bfead9616d5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.199596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed10535-c4fe-423c-b4de-de6dd463fc6e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5" status: 404 len: 111 microversion: 2.1 time: 0.056507 Nov 02 12:01:45.200743 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1265/2565] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] GET /compute/v2.1/servers/8fe6f1d8-28d0-436b-9244-0bfead9616d5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.210489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a8c73a6-a71b-4ca8-8b7f-a238bf046e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b37a63a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.251769 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1a8c73a6-a71b-4ca8-8b7f-a238bf046e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a8c73a6-a71b-4ca8-8b7f-a238bf046e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 HTTP/1.1 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ceb7f608-6375-4230-82e8-475823b14502'} Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ceb7f608-6375-4230-82e8-475823b14502 to delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ceb7f608-6375-4230-82e8-475823b14502 could not be found. Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.257714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a8c73a6-a71b-4ca8-8b7f-a238bf046e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.262358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a8c73a6-a71b-4ca8-8b7f-a238bf046e34 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502" status: 404 len: 62 microversion: 2.1 time: 0.054842 Nov 02 12:01:45.286217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.287250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.288108 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1301/2566] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/images/ceb7f608-6375-4230-82e8-475823b14502 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:01:45.321855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.322493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.326483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.327718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.333995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.352713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.359693 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c HTTP/1.1 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd72b0e6d-8452-43e4-b6ad-621421f93b1c'} Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.366270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.370833 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.374088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.375663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdc427bb-544c-43cc-a68b-60f97710009d tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 404 len: 111 microversion: 2.1 time: 0.105236 Nov 02 12:01:45.396733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.397380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: d72b0e6d-8452-43e4-b6ad-621421f93b1c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.404941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1266/2567] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.440459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.441084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.441641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.448089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.448676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.449131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.521290 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c HTTP/1.1 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd72b0e6d-8452-43e4-b6ad-621421f93b1c'} Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.536547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance d72b0e6d-8452-43e4-b6ad-621421f93b1c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8988b43-f392-47cf-a049-4864d6436df3 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c" status: 404 len: 111 microversion: 2.1 time: 0.157575 Nov 02 12:01:45.545652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1302/2568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] GET /compute/v2.1/servers/d72b0e6d-8452-43e4-b6ad-621421f93b1c => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.565225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76850367-94c1-436b-aa35-6cc364097b42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b30ce310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.610143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-76850367-94c1-436b-aa35-6cc364097b42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76850367-94c1-436b-aa35-6cc364097b42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 HTTP/1.1 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '77f8f2a2-a311-4492-b071-757cff401903'} Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 77f8f2a2-a311-4492-b071-757cff401903 to delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77f8f2a2-a311-4492-b071-757cff401903 could not be found. Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.623140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.628011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76850367-94c1-436b-aa35-6cc364097b42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.634296 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76850367-94c1-436b-aa35-6cc364097b42 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903" status: 404 len: 62 microversion: 2.1 time: 0.056003 Nov 02 12:01:45.635537 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1267/2569] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/images/77f8f2a2-a311-4492-b071-757cff401903 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:45.644490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.645527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.686828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.689906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.690366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.691206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.691667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.692103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.723063 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 HTTP/1.1 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '103d200a-8c8d-49ed-871e-9916ea9a2163'} Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.731053 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.737708 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.739435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.740643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec7207ab-63fb-4219-86e4-13767ab5db87 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 404 len: 111 microversion: 2.1 time: 0.100584 Nov 02 12:01:45.741226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1303/2570] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.750118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.751064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 103d200a-8c8d-49ed-871e-9916ea9a2163] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.769024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.769024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.769024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.771476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.772098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.772826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.801500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 HTTP/1.1 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '103d200a-8c8d-49ed-871e-9916ea9a2163'} Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.807859 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 103d200a-8c8d-49ed-871e-9916ea9a2163 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-432dace4-9649-4581-a04f-afa0a3108c77 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163" status: 404 len: 111 microversion: 2.1 time: 0.064011 Nov 02 12:01:45.815319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1268/2571] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] GET /compute/v2.1/servers/103d200a-8c8d-49ed-871e-9916ea9a2163 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.818915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad5d30e6-5a01-4fa1-bf56-d7706cc32a7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1b399b0d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.851576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ad5d30e6-5a01-4fa1-bf56-d7706cc32a7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad5d30e6-5a01-4fa1-bf56-d7706cc32a7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 HTTP/1.1 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: exception: Image not found. Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'e6370a5a-b222-4f6b-84bd-081b21bf6c24'} Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e6370a5a-b222-4f6b-84bd-081b21bf6c24 to delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6370a5a-b222-4f6b-84bd-081b21bf6c24 could not be found. Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.853529 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad5d30e6-5a01-4fa1-bf56-d7706cc32a7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad5d30e6-5a01-4fa1-bf56-d7706cc32a7e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24" status: 404 len: 62 microversion: 2.1 time: 0.040948 Nov 02 12:01:45.867967 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1304/2572] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/images/e6370a5a-b222-4f6b-84bd-081b21bf6c24 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:45.870062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.870062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.884275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.884775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.885231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.885939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.886400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.886843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.946856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 HTTP/1.1 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '76336a1f-b324-432e-88e3-38d43e8c0160'} Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:45.952424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:45.956754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:45.957371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01948d12-4590-4f26-907e-88ec937386cb tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 404 len: 111 microversion: 2.1 time: 0.092861 Nov 02 12:01:45.960105 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1269/2573] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:45 2022] DELETE /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:45.971838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:45.972447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: 76336a1f-b324-432e-88e3-38d43e8c0160] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:45.992283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.992811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.993263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:45.995733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:45.996305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:45.996762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.058046 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 HTTP/1.1 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '76336a1f-b324-432e-88e3-38d43e8c0160'} Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.070732 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. Nov 02 12:01:46.074561 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.077472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance 76336a1f-b324-432e-88e3-38d43e8c0160 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:46.083059 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80ed5ec5-1a96-481c-9fae-d615e886272e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160" status: 404 len: 111 microversion: 2.1 time: 0.111701 Nov 02 12:01:46.088354 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1305/2574] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:45 2022] GET /compute/v2.1/servers/76336a1f-b324-432e-88e3-38d43e8c0160 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:46.093403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc11e12-10bb-4d75-8701-48734620ad99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '.version_select at 0x7ff1bbb115e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:46.477499 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dbc11e12-10bb-4d75-8701-48734620ad99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Image not found. Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc11e12-10bb-4d75-8701-48734620ad99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 HTTP/1.1 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: exception: Image not found. Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '9509354c-eea5-41fe-bbca-a2a4c434bc35'} Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9509354c-eea5-41fe-bbca-a2a4c434bc35 to delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9509354c-eea5-41fe-bbca-a2a4c434bc35 could not be found. Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.480131 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc11e12-10bb-4d75-8701-48734620ad99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Image not found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbc11e12-10bb-4d75-8701-48734620ad99 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35" status: 404 len: 62 microversion: 2.1 time: 0.393901 Nov 02 12:01:46.485041 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1270/2575] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:46 2022] DELETE /compute/v2.1/images/9509354c-eea5-41fe-bbca-a2a4c434bc35 => generated 62 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:01:46.491138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:46.491570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:46.501464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.502244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.503006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.504397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.505398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.506169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.525057 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 HTTP/1.1 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b0e8454f-78e0-4835-b09a-6d7ded72d0e6'} Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:46.526628 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:46.530259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc59b27f-b6bb-42b2-a8e4-b59658103071 tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 404 len: 111 microversion: 2.1 time: 0.041014 Nov 02 12:01:46.538423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:46.539336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] [instance: b0e8454f-78e0-4835-b09a-6d7ded72d0e6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:46.555080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.555704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.556258 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1306/2576] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:01:46 2022] DELETE /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:01:46.556715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.559436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:46.561552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:46.564347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:46.596483 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] HTTP exception thrown: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Request method failure captured: Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 HTTP/1.1 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlqjBCH6Shh7qol3JzLodfFZNHL97qkgsH2PYcJt-nEb4qiPZwh_mWDRLGaGNRi0aDd7reDYR3e0jxcRdGluwVeUq5b-ATPyNobh30AiB6zt_0w0TqjQ3N15UCxBge65cVXyOUaj6fxiAn3ZBnudSKGD1TI7dBDS7AeS78kivWiT-hQ Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2157796c4e304204b6db4e2654d2b35d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2157796c4e304204b6db4e2654d2b35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2157796c4e304204b6db4e2654d2b35d Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ImagesTestJSON-1207948141 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 0ff679110552451bb279d504c9408303 Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ImagesTestJSON-1207948141-project Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'b0e8454f-78e0-4835-b09a-6d7ded72d0e6'} Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.598057 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. Nov 02 12:01:46.601816 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:01:46.604218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] Returning 404 to user: Instance b0e8454f-78e0-4835-b09a-6d7ded72d0e6 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:01:46.605787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f17c06ab-adb4-4743-ad54-2c375230dd5e tempest-ImagesTestJSON-1207948141 tempest-ImagesTestJSON-1207948141-project] 10.222.0.48 "GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6" status: 404 len: 111 microversion: 2.1 time: 0.072834 Nov 02 12:01:46.607551 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1271/2577] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:46 2022] GET /compute/v2.1/servers/b0e8454f-78e0-4835-b09a-6d7ded72d0e6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:01:47.120733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2054755865", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "3d63d438-52c6-4f8f-a0dc-4f58acbb0884"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:47.224768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] validate_networks() for [('3d63d438-52c6-4f8f-a0dc-4f58acbb0884', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:48.393647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:48.394281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:48.394825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:48.395425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:48.395900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:48.414105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:48.416136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:48.418514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:48.419685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:48.421356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:48.422930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:48.470685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Getting quotas for project abd5b77bc3804548974c81e02f31454d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:48.484246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Getting quotas for user 32f3121a34f64914adf955be7780850e and project abd5b77bc3804548974c81e02f31454d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:48.518178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:48.524396 n-d-855649-4 devstack@n-api.service[127567]: WARNING nova.utils [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2054755865 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-205475586 Nov 02 12:01:48.525559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:48.874963 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29baaa2f-b24d-44e6-a5bd-2c089d73c07c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.293597 Nov 02 12:01:48.879027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1307/2578] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:01:48.888997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-549c00d1-f6fd-4c9e-93c7-0470caf5168c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:48.889454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-549c00d1-f6fd-4c9e-93c7-0470caf5168c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:49.053688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-549c00d1-f6fd-4c9e-93c7-0470caf5168c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:49.069942 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-549c00d1-f6fd-4c9e-93c7-0470caf5168c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1232 microversion: 2.1 time: 0.179843 Nov 02 12:01:49.071075 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1272/2579] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:48 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1232 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:49.544719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31b00da6-1dae-42d3-928c-40dfdeb18ee8 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b383bc10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:49.637277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31b00da6-1dae-42d3-928c-40dfdeb18ee8 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab" status: 200 len: 662 microversion: 2.1 time: 0.097508 Nov 02 12:01:49.637277 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1308/2580] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:49 2022] GET /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:49.648019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22c26289-6de6-47aa-9c58-83cfaa89c052 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb11ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:49.726281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22c26289-6de6-47aa-9c58-83cfaa89c052 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab" status: 200 len: 662 microversion: 2.1 time: 0.082901 Nov 02 12:01:49.728854 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1273/2581] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:49 2022] GET /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:50.093526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9772a3c3-ea50-46f6-aae0-73fd7a10dded tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:50.094410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9772a3c3-ea50-46f6-aae0-73fd7a10dded tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:50.236447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9772a3c3-ea50-46f6-aae0-73fd7a10dded tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:50.249708 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9772a3c3-ea50-46f6-aae0-73fd7a10dded tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1232 microversion: 2.1 time: 0.161526 Nov 02 12:01:50.260552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1309/2582] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:50 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1232 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:51.286553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:51.287900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:51.297742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:51.298512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:51.299224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:51.312606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:51.314160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:51.322129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:51.496857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:51.506774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e7f5f6c-af20-455a-9d81-ce0f10459b6a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1236 microversion: 2.1 time: 0.224959 Nov 02 12:01:51.509935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1274/2583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:51 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1236 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:52.546279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:52.548578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:52.564264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:52.564264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:52.564264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:52.565279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:52.566322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:52.567186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:52.699963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:52.730212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c6d1f57-e6f6-473f-8bb3-f0fedeee28fe tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1228 microversion: 2.1 time: 0.199479 Nov 02 12:01:52.731690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1310/2584] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:52 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1228 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:52.767619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1aeace37-8513-4850-9719-d0dbc84e58b7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb25ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:52.881234 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1aeace37-8513-4850-9719-d0dbc84e58b7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292" status: 200 len: 662 microversion: 2.1 time: 0.118640 Nov 02 12:01:52.882666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1275/2585] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:52 2022] GET /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292 => generated 662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:52.897303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e9c063d-7a2d-40c8-b8ed-dbbec4ffaecf tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3765ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:52.959898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e9c063d-7a2d-40c8-b8ed-dbbec4ffaecf tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292" status: 200 len: 662 microversion: 2.1 time: 0.066376 Nov 02 12:01:52.966403 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1311/2586] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:52 2022] GET /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:53.758481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:53.759131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:53.767955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.769821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.770724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.771732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:53.772696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:53.773399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:53.859222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:53.872796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5ecadb4-5012-4824-848a-5c819712d6cb tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1284 microversion: 2.1 time: 0.117709 Nov 02 12:01:53.883518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1276/2587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:53 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:54.764961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Calling method '.version_select at 0x7ff1b397d670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.769490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.770385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.770836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.830188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.830960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.832791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.866356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.867131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.867727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.893224 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-637a970d-c302-4fbe-8446-a89e2489dc5f tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1482076811-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.346760 Nov 02 12:01:54.902536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:54.904505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:54.916922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.917750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1312/2588] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:54.923521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.930880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:54.935340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:54.937248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:54.937712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:55.181011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:55.201236 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d99bb2a-e2b8-40ff-aa6f-57627647f4b3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1292 microversion: 2.1 time: 0.306178 Nov 02 12:01:55.202666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1277/2589] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:54 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1292 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:55.633597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1422157078", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "187618f9-0ea2-4688-b320-9ee5aae0805b"}], "block_device_mapping_v2": [{"uuid": "52b6e322-c027-40b6-9744-db7722a78a9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:55.783482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] validate_networks() for [('187618f9-0ea2-4688-b320-9ee5aae0805b', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:56.235086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:56.236335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:56.250569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:56.254306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:56.255595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:56.259296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:56.259296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:56.259296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:56.295027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:56.521943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:56.541494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f3c81c8-33df-4251-a3a7-a13b86d14c06 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1290 microversion: 2.1 time: 0.313283 Nov 02 12:01:56.542115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1278/2590] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:56 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1290 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:56.571133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d1be5c8-a87d-495e-a6e2-941baa928488 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb15ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:56.655116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d1be5c8-a87d-495e-a6e2-941baa928488 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9" status: 200 len: 662 microversion: 2.1 time: 0.096106 Nov 02 12:01:56.664909 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1279/2591] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:56 2022] GET /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:56.680754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-258846fe-44cf-4cb9-8499-cff25faa7b8c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b30cef70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:56.749798 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-258846fe-44cf-4cb9-8499-cff25faa7b8c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9" status: 200 len: 662 microversion: 2.1 time: 0.065466 Nov 02 12:01:56.749798 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1280/2592] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:01:56 2022] GET /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:01:56.910147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-44196204", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:56.984682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:57.549457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:57.551099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:57.552409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:57.553042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:57.553854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:57.596221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:57.601047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:57.602075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.603247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:57.603939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:57.606376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.657147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:57.661582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:57.662104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:57.662763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:57.663393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:57.672857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:57.673440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Getting quotas for user 29699172e95148b99d076a8bcfc09668 and project 285fc9da5e0f4089a8aec02963aeb4a5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:57.688521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:57.689732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:57.703595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.704970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:57.707402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:57.707402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:57.793447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Getting quotas for project dca6e43e30b14de69b5298d806679f45. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:57.827409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Getting quotas for user e95281deb7084a52a5c2e8d5bfef9eeb and project dca6e43e30b14de69b5298d806679f45. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:57.849001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:57.851220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52b6e322-c027-40b6-9744-db7722a78a9e',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:57.854794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:57.857423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:58.075996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6712039e-c778-4004-8fbb-d6db8ee205a5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169104 Nov 02 12:01:58.076948 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1281/2593] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:01:58.082965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:58.084028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:58.092705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:58.093488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:58.093943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:58.094669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:58.095177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:58.095681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:58.529320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:58.540281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ef5a36b-4dd4-4055-b461-2121f64f551b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 0.461964 Nov 02 12:01:58.555128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1282/2594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:58 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:01:58.562841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-434393632", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:01:58.641080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:01:58.817312 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40e1a6a8-570a-40d7-a530-73731ba952a9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.187812 Nov 02 12:01:58.818215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1313/2595] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:01:58.829809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da204a4b-7df5-4e00-9d68-08e779a20e42 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:58.830424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da204a4b-7df5-4e00-9d68-08e779a20e42 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:59.040739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da204a4b-7df5-4e00-9d68-08e779a20e42 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:01:59.055073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da204a4b-7df5-4e00-9d68-08e779a20e42 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1053 microversion: 2.1 time: 0.229262 Nov 02 12:01:59.055697 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1314/2596] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:58 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1053 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:01:59.454526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:01:59.455189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:01:59.455973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:01:59.456578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:01:59.457044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:01:59.469693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:59.480636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.481776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.482924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.483766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.484369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.484911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.513595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Getting quotas for project dca6e43e30b14de69b5298d806679f45. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:01:59.520075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Getting quotas for user e95281deb7084a52a5c2e8d5bfef9eeb and project dca6e43e30b14de69b5298d806679f45. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:01:59.535428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:01:59.537987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:01:59.566642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:59.572902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:01:59.578966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.580353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.581020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.582169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:01:59.583535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:01:59.584239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:01:59.591760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:01:59.817761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-604f052e-c801-4dcb-94a9-6ddc2b6efa25 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261727 Nov 02 12:01:59.819558 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1283/2597] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:01:59.835814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-975eb526-5ac1-47ee-b984-2efadab7e412 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:01:59.835814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-975eb526-5ac1-47ee-b984-2efadab7e412 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:00.036312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-975eb526-5ac1-47ee-b984-2efadab7e412 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:00.045468 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-975eb526-5ac1-47ee-b984-2efadab7e412 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1217 microversion: 2.1 time: 0.219028 Nov 02 12:02:00.046635 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1284/2598] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:59 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:00.065379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:00.078398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:00.079422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:00.082772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-327032cf-0b30-457c-8933-a7c0e57af3b8 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 0.521085 Nov 02 12:02:00.087478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1315/2599] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:01:59 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:00.089778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:00.093915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:00.094436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:00.095237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:00.096653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:00.098449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:00.315202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:00.327260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21f85505-23f5-4488-9e6a-4eab8b993143 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1103 microversion: 2.1 time: 0.249477 Nov 02 12:02:00.335290 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1285/2600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:00 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1103 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:00.975307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc114348-9be4-472f-a508-93cead96e16b", "tag": "af350749-2c20-4b44-be1a-d5ad4e4db9c6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:01.003147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.004265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.004955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.034549 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] Creating event network-changed:af350749-2c20-4b44-be1a-d5ad4e4db9c6 for instance cc114348-9be4-472f-a508-93cead96e16b on n-h2-855649-4 Nov 02 12:02:01.041885 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-aeadc22c-fcd3-4ffa-b90e-42a545eecfb2 req-244df6f0-54f7-4429-bbaa-988941e265da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071672 Nov 02 12:02:01.047428 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1286/2601] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:02:01.047909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Calling method '.version_select at 0x7ff1b370bb80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:01.072865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2c02dcb-c45b-48fe-ae29-996aa495eac4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:01.079884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2c02dcb-c45b-48fe-ae29-996aa495eac4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:01.087568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.087568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.087568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.091773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.092835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.093487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.124921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-974c8c9a-8f39-45ae-a36d-8c9b224a97d3 tempest-AbsoluteLimitsTestJSON-1528711084 tempest-AbsoluteLimitsTestJSON-1528711084-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.408196 Nov 02 12:02:01.125477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1316/2602] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Nov 2 12:02:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:01.131244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:01.132709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:01.146144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.147047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.147919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.148872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.150183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.151149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.345421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2c02dcb-c45b-48fe-ae29-996aa495eac4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:01.356988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2c02dcb-c45b-48fe-ae29-996aa495eac4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1217 microversion: 2.1 time: 0.286151 Nov 02 12:02:01.358166 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1287/2603] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:01 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:01.375158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:01.375884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:01.388184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.388529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.389008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.389727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:01.390192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:01.390624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:01.543684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:01.562417 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-218d1fc7-4c6d-47fc-907d-4d7ae260774e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1095 microversion: 2.1 time: 0.199341 Nov 02 12:02:01.563101 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1288/2604] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:01 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1095 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:01.815644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:01.838628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f387fe0f-7096-4661-ae31-5d8b41b08891 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 0.711826 Nov 02 12:02:01.842825 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1317/2605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:01 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:02.381702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:02.382340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:02.399488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.401097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.412225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:02.413184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.420604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.421169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:02.582968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:02.587816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:02.588531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:02.594527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca88fcb0-7308-4269-828c-2654ecc0db63 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1213 microversion: 2.1 time: 0.217369 Nov 02 12:02:02.603240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.604060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.605618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:02.608975 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1289/2606] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:02 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:02.615141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.615763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.616227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:02.785723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:02.799406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26739d50-c212-4e2c-a67c-c1fb91fa2c8e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1151 microversion: 2.1 time: 0.213457 Nov 02 12:02:02.818597 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1318/2607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:02 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1151 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:02.870214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:02.870868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:02.880141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.880698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.881202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:02.882265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:02.883083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:02.883979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:03.617791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:03.622696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:03.623851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:03.628192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31a07ea0-9b9a-452e-b9de-04ec4d5c1d5a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 0.761990 Nov 02 12:02:03.632098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1290/2608] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:02 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:03.634696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:03.636110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:03.638460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:03.639787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:03.640668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:03.642411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:03.828029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:03.828211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:03.872155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:03.872950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:03.873707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:03.874617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:03.875321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:03.875898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:03.944790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:03.960272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd90ba80-eaf3-4cb1-9167-5fa7585da39a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1269 microversion: 2.1 time: 0.342752 Nov 02 12:02:03.961607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1319/2609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:03 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1269 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:02:04.234935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:04.248724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76ddc4fc-af8b-47f8-ac8b-a35cc65b7929 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1169 microversion: 2.1 time: 0.425506 Nov 02 12:02:04.264779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1291/2610] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:03 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1169 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:04.661775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:04.663139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:04.684334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:04.687194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:04.687958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:04.699511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:04.699511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:04.699511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:04.947923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:04.954718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:04.970501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Searching by: {'deleted': False, 'project_id': '73c43a47405e4bc4ac64d005b5460bff'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:02:04.999038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:04.999600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.000137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.001083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.003597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.004184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.092866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:02:05.144860 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec4370d5-fa29-4ec9-8943-12ca3d2704f7 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.200777 Nov 02 12:02:05.147393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1292/2611] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:02:04 2022] GET /compute/v2.1/servers => generated 340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:05.166486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:05.167358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:05.176934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.180181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.185783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.190049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.190793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.191454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.744780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:05.755522 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57815451-fdab-4533-be50-5b16dd59988e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1287 microversion: 2.1 time: 0.606763 Nov 02 12:02:05.756818 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1293/2612] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:05 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1287 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:05.769603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:05.781459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:05.782295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Searching by: {'deleted': False, 'project_id': '73c43a47405e4bc4ac64d005b5460bff'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:02:05.807441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.808769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.809426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.810529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.811203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.814891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.823759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:05.844828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff19aaf8-29dd-40a2-b5b7-349cecb28945 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 1.185237 Nov 02 12:02:05.847241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1320/2613] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:04 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:05.872285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:05.875890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:05.894852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.897478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.898112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.900136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:05.902111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:05.905333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:05.986736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:02:06.092876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:06.103405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:06.103560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:06.104009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:06.644291 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9e3085b-ed88-49cf-b492-534931feda13 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.885598 Nov 02 12:02:06.644890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1294/2614] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:02:05 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:06.722302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:06.738034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8d2115c-abdc-45c7-8b28-ad0fc278233e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1211 microversion: 2.1 time: 0.885350 Nov 02 12:02:06.740666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1321/2615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:05 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1211 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:06.783621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e19b8d6d-ed33-46dc-bb63-b4a7727ae0e2 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:06.801928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e19b8d6d-ed33-46dc-bb63-b4a7727ae0e2 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059078 Nov 02 12:02:06.814877 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1322/2616] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:02:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:06.821523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:06.822406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:06.831942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:06.833653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:06.834420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:06.836133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:06.836758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:06.837352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:07.034951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:07.045564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8f8ee8e-dede-4dbb-a6e7-5a4e6b810250 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1275 microversion: 2.1 time: 0.229062 Nov 02 12:02:07.049020 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1323/2617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:06 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:07.063543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:07.064596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:07.080176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:07.082797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:07.084071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:07.092039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:07.098262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:07.098262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:07.262049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-27430057", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7c73d261-5263-4009-85e9-ad9c09c3bc0e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:07.482749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] validate_networks() for [('7c73d261-5263-4009-85e9-ad9c09c3bc0e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:02:08.705867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:08.721936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be4c7a9d-9632-4332-a76d-8312dedeee74 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 1.671451 Nov 02 12:02:08.722760 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1324/2618] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:07 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:08.729839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:08.730566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:08.739606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:08.742092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:08.742872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:08.743464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:08.744307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:08.745294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:08.748025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:08.824030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:02:09.123603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:09.123603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:09.123603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:09.123603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:09.123603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:09.136157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.139326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.139817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.140654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.141124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.141558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.198549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:09.209318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for user b233c50171014c42bb2c87016c696e01 and project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:09.240999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:02:09.248271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:02:09.463888 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9429108a-5a07-4c60-8dff-c232d51c255e tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 204 len: 0 microversion: 2.1 time: 0.739671 Nov 02 12:02:09.465540 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1325/2619] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:02:08 2022] DELETE /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:02:09.471997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:09.472982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:09.487155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.487907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.490035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.491030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.495875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.496608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.524184 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab77f892-254e-42d9-a793-400725c93e1a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.873179 Nov 02 12:02:09.532442 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1295/2620] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:02:09.544771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:09.545539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:09.567722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.568248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.579787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.580641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.581223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.581689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.816635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:09.825229 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76484b1b-bd25-455a-b0a1-18f863771ea2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1275 microversion: 2.1 time: 0.291480 Nov 02 12:02:09.825904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1296/2621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:09 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:09.857601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:09.858502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:09.875349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.876133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.876813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:09.878473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:09.879266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:09.883576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:10.382600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:10.401114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:10.424829 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-607757ea-1507-4ee1-8022-d75cd3e17464 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1716 microversion: 2.1 time: 0.584464 Nov 02 12:02:10.425900 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3f38ebe-52fb-47c2-8bdb-8c5b1b409d1e tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1211 microversion: 2.1 time: 0.957083 Nov 02 12:02:10.443556 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1297/2622] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:09 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1716 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:10.443705 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1326/2623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:09 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1211 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:10.456076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55e76637-b33e-413f-b408-fddfca49cfc7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:10.459941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab28a3-d4bd-4878-9cc3-1a3ffa827d52", "tag": "47892134-ad99-497b-89d7-ff35bddcfa55"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:10.466687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55e76637-b33e-413f-b408-fddfca49cfc7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:10.479772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:10.480265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:10.480732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:10.521095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] Creating event network-changed:47892134-ad99-497b-89d7-ff35bddcfa55 for instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 on n-h1-855649-4 Nov 02 12:02:10.526297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fcc58b34-df22-4973-b05a-45b73bd6a716 req-af8e07eb-21e5-4aa3-a4b5-428fd22421b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096594 Nov 02 12:02:10.527326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1327/2624] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:10.536703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:10.537800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:10.563753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:10.564267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:10.564778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:10.566055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:10.566532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:10.566994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:10.632757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55e76637-b33e-413f-b408-fddfca49cfc7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:10.656334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=27 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:10.658654 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55e76637-b33e-413f-b408-fddfca49cfc7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1216 microversion: 2.1 time: 0.226280 Nov 02 12:02:10.659595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1298/2625] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:10 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1216 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:10.867263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:10.871337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:10.896823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:10.897380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:10.897823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:10.898552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:10.899248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:10.899844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:11.084474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:11.109466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:13.061879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:13.095639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f7f0a3c-e242-4adf-9786-5c4fc8c48c4e tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 2.562814 Nov 02 12:02:13.096585 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1328/2626] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:10 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:13.112268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc114348-9be4-472f-a508-93cead96e16b", "name": "network-vif-plugged", "status": "completed", "tag": "af350749-2c20-4b44-be1a-d5ad4e4db9c6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:13.164025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.166078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.170008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.221196 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] Creating event network-vif-plugged:af350749-2c20-4b44-be1a-d5ad4e4db9c6 for instance cc114348-9be4-472f-a508-93cead96e16b on n-h2-855649-4 Nov 02 12:02:13.232197 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1e0e6c8c-e301-43bb-98f6-87131074d900 req-6d96b592-4fbc-4173-8d84-250267a54e23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133371 Nov 02 12:02:13.235353 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1329/2627] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:13.259585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:13.263737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:13.286925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.289748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.290528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.301923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.306525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.309097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.744338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:13.755465 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c257b77f-4d7f-49bd-9e34-4ccc1e5ce4a4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 2.907017 Nov 02 12:02:13.767476 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1299/2628] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:10 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 2920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:13.782930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:13.784411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:13.796682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.797589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.798400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.799376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.800001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.800593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.880051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:13.904244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-249a36c0-3902-4cfa-a098-a52578923ae1 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1649 microversion: 2.1 time: 0.661609 Nov 02 12:02:13.904244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1330/2629] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:13 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1649 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:13.924621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:13.925750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:13.941589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.942776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.943506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:13.945813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:13.946564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:13.947440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:14.313915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:14.351261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa451614-9b7d-4cd0-939d-76811ba2a820 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1268 microversion: 2.1 time: 0.428112 Nov 02 12:02:14.351261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1331/2630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:13 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1268 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:14.391069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:14.395106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:14.435436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:14.453025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:14.453993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:14.456837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:14.457436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:14.459916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.013623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:15.086292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3f06e92-3164-427d-bf8e-bc202bbedb74 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1211 microversion: 2.1 time: 1.310869 Nov 02 12:02:15.092433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1300/2631] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:13 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1211 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:15.122105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:15.123159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:15.133052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.135028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.140229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.140229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.140229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.140229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.432310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:15.451464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-674d8577-6cc9-4e8a-b324-a7b16bba702c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1332 microversion: 2.1 time: 1.093405 Nov 02 12:02:15.452404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1332/2632] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:14 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1332 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:15.459275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2607e82a-cb59-420d-83ed-3e34febb4fe8", "name": "network-vif-deleted", "tag": "86607663-ecc9-4afd-af9d-67c145899022"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:15.473664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.480221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.480221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.482592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:15.520526 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] Creating event network-vif-deleted:86607663-ecc9-4afd-af9d-67c145899022 for instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 on n-h1-855649-4 Nov 02 12:02:15.529006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3b0e703b-5e39-4a22-8cd6-715a994be9fe req-1a6b297b-56fc-48aa-9c27-ec8001b99766 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073854 Nov 02 12:02:15.530326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1333/2633] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:15.543260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:15.543260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:15.567810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.568585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.569430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.572730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.573479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.575467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.665866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:15.669123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:15.669830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:15.672076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lazy-loading 'fault' on Instance uuid 2607e82a-cb59-420d-83ed-3e34febb4fe8 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:02:16.858829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e344c30d8a47ccb3ba188c7a7ca5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c43a47405e4bc4ac64d005b5460bff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:16.867846 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3d96b8d-bded-4ef6-8a08-e12a279e8c63 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 200 len: 1368 microversion: 2.1 time: 1.335076 Nov 02 12:02:16.876490 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1334/2634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:15 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 1368 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:16.881685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:16.887674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:16.898288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:16.899171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:16.900067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:16.901189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:16.905343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:16.906193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:16.987279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:16.994289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:16.996820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42519b23-3d65-4a63-9b9d-e964eba46822 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 1.902273 Nov 02 12:02:16.997462 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1301/2635] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:15 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:17.013670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:17.024506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:17.043336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.044431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.044881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.061523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.062115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.062580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.105003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:17.119793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27ea827f-105a-4aff-8e47-3d41c2e5cbdf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1274 microversion: 2.1 time: 0.241918 Nov 02 12:02:17.135431 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1335/2636] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:16 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.166266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.759199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:17.778735 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76cff9f6-fecc-45a3-a8f8-e00d514006d3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.773453 Nov 02 12:02:17.783995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1302/2637] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:17 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:17.786214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:17.796831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a9d0c3c-d741-40e7-bab4-1c06dca19c7b", "tag": "54a5b86f-f295-40d2-be5f-a0c8343cd66b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:17.811995 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e57ba81b-7086-4fb3-8023-e6615e36e5a3 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1534 microversion: 2.1 time: 0.671277 Nov 02 12:02:17.812942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1336/2638] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:17 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1534 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:17.832979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.833474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.833922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.865309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71a008d6-bed7-4754-bc85-2e84e6afe77a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'create', calling method: .version_select at 0x7ff1b399b670>, body: {"pool": "673eecb1-78e5-4d1a-b3ef-8aece7cb5288"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:17.876655 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] Creating event network-changed:54a5b86f-f295-40d2-be5f-a0c8343cd66b for instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b on n-h1-855649-4 Nov 02 12:02:17.909783 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec981b87-39c0-4940-a6d8-ac054c62cccc req-adf3f1c1-529f-42b5-9e22-a73c94f1964d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124236 Nov 02 12:02:17.914238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1303/2639] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:17.925332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:17.927797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] [instance: 2607e82a-cb59-420d-83ed-3e34febb4fe8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:17.945361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.945853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.955703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:17.957457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:17.964616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:17.965369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:18.018208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] HTTP exception thrown: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Request method failure captured: Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 HTTP/1.1 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlvu0u-QqbgAnP6qr3pVkSpZKB9k2EKrLxM8EdemI1n4eTWR3Q72oi6ZgnlyBQfHLJhwDp49Msz9Dn8_FnWKAotM4eH9Ls1k0Rwa2m1sSEyzcnVyAvuKkXdf8ioEH6yVlGy5fHJ8DWAUBtYiaU3UNgI5J6tz3oziXbgveNg2uk_RBFM Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 73c43a47405e4bc4ac64d005b5460bff Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestManualDisk-1382977265 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73c43a47405e4bc4ac64d005b5460bff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73c43a47405e4bc4ac64d005b5460bff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73c43a47405e4bc4ac64d005b5460bff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73c43a47405e4bc4ac64d005b5460bff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestManualDisk-1382977265 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 73c43a47405e4bc4ac64d005b5460bff Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestManualDisk-1382977265 Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestManualDisk-1382977265-project Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 21e344c30d8a47ccb3ba188c7a7ca5cf Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestManualDisk-1382977265-project Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2607e82a-cb59-420d-83ed-3e34febb4fe8'} Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:18.024151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Returning 404 to user: Instance 2607e82a-cb59-420d-83ed-3e34febb4fe8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:02:18.029206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2b0024e-480f-4bab-8357-ba5d5a93cc24 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8" status: 404 len: 111 microversion: 2.1 time: 0.110940 Nov 02 12:02:18.032653 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1304/2640] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:17 2022] GET /compute/v2.1/servers/2607e82a-cb59-420d-83ed-3e34febb4fe8 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:02:18.042879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:18.044334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:18.072007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:18.072849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:18.074164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:18.075440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:18.076110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:18.077864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:18.686073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:18.692318 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4cef894-13d3-4bc6-88a9-4d1c6e682dab tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.656390 Nov 02 12:02:18.708841 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1305/2641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:18 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:18.718530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b562ffc-3ebb-4418-80c4-bebf86b94520 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] Calling method '.version_select at 0x7ff1bbb11160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:18.835606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b562ffc-3ebb-4418-80c4-bebf86b94520 tempest-ServersTestManualDisk-1382977265 tempest-ServersTestManualDisk-1382977265-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356986075" status: 202 len: 0 microversion: 2.1 time: 0.125570 Nov 02 12:02:18.842354 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1306/2642] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356986075 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:18.852322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:18.855419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:18.869807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:18.872926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:18.873654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:18.876951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:18.877625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:18.880272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:19.162685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:19.973721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:19.985048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08fd1090-1225-418e-bf4b-9ad6954294fe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 1.141249 Nov 02 12:02:19.992437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1307/2643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:18 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:20.004380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:20.010815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:20.044814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:20.048784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:20.052007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:20.058026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:20.058997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:20.059968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:21.391833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:21.409800 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b728937-010f-4483-b90b-28de20a2e69c tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 1.415881 Nov 02 12:02:21.412042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1308/2644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:19 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:21.418285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:21.420153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:21.426939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:21.432186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:21.433261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:21.434217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:21.434843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:21.435491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:21.805022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:21.833019 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92581392-ad31-4c85-bdc4-8874db4e1d93 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.416537 Nov 02 12:02:21.849209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1309/2645] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:21 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:21.860216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:21.885830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:21.886334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:21.886772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:21.908546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] Creating event network-changed:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:02:21.922846 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6fad9b5b-f328-4aa8-996d-1cff58c7ee03 req-871d0b71-e39c-40f4-87dc-862d3218a1f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077780 Nov 02 12:02:21.929057 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1310/2646] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:21.949194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:21.949969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:21.969541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:21.970074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:21.970523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:21.971504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:21.972134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:21.972718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:22.131538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:22.629184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:22.641570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c27a435-48c6-45c3-89c4-af9ce2f20db7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.711159 Nov 02 12:02:22.645734 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1311/2647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:21 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:23.149475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-977d2513-0795-461e-9c5e-2ea3b23bc125 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1b2ff2550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-208752069", "description": "tempest-description-1683546176"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:24.040709 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71a008d6-bed7-4754-bc85-2e84e6afe77a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.172165 Nov 02 12:02:24.040709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1337/2648] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:02:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:02:24.049338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:24.052085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:24.064796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.065642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.066303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:24.067086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.067825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.068622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:24.624082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-977d2513-0795-461e-9c5e-2ea3b23bc125 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.975371 Nov 02 12:02:24.625466 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1312/2649] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:24.645602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:24.647013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:24.667699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.669060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.671311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:24.680785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.680785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.680785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:24.940659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:24.970994 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-380dc576-a58c-4c54-acc1-a3ee06ace4f0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.927768 Nov 02 12:02:24.970994 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1338/2650] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:24 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:24.978080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:24.979493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:24.992514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.993773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.994669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:24.995727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:24.997205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:24.997908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:26.244454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:26.263464 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a75f115e-f7dd-4099-926e-48ce441b9d50 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 1.623900 Nov 02 12:02:26.264255 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1313/2651] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:24 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:26.271579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f4b294-ab0d-41f0-84aa-89b3227d546a", "tag": "6b77c7b8-505e-4949-a41f-9f680d0eec8e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:26.290606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:26.291597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:26.292290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:26.328202 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] Creating event network-changed:6b77c7b8-505e-4949-a41f-9f680d0eec8e for instance 64f4b294-ab0d-41f0-84aa-89b3227d546a on n-h2-855649-4 Nov 02 12:02:26.347777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f71533ea-ba5e-43e7-8358-dca600afa1e8 req-6bc301a9-943f-4997-bcde-6a972a0fabe9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082050 Nov 02 12:02:26.357637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1314/2652] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:26.357637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: .version_select at 0x7ff1b9436f70>, body: {"addFloatingIp": {"address": "172.25.8.226"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:26.363399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:26.374992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:26.375902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:26.376577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:26.378411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:26.379218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:26.380162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:26.449716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:26.462414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d5bda4c-cbea-4c89-8a59-b76da401b0a6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 1.494595 Nov 02 12:02:26.466010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1339/2653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:24 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:26.480320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04162572-aaaa-4892-a555-f93030d10ba2 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1b3ecf040>, body: {"security_group_rule": {"parent_group_id": "bb02c28c-bf85-42dd-929e-d689e014d3ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:26.509604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:02:26.510453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquired lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:02:27.990815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04162572-aaaa-4892-a555-f93030d10ba2 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.520539 Nov 02 12:02:28.002834 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1340/2654] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:28.014726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:28.016117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:28.033424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.034386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.034939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:28.035760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.037013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.037558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:28.448613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:28.461293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8edfe84b-adee-4087-84e9-45ea489de167 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.456133 Nov 02 12:02:28.463076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1341/2655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:28 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:28.469180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:28.470210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:28.477209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.478034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.478639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:28.480216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.481644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.482643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:28.947894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:28.962169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c539c70-ef21-4662-a86c-cb7165d8f3e4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.497016 Nov 02 12:02:28.966575 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1342/2656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:28 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:28.972672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:28.973548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:28.981051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.981786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.982811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:28.984086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:28.988347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:28.988953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:29.806718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:29.833022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fc49ea0-a0d2-4d9f-a658-898816901e83 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.866238 Nov 02 12:02:29.835069 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1343/2657] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:28 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:29.850037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac28baa8-3de3-40c3-8124-f581bfcbb740 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1b3dd8040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1123930212", "description": "tempest-description-1077854009"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:30.140192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:02:30.827125 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac28baa8-3de3-40c3-8124-f581bfcbb740 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.989850 Nov 02 12:02:30.828758 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1344/2658] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:30.843960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:30.844598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:30.856011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:30.856516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:30.856962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:30.857958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:30.858594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:30.859202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:31.325083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Updating instance_info_cache with network_info: [{"id": "af350749-2c20-4b44-be1a-d5ad4e4db9c6", "address": "fa:16:3e:5a:98:db", "network": {"id": "3d63d438-52c6-4f8f-a0dc-4f58acbb0884", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-65409856-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd5b77bc3804548974c81e02f31454d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaf350749-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:02:31.382480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:31.401454 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59626eb3-5828-4016-a371-5b1e31079706 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.570837 Nov 02 12:02:31.404167 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1345/2659] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:30 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:31.411371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-plugged", "status": "completed", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:31.425027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:31.425851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:31.426463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:31.448791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] Creating event network-vif-plugged:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:02:31.455736 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-95a1b2ea-172c-4d0e-aa69-47264c7728ca req-28fad488-621c-4b6d-8850-9d2ab1536974 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048257 Nov 02 12:02:31.457115 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1346/2660] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:31.462135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Releasing lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:02:31.462135 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72c83cbf-b99a-4e98-b0a4-40127c54bae5 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 202 len: 0 microversion: 2.1 time: 5.108083 Nov 02 12:02:31.462135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1315/2661] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:26 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 0 bytes in 5110 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:02:31.465160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:31.466205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:31.479939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:31.481438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:31.482259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:31.483881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:31.484581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:31.485576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:31.489794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc114348-9be4-472f-a508-93cead96e16b", "tag": "af350749-2c20-4b44-be1a-d5ad4e4db9c6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:31.531540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:31.536996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:31.537571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:31.540082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:31.560828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] Creating event network-changed:af350749-2c20-4b44-be1a-d5ad4e4db9c6 for instance cc114348-9be4-472f-a508-93cead96e16b on n-h2-855649-4 Nov 02 12:02:31.567145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-63b13d01-ebad-4e9c-b105-e069c4ca607c req-a86c6c40-2616-44bc-adee-f9918088bc4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105530 Nov 02 12:02:31.569438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1316/2662] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:31.576893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0cb1511-2772-48d2-bf2d-a822bd07cfd2 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bba8e550>, body: {"security_group_rule": {"parent_group_id": "d0902281-1746-476b-bc47-3950bf7d64a5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:32.080401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:32.112774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1192fc39-93a9-4f2c-a8e9-d9de1a4a17a0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.651805 Nov 02 12:02:32.114351 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1347/2663] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:31 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:32.170362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:32.175335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:32.220056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:32.227237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:32.229098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:32.231397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:32.232551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:32.233643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:32.576451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:32.588885 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-683b3933-7fab-49d5-8714-1e614c159ca0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.457868 Nov 02 12:02:32.591470 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1348/2664] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:32 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:32.604382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c76c38-1ef9-4488-bd39-e0a53c7f7612 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'create', calling method: .version_select at 0x7ff1b36b2310>, body: {"pool": "673eecb1-78e5-4d1a-b3ef-8aece7cb5288"} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:32.821047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0cb1511-2772-48d2-bf2d-a822bd07cfd2 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.249106 Nov 02 12:02:32.825283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1317/2665] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:32.850592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:32.853880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:32.896596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:32.898832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:32.899349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:32.901328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:32.902567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:32.903811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:33.710519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:33.724801 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcec6040-daa5-48e5-be2d-310dd6761697 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.895817 Nov 02 12:02:33.726033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1318/2666] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:32 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:33.738553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06f0db3f-f4a8-4ac5-b627-2cc0a9c51129 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbb11790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-549750804", "description": "tempest-description-843425939"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:34.812195 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06f0db3f-f4a8-4ac5-b627-2cc0a9c51129 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.077054 Nov 02 12:02:34.817668 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1319/2667] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:33 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:34.833882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:34.837455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:34.858651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:34.859284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:34.860138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:34.861126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:34.861995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:34.909110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:35.367852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:35.388609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d865a489-9c53-4298-9dbd-6af8d6b4efcb tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.568782 Nov 02 12:02:35.390566 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1320/2668] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:34 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:35.401117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:35.402213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:35.454743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:35.456031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:35.456940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:35.458186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:35.460623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:35.465563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:36.329325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:36.342551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7b5cbd3-ca31-4f68-b2a8-4d2606d4f98c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.949810 Nov 02 12:02:36.343190 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1321/2669] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:35 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:36.348597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d0c3c-d741-40e7-bab4-1c06dca19c7b", "name": "network-vif-plugged", "status": "completed", "tag": "54a5b86f-f295-40d2-be5f-a0c8343cd66b"}, {"server_uuid": "4fab28a3-d4bd-4878-9cc3-1a3ffa827d52", "name": "network-vif-plugged", "status": "completed", "tag": "47892134-ad99-497b-89d7-ff35bddcfa55"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:36.360207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:36.360704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:36.361138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:36.378137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Creating event network-vif-plugged:54a5b86f-f295-40d2-be5f-a0c8343cd66b for instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b on n-h1-855649-4 Nov 02 12:02:36.378929 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] Creating event network-vif-plugged:47892134-ad99-497b-89d7-ff35bddcfa55 for instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 on n-h1-855649-4 Nov 02 12:02:36.387739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f8780191-4b68-4cc2-8685-bc12a50a987b req-6d0709db-3575-4669-a926-35110626884a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042462 Nov 02 12:02:36.388527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1322/2670] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:36.393662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:36.396052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:36.417680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:36.418623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:36.419629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:36.421091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:36.422077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:36.423126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:37.092550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:37.107782 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df3dcb99-1faf-41c7-a450-96297c8587fd tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1199 microversion: 2.1 time: 0.717222 Nov 02 12:02:37.119053 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1323/2671] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:36 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1199 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:37.119053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f298e70-6762-4054-920d-9c93dd2fce25 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbb11790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1248924249", "description": "tempest-description-1974767571"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:37.480484 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c76c38-1ef9-4488-bd39-e0a53c7f7612 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.887596 Nov 02 12:02:37.483790 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1349/2672] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:02:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:37.492767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25b6b181-07ca-4fc0-8626-4e3c6056b15b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Action: 'create', calling method: .version_select at 0x7ff1b3714550>, body: {"keypair": {"name": "tempest-keypair-199933078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvh6VxH2TvQumQArsZj3sMLjeaMJb8jVJK8M1bHAmFrOPp5HH5jYcwI3eo3DZ3ktMdB3DZsLdldfk2lhEGYNRn4VcIBAhB2FFni5eV9G5MkZVAGFTbRZwixIO0OzbHSxA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:37.528891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-25b6b181-07ca-4fc0-8626-4e3c6056b15b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Getting quotas for project 1cbd89dc180e42ca9337a58e9348efc5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:37.536757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-25b6b181-07ca-4fc0-8626-4e3c6056b15b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Getting quotas for user 697b00bb715f446f98a3e11f7617e001 and project 1cbd89dc180e42ca9337a58e9348efc5. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:37.665392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25b6b181-07ca-4fc0-8626-4e3c6056b15b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.179716 Nov 02 12:02:37.671265 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1350/2673] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 12:02:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:02:37.677034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:37.677669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:37.684563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:37.685250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:37.685696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:37.686416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:37.686881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:37.688025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.032824 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f298e70-6762-4054-920d-9c93dd2fce25 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.921763 Nov 02 12:02:38.034124 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1324/2674] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:37 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:38.048857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:38.055832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:38.056980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:38.066646 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78384898-e720-4226-b1af-92201fa0c282 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1317 microversion: 2.1 time: 0.399377 Nov 02 12:02:38.067635 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1351/2675] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:37 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:38.068771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.069520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.070060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.070946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.071606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.072686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.079664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: .version_select at 0x7ff1b9436f70>, body: {"addFloatingIp": {"address": "172.25.8.153"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:38.091371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:38.099986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.104516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.105173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.106011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:38.107300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:38.107979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:38.193683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:02:38.194093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquired lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:02:38.335346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:38.354544 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9c2f044-c609-4bbd-b770-9f43edfa792d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.315578 Nov 02 12:02:38.354544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1325/2676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:38 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:38.362148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cd6ee5c-bf0a-445d-9208-795ae91a2f27 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bba558b0>, body: {"security_group_rule": {"parent_group_id": "8d1e5d81-c1b9-49c8-b409-4d7c29df94fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f970e436-0d1c-46d3-8182-3555a554ad98"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:39.596630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288.", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:02:39.597250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Releasing lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:02:39.598312 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.598312 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Request method failure captured: Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action HTTP/1.1 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 46 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwqEMoVQG7egz4rqlslsLnhx7WZJ2N3tKFNdQD_ShTnNubpZ8q-OD3kbUGFgsbtMV5NjjrpdH3n17_AK3m4BiQjCxvvw73zEiQaKggNGtEsxivH4K0VyFPhjpLg35H-eYO2nZH85JYjsC5TYbWkKKJNXfBXC87Y8jdx0BcZ4k9o4n8 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd5b77bc3804548974c81e02f31454d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 32f3121a34f64914adf955be7780850e Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: {"addFloatingIp": {"address": "172.25.8.153"}} Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'cc114348-9be4-472f-a508-93cead96e16b', 'body': {'addFloatingIp': {'address': '172.25.8.153'}}} Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:02:39.600960 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] Nov 02 12:02:39.609716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Returning 400 to user: Cannot associate floating IP 172.25.8.153 (3c188474-5f41-4915-aaff-a70128628e3c) with port af350749-2c20-4b44-be1a-d5ad4e4db9c6 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 673eecb1-78e5-4d1a-b3ef-8aece7cb5288. Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-b1316198-116b-42e7-bbe7-e51c8b6edd5c'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf9e9e43-3952-4f82-9128-a8eed0ed7054 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 400 len: 381 microversion: 2.1 time: 1.533782 Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1352/2677] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:38 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 381 bytes in 1535 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:39.616945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:39.624346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:39.624838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:39.625330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:39.626019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:39.626481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:39.626906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.122382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:40.134752 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7323354a-a952-44ea-a544-de614a191972 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1383 microversion: 2.1 time: 0.530280 Nov 02 12:02:40.142067 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1353/2678] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:39 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1383 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:40.147504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b294-ab0d-41f0-84aa-89b3227d546a", "name": "network-vif-plugged", "status": "completed", "tag": "6b77c7b8-505e-4949-a41f-9f680d0eec8e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:40.174081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.174636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.175144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.217603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] Creating event network-vif-plugged:6b77c7b8-505e-4949-a41f-9f680d0eec8e for instance 64f4b294-ab0d-41f0-84aa-89b3227d546a on n-h2-855649-4 Nov 02 12:02:40.223608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b4610219-c0c3-4843-b442-603534f360bc req-87a195c8-7363-4615-a067-14ec779567d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079959 Nov 02 12:02:40.224616 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1354/2679] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:40.243540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:40.243540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:40.256615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.257427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.258104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.260056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.264216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.264900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.474360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5cd6ee5c-bf0a-445d-9208-795ae91a2f27 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.119786 Nov 02 12:02:40.491148 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1326/2680] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:38 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:40.497980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:40.498618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:40.516165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.516792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.517119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:40.517932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:40.518450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:40.518907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:41.032233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:41.040160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:41.045933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:41.047070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02fa1589-f2ae-465d-bba7-30a4e610b9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1316 microversion: 2.1 time: 0.552265 Nov 02 12:02:41.054154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1327/2681] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:40 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:41.071620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-465cd5d5-f6d7-41a3-bacf-887d3436d002 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '.version_select at 0x7ff1bba9c4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:41.073786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f25c9e5-ca99-4d01-85c0-297c2d8fa28a tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1467 microversion: 2.1 time: 0.847767 Nov 02 12:02:41.087012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1355/2682] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:40 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1467 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:41.399322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:41.400144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:41.402246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:41.408480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:41.408978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:41.409557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:41.410355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:41.410886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:41.411535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:42.098819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:42.102524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75d4467e-ce03-473b-be9f-c390c5753f95 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1534 microversion: 2.1 time: 1.024492 Nov 02 12:02:42.103718 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1356/2683] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:41 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1534 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:42.110733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e87e4ce-cd6e-4ebf-96f2-c3342a1471cd tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbafa550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-823148620", "description": "tempest-description-2098433016"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:43.158696 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e87e4ce-cd6e-4ebf-96f2-c3342a1471cd tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.051483 Nov 02 12:02:43.161186 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1357/2684] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:43.176641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:43.178530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:43.193474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.194187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.195536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.198024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.200212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.202098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.236351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-465cd5d5-f6d7-41a3-bacf-887d3436d002 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3c188474-5f41-4915-aaff-a70128628e3c" status: 202 len: 0 microversion: 2.1 time: 2.180764 Nov 02 12:02:43.237965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1328/2685] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:02:41 2022] DELETE /compute/v2.1/os-floating-ips/3c188474-5f41-4915-aaff-a70128628e3c => generated 0 bytes in 2183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:43.245267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:43.247619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:43.253192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.254230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.254681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.255434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.255894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.256326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.519963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:43.529334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b7fa427-cb29-4817-993b-b7eee7931c88 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1506 microversion: 2.1 time: 0.289104 Nov 02 12:02:43.530205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1329/2686] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:43 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:43.552594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:43.553687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:43.555182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:43.561901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.562408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.562860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.563627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:43.565639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:43.566112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:43.567593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87b687e0-ed24-4d81-a2a1-96eccb5d5516 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1466 microversion: 2.1 time: 0.404827 Nov 02 12:02:43.568483 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1358/2687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:43 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1466 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:43.577895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed378a98-de97-4b98-b422-5760772d5ab0 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbafa550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-844339100", "description": "tempest-description-1615493143"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:43.890024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a80bab5e-be51-4b99-9ae0-bf0653ca9a51 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1534 microversion: 2.1 time: 0.357757 Nov 02 12:02:43.890646 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1330/2688] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:43 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1534 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:43.897659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: .version_select at 0x7ff1b9436ee0>, body: {"removeFloatingIp": {"address": "172.25.8.226"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:44.262699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:44.276932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.277771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.278666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.280210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:44.281285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:44.282165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:44.536214 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed378a98-de97-4b98-b422-5760772d5ab0 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.965790 Nov 02 12:02:44.537707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1359/2689] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:44.543815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1300356607", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "934e0957-da83-4688-ac58-7a5acdb8cfa8"}, {"port": "eadf8d60-0c26-45e9-b1bc-480e455004ef", "tag": "port-1"}, {"port": "13fc1c9d-d40d-44c2-aa1b-815471bf931b", "tag": "port-2"}, {"uuid": "5e1585f2-8b63-42e1-aa88-18a22a511b52", "tag": "net-1"}, {"uuid": "5e1585f2-8b63-42e1-aa88-18a22a511b52"}, {"uuid": "9abef72a-a305-45f2-93b7-c57413753253", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9abef72a-a305-45f2-93b7-c57413753253", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "153ffb4d-301c-482f-aadc-cb35748d7f5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "369c58dd-31cc-4f9f-a2aa-b7ce24b0c0e9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "56978fcf-1a81-4661-91a2-203abf0f4050", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1645027865"}], "key_name": "tempest-keypair-199933078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:45.231894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:02:45.232660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquired lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:02:45.260219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] validate_networks() for [('934e0957-da83-4688-ac58-7a5acdb8cfa8', None, None, None, None, None), (None, None, 'eadf8d60-0c26-45e9-b1bc-480e455004ef', None, None, None), (None, None, '13fc1c9d-d40d-44c2-aa1b-815471bf931b', None, None, None), ('5e1585f2-8b63-42e1-aa88-18a22a511b52', None, None, None, None, None), ('5e1585f2-8b63-42e1-aa88-18a22a511b52', None, None, None, None, None), ('9abef72a-a305-45f2-93b7-c57413753253', '10.2.2.100', None, None, None, None), ('9abef72a-a305-45f2-93b7-c57413753253', '10.2.2.200', None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:02:46.810372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:02:47.552417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:48.010371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Updating instance_info_cache with network_info: [{"id": "af350749-2c20-4b44-be1a-d5ad4e4db9c6", "address": "fa:16:3e:5a:98:db", "network": {"id": "3d63d438-52c6-4f8f-a0dc-4f58acbb0884", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-65409856-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd5b77bc3804548974c81e02f31454d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaf350749-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:02:48.166330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Releasing lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:02:48.167249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4552e1f8-85bb-451c-ad6e-bd9a7e84db6d tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 202 len: 0 microversion: 2.1 time: 4.275414 Nov 02 12:02:48.169441 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1331/2690] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:43 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 0 bytes in 4278 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:02:48.175653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:48.176286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:48.213218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:48.214102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:48.232334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:48.237274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:48.238038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:48.238537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:48.684961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:48.700487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-caf586a0-ec35-4c51-a533-bb5ad4b0c66c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1506 microversion: 2.1 time: 0.529875 Nov 02 12:02:48.704203 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1332/2691] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:48 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:48.710034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1931896791"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:48.713074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:48.726437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:48.727271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:48.727920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:48.728866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:48.729524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:48.730208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:49.499803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-480ca0c1-9b63-4322-9e70-b199d1f55674 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "POST /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8/action" status: 202 len: 0 microversion: 2.1 time: 0.793490 Nov 02 12:02:49.514491 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1333/2692] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:48 2022] POST /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:02:49.521182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:49.530532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:49.557116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27cc33a5-92eb-498e-84bf-ad151b86c90d tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040344 Nov 02 12:02:49.557762 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1334/2693] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 12:02:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:49.562836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acbd18e2-78ad-4d9f-abf3-f3843cfd4c75 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbb4d1f0>, body: {"security_group_rule": {"parent_group_id": "79b80a02-a893-41c1-8fa9-b21fed124c78", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "feb4b286-ff5c-4e1d-89f5-563282a476ec"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:49.645905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:49.646813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:49.647873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:49.648948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:49.649697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:49.668135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:49.668834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:49.670307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:49.672608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:49.673639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:49.674343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:49.722439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Getting quotas for project 1cbd89dc180e42ca9337a58e9348efc5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:49.734842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Getting quotas for user 697b00bb715f446f98a3e11f7617e001 and project 1cbd89dc180e42ca9337a58e9348efc5. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:50.018233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:02:50.021622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='153ffb4d-301c-482f-aadc-cb35748d7f5b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='369c58dd-31cc-4f9f-a2aa-b7ce24b0c0e9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56978fcf-1a81-4661-91a2-203abf0f4050',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:02:50.302694 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acbd18e2-78ad-4d9f-abf3-f3843cfd4c75 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.743721 Nov 02 12:02:50.303547 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1335/2694] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:49 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:50.374491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1872310077", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:50.447406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] validate_networks() for [('dc66a32c-6f2b-4312-b723-7b0cd2c081d0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:02:50.888902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:50.889633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:50.889873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:50.890288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:50.890741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:50.902162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:50.902703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:50.903302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:50.904178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:50.904653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:50.905180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:50.928148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:50.935543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for user e61ff49dd4424227ab6c623289ef4a14 and project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:50.951410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:02:50.954420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:02:51.151720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66025868-697d-4f8e-bbc7-60daed83a963 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.846867 Nov 02 12:02:51.153409 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1336/2695] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:02:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:02:51.157980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc114348-9be4-472f-a508-93cead96e16b", "tag": "af350749-2c20-4b44-be1a-d5ad4e4db9c6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:51.169252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:51.169752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:51.170366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:51.190254 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] Creating event network-changed:af350749-2c20-4b44-be1a-d5ad4e4db9c6 for instance cc114348-9be4-472f-a508-93cead96e16b on n-h2-855649-4 Nov 02 12:02:51.190254 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-813fddd1-aa6d-4662-954d-a20a1caa515a req-f2e612d4-9194-485c-9bcb-5882939d1f23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032737 Nov 02 12:02:51.191278 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1337/2696] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:51.196479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82b3f9b3-1874-4a08-bf53-a8acfd47816c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '.version_select at 0x7ff1bba8e310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:51.608354 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59da90d8-ce5f-4b16-aa52-6ec239b5f979 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.069232 Nov 02 12:02:51.610201 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1360/2697] 10.222.0.48 () {62 vars in 1189 bytes} [Wed Nov 2 12:02:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 7072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:02:51.616947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:51.621641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:51.632100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:51.633122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:51.633725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:51.634702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:51.635421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:51.636009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:51.737753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:51.738206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:51.738930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:51.739452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:51.739877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:52.109197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:52.117974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:52.119152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:52.119911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:52.121137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:52.121829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:52.122542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:52.173681 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6ea7c62-f55b-42d5-8b45-64e46578db3d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "POST /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a/action" status: 202 len: 1108 microversion: 2.1 time: 0.562026 Nov 02 12:02:52.174449 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1361/2698] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:51 2022] POST /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a/action => generated 1108 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:02:52.181656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89152dda-8fdf-4740-8650-adaa897f421f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3714dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:52.240975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89152dda-8fdf-4740-8650-adaa897f421f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.063382 Nov 02 12:02:52.242356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1362/2699] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:02:52 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:52.247784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-855649-4", "block_migration": false, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:52.250360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:52.259080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:52.259833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:52.260499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:52.262103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:52.262799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:52.263311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:52.319065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lazy-loading 'flavor' on Instance uuid 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:02:52.336977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Going to try to live migrate instance to n-h2-855649-4 {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:02:53.083858 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82b3f9b3-1874-4a08-bf53-a8acfd47816c tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/f3bcfca5-187c-4c60-96cc-e8e942f95c48" status: 202 len: 0 microversion: 2.1 time: 1.888814 Nov 02 12:02:53.083858 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1338/2700] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:02:51 2022] DELETE /compute/v2.1/os-floating-ips/f3bcfca5-187c-4c60-96cc-e8e942f95c48 => generated 0 bytes in 1890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:53.094925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7aa8da42-07f3-4ed3-9146-7591ab0ead75 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1bbb1daf0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:53.454710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7aa8da42-07f3-4ed3-9146-7591ab0ead75 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/feb4b286-ff5c-4e1d-89f5-563282a476ec" status: 202 len: 0 microversion: 2.1 time: 0.370844 Nov 02 12:02:53.458095 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1339/2701] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:02:53 2022] DELETE /compute/v2.1/os-security-groups/feb4b286-ff5c-4e1d-89f5-563282a476ec => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:53.473327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:53.475842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:53.486029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:53.486820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:53.490242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:53.493962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:53.494634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:53.496258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:53.630522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:53.639632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-492d6df0-3f9b-4a38-8c10-1c5ae8a31aca tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1226 microversion: 2.1 time: 0.179747 Nov 02 12:02:53.640272 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1340/2702] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:53 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:53.644999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:53.646245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:53.744061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:53.754603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:53.758528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:53.760073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c017a566-918e-431d-94b2-5b9a45ed33eb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1285 microversion: 2.32 time: 0.118813 Nov 02 12:02:53.776313 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1341/2703] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:02:53 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:02:53.786272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:53.787237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:53.794638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:53.795502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:53.796400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:53.797349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:53.798006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:53.798672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:54.025423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:54.040173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bcba062e-9b7f-4c3b-9166-a1467ce7c23e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.261771 Nov 02 12:02:54.043478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1342/2704] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:53 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:54.055123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16d20c9b-711e-4d2d-a85d-550ac8a81255 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16d20c9b-711e-4d2d-a85d-550ac8a81255 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Request method failure captured: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action HTTP/1.1 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 34 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwqEMoVQG7egz4rqlslsLnhx7WZJ2N3tKFNdQD_ShTnNubpZ8q-OD3kbUGFgsbtMV5NjjrpdH3n17_AK3m4BiQjCxvvw73zEiQaKggNGtEsxivH4K0VyFPhjpLg35H-eYO2nZH85JYjsC5TYbWkKKJNXfBXC87Y8jdx0BcZ4k9o4n8 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd5b77bc3804548974c81e02f31454d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 32f3121a34f64914adf955be7780850e Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: {"addFloatingIp": {"address": ""}} Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc114348-9be4-472f-a508-93cead96e16b', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:02:54.059279 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16d20c9b-711e-4d2d-a85d-550ac8a81255 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16d20c9b-711e-4d2d-a85d-550ac8a81255 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 400 len: 142 microversion: 2.1 time: 0.016310 Nov 02 12:02:54.063752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1343/2705] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:54 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:02:54.067995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7d7abdd-8830-4823-bbed-e1eac6aabf42 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba9c8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:54.121774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7d7abdd-8830-4823-bbed-e1eac6aabf42 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.058543 Nov 02 12:02:54.130175 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1344/2706] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:02:54 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:54.135590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f059a58-fc9e-4a7a-a7f4-1a005f5ac531 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1bba558b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:54.202198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f059a58-fc9e-4a7a-a7f4-1a005f5ac531 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/79b80a02-a893-41c1-8fa9-b21fed124c78" status: 200 len: 247 microversion: 2.1 time: 0.069853 Nov 02 12:02:54.207127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1345/2707] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:02:54 2022] GET /compute/v2.1/os-security-groups/79b80a02-a893-41c1-8fa9-b21fed124c78 => generated 247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:54.212889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1431965956", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:54.271163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] validate_networks() for [('dc66a32c-6f2b-4312-b723-7b0cd2c081d0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:02:54.788321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:02:54.788756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:02:54.789239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:02:54.789692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:02:54.790109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:02:54.799864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:54.803706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:54.803706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:54.803706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:54.803706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:54.803706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:54.820995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:02:54.826403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for user e61ff49dd4424227ab6c623289ef4a14 and project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:02:54.839483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:02:54.841924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:02:55.059275 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7861397e-77de-451f-97da-c83ac4b292aa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.850054 Nov 02 12:02:55.061171 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1346/2708] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:02:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:02:55.068006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:55.070900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:55.077780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:55.078555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:55.079066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:55.079882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:55.080350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:55.080785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:55.119472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:02:55.119883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquired lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:02:55.368112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Releasing lock "refresh_cache-cc114348-9be4-472f-a508-93cead96e16b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:02:55.368707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] HTTP exception thrown: floating IP not found Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Request method failure captured: Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action HTTP/1.1 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 41 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwqEMoVQG7egz4rqlslsLnhx7WZJ2N3tKFNdQD_ShTnNubpZ8q-OD3kbUGFgsbtMV5NjjrpdH3n17_AK3m4BiQjCxvvw73zEiQaKggNGtEsxivH4K0VyFPhjpLg35H-eYO2nZH85JYjsC5TYbWkKKJNXfBXC87Y8jdx0BcZ4k9o4n8 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd5b77bc3804548974c81e02f31454d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 32f3121a34f64914adf955be7780850e Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: exception: floating IP not found Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc114348-9be4-472f-a508-93cead96e16b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 12:02:55.370951 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Returning 404 to user: floating IP not found {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbefda35-887f-4518-b317-d703bc53de36 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 404 len: 67 microversion: 2.1 time: 0.309131 Nov 02 12:02:55.375486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1347/2709] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:55 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 67 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:02:55.385660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23e0000f-461c-4ecb-bd0d-0e5259aec4a0 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbb55b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-670839521", "description": "tempest-description-1721144973"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:56.395777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23e0000f-461c-4ecb-bd0d-0e5259aec4a0 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.021267 Nov 02 12:02:56.406926 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1348/2710] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:02:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:56.412694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:56.413368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:56.438457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:56.439272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:56.439745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:56.440507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:56.440979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:56.441504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:56.768080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:56.789085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:56.791569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:56.796529 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36c2c013-3941-4fcc-a884-8aa10ab6abf3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1575 microversion: 2.32 time: 0.387707 Nov 02 12:02:56.798888 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1349/2711] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:02:56 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1575 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:02:56.805423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:56.807236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:56.816873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:56.817385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:56.821478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:56.822378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:56.822874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:56.823371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.029332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:57.029332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a751d0e-79ea-4a1b-857f-167753ac5528 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.227150 Nov 02 12:02:57.029332 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1350/2712] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:56 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:57.034459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:57.038082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:57.044770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.045654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.046342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.047193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.048007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.048651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.128586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:57.137628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7e8e0a6-a90b-4037-9864-8de5efeb4327 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1226 microversion: 2.1 time: 0.106727 Nov 02 12:02:57.138327 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1351/2713] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:57 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:57.143542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9cc1550-0e4f-432f-aab5-7e260da5c498 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba8ee50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:57.192098 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9cc1550-0e4f-432f-aab5-7e260da5c498 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.052203 Nov 02 12:02:57.193003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1352/2714] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:02:57 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:57.198363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f104551-5ae7-4622-84f1-bac79f50ac3a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:57.266460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5f104551-5ae7-4622-84f1-bac79f50ac3a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f104551-5ae7-4622-84f1-bac79f50ac3a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Request method failure captured: Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action HTTP/1.1 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 44 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwqEMoVQG7egz4rqlslsLnhx7WZJ2N3tKFNdQD_ShTnNubpZ8q-OD3kbUGFgsbtMV5NjjrpdH3n17_AK3m4BiQjCxvvw73zEiQaKggNGtEsxivH4K0VyFPhjpLg35H-eYO2nZH85JYjsC5TYbWkKKJNXfBXC87Y8jdx0BcZ4k9o4n8 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd5b77bc3804548974c81e02f31454d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 32f3121a34f64914adf955be7780850e Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP not found for address 0.0.0.0. Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc114348-9be4-472f-a508-93cead96e16b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 12:02:57.268137 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f104551-5ae7-4622-84f1-bac79f50ac3a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:02:57.274532 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f104551-5ae7-4622-84f1-bac79f50ac3a tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action" status: 404 len: 88 microversion: 2.1 time: 0.075234 Nov 02 12:02:57.276059 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1353/2715] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:57 2022] POST /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b/action => generated 88 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:02:57.291895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-plugged", "status": "completed", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:57.323137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.324544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.324640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.336000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-535e3b60-4b25-4b8f-a2cb-875741763813 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52/action" status: 202 len: 0 microversion: 2.1 time: 5.092456 Nov 02 12:02:57.337350 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1363/2716] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:02:52 2022] POST /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52/action => generated 0 bytes in 5094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:02:57.354149 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] Creating event network-vif-plugged:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:02:57.356579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6df2895c-d4ad-4bfb-98ea-91c0bd6fcd67 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1b370be50>, body: {"security_group_rule": {"parent_group_id": "452e026b-4a0b-491d-87cf-633972b55531", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:57.373046 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6ea05d60-a809-425f-9201-2b6c2c8d6342 req-e3c2a029-712f-470c-828e-427de732ec1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094176 Nov 02 12:02:57.382399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1354/2717] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:57.390371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:57.392030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:57.399726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.401043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.401969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.405011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:57.405774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:57.407558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:57.488701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:02:57.608035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:58.047607 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01f06862-f9ae-4d91-aa8d-6f2a5fcd4e07 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 204 len: 0 microversion: 2.1 time: 0.663439 Nov 02 12:02:58.048359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1355/2718] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:02:57 2022] DELETE /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:02:58.065659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:58.066626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:58.084827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.088091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.088091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.088091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.088091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.089513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.400591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6df2895c-d4ad-4bfb-98ea-91c0bd6fcd67 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.062000 Nov 02 12:02:58.401946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1364/2719] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:02:58.407524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:58.408640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:58.415659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.416432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.417058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.417897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.421457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.421457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.580700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:58.596747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:58.600002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:58.601499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f639d4d6-78a1-454d-b87b-a8372064e2fe tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1583 microversion: 2.32 time: 0.197713 Nov 02 12:02:58.603279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1365/2720] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:02:58 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1583 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:02:58.615440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:58.624321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:58.624751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1f2428e-e4a4-4d4f-9cf5-1822947dfbd1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.572630 Nov 02 12:02:58.626633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:58.628992 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1356/2721] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:58 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:58.635649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:58.637302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:58.642896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.643472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.644560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.645850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.647247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.648332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.664263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.665205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.666179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:58.667614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:58.668431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:58.670033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.011233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:59.021103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e25e6ac-2779-4986-9f2c-72114e1baf2d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.414889 Nov 02 12:02:59.022383 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1366/2722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:58 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:59.030596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:59.031609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:59.058377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.060657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:59.061925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.063769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.065288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.066357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.068223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.074860 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e763f3c9-b250-48e9-ac40-52ae1714e486 tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1540 microversion: 2.1 time: 0.442876 Nov 02 12:02:59.081890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1357/2723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:58 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1540 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:59.083070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f042899b-a1d7-4d8b-a2db-18b117d40383 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb1dc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:59.180830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f042899b-a1d7-4d8b-a2db-18b117d40383 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.103395 Nov 02 12:02:59.191296 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1358/2724] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:02:59 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:59.196577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-797f1785-2656-46a0-ab83-dec04e67bc3b tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Action: 'create', calling method: .version_select at 0x7ff1bbaad8b0>, body: {"security_group_rule": {"parent_group_id": "452e026b-4a0b-491d-87cf-633972b55531", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:02:59.251639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:02:59.264455 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a13dd27-ba19-4f3c-aba7-aeafac5420c8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1274 microversion: 2.1 time: 0.240503 Nov 02 12:02:59.268102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1367/2725] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:02:59 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:02:59.633533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:02:59.635112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:02:59.644129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.645765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.646550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.647861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:02:59.648349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:02:59.648786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:02:59.705640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:02:59.747576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:00.083940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:00.106892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:00.110337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:00.112750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-967c232c-7cf9-45e0-8956-fd93732a598f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1593 microversion: 2.32 time: 0.483470 Nov 02 12:03:00.113393 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1368/2726] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:02:59 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1593 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:00.122770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:00.123688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:00.146088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.146966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.147678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:00.149002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.149723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.169684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:00.595543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:00.610268 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77004742-7643-4551-b8ca-1d571db84a7b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.495808 Nov 02 12:03:00.611637 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1369/2727] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:00 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:00.641550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:00.645370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:00.661447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.663521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.664752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:00.666956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:00.669418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:00.670080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.139676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:01.153978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5ce5b16-127f-4b42-a8f7-d56cafcc27a1 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.540015 Nov 02 12:03:01.156424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1370/2728] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:00 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:01.166451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:01.169781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:01.181491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.181994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.190623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.191828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.192497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.192946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.486303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-797f1785-2656-46a0-ab83-dec04e67bc3b tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 2.293499 Nov 02 12:03:01.486969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1359/2729] 10.222.0.48 () {60 vars in 1195 bytes} [Wed Nov 2 12:02:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:01.492910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23d2db00-c35f-40e8-8961-23bfdf9c2498 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba0ba60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:01.615864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23d2db00-c35f-40e8-8961-23bfdf9c2498 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.127470 Nov 02 12:03:01.616457 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1360/2730] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:01 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:01.637842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:01.647530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:01.693055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.693592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.694053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.694804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:01.711359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:01.711942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:01.719000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f3121a34f64914adf955be7780850e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd5b77bc3804548974c81e02f31454d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:01.765574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0fd21e5-5652-43e9-a9f0-b4938386737b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 200 len: 1498 microversion: 2.1 time: 0.603663 Nov 02 12:03:01.787245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1371/2731] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:01 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 1498 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:02.003482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc114348-9be4-472f-a508-93cead96e16b", "name": "network-vif-deleted", "tag": "af350749-2c20-4b44-be1a-d5ad4e4db9c6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:02.031232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.034174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.035026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.074694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] Creating event network-vif-deleted:af350749-2c20-4b44-be1a-d5ad4e4db9c6 for instance cc114348-9be4-472f-a508-93cead96e16b on n-h2-855649-4 Nov 02 12:03:02.086571 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2b9efcf6-7d44-4fe9-81d4-9a91267c1f04 req-5bd41c97-4942-4b44-931d-78b51ab61083 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295976 Nov 02 12:03:02.089154 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1372/2732] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:02.119678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:02.124582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:02.154718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.155661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.156401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.157346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.158013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.158445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.231152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:02.233175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3772c31d-8c25-4d26-9ed3-58d3e6d60139 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1292 microversion: 2.1 time: 0.615686 Nov 02 12:03:02.233769 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1361/2733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:01 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1292 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:02.238682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913d268b-12de-473f-b12a-32516fe6c52d", "tag": "a8399d01-2b5b-4627-9639-e2bcf8897fb0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:02.249410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.250413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.251110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.271328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] Creating event network-changed:a8399d01-2b5b-4627-9639-e2bcf8897fb0 for instance 913d268b-12de-473f-b12a-32516fe6c52d on n-h2-855649-4 Nov 02 12:03:02.279195 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-827306e6-9542-4a7b-96da-99ff8b3ad5b9 req-cbb1473a-eaa5-4e6e-9785-9257bb6c9fb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043617 Nov 02 12:03:02.281569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1362/2734] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:02.286698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30ebf28a-656b-4a8d-a90d-cfacb2dd8ddd tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1bba558b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:02.460796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:02.483496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:02.483496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:02.483496 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-110870fb-c41f-49fa-ac12-861284597145 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1593 microversion: 2.32 time: 0.390827 Nov 02 12:03:02.485326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1373/2735] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:02 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1593 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:02.501537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:02.502164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:02.508880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.509378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.509882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.510545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.511032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.512089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.750205 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30ebf28a-656b-4a8d-a90d-cfacb2dd8ddd tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/452e026b-4a0b-491d-87cf-633972b55531" status: 200 len: 664 microversion: 2.1 time: 0.467460 Nov 02 12:03:02.752064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1363/2736] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:03:02 2022] GET /compute/v2.1/os-security-groups/452e026b-4a0b-491d-87cf-633972b55531 => generated 664 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:02.765384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:02.767016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:02.779194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.780001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.780628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:02.781546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:02.784438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:02.785199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.077556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:03.081429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:03.097524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b51e9f1b-4e65-4f8a-9962-164cc0ba357a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.609360 Nov 02 12:03:03.098182 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1374/2737] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:02 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:03.114832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e464de05-d835-48ac-8883-cbbb3d781d96 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b37148b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.211984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e464de05-d835-48ac-8883-cbbb3d781d96 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.110607 Nov 02 12:03:03.213329 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1375/2738] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:03 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:03.226348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-761d1d69-d091-4974-ac2a-5a7eb3a282fb tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b3815820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.396347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:03.409147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56397bf2-8dde-427e-93a1-692e4c649ffe tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.655792 Nov 02 12:03:03.410578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1364/2739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:02 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:03.423702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.424807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] [instance: cc114348-9be4-472f-a508-93cead96e16b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:03.434746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:03.437205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.442150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.442788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.443840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.444743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.446144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.474648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] HTTP exception thrown: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Request method failure captured: Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b HTTP/1.1 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwqEMoVQG7egz4rqlslsLnhx7WZJ2N3tKFNdQD_ShTnNubpZ8q-OD3kbUGFgsbtMV5NjjrpdH3n17_AK3m4BiQjCxvvw73zEiQaKggNGtEsxivH4K0VyFPhjpLg35H-eYO2nZH85JYjsC5TYbWkKKJNXfBXC87Y8jdx0BcZ4k9o4n8 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd5b77bc3804548974c81e02f31454d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd5b77bc3804548974c81e02f31454d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd5b77bc3804548974c81e02f31454d Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052 Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 32f3121a34f64914adf955be7780850e Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc114348-9be4-472f-a508-93cead96e16b'} Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. Nov 02 12:03:03.485220 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. Nov 02 12:03:03.490839 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:03:03.493014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] Returning 404 to user: Instance cc114348-9be4-472f-a508-93cead96e16b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:03.494138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2ca4fc9-8cac-4f42-9677-eddec948101b tempest-FloatingIPsAssociationNegativeTestJSON-989241052 tempest-FloatingIPsAssociationNegativeTestJSON-989241052-project] 10.222.0.48 "GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b" status: 404 len: 111 microversion: 2.1 time: 0.083015 Nov 02 12:03:03.501904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1365/2740] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:03 2022] GET /compute/v2.1/servers/cc114348-9be4-472f-a508-93cead96e16b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:03:03.512245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:03.515895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:03.540181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.540909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.543723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:03.548997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:03.548997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:03.548997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:04.811498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:04.829874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:04.834332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:04.844401 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b44f3c2-37b0-41a5-af24-f21072036249 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 1.340974 Nov 02 12:03:04.858542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1366/2741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:03 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:04.858542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:04.859589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:04.876590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:04.880260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:04.880925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:04.882878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:04.884837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:04.887623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:05.055866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-761d1d69-d091-4974-ac2a-5a7eb3a282fb tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/70b8c6c4-fdec-4211-bf26-ebe575f6cfa7" status: 202 len: 0 microversion: 2.1 time: 1.837969 Nov 02 12:03:05.058338 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1376/2742] 10.222.0.48 () {58 vars in 1287 bytes} [Wed Nov 2 12:03:03 2022] DELETE /compute/v2.1/os-security-group-rules/70b8c6c4-fdec-4211-bf26-ebe575f6cfa7 => generated 0 bytes in 1842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:05.070177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:05.070720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:05.109961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:05.109961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:05.109961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:05.120312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:05.125734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:05.126401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:05.433862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:05.451813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:05.464236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:05.473517 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a66eb093-8a2b-4b98-a496-a1c1375d16bd tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1661 microversion: 2.32 time: 0.619681 Nov 02 12:03:05.490488 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1367/2743] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:04 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1661 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:05.496534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50c19328-d612-49c7-848f-4ec949a11be2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbaaf0d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:05.587406 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50c19328-d612-49c7-848f-4ec949a11be2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.095311 Nov 02 12:03:05.588902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1368/2744] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:05 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:05.604758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:05.606100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:05.624189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:05.626176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:05.626176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:05.626940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:05.627434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:05.631087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:05.761186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:05.784251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e741969-d17d-4962-a51c-e71bed7c1363 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.725835 Nov 02 12:03:05.788875 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1377/2745] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:05 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:05.811290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee13a506-5b7d-494c-b452-4adb2e78a513 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b3e229d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:06.370324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:06.390507 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7c2d435-16e6-4a3c-9a1e-34d0b75eda8a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 0.793170 Nov 02 12:03:06.396471 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1369/2746] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:05 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:06.416083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:06.417866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:06.438718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:06.440279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:06.441086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:06.443253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:06.444028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:06.444648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.023715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:08.034813 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d9c307d-2fa9-4284-9566-9a1459791c88 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 1.637072 Nov 02 12:03:08.038573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1370/2747] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:06 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:08.061564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:08.062532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:08.082421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.086102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.086884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.087789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.088473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.089932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.418055 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee13a506-5b7d-494c-b452-4adb2e78a513 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/452e026b-4a0b-491d-87cf-633972b55531" status: 202 len: 0 microversion: 2.1 time: 2.626396 Nov 02 12:03:08.442335 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1378/2748] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:05 2022] DELETE /compute/v2.1/os-security-groups/452e026b-4a0b-491d-87cf-633972b55531 => generated 0 bytes in 2629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:08.442335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89bf9222-69e3-4e18-9363-01cbb447caaf tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba50040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:08.534798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89bf9222-69e3-4e18-9363-01cbb447caaf tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.110752 Nov 02 12:03:08.540951 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1379/2749] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:08 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:08.566651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:08.583097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:08.648974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.657060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.657060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:08.664093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:08.667180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:08.670195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:09.015550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:09.034128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:09.037981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:09.042353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f22f3422-ff32-4d50-b3cc-69b671a0c43a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1661 microversion: 2.32 time: 0.996894 Nov 02 12:03:09.054098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1371/2750] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:08 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1661 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:09.060051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:09.060966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:09.069479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:09.069884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:09.070338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:09.071143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:09.071956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:09.072098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.135141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:10.149883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16275d66-0827-45c6-954a-ad584080609a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.605668 Nov 02 12:03:10.153591 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1380/2751] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:08 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:10.167252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b37143a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.377362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:03:10.377978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Neutron security group feb4b286-ff5c-4e1d-89f5-563282a476ec not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:03:10.378609 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] HTTP exception thrown: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.378609 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Request method failure captured: Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/feb4b286-ff5c-4e1d-89f5-563282a476ec HTTP/1.1 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlxNlxIFHFtqRXZrQmVu4RBBwsGWyJ9NwXR8cK1FtoP98cO6UFnhHuUcOskoBz9GtSaS_k4rYZteges3HAXECdhXD24LdxlAXAgdNSMjcEKYwmfcvZsMBZsVfl9WZw1DETxby5CqMSKcsmBf-dNEJ7ORH6shdPbVDJITU4QsrNWCqTw Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6b2156713d1d4c77bfe9adfbb0bf6f85 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1392707127 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b2156713d1d4c77bfe9adfbb0bf6f85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b2156713d1d4c77bfe9adfbb0bf6f85", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b2156713d1d4c77bfe9adfbb0bf6f85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b2156713d1d4c77bfe9adfbb0bf6f85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1392707127 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6b2156713d1d4c77bfe9adfbb0bf6f85 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1392707127 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupRulesTestJSON-1392707127-project Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e15f6b9590d04c379a91c0873ed54f26 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1392707127-project Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'feb4b286-ff5c-4e1d-89f5-563282a476ec'} Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:03:10.381040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Returning 404 to user: Security group feb4b286-ff5c-4e1d-89f5-563282a476ec does not exist Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-4b795d7b-f8c3-4902-ad8c-50e8f03ffefa'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69ddfdcf-9540-4ca2-9337-5673970c76c6 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/feb4b286-ff5c-4e1d-89f5-563282a476ec" status: 404 len: 194 microversion: 2.1 time: 0.226928 Nov 02 12:03:10.385640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1381/2752] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:10 2022] DELETE /compute/v2.1/os-security-groups/feb4b286-ff5c-4e1d-89f5-563282a476ec => generated 194 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:03:10.397099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.398491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:10.419593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.422178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:10.422649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.422865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.427029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.427513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.427975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.437719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ef65ddc-e5c1-4204-bb12-24c9738a418f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 1.382351 Nov 02 12:03:10.439614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1372/2753] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:09 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:10.454023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a3838c-a50d-4cc9-ba70-6ed331052732", "tag": "31f8d285-61e4-4afd-a77b-1ac5c8611a7f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:10.497814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.498330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.498775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.553063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] Creating event network-changed:31f8d285-61e4-4afd-a77b-1ac5c8611a7f for instance d9a3838c-a50d-4cc9-ba70-6ed331052732 on n-h2-855649-4 Nov 02 12:03:10.560983 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b9d010e9-9fce-42af-be16-fa4581943e3a req-77eec5c1-5e1d-44b3-a33b-4ee1d5666cee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120011 Nov 02 12:03:10.572261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1373/2754] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:10.579202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b53d8237-7253-477f-97f9-10347ac442b0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba2a670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.661474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b53d8237-7253-477f-97f9-10347ac442b0 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.087420 Nov 02 12:03:10.680166 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1374/2755] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:10 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:10.692200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:10.693926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:10.702774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.703777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.704467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:10.705391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:10.706012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:10.706591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:11.078393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:11.096018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51816702-9545-40ee-9d06-08643f5f1fc4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.711637 Nov 02 12:03:11.097564 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1382/2756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:10 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:11.104360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed7cdaee-04e4-410c-9124-ef41fafd7915 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b3815c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:11.327230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:11.346925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:11.349359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:11.367122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c2068ad-309b-497e-9c5e-367a4223ee15 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1708 microversion: 2.32 time: 0.676835 Nov 02 12:03:11.368387 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1375/2757] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:10 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1708 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:11.379985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:11.392041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:11.406700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:11.407235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:11.407677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:11.412302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:11.413116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:11.413792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:12.338569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:12.348214 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-796bdc01-d8ea-4f2e-b7a8-f215209147cc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.972881 Nov 02 12:03:12.358215 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1376/2758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:11 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:12.375409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:12.376067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:12.393193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:12.393694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:12.394144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:12.396821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:12.398808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:12.399856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:12.982079 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed7cdaee-04e4-410c-9124-ef41fafd7915 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/79b80a02-a893-41c1-8fa9-b21fed124c78" status: 202 len: 0 microversion: 2.1 time: 1.882886 Nov 02 12:03:12.985501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1383/2759] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:11 2022] DELETE /compute/v2.1/os-security-groups/79b80a02-a893-41c1-8fa9-b21fed124c78 => generated 0 bytes in 1887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:12.997286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccad14a1-9f6b-4391-b6d4-c585a39e610d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9a08b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:13.132668 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccad14a1-9f6b-4391-b6d4-c585a39e610d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.145702 Nov 02 12:03:13.133348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1384/2760] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:12 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:13.148626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913d268b-12de-473f-b12a-32516fe6c52d", "name": "network-vif-plugged", "status": "completed", "tag": "a8399d01-2b5b-4627-9639-e2bcf8897fb0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:13.204576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.206713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.209922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.251710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] Creating event network-vif-plugged:a8399d01-2b5b-4627-9639-e2bcf8897fb0 for instance 913d268b-12de-473f-b12a-32516fe6c52d on n-h2-855649-4 Nov 02 12:03:13.266449 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a6c14bfb-12a5-489d-9cea-8eaa28c7c094 req-3f223561-e0a4-45a5-912a-9a0d1311b053 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127462 Nov 02 12:03:13.271058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1385/2761] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:13.282301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:13.287890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:13.310751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.311737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.312528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.314909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.316552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.319662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.347481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:13.369550 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87019a8e-b892-40e3-a44e-c5aa9fda5a15 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1513 microversion: 2.1 time: 1.005385 Nov 02 12:03:13.374437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1377/2762] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:12 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1513 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:13.388724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:13.391699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:13.416839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.417326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.417881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.423989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:13.424633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:13.428545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:13.809607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:13.823388 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c943600-9593-4a0c-9e67-2fbe4c59544b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.550521 Nov 02 12:03:13.841680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1386/2763] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:13 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:13.857932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97621cfc-6d31-4032-8731-777a2a81cf37 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1bb995790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:14.151878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:14.199436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:14.213534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:14.226910 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f375563c-a956-41ce-b5b9-ec5df4f5ea03 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1755 microversion: 2.32 time: 0.847668 Nov 02 12:03:14.227922 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1378/2764] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:13 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1755 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:14.248068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:14.263879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:14.282501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:14.291869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:14.294588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:14.303222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:14.303774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:14.312541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:15.734448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:15.738003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:15.747871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-274c89a4-9d18-48a8-b384-491a67e3fab2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.510992 Nov 02 12:03:15.786224 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1379/2765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:14 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:15.794254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19afdd8f-5a53-4bdc-be66-8dd96002c66e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb08310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:15.936975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19afdd8f-5a53-4bdc-be66-8dd96002c66e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.148077 Nov 02 12:03:15.946936 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1380/2766] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:15 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:15.962169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:15.963188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:15.981801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:15.986420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:15.987713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:15.988484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:15.988958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:15.989402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.372407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97621cfc-6d31-4032-8731-777a2a81cf37 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f970e436-0d1c-46d3-8182-3555a554ad98" status: 202 len: 0 microversion: 2.1 time: 2.529435 Nov 02 12:03:16.376289 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1387/2767] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:13 2022] DELETE /compute/v2.1/os-security-groups/f970e436-0d1c-46d3-8182-3555a554ad98 => generated 0 bytes in 2531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:16.379863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:16.380581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:16.399842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:16.403807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.404325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.404772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.405497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.405966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.406393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.851778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:16.852155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:16.858482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af31cb81-4791-4b83-a99f-7a67cc41ddbf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.483414 Nov 02 12:03:16.860365 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff7c09c4-3b97-4529-988e-e4734ddb1b16 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.911729 Nov 02 12:03:16.864948 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1381/2768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:15 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:16.875573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:16.876210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:16.889766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1388/2769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:16 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:16.892521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.892521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.894750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.895980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:16.897503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:16.905662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:16.911006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43f5934b-f327-4979-aa8f-e1efe0e8a47d tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b36c7940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:17.485430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:17.499988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:17.508305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:17.520566 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-462e9088-d99c-4f93-a70f-8ce258379065 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1755 microversion: 2.32 time: 0.654358 Nov 02 12:03:17.521421 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1382/2770] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:16 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1755 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:17.527914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:17.528808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:17.545314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:17.546084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:17.546914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:17.547903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:17.551659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:17.552401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:17.975113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:17.983709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-104ffae6-9de0-4b78-a547-5f856ab887e1 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.460034 Nov 02 12:03:17.984297 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1383/2771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:17 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:17.988923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c884160d-f1b3-4225-a8bc-e8e4ccf2495e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b350c3a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.040389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c884160d-f1b3-4225-a8bc-e8e4ccf2495e tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.055001 Nov 02 12:03:18.041122 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1384/2772] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:17 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:18.046763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.047447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:18.054886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.055458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.055906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.057282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.057763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.059000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.210536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:18.221182 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1fb078b-705c-4b0f-b286-a5d5228bfef8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.178807 Nov 02 12:03:18.222057 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1385/2773] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:18 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:18.228008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.228561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:18.235968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.236464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.236937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.237713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.238176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.238606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.410297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:18.454258 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-907b6bf9-2363-4590-a76e-6e708a9b1c3f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.199739 Nov 02 12:03:18.454258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1386/2774] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:18 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:18.457160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43f5934b-f327-4979-aa8f-e1efe0e8a47d tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8d1e5d81-c1b9-49c8-b409-4d7c29df94fb" status: 202 len: 0 microversion: 2.1 time: 1.539917 Nov 02 12:03:18.457160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1389/2775] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:16 2022] DELETE /compute/v2.1/os-security-groups/8d1e5d81-c1b9-49c8-b409-4d7c29df94fb => generated 0 bytes in 1541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:18.458050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32e0d89f-8261-4cb8-9c63-befd81df8c41 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1b3d175e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.551715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:18.552610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:18.565628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.566963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.567669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:18.569432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:18.570144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:18.570833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.397823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:19.424459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:19.426577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:19.428203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb3afe9f-cb3a-4e40-b1ff-25a99e07f9be tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1802 microversion: 2.32 time: 0.881350 Nov 02 12:03:19.428801 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1390/2776] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:18 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1802 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:19.437760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a3838c-a50d-4cc9-ba70-6ed331052732", "name": "network-vif-plugged", "status": "completed", "tag": "31f8d285-61e4-4afd-a77b-1ac5c8611a7f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:19.452651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.453909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.454752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.478750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] Creating event network-vif-plugged:31f8d285-61e4-4afd-a77b-1ac5c8611a7f for instance d9a3838c-a50d-4cc9-ba70-6ed331052732 on n-h2-855649-4 Nov 02 12:03:19.491978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67fbd9dd-de4d-4dfe-bfec-92c276b514a0 req-811ff5d5-e6c1-41a7-80a8-7ea5438f3084 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057361 Nov 02 12:03:19.493589 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1391/2777] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:19.504238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:19.506075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:19.519568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.520804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.521807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.523222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.525923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.526347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.715129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:19.724416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4342ca38-dbc0-4323-99a8-f81f551f73cb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.228996 Nov 02 12:03:19.725153 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1392/2778] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:19 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:19.730308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5efa770e-4ba9-4718-924c-489c76ad5cb5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3714310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:19.748133 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32e0d89f-8261-4cb8-9c63-befd81df8c41 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d0902281-1746-476b-bc47-3950bf7d64a5" status: 202 len: 0 microversion: 2.1 time: 1.310676 Nov 02 12:03:19.749359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1387/2779] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:18 2022] DELETE /compute/v2.1/os-security-groups/d0902281-1746-476b-bc47-3950bf7d64a5 => generated 0 bytes in 1313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:19.758103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:19.761656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:19.766373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.766886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.767818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.783242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.783740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.784369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.801564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5efa770e-4ba9-4718-924c-489c76ad5cb5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1453 microversion: 2.1 time: 0.074903 Nov 02 12:03:19.803372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1393/2780] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:19 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:19.822078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:19.823596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:19.835396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.838193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.838193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:19.839433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:19.840572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:19.841495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:20.091232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:20.105938 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6ed1042-c2c6-4a30-939f-0276226ae1eb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.354474 Nov 02 12:03:20.110462 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1388/2781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:19 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:20.139799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69d028b6-1f76-4666-874c-f17c44eeb7a3 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] Calling method '.version_select at 0x7ff1bbb084c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:20.362892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:20.372591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a0a78ec-aebb-43e8-a334-10a48d1f2bbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.567945 Nov 02 12:03:20.376909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1394/2782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:19 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:20.486880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:20.493155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:20.527914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:20.530217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:20.533732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:20.534842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:20.535736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:20.536446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:21.044420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:21.055715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:21.057196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:21.058473 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4f51b8f-89e4-4f68-872d-069798cd71cb tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1802 microversion: 2.32 time: 0.582460 Nov 02 12:03:21.059147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1395/2783] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:20 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1802 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:21.063813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:21.064674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:21.078657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:21.079468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:21.080096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:21.081134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:21.081592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:21.082019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:21.257838 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69d028b6-1f76-4666-874c-f17c44eeb7a3 tempest-SecurityGroupRulesTestJSON-1392707127 tempest-SecurityGroupRulesTestJSON-1392707127-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/bb02c28c-bf85-42dd-929e-d689e014d3ba" status: 202 len: 0 microversion: 2.1 time: 1.145384 Nov 02 12:03:21.258825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1389/2784] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:03:20 2022] DELETE /compute/v2.1/os-security-groups/bb02c28c-bf85-42dd-929e-d689e014d3ba => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:03:21.263865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8d39fab-cdf0-4f47-bcfd-3c419a5d658b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba60af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:21.342959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8d39fab-cdf0-4f47-bcfd-3c419a5d658b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1462 microversion: 2.1 time: 0.082483 Nov 02 12:03:21.344605 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1390/2785] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:21 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:21.356870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:21.357548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:21.365398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:21.366227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:21.366922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:21.367931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:21.368618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:21.369538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:21.887566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:21.949023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad1c5597-42f5-45d3-89ce-28d5f3656729 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.888519 Nov 02 12:03:21.971038 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1396/2786] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:21 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:21.981909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9ac6fd5-09d3-45d1-b24f-c9433a26594b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba50310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:22.049246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9ac6fd5-09d3-45d1-b24f-c9433a26594b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 200 len: 1462 microversion: 2.1 time: 0.075014 Nov 02 12:03:22.053449 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1397/2787] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:21 2022] GET /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 1462 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:22.056447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:22.057305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:22.064645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.065710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.066379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.067326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.067971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.068597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.162052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:22.172720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49b42346-cbb0-4f34-b124-5d403e9a7019 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.826663 Nov 02 12:03:22.173314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1391/2788] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:21 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:22.192773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b294-ab0d-41f0-84aa-89b3227d546a", "name": "network-vif-unplugged", "status": "completed", "tag": "6b77c7b8-505e-4949-a41f-9f680d0eec8e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:22.209068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.210179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.211514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.231878 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] Creating event network-vif-unplugged:6b77c7b8-505e-4949-a41f-9f680d0eec8e for instance 64f4b294-ab0d-41f0-84aa-89b3227d546a on n-h2-855649-4 Nov 02 12:03:22.241067 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1625ebc1-f7ee-4b80-955d-eeaaf8c572dd req-b8a6b06e-d2a5-4e79-b25e-1fbc91ca68e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061145 Nov 02 12:03:22.243362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1392/2789] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:22.254185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:22.255279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:22.264493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.272156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.272156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.272156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.272156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.272156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.479887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:22.501259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b25d74fe-acc3-4044-840b-48e8d4d18008 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1322 microversion: 2.1 time: 0.449726 Nov 02 12:03:22.520209 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1398/2790] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:22 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:22.527482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:22.528402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:22.535757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.536665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.537344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:22.538334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:22.539117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:22.540380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.018094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.030411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61776de9-722a-4883-b948-7517373c0727 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1466 microversion: 2.1 time: 0.783115 Nov 02 12:03:23.031067 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1393/2791] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:22 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1466 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:23.041866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:23.046545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:23.067475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.067980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.068423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.069148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.081737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.082371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.337740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.348965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.350504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.351757 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d80bd14-00ab-4566-a153-0c5d4e8222f2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1849 microversion: 2.32 time: 0.830000 Nov 02 12:03:23.353818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1399/2792] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:22 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1849 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:23.368108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1744990356"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:23.378229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:23.393105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.393603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.394114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.394779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.401504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.402553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.757449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:23.772112 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35ab41a8-2fc8-4d94-a120-96a861e042e2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.739192 Nov 02 12:03:23.772972 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1394/2793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:23 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:23.791368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:23.793615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:23.805354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.806264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.806945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:23.809418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:23.810234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:23.810948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.184342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d586a362-3c3d-4da1-bb8c-601c571fbf36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "POST /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b/action" status: 202 len: 0 microversion: 2.1 time: 0.813417 Nov 02 12:03:24.191321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1400/2794] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:03:23 2022] POST /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:03:24.198148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:24.202042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:24.234217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.234731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.239151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.240021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.242261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.242723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.472447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:24.488890 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d7a4570-c20d-4ec5-b83d-662fdebce179 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.714585 Nov 02 12:03:24.490251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1395/2795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:23 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:24.517539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce391c63-6cff-401f-aa99-165b8d003502 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9c64c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:24.634918 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce391c63-6cff-401f-aa99-165b8d003502 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.139142 Nov 02 12:03:24.636670 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1396/2796] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:24 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:24.642264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b294-ab0d-41f0-84aa-89b3227d546a", "name": "network-vif-plugged", "status": "completed", "tag": "6b77c7b8-505e-4949-a41f-9f680d0eec8e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:24.672273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.675664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.676304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.693388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] Creating event network-vif-plugged:6b77c7b8-505e-4949-a41f-9f680d0eec8e for instance 64f4b294-ab0d-41f0-84aa-89b3227d546a on n-h2-855649-4 Nov 02 12:03:24.703542 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-64ebfdff-8f06-44dd-8a85-815f7d90f7dd req-ef89e612-9e35-4e47-8c42-43229e8b16ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065159 Nov 02 12:03:24.708189 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1397/2797] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:24.714189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:24.715464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:24.717613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:24.724925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.725702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.726418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.727614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.728380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.728743 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-debced72-952e-4123-a540-7e2bda762e0f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1515 microversion: 2.1 time: 0.541043 Nov 02 12:03:24.729281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.739418 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1401/2798] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:24 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1515 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:24.766842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:24.771245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:24.789766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.790678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.791687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.793837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:24.796209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:24.807450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:24.835290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:24.852402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'flavor' on Instance uuid d9a3838c-a50d-4cc9-ba70-6ed331052732 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:03:25.320240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a49fd3e0-f201-4b5e-a437-6f059d5e4c13 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action" status: 200 len: 32 microversion: 2.1 time: 0.560588 Nov 02 12:03:25.322612 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1402/2799] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:03:24 2022] POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action => generated 32 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:03:25.337819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:25.341459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:25.356329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:25.357654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:25.358297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:25.359687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:25.367021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:25.367953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:25.681055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:25.697773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:25.699868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:25.706307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aeb8057d-b777-47ed-a426-78328e916f4a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1849 microversion: 2.32 time: 0.996401 Nov 02 12:03:25.707099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1398/2800] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:24 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1849 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:25.713526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:25.714265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:25.722996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:25.723622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:25.724550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:25.725574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:25.726229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:25.726833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.150227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:26.173356 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e25c4c06-f6ea-4d16-9a91-645379895655 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.848162 Nov 02 12:03:26.178646 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1403/2801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:25 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:26.188913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:26.189894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:26.200155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.202446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.203936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.214913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:26.225820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.226811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.228541 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41691534-c646-423e-b72a-6f6d7e271fb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 0.519602 Nov 02 12:03:26.231206 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1399/2802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:25 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:26.231628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.242257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23ce5dca-14c5-403f-b0ed-71e8c26af981 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9c6160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:26.322777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23ce5dca-14c5-403f-b0ed-71e8c26af981 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.089709 Nov 02 12:03:26.323675 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1400/2803] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:26 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:26.681087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:26.716442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d7fc165-2fc0-4946-b2cf-d4eed46f6d48 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1519 microversion: 2.1 time: 0.535661 Nov 02 12:03:26.717822 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1404/2804] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:26 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1519 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:26.756762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:26.756762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:26.756762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.756762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.756762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.767614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.768450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.769497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.826777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-unplugged", "status": "completed", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:26.850202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:26.851112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:26.851783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:26.889873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] Creating event network-vif-unplugged:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:03:26.909139 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1aa1519d-ecea-4d5d-99e2-a7834d148040 req-abd8028a-59df-4df0-998e-decdaa0a9ed3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087841 Nov 02 12:03:26.910450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1405/2805] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:27.207654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:27.208463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:27.220848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:27.224385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:27.226179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:27.227086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:27.242249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:27.242249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:27.836288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:27.885681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:27.890827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:27.895229 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd32f45d-3a07-4fa1-917e-bbec3587eb18 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1849 microversion: 2.32 time: 1.153952 Nov 02 12:03:27.896538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1401/2806] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:26 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1849 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:27.906463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:27.910569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:27.916213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:27.917168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:27.917863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:27.918944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:27.919850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:27.920722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:28.624385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:28.637836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec17f3ae-86f0-4c23-8380-bc735baf0c47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.434195 Nov 02 12:03:28.639956 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1406/2807] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:27 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:28.661929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-776b3c4e-cab2-4dbf-8610-5c3e2fb34cce tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3c34040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:28.753088 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-776b3c4e-cab2-4dbf-8610-5c3e2fb34cce tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.109903 Nov 02 12:03:28.763817 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1407/2808] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:28 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:28.772007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:28.775591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:28.812234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:28.812632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:28.815315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:28.818970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:28.819664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:28.820261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:29.011558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:29.028207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6af2c6a-2069-44e9-9411-1f8f43875fc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 1.129725 Nov 02 12:03:29.032626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1402/2809] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:27 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:29.047005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "b879a752-ec06-440b-84a3-563bb110cd1d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:29.098154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:29.099613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:29.107174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:29.125369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] Creating event network-changed:b879a752-ec06-440b-84a3-563bb110cd1d for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:03:29.147558 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-be538c1e-0b79-4a9a-9c26-1c379e10de55 req-8c601daf-a3b3-42fa-b0c3-5fad734a459d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106335 Nov 02 12:03:29.148610 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1403/2810] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:29.165133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:29.168124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:29.200917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:29.201438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:29.205073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:29.206216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:29.208425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:29.208940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:30.629734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:30.647118 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2739a981-5dc2-475f-9a9d-730cea1b0e21 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1504 microversion: 2.1 time: 1.888793 Nov 02 12:03:30.649430 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1408/2811] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:28 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1504 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:30.661718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:30.665006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:30.696234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:30.697640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:30.700096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:30.701150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:30.702350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:30.704957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:30.793590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:30.812025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:30.813489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:30.835636 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-289ea803-4350-4d8a-9db6-5b188f439517 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1849 microversion: 2.32 time: 1.685313 Nov 02 12:03:30.837936 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1404/2812] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:29 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1849 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:30.848092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f04842ba-511f-4c2a-915b-da89bbe5fce4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b33a83a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:30.973710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f04842ba-511f-4c2a-915b-da89bbe5fce4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.136403 Nov 02 12:03:30.974659 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1405/2813] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:30 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:30.992154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:30.993198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:31.020565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:31.021970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:31.022800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:31.023871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:31.027674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:31.028355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:31.070080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:32.518348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:32.538216 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7df61ef-0615-46d9-be9e-a4c7d4440a30 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.881053 Nov 02 12:03:32.539211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1409/2814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:30 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:32.605175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:32.606052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:32.653650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:32.654435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:32.658736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:32.660769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:32.661883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:32.664550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:32.691955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:32.712585 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d892909-90ef-47cc-a398-147e4b789d53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 1.735304 Nov 02 12:03:32.715956 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1406/2815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:30 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:32.744423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab28a3-d4bd-4878-9cc3-1a3ffa827d52", "name": "network-vif-unplugged", "status": "completed", "tag": "47892134-ad99-497b-89d7-ff35bddcfa55"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:32.791335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:32.792194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:32.792714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:32.830712 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] Creating event network-vif-unplugged:47892134-ad99-497b-89d7-ff35bddcfa55 for instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 on n-h1-855649-4 Nov 02 12:03:32.847472 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-26a38d60-d10e-43c3-9332-4a7afd378841 req-c5c06962-7a7a-430e-9622-b6dcdddc7c1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127694 Nov 02 12:03:32.850573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1407/2816] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:32.873420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:32.875679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:32.899509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:32.900818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:32.901634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:32.902425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:32.902912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:32.905820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:33.761381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:33.779778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3726a857-a8ee-423f-9acb-6101a96a4d84 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 200 len: 1504 microversion: 2.1 time: 1.238340 Nov 02 12:03:33.795013 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1410/2817] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:32 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 1504 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:33.802271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-487f2539-156a-4605-83f0-94ffcbf6fc59 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb947a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:33.871446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-487f2539-156a-4605-83f0-94ffcbf6fc59 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.086170 Nov 02 12:03:33.873132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1411/2818] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:33 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:33.880458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:33.881830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:33.902273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:33.903171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:33.910046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:33.910046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:33.910046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:33.910046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:33.937180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:33.976485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:33.980286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:33.984717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-837fd5ea-6c44-4cae-9855-22fdf029f369 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1870 microversion: 2.32 time: 1.130392 Nov 02 12:03:34.000287 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1408/2819] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:32 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1870 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:34.020671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:34.021621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:34.033990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:34.034766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:34.035481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:34.036676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:34.037474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:34.037924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:34.402516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:34.414291 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91491933-22bb-463b-b8da-130af66df421 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.539447 Nov 02 12:03:34.414911 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1412/2820] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:33 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:34.433419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:34.434192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:34.449732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:34.450702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:34.451408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:34.454690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:34.457929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:34.459515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:34.532623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:03:34.536150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:34.550660 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8fc1d47-f952-45ea-bd32-81fbe6f7557c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 0.548934 Nov 02 12:03:34.551772 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1409/2821] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:34 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:34.888650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75a1d62b-9955-40f1-89dc-58359d5aea8d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb15af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:34.988280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75a1d62b-9955-40f1-89dc-58359d5aea8d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.104030 Nov 02 12:03:34.991874 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1410/2822] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:34 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:35.006965 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18864c33-d535-485f-b36e-c24ba82e734f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 204 len: 0 microversion: 2.1 time: 0.590698 Nov 02 12:03:35.010828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fab28a3-d4bd-4878-9cc3-1a3ffa827d52", "tag": "47892134-ad99-497b-89d7-ff35bddcfa55"}, {"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "eadf8d60-0c26-45e9-b1bc-480e455004ef"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:35.012544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1413/2823] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:03:34 2022] DELETE /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:03:35.036069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:35.036785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:35.053370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:35.054306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:35.054602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:35.055180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:35.059937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:35.060118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:35.060118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:35.060118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:35.061019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:35.085882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Creating event network-changed:47892134-ad99-497b-89d7-ff35bddcfa55 for instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 on n-h1-855649-4 Nov 02 12:03:35.091451 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] Creating event network-changed:eadf8d60-0c26-45e9-b1bc-480e455004ef for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:03:35.112757 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1a7a66ac-a049-446e-8ed8-20c2326d152b req-64f5170b-1707-40ab-be76-172b36e39095 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110571 Nov 02 12:03:35.115427 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1411/2824] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:35.289396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1663751709", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7c73d261-5263-4009-85e9-ad9c09c3bc0e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:35.444570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] validate_networks() for [('7c73d261-5263-4009-85e9-ad9c09c3bc0e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:03:35.878636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:35.895031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:35.902570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:35.912202 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7bca631c-b06e-4f09-9cdc-4e6be9732c8b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1870 microversion: 2.32 time: 0.872889 Nov 02 12:03:35.912202 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1414/2825] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:35 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1870 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:03:35.916545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:35.920460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:35.937743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:35.942054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:35.943863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:35.944931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:35.945652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:35.946348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:37.280195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:37.320593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38b9679e-28f4-4139-8443-a7fb8213284b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.404985 Nov 02 12:03:37.323019 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1415/2826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:35 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:37.347777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:37.348669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:37.363098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:37.367165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:37.369075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:37.370912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:37.374589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:37.375413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.684355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:03:38.684876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:03:38.685925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:03:38.686688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:03:38.687445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:03:38.690393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=74 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:38.721024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.722063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.722718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.726804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:38.727645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:38.728281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:38.810348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:03:38.829729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for user b233c50171014c42bb2c87016c696e01 and project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:03:38.872021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:03:38.875808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:03:39.102572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:39.124665 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4070e3b0-ea9e-4f63-bf3e-34c3f2d34d35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 1.797078 Nov 02 12:03:39.129792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1416/2827] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:37 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:39.163448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d0c3c-d741-40e7-bab4-1c06dca19c7b", "name": "network-vif-plugged", "status": "completed", "tag": "54a5b86f-f295-40d2-be5f-a0c8343cd66b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:39.179453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.179596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.180253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.197330 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] Creating event network-vif-plugged:54a5b86f-f295-40d2-be5f-a0c8343cd66b for instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b on n-h1-855649-4 Nov 02 12:03:39.206257 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-99212016-629a-4901-b8e5-4524f984120a req-8aa353bf-9691-446d-a003-8aa8a8de4de0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059161 Nov 02 12:03:39.210054 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1417/2828] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:39.225856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f046141f-d961-4f6f-b06f-48e0c0cefd11 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb995700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:39.287169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f046141f-d961-4f6f-b06f-48e0c0cefd11 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.075777 Nov 02 12:03:39.288584 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1418/2829] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:39 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:39.294938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:39.296082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:39.304947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.307331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.308574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.309906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.311737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.313002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.737747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:39.741382 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e1fd5554-ba11-4446-af93-cfcd655cb414 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.456978 Nov 02 12:03:39.743042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1412/2830] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:03:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:03:39.743257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:39.749015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:39.750171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:39.766372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.770312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.771030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.771950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:39.772796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:39.775507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:39.783614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:39.784156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:39.789274 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e388ec1-1baf-42da-b846-80e8e9631aa0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1870 microversion: 2.32 time: 0.499264 Nov 02 12:03:39.813125 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1419/2831] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:39 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1870 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:39.853466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59556915-1efb-4d97-ab2d-5f093473f517 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:39.853466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59556915-1efb-4d97-ab2d-5f093473f517 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:40.458719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59556915-1efb-4d97-ab2d-5f093473f517 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:40.473694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59556915-1efb-4d97-ab2d-5f093473f517 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1218 microversion: 2.1 time: 0.658560 Nov 02 12:03:40.477842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1420/2832] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:39 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1218 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:40.503081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:40.505658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:40.579299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.580181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.580841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:40.584059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.585426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.586407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:40.730571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:40.735370 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59a82ef2-1e57-4d53-9cb4-528d4fcc25c8 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.990831 Nov 02 12:03:40.736305 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1413/2833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:39 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:40.748912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-974e9728-de9b-49a2-8157-d8f1dbdca693 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bba600d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:40.825173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-974e9728-de9b-49a2-8157-d8f1dbdca693 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.087538 Nov 02 12:03:40.835746 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1414/2834] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:40 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:40.835746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:40.841250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:40.855540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.860416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.864062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:40.874669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:40.876134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:40.877248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.367856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:41.391084 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3710c369-2649-4cd5-a302-4f1ae1a66951 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 0.911267 Nov 02 12:03:41.402466 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1421/2835] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:40 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:41.503164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-919ab9ec-9708-4edc-a258-8424765c8482 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:41.504199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-919ab9ec-9708-4edc-a258-8424765c8482 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:41.739216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-919ab9ec-9708-4edc-a258-8424765c8482 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:41.750923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-919ab9ec-9708-4edc-a258-8424765c8482 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1218 microversion: 2.1 time: 0.252807 Nov 02 12:03:41.768198 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1422/2836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:41 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:41.789747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b294-ab0d-41f0-84aa-89b3227d546a", "name": "network-vif-deleted", "tag": "6b77c7b8-505e-4949-a41f-9f680d0eec8e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:41.830065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:41.830650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:41.843872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.882955 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] Creating event network-vif-deleted:6b77c7b8-505e-4949-a41f-9f680d0eec8e for instance 64f4b294-ab0d-41f0-84aa-89b3227d546a on n-h2-855649-4 Nov 02 12:03:41.885392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:41.910557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:41.916043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:41.919035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-16de064e-25d0-4fb4-b24b-9a8099a8bd03 req-75883547-1466-4d07-8fd2-8d4d3ff4788b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149187 Nov 02 12:03:41.919497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c297809-67de-4846-8d18-939980a5796b tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1891 microversion: 2.32 time: 1.089924 Nov 02 12:03:41.925909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1423/2837] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:41.933404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:41.934874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:41.939082 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1415/2838] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:40 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1891 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:41.943153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:41.944014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:41.944856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.946195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:41.946838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:41.947455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:41.967736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a27a117-7bff-474d-b83d-246a2473e911 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9c6040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:42.141519 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a27a117-7bff-474d-b83d-246a2473e911 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.201035 Nov 02 12:03:42.142455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1416/2839] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:41 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:42.278060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:42.313543 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a380ae7-3dfb-4531-9e91-4a7bcdb7f10d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.385580 Nov 02 12:03:42.315087 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1424/2840] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:41 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:42.452833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:42.458097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:42.527445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.530112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.531576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:42.534721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.535911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.536991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:42.805697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:42.807087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:42.832361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.836162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.836830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:42.842954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:42.843723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:42.846761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:43.681904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:43.704261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8092fed6-b7e5-4f18-b7e5-a9bc37107494 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1214 microversion: 2.1 time: 0.911841 Nov 02 12:03:43.706570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1425/2841] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:42 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1214 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:43.726928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:43.728316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:43.749456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:43.750236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:43.764613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:43.767370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:43.769226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:43.769880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:43.843962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:43.852662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da506acd-3ef0-49a6-9906-918e38edca50 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 1.421455 Nov 02 12:03:43.853277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1417/2842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:42 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:43.894023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f4778ca-cb6a-47c5-97f1-2d973d830970 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b39a4790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:44.050376 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f4778ca-cb6a-47c5-97f1-2d973d830970 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.171024 Nov 02 12:03:44.053360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1418/2843] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:43 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:44.063675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:44.084483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:44.115161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.117347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.121932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.123702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.125287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.127239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.865694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:44.890964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:44.892429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:44.893633 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a776c9e-5feb-484f-81be-9b7a50131d8a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.185730 Nov 02 12:03:44.894211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1426/2844] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:43 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:44.904158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "13fc1c9d-d40d-44c2-aa1b-815471bf931b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:44.939500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:44.939500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:44.939500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:44.992393 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] Creating event network-changed:13fc1c9d-d40d-44c2-aa1b-815471bf931b for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:03:45.019334 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e99fe0fd-64fe-43da-b3bb-f6ee8c7702cb req-f3c0bd54-a79c-4e71-8bf0-06defe8a3c8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123696 Nov 02 12:03:45.020004 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1427/2845] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:45.037154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:45.037499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:45.057137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.062642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.067260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:45.077018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:45.087307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d36da64c-a310-4e81-9d3b-b68a09df32f5 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.032657 Nov 02 12:03:45.088525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.090082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.094751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:45.098447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1419/2846] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:44 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:45.114001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:45.114881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:45.143182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.147699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.148347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:45.154679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.157823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.158510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:45.325370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:45.335724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-476a04af-7938-40e9-93d5-62a2cd7468f5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1270 microversion: 2.1 time: 0.314473 Nov 02 12:03:45.339428 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1428/2847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:45 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1270 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:45.353090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb7710a1-e8dd-4a32-94f0-335d9f2960f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb961940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:45.465269 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb7710a1-e8dd-4a32-94f0-335d9f2960f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.120873 Nov 02 12:03:45.477254 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1429/2848] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:45 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:45.930148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:45.930834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:45.943269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.944011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.944819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:45.945837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:45.946532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:45.947166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.125080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:47.140921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30d63244-808a-4da8-a981-a155810d6dbd tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 2.037795 Nov 02 12:03:47.141741 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1420/2849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:45 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:47.158606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:47.159268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:47.170460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.170965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.171441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.172165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.172628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.173058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.690549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:47.709551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:47.715364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:47.724052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43182251-f716-4ace-b106-bd50cb9679ca tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.798376 Nov 02 12:03:47.745404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1430/2850] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:45 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:03:47.778947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:47.779485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:47.781647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:47.821530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.822038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.822483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:47.835598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:47.836055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:47.839986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:48.713700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:48.730956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92cd4f46-ef5a-4cc2-b2f1-24f554779a6b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1276 microversion: 2.1 time: 0.968395 Nov 02 12:03:48.732114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1431/2851] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:47 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1276 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:48.738924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69a2f9b1-812d-4638-9ca8-5d287cb3eb44 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9a0940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:48.776541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:48.813230 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69a2f9b1-812d-4638-9ca8-5d287cb3eb44 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.079960 Nov 02 12:03:48.815290 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1432/2852] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:48 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:48.827037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "2d8bdb28-49c7-46e6-bf07-b47c1518f9d2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:48.851679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:48.858531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:48.858531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:48.858531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:48.889329 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] Creating event network-changed:2d8bdb28-49c7-46e6-bf07-b47c1518f9d2 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:03:48.912902 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c011e9eb-3280-4b3f-884d-fd74e766a2a4 req-d27e3734-5a92-443a-91c6-8abffa4171a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095972 Nov 02 12:03:48.914195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1433/2853] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:49.307466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:49.327860 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e450d6e-6243-40ac-9ba4-5440f3cf6ae4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 2.179862 Nov 02 12:03:49.330575 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1421/2854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:47 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:49.337715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-482cdfa2-c632-46d0-98b2-8a2803e315f6 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Action: 'create', calling method: .version_select at 0x7ff1bb947310>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:49.353120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:49.353761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:49.397587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:49.399597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:49.403716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:49.404781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:49.405418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:49.406626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:51.495922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:51.507952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ead2aa25-e44a-4017-a4b4-b4fbf3405e1e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 2.176064 Nov 02 12:03:51.528136 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1422/2855] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:49 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:51.579175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:51.580172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:51.596230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:51.597967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:51.601142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:51.602295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:51.604551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:51.605355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:51.743252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:53.181056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:53.197474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:53.215985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:53.223388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed984be5-6a5d-4c79-b8fe-b1dd407799b2 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.668257 Nov 02 12:03:53.228793 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1423/2856] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:51 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:53.243528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:53.243528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:53.259653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.262442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.263227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:53.268596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.269750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.270567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:53.678568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:53.689208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87f0db5c-1866-4e7f-ae84-dc7a81a0c4e8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1318 microversion: 2.1 time: 0.458759 Nov 02 12:03:53.691922 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1424/2857] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:53 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:53.708973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-822f20ce-9471-4c45-ad4f-18b4215baf74 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b35cca60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:53.781038 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-822f20ce-9471-4c45-ad4f-18b4215baf74 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.087267 Nov 02 12:03:53.782402 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1425/2858] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:53 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:53.800845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:53.802028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:53.809966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.813389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.814392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:53.815545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:53.818389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:53.819280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.082916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:54.112151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ad1e7bf-7bab-455a-b648-b6b5f807bed4 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 0.322206 Nov 02 12:03:54.116716 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1426/2859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:53 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:54.164254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:54.164899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:54.218014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.218848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.224078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.230025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.231707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.233734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.802533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:54.812827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4568df79-71e0-40b5-aad0-4b96c5ba331f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1521 microversion: 2.1 time: 0.679602 Nov 02 12:03:54.814699 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1427/2860] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:54 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:54.834790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:54.835779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:54.843247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.844106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.844781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:54.845873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:54.846573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:54.847309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:56.587173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:56.616531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:56.625430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:56.628093 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18fd13bd-8e54-4634-b516-4a640db9c929 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.811314 Nov 02 12:03:56.652103 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1428/2861] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:03:54 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:03:56.678565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "0ff918d3-9b80-4216-9267-64ae5089850a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:03:56.693396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:56.694748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:56.695439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:56.710815 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] Creating event network-changed:0ff918d3-9b80-4216-9267-64ae5089850a for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:03:56.719623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-66e57376-8797-4b00-afec-ff383f8ad3a9 req-f933b43b-6a77-49be-8268-6c8c4af5b2b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063539 Nov 02 12:03:56.725169 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1429/2862] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:03:56.746676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:56.750743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:56.768062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:56.769152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:56.770681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:56.772812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:56.773448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:56.775125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:58.297922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:58.309775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:58.320227 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5b09277-5064-4c92-bc80-3a941b779c4b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1318 microversion: 2.1 time: 1.595137 Nov 02 12:03:58.321244 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1430/2863] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:56 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1318 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:58.332777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0b9da0e-7c3c-400b-a404-18413c70801b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b39a4040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:58.423402 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0b9da0e-7c3c-400b-a404-18413c70801b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1453 microversion: 2.1 time: 0.100737 Nov 02 12:03:58.430126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1431/2864] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:03:58 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:58.434015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:58.434645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:58.465081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:58.465081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:58.474914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:58.475753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:58.476255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:58.476860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:58.889535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=49 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:59.183334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:03:59.573495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:03:59.587866 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c121ed5-6a74-4033-a134-8a496b5a9f97 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1393 microversion: 2.1 time: 1.157961 Nov 02 12:03:59.589066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1432/2865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:58 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1393 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:03:59.602871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:03:59.609372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:03:59.617584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:59.618088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:59.618533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:03:59.619282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:03:59.619945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:03:59.620348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:00.504703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:00.536537 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16c80299-2134-45f0-8e20-315e9dc8db01 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1501 microversion: 2.1 time: 0.941339 Nov 02 12:04:00.537578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1433/2866] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:03:59 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1501 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:00.552644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:00.555950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:00.575199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:00.575881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:00.579054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:00.581310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:00.581853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:00.585804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:01.011011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-482cdfa2-c632-46d0-98b2-8a2803e315f6 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 12.093264 Nov 02 12:04:01.011605 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1434/2867] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:03:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 12096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:01.024838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c3254f-6563-4c0d-8167-c4c7999deaab", "tag": "9c492ab5-152c-4f3d-9582-57dc643bfb7f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:01.038114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:01.039039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:01.040313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:01.057566 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] Creating event network-changed:9c492ab5-152c-4f3d-9582-57dc643bfb7f for instance 93c3254f-6563-4c0d-8167-c4c7999deaab on n-h1-855649-4 Nov 02 12:04:01.071293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ee01871d-9c1e-46b6-a5aa-9c0e7514c89b req-c4a12b73-249a-4fdf-807c-8aa54ac99d38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050188 Nov 02 12:04:01.074359 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1435/2868] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:01.087025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:01.087025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:01.096117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:01.097301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:01.098317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:01.099588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:01.101741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:01.102443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:01.267836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:01.280416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:01.282566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:01.284041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91bdb090-a1bf-4911-97c1-592ae2db6769 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.745247 Nov 02 12:04:01.284704 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1434/2869] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:00 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:01.291790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95f69603-4b21-40e4-b6f8-a54314880dc9 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b350c940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:01.344991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95f69603-4b21-40e4-b6f8-a54314880dc9 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1462 microversion: 2.1 time: 0.058886 Nov 02 12:04:01.362835 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1435/2870] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:01 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1462 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:01.469776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ccf53e40-6970-4b56-a9c6-d2a5a22af52a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1b357fb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-786813489", "description": "tempest-description-220077789"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:01.985249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:01.993897 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f17e91fb-461d-4e9a-9fed-d8918f46315d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1318 microversion: 2.1 time: 0.917953 Nov 02 12:04:01.995258 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1436/2871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:01 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:02.007822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:02.007822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:02.010306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.011488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.012873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.014115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.014841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.020427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.402095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:02.410864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9347137-123c-45b4-8a61-bcce6cbd0aeb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1515 microversion: 2.1 time: 0.414225 Nov 02 12:04:02.411682 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1437/2872] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:01 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1515 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:02.417384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:02.426463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:02.426463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.426463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.426463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.427692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:02.428337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:02.428949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:02.705009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ccf53e40-6970-4b56-a9c6-d2a5a22af52a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.355779 Nov 02 12:04:02.707923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1436/2873] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:01 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:02.718636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df35d8c6-73b2-4c2c-b1e2-4b3a87956aef tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Action: 'create', calling method: .version_select at 0x7ff1b348d5e0>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:03.158194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.180192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77bc4327-7107-4b61-b54a-b000f85c22c2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1383 microversion: 2.1 time: 0.766340 Nov 02 12:04:03.197340 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1438/2874] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:02 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1383 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:03.207761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e02dca5-c6ea-4f11-85e3-c04a1d27863c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9a0940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:03.266649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e02dca5-c6ea-4f11-85e3-c04a1d27863c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 200 len: 1462 microversion: 2.1 time: 0.062237 Nov 02 12:04:03.268372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1439/2875] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:03 2022] GET /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 1462 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:03.273575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:03.280947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:03.293220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.296979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.300520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.302212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:03.302913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:03.305292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:03.695869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.707708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.707708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:03.709116 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ce422ef-4328-4556-8bef-3cb3babd6c61 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.439525 Nov 02 12:04:03.710059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1440/2876] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:03 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:03.715453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:03.718703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 519f269c-3793-42b6-9b49-a1206a2e553c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:03.725171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/519f269c-3793-42b6-9b49-a1206a2e553c/action HTTP/1.1 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 14 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: {"rescue": {}} Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '519f269c-3793-42b6-9b49-a1206a2e553c', 'body': {'rescue': {}}} Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:03.738736 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 404 to user: Instance 519f269c-3793-42b6-9b49-a1206a2e553c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42fbd479-87e1-4649-bb00-b403a7b70a9f tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/519f269c-3793-42b6-9b49-a1206a2e553c/action" status: 404 len: 111 microversion: 2.1 time: 0.029420 Nov 02 12:04:03.744556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1441/2877] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:03 2022] POST /compute/v2.1/servers/519f269c-3793-42b6-9b49-a1206a2e553c/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:03.747849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db8a2943-d652-4ccb-892e-fa87c1f55f51 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1bb9474c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-976745494", "description": "tempest-description-2836227"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:04.767984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db8a2943-d652-4ccb-892e-fa87c1f55f51 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 1.025107 Nov 02 12:04:04.769410 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1442/2878] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:03 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:04.792359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:04.795858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:04.809364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:04.812395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:04.813233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:04.815117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:04.819866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:04.819866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.221064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:05.233185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e97f872e-693a-4f60-9dd5-98429a7f16e6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1318 microversion: 2.1 time: 0.448589 Nov 02 12:04:05.242405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1443/2879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:04 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:05.254961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "f41ae705-0356-48af-848d-ad7512330081"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:05.270562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.271368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.271992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.302938 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] Creating event network-changed:f41ae705-0356-48af-848d-ad7512330081 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:05.310672 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c1118917-f9a5-4762-b01a-24a7b39fb8ef req-482bb6f7-c505-483c-be8e-8448e8143543 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065423 Nov 02 12:04:05.311941 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1444/2880] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:05.318901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b77ce00-d21c-456f-87cb-a091755dfcb4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '.version_select at 0x7ff1b81618b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:05.323407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b77ce00-d21c-456f-87cb-a091755dfcb4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.324212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b77ce00-d21c-456f-87cb-a091755dfcb4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.326890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b77ce00-d21c-456f-87cb-a091755dfcb4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.339308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b77ce00-d21c-456f-87cb-a091755dfcb4 tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.025541 Nov 02 12:04:05.340288 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1445/2881] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 12:04:05 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:05.361740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:05.365212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:05.385052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.385836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.386605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.388679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.389389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.390179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.762804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:05.777709 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e3cc854-451a-4a96-a226-6b9534d64d3c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1467 microversion: 2.1 time: 0.429030 Nov 02 12:04:05.787181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1446/2882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:05 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1467 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:05.802886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:05.805443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:05.829305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.829862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.830439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:05.831732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:05.832573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:05.833569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:06.303855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68505fde-e526-4673-b7fd-85f18352f924 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action" status: 202 len: 0 microversion: 2.1 time: 0.496790 Nov 02 12:04:06.305291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1447/2883] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:05 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:06.318930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:06.323381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:06.337705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:06.338899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:06.339455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:06.340560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:06.353368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:06.355356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:07.256353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:07.266689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:07.268180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:07.269436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c70ed88-18bc-43fd-8b84-af8931c2c446 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.961332 Nov 02 12:04:07.270032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1448/2884] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:06 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:07.274930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1945283542", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "91a05a32-8a21-4d3f-a411-604b20e5411d"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:07.335322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] validate_networks() for [('91a05a32-8a21-4d3f-a411-604b20e5411d', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:04:07.335998 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df35d8c6-73b2-4c2c-b1e2-4b3a87956aef tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.626707 Nov 02 12:04:07.337288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1437/2885] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:04:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:07.343549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:07.344201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:07.355478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:07.782456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4857c922-7295-4518-9adf-a35b65b45cba tempest-LiveMigrationTest-3724996 tempest-LiveMigrationTest-3724996-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1534 microversion: 2.1 time: 0.443428 Nov 02 12:04:07.792571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1438/2886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:07 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1534 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:07.799363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1727789552"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:07.802740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:07.823690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:07.824393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:07.824942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:07.825907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:07.826859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:07.828237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.196258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:04:08.196258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:04:08.196258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:04:08.196796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:04:08.196796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:04:08.208135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.208637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.209077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.209816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.210276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.211524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.245384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Getting quotas for project fd28d11d0d4a46f09bcd37ce4df337c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:08.258170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Getting quotas for user bb4b9b23379b4029b0ae12cc6620bd93 and project fd28d11d0d4a46f09bcd37ce4df337c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:08.290499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:04:08.298580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:04:08.467686 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ecf0a2f-7191-4cc9-bc1e-9c7577a7a898 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "POST /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8/action" status: 202 len: 0 microversion: 2.1 time: 0.673502 Nov 02 12:04:08.469330 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1439/2887] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:07 2022] POST /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:04:08.489386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3254f-6563-4c0d-8167-c4c7999deaab", "name": "network-vif-plugged", "status": "completed", "tag": "9c492ab5-152c-4f3d-9582-57dc643bfb7f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:08.522642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f0da1a1-f6cf-4425-877f-870db3d03f24 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249741 Nov 02 12:04:08.523365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1449/2888] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:04:08.532778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.533317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.533807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.546051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:08.557045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:08.563561 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] Creating event network-vif-plugged:9c492ab5-152c-4f3d-9582-57dc643bfb7f for instance 93c3254f-6563-4c0d-8167-c4c7999deaab on n-h1-855649-4 Nov 02 12:04:08.576297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.582239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3141a697-3ba2-4c71-9775-4fb20e6ba8b2 req-5ff0be88-df6b-43ff-81e4-a4c069c2c8d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104775 Nov 02 12:04:08.582858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.583547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.583952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1440/2889] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:08.585024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.585507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.585963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.609074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:08.611290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:08.635177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.638012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.639102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:08.640551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:08.641529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:08.642368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:09.240993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:09.251655 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b161484-ad88-4140-be65-375e13e8234c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1318 microversion: 2.1 time: 0.718948 Nov 02 12:04:09.252162 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1450/2890] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:08 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:09.263394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f05d3ce3-11f0-4e54-a7a2-1478ce000180 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Action: 'create', calling method: .version_select at 0x7ff1bb9a04c0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:09.268192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:09.280382 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ea992c3-18e4-4034-9064-4b9532189a9d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1500 microversion: 2.1 time: 0.678598 Nov 02 12:04:09.292952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1441/2891] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:08 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1500 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:09.305580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "f6e7433d-cdbb-4831-805c-6ec5d60d2aee"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:09.315330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:09.319860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:09.320115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:09.320558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:09.333187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] Creating event network-changed:f6e7433d-cdbb-4831-805c-6ec5d60d2aee for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:09.338256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1cf447c5-c326-4641-a6c2-e461461c1a06 req-18a44ca1-3424-4971-bff7-e4617211bccc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 Nov 02 12:04:09.338935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1442/2892] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:09.344781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:09.345345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:09.352885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:09.353384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:09.353875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:09.354605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:09.355837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:09.356288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:09.390282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:09.927819 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-446df81e-aa15-4798-ad48-a00331277159 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 204 len: 0 microversion: 2.1 time: 0.585466 Nov 02 12:04:09.930407 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1443/2893] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:09 2022] DELETE /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:09.940478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:09.942339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:09.954125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:09.954945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:09.955572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:09.956946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:09.957581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:09.961696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.040625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:11.058005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:11.060371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:11.063079 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e164fdf3-c7ae-46fc-b987-42d4f808057a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.129385 Nov 02 12:04:11.066500 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1444/2894] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:09 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:11.081819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6880b5b-965d-4388-a31a-5b5e73943bd5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b34b1dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:11.177351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6880b5b-965d-4388-a31a-5b5e73943bd5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.107156 Nov 02 12:04:11.178545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1445/2895] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:11 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:11.204958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:11.205999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:11.236215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.237554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.238015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.238927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.239657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.240848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.415657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:11.427091 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-369d1a5c-f1ba-49be-bbc5-382ccc5e637e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1268 microversion: 2.1 time: 0.246961 Nov 02 12:04:11.428300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1446/2896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:11 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:11.438096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:11.441099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:11.454595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.454595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.454595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.454595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.455899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.456459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.509178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'flavor' on Instance uuid 913d268b-12de-473f-b12a-32516fe6c52d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:11.527837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Cannot 'rescue' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state paused Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action HTTP/1.1 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 14 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: {"rescue": {}} Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'rescue' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state paused Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '913d268b-12de-473f-b12a-32516fe6c52d', 'body': {'rescue': {}}} Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 913d268b-12de-473f-b12a-32516fe6c52d in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state paused Nov 02 12:04:11.530457 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state paused Nov 02 12:04:11.538196 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:11.543627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 409 to user: Cannot 'rescue' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state paused {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:11.550230 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ef2f63b-b3c9-470d-8fb4-42158ab98653 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action" status: 409 len: 144 microversion: 2.1 time: 0.112974 Nov 02 12:04:11.550230 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1447/2897] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:11 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action => generated 144 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:04:11.561308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:11.562216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:11.570472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.571319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.571996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.574776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.594863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.599360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.846068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:11.878067 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60273034-2ef2-4546-849a-70b2539fe4dc tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1389 microversion: 2.1 time: 0.324037 Nov 02 12:04:11.893972 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1448/2898] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:11 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1389 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:11.903151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:11.906087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:11.918890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.919421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.919887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:11.920600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:11.921059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:11.921493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:12.305637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:12.315743 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ecc51b4-ce31-404b-a600-6b946c2ac032 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1509 microversion: 2.1 time: 0.426971 Nov 02 12:04:12.316342 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1449/2899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:11 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:12.321387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d0c3c-d741-40e7-bab4-1c06dca19c7b", "name": "network-vif-unplugged", "status": "completed", "tag": "54a5b86f-f295-40d2-be5f-a0c8343cd66b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:12.341058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:12.341888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:12.342513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:12.356399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] Creating event network-vif-unplugged:54a5b86f-f295-40d2-be5f-a0c8343cd66b for instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b on n-h1-855649-4 Nov 02 12:04:12.362289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-02283669-01f4-4729-835f-bdf539af4449 req-2792bc6e-65fe-49ba-9a00-1006a365b887 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044345 Nov 02 12:04:12.363450 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1450/2900] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:12.371133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:12.371830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:12.379605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:12.384601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:12.384601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:12.384601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:12.384601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:12.384601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:12.408997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:12.719652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f902dab-6062-4fd4-80a9-4228f2b62569 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action" status: 202 len: 0 microversion: 2.1 time: 0.351334 Nov 02 12:04:12.719652 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1451/2901] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:12 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:12.735815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:12.749911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:12.774666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:12.776058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:12.776958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:12.779706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:12.782868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:12.792537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:13.206472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:13.217466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:13.219118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:13.220416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9c44e4e-5eb0-4122-84ba-2e32d5771f34 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.498578 Nov 02 12:04:13.221021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1452/2902] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:12 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:13.238694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79a30113-8ee5-475a-98cc-bf0700a12e57 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3a16dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:13.370641 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79a30113-8ee5-475a-98cc-bf0700a12e57 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.148456 Nov 02 12:04:13.373030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1453/2903] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:13 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:13.383353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:13.384493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:13.393686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:13.394794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:13.395787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:13.397327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:13.398208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:13.399091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:13.921243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:13.933529 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c04f75b-4d75-4673-8787-af95c8ab34bc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1509 microversion: 2.1 time: 0.556798 Nov 02 12:04:13.934062 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1454/2904] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:13 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:13.939422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:13.940104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:13.951736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:13.952513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:13.953160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:13.953924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:13.954610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:13.955137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:14.075938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:14.086155 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be691111-2245-452e-98bf-4fbe6ab5516a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1274 microversion: 2.1 time: 0.150921 Nov 02 12:04:14.093458 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1455/2905] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:13 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:14.106418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:14.107503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:14.127028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:14.127028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:14.127028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:14.127028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:14.127711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:14.128240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.284363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f05d3ce3-11f0-4e54-a7a2-1478ce000180 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.028418 Nov 02 12:04:15.287439 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1451/2906] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:04:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:15.296865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:15.300078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:15.312337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.313215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.313886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.315504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.316225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.317330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.351683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:15.360479 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b04b0ceb-9d69-437f-ab21-eed2f28fb036 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1515 microversion: 2.1 time: 1.265140 Nov 02 12:04:15.368935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1456/2907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:14 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1515 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:15.374838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:15.377878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:15.385542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.386390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.387038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.388839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.388839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.389354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.564601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:15.565628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62954f29-0314-4443-87ed-b1e9d140b605 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "PUT /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1081 microversion: 2.1 time: 0.194685 Nov 02 12:04:15.579009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1457/2908] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:04:15 2022] PUT /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1081 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:15.579357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47065222-55fa-4ccc-8b32-586e4c340820 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1347 microversion: 2.1 time: 0.285376 Nov 02 12:04:15.584860 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1452/2909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:15 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1347 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:15.596443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:15.605564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:15.606285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2393e785-e2ef-4ee5-a439-aed79b9fad36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b344d1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:15.635909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.638448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.638915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.645465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.645983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.665047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.713888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2393e785-e2ef-4ee5-a439-aed79b9fad36 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.121639 Nov 02 12:04:15.737259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1458/2910] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:15 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:15.750913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:15.753257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:15.772440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.780511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.780511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:15.806221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:15.811034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:15.815667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.656536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:16.676879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:16.689111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:16.698958 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbaceef8-b9ef-482a-98ca-dbb134394899 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.959962 Nov 02 12:04:16.702839 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1459/2911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:15 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:16.704063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:16.707657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d393c40b-de8e-41c1-8e28-efd751a084fc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.120457 Nov 02 12:04:16.711687 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1453/2912] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:15 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:16.724020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fab28a3-d4bd-4878-9cc3-1a3ffa827d52", "name": "network-vif-deleted", "tag": "47892134-ad99-497b-89d7-ff35bddcfa55"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:16.724430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68800330-5f38-4239-ab81-23448794c02c tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Action: 'create', calling method: .version_select at 0x7ff1bb9b2dc0>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:16.756274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.759775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.760591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.792218 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] Creating event network-vif-deleted:47892134-ad99-497b-89d7-ff35bddcfa55 for instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 on n-h2-855649-4 Nov 02 12:04:16.824987 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c153ea23-2cf0-4b24-a80d-66b4fc509e1b req-2930ed57-747a-40f6-a34e-d60d3b09c980 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111742 Nov 02 12:04:16.825907 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1454/2913] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:16.841323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:16.842431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:16.857326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.863112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.865681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:16.869548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:16.873238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:16.875340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:17.756578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:17.767319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff9fcae5-b4a3-41c2-b830-7d1e6db15c26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1507 microversion: 2.1 time: 0.932001 Nov 02 12:04:17.777614 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1455/2914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:16 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1507 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:17.814056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-plugged", "status": "completed", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:17.848849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:17.849604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:17.853317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:17.879189 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] Creating event network-vif-plugged:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:04:17.892775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-89980ca9-5767-4fc6-9899-242446152cff req-ef78df1c-c201-46c3-970f-37f613dee304 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110830 Nov 02 12:04:17.893855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1456/2915] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:17.909371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:17.910834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:17.926921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:17.928893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:17.930248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:17.931730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:17.934474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:17.935200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:18.218717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:18.231766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:18.234795 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf3ee20c-f27b-4767-b278-d6615d43892f tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1184 microversion: 2.1 time: 0.336536 Nov 02 12:04:18.236204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1457/2916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:17 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1184 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:18.261053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff608ba5-641a-4699-bced-9e651d7fb901 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb958790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:18.281568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:18.348105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff608ba5-641a-4699-bced-9e651d7fb901 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.095573 Nov 02 12:04:18.349015 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1458/2917] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:18 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:18.364238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:18.365078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:18.371845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:18.372333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:18.372772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:18.373484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:18.383553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:18.384063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:18.431138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:19.179294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:19.179294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35fee0a4-f1f5-4efe-b240-fd2c2970aee9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.784269 Nov 02 12:04:19.179294 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1459/2918] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:18 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:19.179294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:19.179294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:19.181410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:19.182464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:19.182920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:19.183698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:19.186339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:19.187011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.253006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:20.294163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:20.301220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:20.303849 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93a4cc58-218f-42e0-8b31-b4c114e1fdc9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.149537 Nov 02 12:04:20.327736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1460/2919] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:19 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:20.338627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:20.342535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:20.366084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.366708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.367292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.368123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.368835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.369539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.795378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:20.824690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-238602fd-53d5-42be-83b6-1d26fdefefc8 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1507 microversion: 2.1 time: 0.495251 Nov 02 12:04:20.836074 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1461/2920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:20 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:20.856773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:20.864534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:20.891138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.894035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.894519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.896561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:20.897957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:20.900867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:20.986820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'flavor' on Instance uuid 913d268b-12de-473f-b12a-32516fe6c52d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:21.454768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef028f05-66c2-4ef2-af7d-d76794ec30f9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action" status: 200 len: 32 microversion: 2.1 time: 0.616628 Nov 02 12:04:21.463662 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1462/2921] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:20 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action => generated 32 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:21.468016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:21.468904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:21.487779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.493692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.495204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.496129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.498947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.504060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.634368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:21.645667 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d508865-9531-46ef-ae1c-5f3bcb186b22 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1184 microversion: 2.1 time: 0.187929 Nov 02 12:04:21.659017 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1463/2922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:21 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1184 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:21.664017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df25ca93-cbf5-4831-939e-142c31021428 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b305b040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:21.743529 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df25ca93-cbf5-4831-939e-142c31021428 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.093496 Nov 02 12:04:21.744687 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1464/2923] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:21 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:21.757659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:21.760369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:21.780214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.352432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:22.366483 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67f2634f-cdcb-4d4f-b583-508635e305b7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.617273 Nov 02 12:04:22.367496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1465/2924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:21 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:22.379061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:22.391333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:22.404029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:22.406799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:22.413297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.417956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:22.417956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:22.417956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.550926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:04:22.551646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:04:22.552128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:04:22.552678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:04:22.553196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:04:22.850213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:22.878606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:22.880702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:22.883008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.891635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:22.893700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:22.896689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.958492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e4198e2-6a61-490b-9366-2542d6146e24 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "POST /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab/action" status: 202 len: 1113 microversion: 2.1 time: 0.589463 Nov 02 12:04:22.959999 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1466/2925] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:22 2022] POST /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab/action => generated 1113 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:04:22.965992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024ac85c-57a5-4779-8e40-789a4330e60c", "tag": "d326e7d2-a469-42e1-976c-050cdeb4efa2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:22.976697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:22.977585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:22.978255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:22.991594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] Creating event network-changed:d326e7d2-a469-42e1-976c-050cdeb4efa2 for instance 024ac85c-57a5-4779-8e40-789a4330e60c on n-h1-855649-4 Nov 02 12:04:22.997879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-46cab39f-5548-41a9-a5d6-c45135f0f943 req-2551532b-07f1-4b88-abe8-5a2d45f01315 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036285 Nov 02 12:04:22.999214 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1467/2926] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:23.006633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:23.008366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:23.016154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:23.017281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:23.017978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:23.019515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:23.020219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:23.020841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:23.524483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:23.534777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:23.550954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:23.550954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9cc97de-8948-4413-b8ba-9c89a280634a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.547789 Nov 02 12:04:23.550954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1468/2927] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:22 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:23.564683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:23.565308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:23.594026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:23.594551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:23.595052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:23.595770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:23.596260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:23.606383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:23.997022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:24.014383 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46ce52e7-cdc1-4c4f-8fb4-c7ae6dcef3c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.448287 Nov 02 12:04:24.026673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1469/2928] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:23 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:24.047615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:24.048587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:24.055955 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68800330-5f38-4239-ab81-23448794c02c tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.346601 Nov 02 12:04:24.057044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1460/2929] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:04:16 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:24.062145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0af34b79-166c-4608-b6de-e1abcc7ccf4f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3cfb820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:24.078335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.078845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.082399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.083861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.084420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.084812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.164040 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0af34b79-166c-4608-b6de-e1abcc7ccf4f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.105786 Nov 02 12:04:24.164642 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1461/2930] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:24.185130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:24.187267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:24.204859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.207570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.210829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.211982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.213106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.213658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.320360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:24.336140 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d33a647-4e68-4688-af40-5acef9060b47 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 200 len: 1184 microversion: 2.1 time: 0.302535 Nov 02 12:04:24.337389 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1470/2931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 1184 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:24.343282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:24.344384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:24.352161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.352928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.353562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.354733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:24.355389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:24.356197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:24.807186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:24.826152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a0ebb04-27dd-47ae-b40e-3bb65c349086 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.654431 Nov 02 12:04:24.828949 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1462/2932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:24.836353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e3e3644-4437-413a-86d0-2621dda4b006 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1b32ea670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:24.968154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:24.979519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0d6fc54-1b48-4cde-b97a-a8fa568a2756 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.640023 Nov 02 12:04:24.987368 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1471/2933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:25.001185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:25.002230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:25.011620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.015765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.016520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:25.018159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:25.023950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:25.024514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.071609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e3e3644-4437-413a-86d0-2621dda4b006 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/ce091c45-43c3-4cb0-9ff5-14beb05f83c6" status: 200 len: 141 microversion: 2.1 time: 1.241385 Nov 02 12:04:26.074502 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1463/2934] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/os-floating-ips/ce091c45-43c3-4cb0-9ff5-14beb05f83c6 => generated 141 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:26.081297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.084483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:26.116656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.119480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.120183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.121651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.122194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.122640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.327943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:26.351233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:26.352938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:26.354374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a968eccc-cbf9-4588-9aff-e1507785ef78 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.365550 Nov 02 12:04:26.368207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1472/2935] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:24 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:26.389477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5768e595-c3af-48cc-b1d3-4bd3a30392ca tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b36e1040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.472343 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5768e595-c3af-48cc-b1d3-4bd3a30392ca tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.087704 Nov 02 12:04:26.472343 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1473/2936] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:26.485038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.487847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:26.512518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.523401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.531345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.532793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.533474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.534115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.559905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] HTTP exception thrown: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Request method failure captured: Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 HTTP/1.1 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlq-HUu10oXgjRMiKmE33-YQtKvB9j4lzKjOQsGseOXVx0DXRciRXs6YzjP-IHWYOCxKNFHftayNCU9pS1DP6soYlJUEyVPwY99xdZCb22RfkStASXyHWJE8higeKNDOsnHcg_qFFlzmEuABQEOEDcuI99C5kTrqsZ-d5N6EFnFQ3Dw Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_285fc9da5e0f4089a8aec02963aeb4a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 29699172e95148b99d076a8bcfc09668 Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4fab28a3-d4bd-4878-9cc3-1a3ffa827d52'} Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:26.570150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Returning 404 to user: Instance 4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8dc7950-c0c9-406e-a55d-5a6651e22b19 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52" status: 404 len: 111 microversion: 2.1 time: 0.097837 Nov 02 12:04:26.575279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1474/2937] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/servers/4fab28a3-d4bd-4878-9cc3-1a3ffa827d52 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:26.580967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.580967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:26.586553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.587162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.603154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.604212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.606582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.613609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.663409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:26.672860 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6944264-b543-4111-bd6d-0257a076d7b6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.596971 Nov 02 12:04:26.685188 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1464/2938] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:26.703435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:26.713676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:26.716065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:26.717473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.720618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.721335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:26.724265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:26.727501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:26.728878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:27.137692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:27.160983 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5783140-2b3d-4047-ad65-0786cf198a96 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.461771 Nov 02 12:04:27.162425 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1465/2939] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:27.169913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c13becab-aff4-412b-8062-cc3a39158c95 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1b3cfb820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:27.191997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:27.202436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0603b5a-64ab-4bdb-8fe2-64ae9fdcc532 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.628845 Nov 02 12:04:27.212362 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1475/2940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:26 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:27.383683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:27.385260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:27.396735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:27.399611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:27.401638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:27.405048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:27.405764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:27.406714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:28.178790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:28.201617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:28.203415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:28.204649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8c6ff02-103e-4d13-81d9-3842215dd75d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.824977 Nov 02 12:04:28.205236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1476/2941] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:27 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:28.248230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e1755f4-9aa2-499e-a22a-d21901f9a348 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb9a1a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:28.341144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e1755f4-9aa2-499e-a22a-d21901f9a348 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.101571 Nov 02 12:04:28.342159 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1477/2942] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:28 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:28.359126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:28.360970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:28.370915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:28.372729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:28.373744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:28.374731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:28.375544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:28.376231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ae4e7c5-374a-44b3-9465-5486dfae00db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.642160 Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1478/2943] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:28 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.172333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:29.173791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a28e460-4e8b-42d9-b261-d9a8c416cd87 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.166800 Nov 02 12:04:29.173791 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1479/2944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:28 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:29.173791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:29.173791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:29.180461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.181224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.182450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.183353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.183997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.185652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.343330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:29.351476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-008ade6d-607d-4915-b5b8-59e2aabc0bab tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.190950 Nov 02 12:04:29.352071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1480/2945] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:29 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:29.357317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024ac85c-57a5-4779-8e40-789a4330e60c", "name": "network-vif-plugged", "status": "completed", "tag": "d326e7d2-a469-42e1-976c-050cdeb4efa2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:29.367639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.368131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.368567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.382302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] Creating event network-vif-plugged:d326e7d2-a469-42e1-976c-050cdeb4efa2 for instance 024ac85c-57a5-4779-8e40-789a4330e60c on n-h1-855649-4 Nov 02 12:04:29.387671 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b0304889-2ac8-4567-94ce-c6e63cf85aea req-cfe7171b-54c7-4a02-a49c-379b754f9fc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034284 Nov 02 12:04:29.388299 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1481/2946] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:29.393562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:29.394280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:29.401807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.406148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.406148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:29.406148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:29.406148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:29.406148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.107038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:30.122547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:30.126514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:30.128336 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31e7de2a-fe52-4d75-b675-013948b99441 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.738791 Nov 02 12:04:30.149612 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1482/2947] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:29 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:30.166220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b0e8f05-c2c9-4b76-b6a2-9858bb5469db tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3078a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:30.242547 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c13becab-aff4-412b-8062-cc3a39158c95 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/ce091c45-43c3-4cb0-9ff5-14beb05f83c6" status: 202 len: 0 microversion: 2.1 time: 3.078640 Nov 02 12:04:30.243455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1466/2948] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:04:27 2022] DELETE /compute/v2.1/os-floating-ips/ce091c45-43c3-4cb0-9ff5-14beb05f83c6 => generated 0 bytes in 3080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:30.252142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:30.253041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:30.255755 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b0e8f05-c2c9-4b76-b6a2-9858bb5469db tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.103519 Nov 02 12:04:30.258371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1483/2949] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:30 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:30.271693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.273678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:30.279146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:30.287143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:30.289157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.297496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.301601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.303798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.305447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.316824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.322103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.325447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.326313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.326813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.327561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.698861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:30.718720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:30.731276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9176650a-d91a-4592-9fa0-a751635248b3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.477346 Nov 02 12:04:30.735051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1467/2950] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:30 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:30.745277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-056fb757-4c9c-48ee-92b9-3ed51975b0d6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1316 microversion: 2.1 time: 0.471815 Nov 02 12:04:30.748331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91957066-5454-4afc-bd37-6941b703a2b3 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1b3abaca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:30.751866 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1484/2951] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:30 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:30.762242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:30.762887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:30.780176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.781072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.781989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:30.783182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:30.783940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:30.784638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:31.130657 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91957066-5454-4afc-bd37-6941b703a2b3 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.394044 Nov 02 12:04:31.131578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1468/2952] 10.222.0.48 () {58 vars in 1164 bytes} [Wed Nov 2 12:04:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:31.145396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72e82f58-3ba2-4391-b50f-49c811e173da tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1b362adc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:31.230120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:31.242634 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b38f7d6a-caea-4dd7-9a10-e41c3d79ba18 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.488458 Nov 02 12:04:31.244275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1485/2953] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:30 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:31.254902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:31.255662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:31.270583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:31.940204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72e82f58-3ba2-4391-b50f-49c811e173da tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.798757 Nov 02 12:04:31.941568 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1469/2954] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:04:31 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:31.952547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1fde4bec-8be9-4004-9a48-edc273b82e9b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3a52820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:31.972601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:31.983277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:31.991661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:31.996151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4de38ea8-c789-4ee2-bc0b-6b1c23493604 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.750705 Nov 02 12:04:31.997035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1486/2955] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:31 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:32.005368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:32.007758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:32.022745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.023831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.024500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.028147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.028812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.029450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.075599 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1fde4bec-8be9-4004-9a48-edc273b82e9b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.130749 Nov 02 12:04:32.077776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1470/2956] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:31 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:32.095158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:32.097297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:32.115198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.116660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.117293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.118186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.118938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.120053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.425420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:32.437586 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be0a6070-f1da-4c1a-81ab-45868b5569a0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.439282 Nov 02 12:04:32.443946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1487/2957] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:31 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:32.451297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995936b0-85a5-4ef3-b24c-6bf627144a20 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1bb995c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:32.460625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:32.474845 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba1a040b-f8c8-4351-b868-1344d18fed65 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1505 microversion: 2.1 time: 0.391063 Nov 02 12:04:32.482140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1471/2958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:32 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:32.492174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:32.499168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:32.512940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.517689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.518422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.519399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.520032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.520655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.926105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:32.935013 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1b89119-cb47-4386-bd70-4f326f3ae9d9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.458236 Nov 02 12:04:32.939492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1472/2959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:32 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:32.950471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-786813489"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:32.957212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:32.971455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.971959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.977172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:32.977453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:32.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:32.979619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:33.420199 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Adding security group 3762c0fb-88a5-4e3c-937f-f74d6badf948 to port d326e7d2-a469-42e1-976c-050cdeb4efa2 Nov 02 12:04:34.528042 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f298ff1-f6c7-437b-9341-9f7c90b576c5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/action" status: 202 len: 0 microversion: 2.1 time: 1.587191 Nov 02 12:04:34.532542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1473/2960] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:32 2022] POST /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/action => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:34.538824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:34.539681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:34.553476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:34.554686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:34.555417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:34.556715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:34.557499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:34.558168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:34.609376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:34.679217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:34.872322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-995936b0-85a5-4ef3-b24c-6bf627144a20 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/a7f765c3-264d-4675-ba22-437ec66e152d" status: 202 len: 0 microversion: 2.1 time: 2.426456 Nov 02 12:04:34.874106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1488/2961] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:04:32 2022] DELETE /compute/v2.1/os-floating-ips/a7f765c3-264d-4675-ba22-437ec66e152d => generated 0 bytes in 2429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:34.886075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:34.887101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:34.902025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:34.903266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:34.905320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:34.908442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:34.909726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:34.910402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.011140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ddc7272-d3af-450a-b5a9-b2a73afcfe16 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 204 len: 0 microversion: 2.1 time: 0.476559 Nov 02 12:04:35.012232 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1474/2962] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:34 2022] DELETE /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:35.018050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84d5b1ea-ac14-48a1-8dd5-aef38169144f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3eeedc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:35.124347 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84d5b1ea-ac14-48a1-8dd5-aef38169144f tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1453 microversion: 2.1 time: 0.110559 Nov 02 12:04:35.128973 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1475/2963] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:35 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:35.140303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:35.141065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:35.153795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.154314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.155071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.155951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.156588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.157039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.424136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:35.441397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:35.444488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:35.449086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:35.450692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8534cd6-7fdc-492c-982e-2d179b29cfa2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.320647 Nov 02 12:04:35.451255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1459edb7-b72f-4e7e-ac70-7468b59491b1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.575781 Nov 02 12:04:35.465101 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1489/2964] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:34 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:35.465319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1476/2965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:35 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:35.472976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-976745494"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:35.474396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:35.480478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:35.482870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:35.484012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.484706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.485312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.486027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.486477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.487135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.493102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.494314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.495186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.495985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.496517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.497144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.693699 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Adding security group ec6cee3a-b3ef-4cf8-bd82-a848971f13e2 to port d326e7d2-a469-42e1-976c-050cdeb4efa2 Nov 02 12:04:35.717188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:35.733050 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1484f4d9-12ce-41c8-b7cf-894723b87b01 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.271719 Nov 02 12:04:35.733768 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1490/2966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:35 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:35.751122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024ac85c-57a5-4779-8e40-789a4330e60c", "tag": "d326e7d2-a469-42e1-976c-050cdeb4efa2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:35.773476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:35.775062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:35.827846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:35.827846 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] Creating event network-changed:d326e7d2-a469-42e1-976c-050cdeb4efa2 for instance 024ac85c-57a5-4779-8e40-789a4330e60c on n-h1-855649-4 Nov 02 12:04:35.827846 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c73952d-6098-4c97-a3e8-fc282ddfc68a req-f992c444-00fe-46a4-b97a-ff872ea0211a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058398 Nov 02 12:04:35.827846 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1491/2967] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:35.827846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a18892a-5f15-4958-beab-a2ddd8928ae7 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1bb9a1940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:37.401682 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7722f3ef-e89d-48c5-839b-bf1e553ba582 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/action" status: 202 len: 0 microversion: 2.1 time: 1.935568 Nov 02 12:04:37.403494 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1477/2968] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:35 2022] POST /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/action => generated 0 bytes in 1939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:37.411112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:37.412353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:37.422307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:37.423244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:37.424229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:37.425288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:37.427090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:37.427873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.135622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:38.152122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c66d7c7f-abbb-411d-b9ab-1a8cee548cf9 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1668 microversion: 2.1 time: 0.746578 Nov 02 12:04:38.155271 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1478/2969] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:37 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1668 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:38.161539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5245e47c-e6e7-4939-80fc-1aeec1a6f0f4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3988430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:38.254785 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5245e47c-e6e7-4939-80fc-1aeec1a6f0f4 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1462 microversion: 2.1 time: 0.097711 Nov 02 12:04:38.255990 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1479/2970] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:38 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:38.262990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:38.263819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:38.273329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.276574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.279989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.281030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.282545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.284390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.470603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:38.480620 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea4a296f-708e-47b1-af9d-6de4b6ad9ff3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.222643 Nov 02 12:04:38.481876 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1480/2971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:38 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:38.488471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:38.489339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:38.498278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.500667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.502075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.503014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.503518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.503956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.762784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a18892a-5f15-4958-beab-a2ddd8928ae7 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/94fd192d-6029-4155-835b-d1fb6de6e3b2" status: 202 len: 0 microversion: 2.1 time: 2.967477 Nov 02 12:04:38.764102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1492/2972] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:04:35 2022] DELETE /compute/v2.1/os-floating-ips/94fd192d-6029-4155-835b-d1fb6de6e3b2 => generated 0 bytes in 2969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:38.772641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:38.773825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:38.788144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.788932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.789605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.790517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.791763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.792410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.902411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:38.921114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:38.923330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:38.924826 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bdcfab09-ce98-4bf0-9197-853e56e66287 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.441063 Nov 02 12:04:38.925479 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1481/2973] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:38 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:38.944796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:38.945393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:38.952479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.953069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.953603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:38.954469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:38.955549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:38.955549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:39.075825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:39.087796 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1db6e13-48d3-45f6-8764-c0d36a914077 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1518 microversion: 2.1 time: 0.318659 Nov 02 12:04:39.088800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1493/2974] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:38 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:39.111630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024ac85c-57a5-4779-8e40-789a4330e60c", "tag": "d326e7d2-a469-42e1-976c-050cdeb4efa2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:39.157837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:39.161139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:39.161139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:39.177047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] Creating event network-changed:d326e7d2-a469-42e1-976c-050cdeb4efa2 for instance 024ac85c-57a5-4779-8e40-789a4330e60c on n-h1-855649-4 Nov 02 12:04:39.182493 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-555bfe96-14f4-43ee-9694-80a6511a28a5 req-d377bdc6-a82b-4b7a-8716-6145b23dc4c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076072 Nov 02 12:04:39.184234 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1494/2975] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:39.190553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-211ec8e5-3559-4d31-b5b8-188d62568af5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b30543a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:39.249978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-211ec8e5-3559-4d31-b5b8-188d62568af5 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 200 len: 1462 microversion: 2.1 time: 0.061781 Nov 02 12:04:39.250804 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1495/2976] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:39 2022] GET /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 1462 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:39.255848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2a9413b-8122-421c-a148-65fdd7bb6096 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] Calling method '.version_select at 0x7ff1b36e1040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:39.393476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db8a44c1-f9f8-46ca-9ec0-02f55e054b1a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/os-security-groups" status: 200 len: 1153 microversion: 2.1 time: 0.453269 Nov 02 12:04:39.394077 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1482/2977] 10.222.0.48 () {58 vars in 1293 bytes} [Wed Nov 2 12:04:38 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c/os-security-groups => generated 1153 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:39.400656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:39.401587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:39.408812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:39.409326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:39.409777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:39.411065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:39.411774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:39.412372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:39.540081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:39.552629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aaf5e6ec-bc11-4237-abb0-1254303e1e6d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1600 microversion: 2.1 time: 0.156766 Nov 02 12:04:39.553869 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1483/2978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:39 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:39.559504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:39.560642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:39.568853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:39.569549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:39.570060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:39.570888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:39.571500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:39.572872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:40.005052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:40.015097 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c81e890-9003-414b-a465-3aa12a4bec62 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1466 microversion: 2.1 time: 0.459850 Nov 02 12:04:40.016200 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1484/2979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:39 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1466 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:40.020875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48cd44f0-27c4-45cc-8bb6-75f1e1011dce tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1bbb15ca0>, body: {"security_group": {"name": " tempest-securitygroup -181386547 ", "description": "tempest-description-1640726836"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:40.595613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48cd44f0-27c4-45cc-8bb6-75f1e1011dce tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.578757 Nov 02 12:04:40.599464 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1485/2980] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:40 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:40.603649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:40.604287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:40.616859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:40.620711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:40.624306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:40.626722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:40.626722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:40.626722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:40.636679 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2a9413b-8122-421c-a148-65fdd7bb6096 tempest-FloatingIPDetailsTestJSON-906723930 tempest-FloatingIPDetailsTestJSON-906723930-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3832a18f-8568-45f2-82c1-ab714d1849ab" status: 202 len: 0 microversion: 2.1 time: 1.383773 Nov 02 12:04:40.638249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1496/2981] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:04:39 2022] DELETE /compute/v2.1/os-floating-ips/3832a18f-8568-45f2-82c1-ab714d1849ab => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:40.653027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:40.654356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:40.693613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:40.694527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:40.698635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:40.700294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:40.701172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:40.702248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.169976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:41.195171 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c93bacba-d3b2-4ebd-8f97-66898e57e2a7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.597054 Nov 02 12:04:41.197729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1486/2982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:40 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:41.205109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac546079-325b-44c1-b53a-39b2b3b4b622 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b36383a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:41.381684 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac546079-325b-44c1-b53a-39b2b3b4b622 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?changes-since=2022-11-02T12%3A01%3A53Z" status: 200 len: 2377 microversion: 2.1 time: 0.182142 Nov 02 12:04:41.391917 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1487/2983] 10.222.0.48 () {58 vars in 1199 bytes} [Wed Nov 2 12:04:41 2022] GET /compute/v2.1/images?changes-since=2022-11-02T12%3A01%3A53Z => generated 2377 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:41.391917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:41.391917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:41.394379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:41.418508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:41.419124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:41.419780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.421207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:41.421700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:41.422143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.807672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:41.856732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:41.859912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:41.861965 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bfeddda-8409-44e2-816d-04e2b31682e8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 1.222267 Nov 02 12:04:41.863106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1497/2984] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:40 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:41.882752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:41.883487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:41.907256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:41.908099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:41.908697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.912361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:41.912361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:41.912361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.950660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:41.951184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:41.951647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:41.952431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lazy-loading 'fault' on Instance uuid 10f47a4b-0e54-4791-900d-e94df091634f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:42.051316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:42.052225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:42.085186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3689492-a7c9-482c-b0bf-c43ac4028753 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 200 len: 1324 microversion: 2.1 time: 0.218711 Nov 02 12:04:42.085826 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1498/2985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:41 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:42.095647 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16a9f795-831f-40a9-93ab-abbeff5f6bf2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1536 microversion: 2.1 time: 0.710770 Nov 02 12:04:42.096963 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1488/2986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:41 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1536 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:42.108496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "b879a752-ec06-440b-84a3-563bb110cd1d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:42.108723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7108b502-31ad-413b-b49f-ac71d08eaac1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b36e1940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.122168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.122917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.123609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:42.137533 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] Creating event network-vif-plugged:b879a752-ec06-440b-84a3-563bb110cd1d for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:42.143466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c614479f-752a-4b19-a6ac-ddeacb5aa370 req-fe8c22a2-6d8b-4940-a9a2-1dbbf6bd86e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044572 Nov 02 12:04:42.144528 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1489/2987] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.149769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4310bb9f-1a3c-4a99-80ee-912cc847e413 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b348d5e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.238432 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4310bb9f-1a3c-4a99-80ee-912cc847e413 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1638420321" status: 200 len: 485 microversion: 2.1 time: 0.092630 Nov 02 12:04:42.239107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1490/2988] 10.222.0.48 () {58 vars in 1231 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1638420321 => generated 485 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.244075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10f47a4b-0e54-4791-900d-e94df091634f", "name": "network-vif-deleted", "tag": "1749bc25-c232-49ad-ba40-02beae75ead8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:42.255329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.255822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.256264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:42.267909 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] Creating event network-vif-deleted:1749bc25-c232-49ad-ba40-02beae75ead8 for instance 10f47a4b-0e54-4791-900d-e94df091634f on n-h2-855649-4 Nov 02 12:04:42.272987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2bdfab3d-bf4a-4849-a11c-9436ea542443 req-e4d80116-2594-4d4d-8b58-ced1716d00d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Nov 02 12:04:42.273795 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1491/2989] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.279765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.280515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:42.286967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.287902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.288362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:42.289147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.295178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.295178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:42.316662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7108b502-31ad-413b-b49f-ac71d08eaac1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7" status: 200 len: 223 microversion: 2.1 time: 0.215354 Nov 02 12:04:42.323782 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1499/2990] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 => generated 223 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.323782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8be78924-a8d0-4a74-b49d-1d6ba2b6a452 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3006dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.438412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8be78924-a8d0-4a74-b49d-1d6ba2b6a452 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?server=0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 958 microversion: 2.1 time: 0.119716 Nov 02 12:04:42.439182 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1500/2991] 10.222.0.48 () {58 vars in 1209 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/images?server=0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 958 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.443980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ff0f99f-7aef-434f-a423-64663775c5c0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3054af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.744339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:42.752988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24321050-3e42-4743-b4b5-9a9ddb2ef9b8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.477716 Nov 02 12:04:42.753816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1492/2992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:42.760658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4475df4c-8bdc-4d8a-aeeb-7c4a94a2e745 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b348d820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.816025 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4475df4c-8bdc-4d8a-aeeb-7c4a94a2e745 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 485 microversion: 2.1 time: 0.061216 Nov 02 12:04:42.816716 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1493/2993] 10.222.0.48 () {58 vars in 1317 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 485 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.829997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d82ee32-1a2e-4b7d-87c8-8e07ab5e572c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb15ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.885895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d82ee32-1a2e-4b7d-87c8-8e07ab5e572c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 485 microversion: 2.1 time: 0.059989 Nov 02 12:04:42.886595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1494/2994] 10.222.0.48 () {58 vars in 1303 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 485 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:42.897066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:42.897708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:42.904722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.905235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.906193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:42.906929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:42.907488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:42.907908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.277489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:43.300076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:43.302873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:43.304386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5139faf8-1b69-4580-9e50-2d740ec03a38 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.416932 Nov 02 12:04:43.319415 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1495/2995] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:42 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:43.319415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-671afbf5-2777-4960-b723-29ca90d85fcc tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3d783a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.328920 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ff0f99f-7aef-434f-a423-64663775c5c0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7" status: 202 len: 0 microversion: 2.1 time: 0.883087 Nov 02 12:04:43.328920 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1501/2996] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:04:42 2022] DELETE /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:43.334344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.334969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: 10f47a4b-0e54-4791-900d-e94df091634f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:43.345287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.351735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.351735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.351735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.351735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.351735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.368095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] HTTP exception thrown: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Request method failure captured: Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f HTTP/1.1 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlq-HUu10oXgjRMiKmE33-YQtKvB9j4lzKjOQsGseOXVx0DXRciRXs6YzjP-IHWYOCxKNFHftayNCU9pS1DP6soYlJUEyVPwY99xdZCb22RfkStASXyHWJE8higeKNDOsnHcg_qFFlzmEuABQEOEDcuI99C5kTrqsZ-d5N6EFnFQ3Dw Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_285fc9da5e0f4089a8aec02963aeb4a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 29699172e95148b99d076a8bcfc09668 Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '10f47a4b-0e54-4791-900d-e94df091634f'} Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:43.370044 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. Nov 02 12:04:43.374241 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.376115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Returning 404 to user: Instance 10f47a4b-0e54-4791-900d-e94df091634f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:43.377397 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-027e9738-442e-4a6c-8b71-92597c2b806a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f" status: 404 len: 111 microversion: 2.1 time: 0.049811 Nov 02 12:04:43.382146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1502/2997] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/servers/10f47a4b-0e54-4791-900d-e94df091634f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:43.387815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.388611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:43.398128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.399129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.399572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.403206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.403206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.403206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.428718 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-671afbf5-2777-4960-b723-29ca90d85fcc tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.122628 Nov 02 12:04:43.431154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1496/2998] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:43.441251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3abadc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.454295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:43.497367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:04:43.498054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:04:43.498697 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.498697 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 HTTP/1.1 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '7c95332d-56b1-495d-82da-adcce4d6b3e7'} Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:04:43.501028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-c828b4a1-798b-4f5b-a569-68535798d194'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4646b4c-84de-45e6-9957-f7ba060b8802 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7" status: 404 len: 194 microversion: 2.1 time: 0.070195 Nov 02 12:04:43.507639 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1497/2999] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:43.512912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94eaf5bb-64be-4938-9c75-3f32a47f12bb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '.version_select at 0x7ff1b3aba430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.583299 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94eaf5bb-64be-4938-9c75-3f32a47f12bb tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453736248" status: 202 len: 0 microversion: 2.1 time: 0.077480 Nov 02 12:04:43.584282 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1498/3000] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453736248 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:43.590368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26a88218-d82c-41a7-8499-2d5ac7c17672 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b34b1700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.656380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:43.665734 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0746e8d-848c-4d8a-b70f-b665ae59c36d tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.282270 Nov 02 12:04:43.666932 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1503/3001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:43.669216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26a88218-d82c-41a7-8499-2d5ac7c17672 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.083262 Nov 02 12:04:43.670790 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1499/3002] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:43.673167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11c5b75d-54f5-43f3-a1bb-967dea9a8a07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1bbad63a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-187401179", "description": "tempest-description-595248217"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:43.686398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea5deb0a-5e6e-4a10-9625-113f04fccd40 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3ec0670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.746132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea5deb0a-5e6e-4a10-9625-113f04fccd40 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.066091 Nov 02 12:04:43.746721 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1500/3003] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:43.761022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14304530-a54e-41b5-8574-77908056e179 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b362a550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.860188 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14304530-a54e-41b5-8574-77908056e179 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A01%3A46Z" status: 200 len: 6330 microversion: 2.1 time: 0.103648 Nov 02 12:04:43.862509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1501/3004] 10.222.0.48 () {58 vars in 1220 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A01%3A46Z => generated 6330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:04:43.870320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:43.871299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:43.880278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.881463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.881906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:43.883279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:43.883928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:43.884413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:44.241554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:44.253961 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-150d766b-5f04-4d20-9d5c-49cbed7bdaa0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.389023 Nov 02 12:04:44.255235 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1502/3005] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:43 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:44.261201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b38fcfa-71c5-4cc5-9b1f-aec4e9db0746 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3ec0a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:44.322887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b38fcfa-71c5-4cc5-9b1f-aec4e9db0746 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1638420321" status: 200 len: 665 microversion: 2.1 time: 0.066360 Nov 02 12:04:44.324568 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1503/3006] 10.222.0.48 () {58 vars in 1252 bytes} [Wed Nov 2 12:04:44 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1638420321 => generated 665 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:44.329960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "eadf8d60-0c26-45e9-b1bc-480e455004ef"}, {"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-unplugged", "status": "completed", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "13fc1c9d-d40d-44c2-aa1b-815471bf931b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:44.346564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:44.347473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:44.348134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:44.349187 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11c5b75d-54f5-43f3-a1bb-967dea9a8a07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.680464 Nov 02 12:04:44.358988 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1504/3007] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:43 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:44.363521 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Creating event network-vif-plugged:eadf8d60-0c26-45e9-b1bc-480e455004ef for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:44.363954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:44.364569 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Creating event network-vif-unplugged:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:04:44.364687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:44.365415 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] Creating event network-vif-plugged:13fc1c9d-d40d-44c2-aa1b-815471bf931b for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:44.377615 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-dd167651-e095-44db-9db9-80fcb3e05875 req-39d5d2f4-7d99-4890-8c23-6e2d906d7e3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.051395 Nov 02 12:04:44.378923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1504/3008] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:44.379372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:44.379905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:44.380575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:44.383728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:44.385034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:44.386402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:44.387045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06addd08-9d24-47e9-971d-62ccc117ef66 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bbb15820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:44.468723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06addd08-9d24-47e9-971d-62ccc117ef66 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1465 microversion: 2.1 time: 0.080272 Nov 02 12:04:44.468723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1505/3009] 10.222.0.48 () {58 vars in 1338 bytes} [Wed Nov 2 12:04:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1465 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:44.469576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39a257f4-7e85-439d-89b1-713686423b6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1b3a52c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1393337451", "description": "tempest-description-1202931799"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:44.787180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:44.800125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:44.802186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:44.803600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9c2596f-1de1-4bc8-a51e-26765a960e67 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.443577 Nov 02 12:04:44.804253 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1505/3010] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:44 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:44.810631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-334d93cd-9b06-498f-a49c-c52029a5cba6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb947af0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:44.901905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-334d93cd-9b06-498f-a49c-c52029a5cba6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1465 microversion: 2.1 time: 0.095974 Nov 02 12:04:44.903797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1506/3011] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Nov 2 12:04:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:44.909685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:44.910830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:44.925476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:44.926427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:44.927837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:44.930252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:44.931565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:44.933970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:45.223294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39a257f4-7e85-439d-89b1-713686423b6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.758412 Nov 02 12:04:45.224789 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1506/3012] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:45.230533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eeb21692-de1c-4462-8fcf-4b9296921166 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b350c1f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:45.298831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:45.309682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c654bf7e-2e81-4ca2-b06f-d88f95712eb2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.404523 Nov 02 12:04:45.311507 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1507/3013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:44 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:45.316468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:45.322270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:45.324992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:45.325717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:45.326357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:45.327525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:45.328216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:45.328793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:45.359709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:45.401603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eeb21692-de1c-4462-8fcf-4b9296921166 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.175537 Nov 02 12:04:45.416992 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1507/3014] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 12:04:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:45.428205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-494535ad-42a4-4eb0-9a41-245a0b5e487c tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1bbb159d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1155071738", "description": "tempest-description-1987386569"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:45.783953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa35e94c-886b-44bb-a300-d1a08420389b tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 204 len: 0 microversion: 2.1 time: 0.470860 Nov 02 12:04:45.789100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1508/3015] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:45 2022] DELETE /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:45.800501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:45.801568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:45.809260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:45.810653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:45.811403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:45.812659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:45.814277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:45.815028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:46.319345 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-494535ad-42a4-4eb0-9a41-245a0b5e487c tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.900708 Nov 02 12:04:46.321061 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1508/3016] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:45 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:46.329054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f223d1ce-8f8b-460e-a9a1-547a8de75122 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b33a8a60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:46.446003 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f223d1ce-8f8b-460e-a9a1-547a8de75122 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.122898 Nov 02 12:04:46.448415 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1509/3017] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 12:04:46 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:46.453987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:46.454946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:46.463203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:46.463988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:46.464658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:46.466169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:46.466842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:46.467518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:46.487696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:46.495660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76bb3b00-231f-41a3-ab6d-eb9946aac8f1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1501 microversion: 2.1 time: 0.704201 Nov 02 12:04:46.511481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1509/3018] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:45 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1501 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:46.519712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:46.520702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:46.528665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:46.529518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:46.530808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:46.531811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:46.532706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:46.533694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:46.913276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:46.923741 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a95c14d-96bc-410b-9834-68b68b451d3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1485 microversion: 2.1 time: 0.473863 Nov 02 12:04:46.925981 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1510/3019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:46 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1485 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:46.932308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b24d042-3503-4f94-a4c0-6511e8159bd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb9b2790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:47.077224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:47.093197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:47.094753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:47.099899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18e90380-e7f1-46e0-996a-d485c21c1430 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.583068 Nov 02 12:04:47.111406 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1510/3020] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:46 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:47.116502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:47.117129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:47.136353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.136724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.137177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.137892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.139261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.139878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.544164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:47.555103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47cc10c6-caca-42d7-85dc-6b8d98007fe5 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.442415 Nov 02 12:04:47.556987 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1511/3021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:47 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:47.562856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "2d8bdb28-49c7-46e6-bf07-b47c1518f9d2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:47.574669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.575643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.576440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.592769 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] Creating event network-vif-plugged:2d8bdb28-49c7-46e6-bf07-b47c1518f9d2 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:47.599036 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-191531c9-0e67-4d0f-880a-3f996d5673e9 req-afbf8892-b359-4102-9306-661f9c0246fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040333 Nov 02 12:04:47.599997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1512/3022] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:47.606043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9330b27d-d8f6-4a5d-9476-80d90aa66889 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1bb95bf70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:47.667831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9330b27d-d8f6-4a5d-9476-80d90aa66889 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043" status: 200 len: 784 microversion: 2.1 time: 0.066276 Nov 02 12:04:47.680839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1513/3023] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:47 2022] GET /compute/v2.1/images/2f72b382-4911-4efc-9bb2-e22b0b29c043 => generated 784 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:47.686884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbdc398c-954f-4671-a01c-503e1148ef5f"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:47.696076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b24d042-3503-4f94-a4c0-6511e8159bd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.768478 Nov 02 12:04:47.697643 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1511/3024] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 12:04:46 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:47.701945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:47.702892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48ac1ae3-a986-4538-a5c6-fc31ade295b3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3e6a160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:47.716414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.716992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.717499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.718462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.719006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.719562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.753770 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Cannot 'attach_volume' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state rescued Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/os-volume_attachments HTTP/1.1 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 74 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: {"volumeAttachment": {"volumeId": "cbdc398c-954f-4671-a01c-503e1148ef5f"}} Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'attach_volume' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state rescued Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '913d268b-12de-473f-b12a-32516fe6c52d', 'body': {'volumeAttachment': {'volumeId': 'cbdc398c-954f-4671-a01c-503e1148ef5f'}}} Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 913d268b-12de-473f-b12a-32516fe6c52d in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 12:04:47.756119 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state rescued Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state rescued Nov 02 12:04:47.762167 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:47.764659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 409 to user: Cannot 'attach_volume' instance 913d268b-12de-473f-b12a-32516fe6c52d while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:47.765659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e6e0781-556f-4ec5-bb01-13ff60842be0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082956 Nov 02 12:04:47.766405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1514/3025] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:04:47 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/os-volume_attachments => generated 152 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:04:47.769820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48ac1ae3-a986-4538-a5c6-fc31ade295b3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.070830 Nov 02 12:04:47.771052 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1512/3026] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 12:04:47 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:47.771708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3306d729-07d8-4196-9c10-55bd82626533 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb95b3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:47.777078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:47.781770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:47.786567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.787677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.788142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.788884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:47.789352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:47.789807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:47.850786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:47.998714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8e0dceb-549e-4ed3-9ce7-8b113e389fbb tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action" status: 202 len: 0 microversion: 2.1 time: 0.225671 Nov 02 12:04:47.999710 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1513/3027] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:04:47 2022] POST /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:48.012502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8f8304a-4900-494c-ad8f-a6d1437aa053 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b3d0c5e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:48.467953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3306d729-07d8-4196-9c10-55bd82626533 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57" status: 202 len: 0 microversion: 2.1 time: 0.699746 Nov 02 12:04:48.469531 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1515/3028] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:04:47 2022] DELETE /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:48.479085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:48.497295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:48.518485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.519604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.520534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:48.521949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.523322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.524375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:48.602373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.603162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.603514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:48.603985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lazy-loading 'fault' on Instance uuid fc44e92c-29a5-41a6-870c-a9d881e34e8c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:48.669204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:48.677826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-244d0f1c-e4da-4276-91b2-5fc8a57ab9d2 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 200 len: 1300 microversion: 2.1 time: 0.206102 Nov 02 12:04:48.678528 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1516/3029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:48 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 1300 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:48.701555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc44e92c-29a5-41a6-870c-a9d881e34e8c", "name": "network-vif-deleted", "tag": "0b1af59e-6454-43b1-84c1-2c0adf0311fa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:48.716814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.716814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.716814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:48.732735 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] Creating event network-vif-deleted:0b1af59e-6454-43b1-84c1-2c0adf0311fa for instance fc44e92c-29a5-41a6-870c-a9d881e34e8c on n-h1-855649-4 Nov 02 12:04:48.739425 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-238c8147-4db6-434b-959d-bbd9c665bcfa req-a221b35a-7894-4865-bef6-93649768b7ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045064 Nov 02 12:04:48.739425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1517/3030] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:48.744430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:48.745192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:48.752268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.752761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.753203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:48.754207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:48.755112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:48.755747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.070535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:49.083374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04b9b6a2-9b50-4372-bd85-51921783edf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1509 microversion: 2.1 time: 0.342683 Nov 02 12:04:49.084862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1518/3031] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:48 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:49.096314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:49.100570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:49.106898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.107501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.108140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.108891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.109829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.110270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.511340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:49.517820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:49.523669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:49.525651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c9cadad-5705-4053-b483-228df14dcec3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.438381 Nov 02 12:04:49.526617 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1519/3032] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:49 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:49.544411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb961b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:49.572193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:04:49.572893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 629caf0d-0730-423a-aea8-74c10826aa57 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:04:49.573431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.573431 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57 HTTP/1.1 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '629caf0d-0730-423a-aea8-74c10826aa57'} Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:04:49.580455 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:04:49.586480 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-cc927958-470d-48eb-b189-35985bade4d8'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:49.593262 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0370fb83-7fbf-4423-a86a-7831d5c8a40a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57" status: 404 len: 194 microversion: 2.1 time: 0.064402 Nov 02 12:04:49.593860 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1520/3033] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:04:49 2022] GET /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:49.602777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.623052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.843173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:49.847257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8f8304a-4900-494c-ad8f-a6d1437aa053 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed" status: 204 len: 0 microversion: 2.1 time: 1.845217 Nov 02 12:04:49.853129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1514/3034] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:47 2022] DELETE /compute/v2.1/images/0520f48a-5fc0-440d-ad63-6f4fee3bf5ed => generated 0 bytes in 1847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:49.859381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09a810c8-2fa6-49a4-bcef-e5b7ca2797d1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb9b2dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:49.865108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fc0243f-a264-467d-9ca0-6b8fa7fe59d3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.268440 Nov 02 12:04:49.871358 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1521/3035] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:49 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:49.878843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3254f-6563-4c0d-8167-c4c7999deaab", "name": "network-vif-unplugged", "status": "completed", "tag": "9c492ab5-152c-4f3d-9582-57dc643bfb7f"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "f41ae705-0356-48af-848d-ad7512330081"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "0ff918d3-9b80-4216-9267-64ae5089850a"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-plugged", "status": "completed", "tag": "f6e7433d-cdbb-4831-805c-6ec5d60d2aee"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:49.891745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.892496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.901786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.920705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Creating event network-vif-unplugged:9c492ab5-152c-4f3d-9582-57dc643bfb7f for instance 93c3254f-6563-4c0d-8167-c4c7999deaab on n-h1-855649-4 Nov 02 12:04:49.921230 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Creating event network-vif-plugged:f41ae705-0356-48af-848d-ad7512330081 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:49.921788 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Creating event network-vif-plugged:0ff918d3-9b80-4216-9267-64ae5089850a for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:49.922446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] Creating event network-vif-plugged:f6e7433d-cdbb-4831-805c-6ec5d60d2aee for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:04:49.933559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bc1feba1-ded3-460b-b163-caf0e814b382 req-4bf6e6e3-05bb-47a0-84cc-8c1615e482c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.060621 Nov 02 12:04:49.934398 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1522/3036] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:49.942088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:49.942813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: fc44e92c-29a5-41a6-870c-a9d881e34e8c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:49.949936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.952378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.955816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.955816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:49.955816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:49.955816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:49.969224 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] HTTP exception thrown: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Request method failure captured: Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c HTTP/1.1 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlq-HUu10oXgjRMiKmE33-YQtKvB9j4lzKjOQsGseOXVx0DXRciRXs6YzjP-IHWYOCxKNFHftayNCU9pS1DP6soYlJUEyVPwY99xdZCb22RfkStASXyHWJE8higeKNDOsnHcg_qFFlzmEuABQEOEDcuI99C5kTrqsZ-d5N6EFnFQ3Dw Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_285fc9da5e0f4089a8aec02963aeb4a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 29699172e95148b99d076a8bcfc09668 Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc44e92c-29a5-41a6-870c-a9d881e34e8c'} Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:49.971128 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Returning 404 to user: Instance fc44e92c-29a5-41a6-870c-a9d881e34e8c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eca0318f-a4a6-430f-bcbb-013927fa3a28 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c" status: 404 len: 111 microversion: 2.1 time: 0.036843 Nov 02 12:04:49.977062 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1523/3037] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:49 2022] GET /compute/v2.1/servers/fc44e92c-29a5-41a6-870c-a9d881e34e8c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:49.981843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73a0ba2d-7b51-4f06-bb66-cb4f52b97c03 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b304fc10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:50.527764 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09a810c8-2fa6-49a4-bcef-e5b7ca2797d1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d" status: 202 len: 0 microversion: 2.1 time: 0.678255 Nov 02 12:04:50.528969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1515/3038] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:04:49 2022] DELETE /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:50.537177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:50.537929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:50.552301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:50.552925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:50.553616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:50.554756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:50.555317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:50.555898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:50.638131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:51.079037 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0fe79f1-90e8-4153-8153-e4dacf356e3a tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 204 len: 0 microversion: 2.1 time: 0.547917 Nov 02 12:04:51.079995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1516/3039] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:50 2022] DELETE /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:51.085810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.086539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:51.093475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.093968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.094411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.095161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.095650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.096085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.333743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:51.345612 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a65f93df-1a3d-4aab-8e6f-b6f794a3b56b tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1509 microversion: 2.1 time: 0.264230 Nov 02 12:04:51.358722 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1517/3040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:51 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:51.358722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3a79ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.379042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:04:51.379997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 6aae5eca-64c4-46f6-a666-f19088b9939d not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:04:51.381169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.381169 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d HTTP/1.1 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '6aae5eca-64c4-46f6-a666-f19088b9939d'} Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:04:51.383697 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-42741631-4e4c-4c1b-be9a-7f2acb0373c3'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c418f164-97a6-4268-bdc9-00b78f70e98a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d" status: 404 len: 194 microversion: 2.1 time: 0.039186 Nov 02 12:04:51.397440 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1518/3041] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:04:51 2022] GET /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:51.408052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.410775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:51.419529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.420539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.421263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.422242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.423498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.424206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.483946 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73a0ba2d-7b51-4f06-bb66-cb4f52b97c03 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580" status: 204 len: 0 microversion: 2.1 time: 1.506090 Nov 02 12:04:51.484712 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1524/3042] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:49 2022] DELETE /compute/v2.1/images/632c4a73-ec51-4fbb-9784-e23e2bea5580 => generated 0 bytes in 1508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:51.489807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.490426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:51.504039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.504545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.507764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.508552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.511735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.512193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.864879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:51.877777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:51.885554 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78d1a03b-0529-44f6-85cd-4099a2169255 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.388792 Nov 02 12:04:51.895129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1525/3043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:51 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:51.901912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:51.905232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:51.906529 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f6b9c1e-5303-4eb6-a2c5-aa641fdff195 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.518281 Nov 02 12:04:51.907896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.908533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:51.909677 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1519/3044] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:51 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:51.932266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e24e465-7134-4690-8e6e-b5f8bdd96cf8 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3a79af0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:51.936746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.937260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.940260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:51.941034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:51.941516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:51.942112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:52.184166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:52.193781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b96bf88b-cee2-43ec-9123-40d9bb16f2a3 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1500 microversion: 2.1 time: 0.297251 Nov 02 12:04:52.207755 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1526/3045] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:51 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1500 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:52.216596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e78559fc-32f0-4a09-a826-1dac71ba229c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b30220d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:52.389632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e24e465-7134-4690-8e6e-b5f8bdd96cf8 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8" status: 202 len: 0 microversion: 2.1 time: 0.476077 Nov 02 12:04:52.389632 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1520/3046] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:04:51 2022] DELETE /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:04:52.396810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3254f-6563-4c0d-8167-c4c7999deaab", "name": "network-vif-plugged", "status": "completed", "tag": "9c492ab5-152c-4f3d-9582-57dc643bfb7f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:52.412166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:52.414014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:52.414474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:52.438645 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] Creating event network-vif-plugged:9c492ab5-152c-4f3d-9582-57dc643bfb7f for instance 93c3254f-6563-4c0d-8167-c4c7999deaab on n-h1-855649-4 Nov 02 12:04:52.451346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0c6a93b8-faac-4204-918d-272477c2c712 req-f1152fae-7675-4fac-8527-6eba317276e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056590 Nov 02 12:04:52.451346 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1521/3047] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:52.453796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:52.454539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:52.462027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:52.462561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:52.463040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:52.463772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:52.464421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:52.465044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:52.712807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:52.721240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93e04663-e992-4393-a3c8-43bd34cedda3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1515 microversion: 2.1 time: 0.272978 Nov 02 12:04:52.721835 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1522/3048] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:52 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:52.727159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3eee3a0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:52.800541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:04:52.801268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 not found {{(pid=127568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:04:52.801908 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.801908 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8 HTTP/1.1 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: exception: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '79085329-ed30-48ff-bdb2-67f7ea3508c8'} Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:04:52.804284 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-132ed2ee-6e8b-4a6f-bccb-8c5af09ff477'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8dce6483-ece6-4843-ace2-a98677aa0b46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8" status: 404 len: 194 microversion: 2.1 time: 0.082800 Nov 02 12:04:52.810775 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1523/3049] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:04:52 2022] GET /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:52.817209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b8e5423-c42b-4e0e-b3ba-af5e0fc240ad tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b350c8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:52.865782 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b8e5423-c42b-4e0e-b3ba-af5e0fc240ad tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2" status: 200 len: 637 microversion: 2.1 time: 0.057458 Nov 02 12:04:52.866799 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1524/3050] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Nov 2 12:04:52 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2 => generated 637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:52.872326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfae162e-774c-4d33-9ebb-ca44cd044d46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b33a8280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:53.269373 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfae162e-774c-4d33-9ebb-ca44cd044d46 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1153 microversion: 2.1 time: 0.400230 Nov 02 12:04:53.280268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1525/3051] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 12:04:52 2022] GET /compute/v2.1/os-security-groups => generated 1153 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:53.285824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-120a678f-1dea-4d61-b47d-f16bfb7e0e21 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b3d78f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:53.340284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-120a678f-1dea-4d61-b47d-f16bfb7e0e21 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:53.345774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-120a678f-1dea-4d61-b47d-f16bfb7e0e21 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:53.495405 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e78559fc-32f0-4a09-a826-1dac71ba229c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c" status: 204 len: 0 microversion: 2.1 time: 1.286195 Nov 02 12:04:53.498845 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1527/3052] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:52 2022] DELETE /compute/v2.1/images/2fb81a43-253c-48b1-9a84-d82fffbfd27c => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:53.502041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:53.502907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:53.511756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.512577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.513094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.513879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.514493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.515069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.521464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:53.738235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:53.746684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7af1e5ce-faf8-4d9e-b434-f0aa8a02b0b3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1524 microversion: 2.1 time: 0.249451 Nov 02 12:04:53.747968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1528/3053] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:53 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:53.755844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:53.758169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:53.764996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.765762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.766382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.768012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.768641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.776701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.850570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-120a678f-1dea-4d61-b47d-f16bfb7e0e21 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.569288 Nov 02 12:04:53.851510 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1526/3054] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:04:53 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:53.856595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:53.857274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:53.865471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.865970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.866633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.867631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:53.868328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:53.868927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:53.989343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29699172e95148b99d076a8bcfc09668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285fc9da5e0f4089a8aec02963aeb4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:53.997975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc061146-0066-4f66-bdc3-211444038f3d tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 200 len: 1458 microversion: 2.1 time: 0.145090 Nov 02 12:04:53.998994 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1527/3055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:53 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 1458 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:54.004842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbbcf921-a42a-46b5-b0f1-608ec44989ea tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1b80c1f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1516017752", "description": "tempest-description-784815297"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:54.080243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:54.098487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:54.106450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:54.107835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07e8932d-c7e0-41dc-a8d1-61d9df073271 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1879 microversion: 2.32 time: 0.358746 Nov 02 12:04:54.109413 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1529/3056] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:53 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1879 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:54.127470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:54.127982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:54.141828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:54.142441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:54.142952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:54.144301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:54.144994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:54.145584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:54.202380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:54.555750 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbbcf921-a42a-46b5-b0f1-608ec44989ea tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.554402 Nov 02 12:04:54.557215 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1528/3057] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:54.566551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9671e65-0441-47f2-aabc-2c3b9d75d998", "name": "network-vif-deleted", "tag": "9f2865b3-4fce-4238-98ff-582aa1c59ce7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:54.578862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:54.579506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:54.580373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:54.599135 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] Creating event network-vif-deleted:9f2865b3-4fce-4238-98ff-582aa1c59ce7 for instance b9671e65-0441-47f2-aabc-2c3b9d75d998 on n-h2-855649-4 Nov 02 12:04:54.606486 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6113de70-88c7-4057-9cc0-9c2310798db2 req-e3fc2377-0d8a-4fac-b4c5-633e8f07b5ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047665 Nov 02 12:04:54.607331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1529/3058] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:54.616403 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67277624-6dab-494d-9316-df10f18f25f3 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 204 len: 0 microversion: 2.1 time: 0.504712 Nov 02 12:04:54.617510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1530/3059] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:54 2022] DELETE /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:54.624267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d20dd67f-7b08-4294-b6c7-6bcb6924addf tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1b3026af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451703513", "description": "tempest-description-51426144"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:54.628449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13100779-b7a0-4940-94a9-c5047820ecf3 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b3a52ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.115399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13100779-b7a0-4940-94a9-c5047820ecf3 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "DELETE /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.505543 Nov 02 12:04:55.116778 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1530/3060] 10.222.0.48 () {58 vars in 1296 bytes} [Wed Nov 2 12:04:54 2022] DELETE /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_version => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:55.125600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.126476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:55.133341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.133749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.134239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.134956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.135436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.135868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.216436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d20dd67f-7b08-4294-b6c7-6bcb6924addf tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.596582 Nov 02 12:04:55.220108 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1531/3061] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:04:54 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:55.228930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.229587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:55.237027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.238006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.238639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.239620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.240266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.240882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.453761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:55.465349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55707261-04b0-4aca-8bd2-edcdd9c47c4d tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1473 microversion: 2.1 time: 0.344285 Nov 02 12:04:55.468964 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1531/3062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:55 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1473 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:55.478926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:55.481912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.482640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] [instance: b9671e65-0441-47f2-aabc-2c3b9d75d998] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:55.490146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.490753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.491233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.491949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.492401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.493214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.495089 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5306133c-0791-430e-b949-bc8fb00b2d50 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1509 microversion: 2.1 time: 0.273414 Nov 02 12:04:55.499194 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1532/3063] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:55 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:55.515997 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] HTTP exception thrown: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Request method failure captured: Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 HTTP/1.1 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlq-HUu10oXgjRMiKmE33-YQtKvB9j4lzKjOQsGseOXVx0DXRciRXs6YzjP-IHWYOCxKNFHftayNCU9pS1DP6soYlJUEyVPwY99xdZCb22RfkStASXyHWJE8higeKNDOsnHcg_qFFlzmEuABQEOEDcuI99C5kTrqsZ-d5N6EFnFQ3Dw Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_285fc9da5e0f4089a8aec02963aeb4a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/285fc9da5e0f4089a8aec02963aeb4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 285fc9da5e0f4089a8aec02963aeb4a5 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-LiveMigrationTest-2028381374 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 29699172e95148b99d076a8bcfc09668 Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-LiveMigrationTest-2028381374-project Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'b9671e65-0441-47f2-aabc-2c3b9d75d998'} Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:04:55.516530 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. Nov 02 12:04:55.520592 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:04:55.521017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1fd8378-b32d-49e7-90ff-ecd9c0c4405d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b302c700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.521983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] Returning 404 to user: Instance b9671e65-0441-47f2-aabc-2c3b9d75d998 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:04:55.523046 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbbcef99-ffc6-4c5d-9014-f3b8588797e0 tempest-LiveMigrationTest-2028381374 tempest-LiveMigrationTest-2028381374-project] 10.222.0.48 "GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998" status: 404 len: 111 microversion: 2.1 time: 0.052786 Nov 02 12:04:55.524143 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1532/3064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:55 2022] GET /compute/v2.1/servers/b9671e65-0441-47f2-aabc-2c3b9d75d998 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:04:55.529509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:55.530326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:55.538175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.538688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.539260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.540092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:55.541059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:55.541487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:55.615069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1fd8378-b32d-49e7-90ff-ecd9c0c4405d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 37 microversion: 2.1 time: 0.114477 Nov 02 12:04:55.615600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1533/3065] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:04:55 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 37 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:55.620422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1525393699", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "91a05a32-8a21-4d3f-a411-604b20e5411d"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:55.728918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] validate_networks() for [('91a05a32-8a21-4d3f-a411-604b20e5411d', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:04:56.054906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:56.068773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:56.070583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:56.071973 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9aa1f9ea-5183-489f-b452-e044fe038ff6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2831 microversion: 2.32 time: 0.546648 Nov 02 12:04:56.072540 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1533/3066] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:04:55 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2831 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:56.077544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:56.078546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:56.088013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:56.088869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:56.089556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:56.090490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:56.091227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:56.091862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:56.970371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:56.982936 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cedb795a-c0fa-45e4-b510-2aa2078194da tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 200 len: 1509 microversion: 2.1 time: 0.909077 Nov 02 12:04:56.983663 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1534/3067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:56 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 1509 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:56.989619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ce7cee5-12f6-4894-a7d8-bd3d71ff69e4 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b3d0c9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:57.063872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9ce7cee5-12f6-4894-a7d8-bd3d71ff69e4 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:57.073181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9ce7cee5-12f6-4894-a7d8-bd3d71ff69e4 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:57.475249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ce7cee5-12f6-4894-a7d8-bd3d71ff69e4 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.490114 Nov 02 12:04:57.475853 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1535/3068] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:04:56 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:57.483184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecddc245-7398-451b-8d04-771dd5fe49d0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: .version_select at 0x7ff1b3d78e50>, body: {"keypair": {"name": "tempest-keypair-1749597881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRMl9xTJruG4+nxG3f8iott6AksaYGb+87nSHtHQoQpHpqmpJUSY9obqbeZoUiGziYd0ykzBgQaWdSibTD0JqSsjBqyJ4KlIKp+fjff5dVnbzvr56xTonOsuCpOxOEZCw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:57.508209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ecddc245-7398-451b-8d04-771dd5fe49d0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for project abd90f20f33c485cad027be5f3c9f296. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:57.516572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ecddc245-7398-451b-8d04-771dd5fe49d0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for user e61ff49dd4424227ab6c623289ef4a14 and project abd90f20f33c485cad027be5f3c9f296. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:57.526698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:04:57.528475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:04:57.529249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:04:57.529830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:04:57.530414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:04:57.541699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.542168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.542838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.543624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.544088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.544852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.565098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Getting quotas for project fd28d11d0d4a46f09bcd37ce4df337c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:57.570842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Getting quotas for user bb4b9b23379b4029b0ae12cc6620bd93 and project fd28d11d0d4a46f09bcd37ce4df337c3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:57.586213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:04:57.589311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:04:57.615035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecddc245-7398-451b-8d04-771dd5fe49d0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137661 Nov 02 12:04:57.615996 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1536/3069] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:04:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:57.622602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:57.623235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:57.629839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.630471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.631012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.631822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.632381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.632890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.726050 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c35d59be-d4e0-44f3-a976-63572cd4fd97 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109168 Nov 02 12:04:57.727188 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1534/3070] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:04:57.733682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:57.734643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:57.737226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:04:57.746060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.747629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.749174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.749174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.749923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.750572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.877207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10141737-7488-4f4c-8946-8df0aeeb72b8 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.259156 Nov 02 12:04:57.878012 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1537/3071] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:04:57 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f/os-interface => generated 1830 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:04:57.900709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:57.903326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:57.919300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.920051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.921307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.926548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:57.926548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:57.926548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:57.952089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:57.970812 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-008f3d82-888d-4111-8e97-8b5cce3033a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1431 microversion: 2.1 time: 0.241168 Nov 02 12:04:57.976378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1535/3072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:57 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1431 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:57.991147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:04:57.999590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-047284e3-d8df-4ca2-b32c-866e5138f337 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b30541f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:58.096645 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-047284e3-d8df-4ca2-b32c-866e5138f337 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.119095 Nov 02 12:04:58.099196 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1536/3073] 10.222.0.48 () {58 vars in 1290 bytes} [Wed Nov 2 12:04:57 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_distro => generated 33 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:58.105409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3add0340-d03f-4c9c-9562-fedbd4ff5606 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:58.106240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3add0340-d03f-4c9c-9562-fedbd4ff5606 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:58.374331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3add0340-d03f-4c9c-9562-fedbd4ff5606 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:58.386835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3add0340-d03f-4c9c-9562-fedbd4ff5606 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1216 microversion: 2.1 time: 0.286267 Nov 02 12:04:58.399150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1537/3074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:58 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:58.399150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e3ea6e6-6a20-42e9-9a26-acfcf0b86c6b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b2fd1a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:58.457036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c263b287-2c34-44b1-aa9b-3fe1f3866c85 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 204 len: 0 microversion: 2.1 time: 0.563738 Nov 02 12:04:58.459410 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1538/3075] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:04:57 2022] DELETE /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:04:58.487373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9e3ea6e6-6a20-42e9-9a26-acfcf0b86c6b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:58.502293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9e3ea6e6-6a20-42e9-9a26-acfcf0b86c6b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:58.515050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9d0c3c-d741-40e7-bab4-1c06dca19c7b", "name": "network-vif-deleted", "tag": "54a5b86f-f295-40d2-be5f-a0c8343cd66b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:58.555054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:58.558689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:58.560534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:58.597639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] Creating event network-vif-deleted:54a5b86f-f295-40d2-be5f-a0c8343cd66b for instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b on n-h1-855649-4 Nov 02 12:04:58.605260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0d6f9063-70d2-43a9-9a05-71b492b26b90 req-13bdcfef-1cbb-4caa-8c48-4629b426406e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143916 Nov 02 12:04:58.606768 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1539/3076] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:04:58.732528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-583775646", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7c73d261-5263-4009-85e9-ad9c09c3bc0e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:58.766198 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e3ea6e6-6a20-42e9-9a26-acfcf0b86c6b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.375915 Nov 02 12:04:58.767207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1538/3077] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:04:58 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:58.777954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c838c3aa-52d2-40fb-a0b3-bb42d28da129 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b2fd1940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:58.840100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] validate_networks() for [('7c73d261-5263-4009-85e9-ad9c09c3bc0e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:04:58.846273 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c838c3aa-52d2-40fb-a0b3-bb42d28da129 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.073296 Nov 02 12:04:58.847416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1539/3078] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:04:58 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:58.858568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17cf1268-602f-43d5-b369-833da18088b6 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b2fd7b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:58.913676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-17cf1268-602f-43d5-b369-833da18088b6 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:58.924600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-17cf1268-602f-43d5-b369-833da18088b6 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:04:59.188922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17cf1268-602f-43d5-b369-833da18088b6 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.335303 Nov 02 12:04:59.197175 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1540/3079] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:04:58 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:04:59.205770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:04:59.206807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:04:59.216199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:59.216820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:59.218217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:59.219731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:59.221677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:59.223904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:59.308011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:04:59.308937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:04:59.310281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:04:59.312080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lazy-loading 'fault' on Instance uuid 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:04:59.472302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:04:59.482670 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b48d078b-39b1-4cde-bc49-3a0f8ece7421 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 200 len: 1307 microversion: 2.1 time: 0.291709 Nov 02 12:04:59.484230 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1541/3080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:04:59 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 1307 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:04:59.491295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b1f989a-4e11-4bba-b555-6c3087344d4d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b3026280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:04:59.553057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3b1f989a-4e11-4bba-b555-6c3087344d4d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:04:59.561050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3b1f989a-4e11-4bba-b555-6c3087344d4d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:00.126496 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b1f989a-4e11-4bba-b555-6c3087344d4d tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.640696 Nov 02 12:05:00.128248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1542/3081] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:04:59 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 64 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:00.143825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:00.145855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:00.160705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:00.161393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:00.162815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:00.172488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:00.174959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:00.175821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:00.346066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:00.356008 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7163a772-a01b-437a-a185-82ac493cf384 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1212 microversion: 2.1 time: 0.226349 Nov 02 12:05:00.357024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1543/3082] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:00 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1212 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:00.362388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-375a5ec4-8a89-4032-a4a7-5496d03a8e31 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1bb9a04c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:00.452950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-375a5ec4-8a89-4032-a4a7-5496d03a8e31 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.094117 Nov 02 12:05:00.454908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1544/3083] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:05:00 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 64 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:00.473922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-050257a4-00dd-4a16-ab66-75785fd2beea tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b305b550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:00.571088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-050257a4-00dd-4a16-ab66-75785fd2beea tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:00.588871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-050257a4-00dd-4a16-ab66-75785fd2beea tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:01.177672 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-050257a4-00dd-4a16-ab66-75785fd2beea tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.713731 Nov 02 12:05:01.181353 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1545/3084] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:05:00 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:01.189242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:01.190594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:01.199202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.199978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.200598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.201751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.202419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.203052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.224831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] HTTP exception thrown: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Request method failure captured: Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b HTTP/1.1 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwpCZNpn7Xmzbv8kyfupZOjcSA0_D1K8IqMmz_P3pu4A6K5vlThVvkQHWGhUOpF3fVwUd9rh2t-3OOrs6-MeiIU1l3POVczHapQ9kafrE6u1vwbdaWdtiBs6-28Y_JQuIiY-zpEgyJUbDe-ebb5doGfG4GePEpyvja2re4tXYAvZs0 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: dca6e43e30b14de69b5298d806679f45 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dca6e43e30b14de69b5298d806679f45", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: dca6e43e30b14de69b5298d806679f45 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListImageFiltersTestJSON-778785838-project Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e95281deb7084a52a5c2e8d5bfef9eeb Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListImageFiltersTestJSON-778785838-project Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '9a9d0c3c-d741-40e7-bab4-1c06dca19c7b'} Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:01.227377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. Nov 02 12:05:01.232821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:01.234431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Returning 404 to user: Instance 9a9d0c3c-d741-40e7-bab4-1c06dca19c7b could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:01.236053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12fa1a72-2f47-4890-9437-5e334b88a434 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b" status: 404 len: 111 microversion: 2.1 time: 0.051156 Nov 02 12:05:01.241215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1546/3085] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:01 2022] GET /compute/v2.1/servers/9a9d0c3c-d741-40e7-bab4-1c06dca19c7b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:01.248381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17c91877-d187-4139-8594-a8c40027054b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update', calling method: .version_select at 0x7ff1b3078040>, body: {"meta": {"os_version": "alt"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:01.325143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-17c91877-d187-4139-8594-a8c40027054b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:01.331639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-17c91877-d187-4139-8594-a8c40027054b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:01.333922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:01.334962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:01.335986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:01.336259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:01.336614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:01.358100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.358605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.359276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.360253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.360727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.361172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.384335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:01.391638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Getting quotas for user b233c50171014c42bb2c87016c696e01 and project 5dcc8ae2734b40baa89abdf7d57c5fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:01.403028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:01.407639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:01.413767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:01.608603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-284cd3d6-55f8-4716-8aa1-9224b13a9d26 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881917 Nov 02 12:05:01.616935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1540/3086] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:01.665656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:01.666432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:01.703820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.708626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.709211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.710058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:01.710956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:01.713829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:01.790779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:01.853299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:02.106644 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17c91877-d187-4139-8594-a8c40027054b tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.863925 Nov 02 12:05:02.107340 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1547/3087] 10.222.0.48 () {60 vars in 1313 bytes} [Wed Nov 2 12:05:01 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata/os_version => generated 31 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:02.118049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:02.121723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:02.161005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.161005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.161005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.164132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.168952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.169719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.308899 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90079b1c-7be5-4543-b005-6e099b0558d6 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 204 len: 0 microversion: 2.1 time: 0.688979 Nov 02 12:05:02.309593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1541/3088] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:01 2022] DELETE /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:02.316190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ed28670-a854-486a-a3d0-c11bd29e46b9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:02.318137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ed28670-a854-486a-a3d0-c11bd29e46b9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:02.402420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:02.415102 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1831fbd8-fc6c-4947-9f46-d18f24fb8b61 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1274 microversion: 2.1 time: 0.306297 Nov 02 12:05:02.419795 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1548/3089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:02 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:02.437073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96c331a0-b661-497e-a37d-44c66fa9aa14 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b2fd14c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:02.455352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ed28670-a854-486a-a3d0-c11bd29e46b9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:02.468866 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ed28670-a854-486a-a3d0-c11bd29e46b9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1217 microversion: 2.1 time: 0.157743 Nov 02 12:05:02.469744 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1542/3090] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:02 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:02.482688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "tag": "b879a752-ec06-440b-84a3-563bb110cd1d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:02.507163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.507807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.508601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.519595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96c331a0-b661-497e-a37d-44c66fa9aa14 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 58 microversion: 2.1 time: 0.098232 Nov 02 12:05:02.528199 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1549/3091] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:05:02 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 58 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:02.541659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:02.542582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:02.543039 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] Creating event network-changed:b879a752-ec06-440b-84a3-563bb110cd1d for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:05:02.557766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d9b6f878-fc6f-4e51-a43b-5a679904ce32 req-14277bb9-7ea2-4c98-b8fb-2f50f1036880 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086559 Nov 02 12:05:02.558686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1543/3092] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:02.560985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.562886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.563366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.568931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:02.571943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:02.573490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43011400-bbd5-466e-88ed-53d69d5e51fa tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'update_all', calling method: .version_select at 0x7ff1b3981b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:02.573695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:02.682466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-43011400-bbd5-466e-88ed-53d69d5e51fa tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:02.694890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-43011400-bbd5-466e-88ed-53d69d5e51fa tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:03.036604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:03.046127 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-126c15bc-4001-4082-97ad-e111b15790a7 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1472 microversion: 2.1 time: 0.516128 Nov 02 12:05:03.063269 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1550/3093] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:02 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:03.265974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43011400-bbd5-466e-88ed-53d69d5e51fa tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.704679 Nov 02 12:05:03.270414 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1544/3094] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:05:02 2022] PUT /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 61 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:03.279457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec8d12f4-58d9-416b-8622-287faac7f489 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Action: 'create', calling method: .version_select at 0x7ff1b3022e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:03.399201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ec8d12f4-58d9-416b-8622-287faac7f489 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:03.409445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ec8d12f4-58d9-416b-8622-287faac7f489 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Getting quotas for user 52f32bbd45074fca8eba344fb43aa36c and project a7afe8578a854407ba4df265a625f6e0. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:03.442276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:03.443086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:03.457395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:03.458021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:03.459654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:03.463402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:03.464432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:03.467452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:03.718458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:03.728777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e64f98a8-6145-45dd-a556-449a51861422 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1274 microversion: 2.1 time: 0.289093 Nov 02 12:05:03.749737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1545/3095] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:03 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:03.754359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:03.755302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:03.763209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:03.764073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:03.765139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:03.766068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:03.766908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:03.767555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:03.912624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:03.924809 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1e6b4f3-c46a-41da-96ec-77e9409c5b2f tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1221 microversion: 2.1 time: 0.174460 Nov 02 12:05:03.948043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1546/3096] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:03 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:03.962228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1994547405", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc66a32c-6f2b-4312-b723-7b0cd2c081d0"}], "security_groups": [{"name": "tempest-securitygroup--1541912302"}], "key_name": "tempest-keypair-1749597881", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:04.073112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec8d12f4-58d9-416b-8622-287faac7f489 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "POST /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.799245 Nov 02 12:05:04.073846 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1551/3097] 10.222.0.48 () {60 vars in 1281 bytes} [Wed Nov 2 12:05:03 2022] POST /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 85 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:04.079765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:04.080642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:04.088334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:04.089229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:04.090015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:04.091768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:04.092560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:04.093422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:04.483150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] validate_networks() for [('dc66a32c-6f2b-4312-b723-7b0cd2c081d0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:05:04.858122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:04.871367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1a314cb-d00a-4477-babf-4c8095d8ae58 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1472 microversion: 2.1 time: 0.796245 Nov 02 12:05:04.873626 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1552/3098] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:04 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1472 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:04.884845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd420d10-2e58-4f2c-896c-0b0370f3c7d7 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] Calling method '.version_select at 0x7ff1b3007ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:04.965523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd420d10-2e58-4f2c-896c-0b0370f3c7d7 tempest-ImagesMetadataTestJSON-391268766 tempest-ImagesMetadataTestJSON-391268766-project] 10.222.0.48 "GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.088247 Nov 02 12:05:04.965523 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1553/3099] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:05:04 2022] GET /compute/v2.1/images/912d38b0-d956-416b-929b-4f9de34fcee2/metadata => generated 85 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:04.994271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c3254f-6563-4c0d-8167-c4c7999deaab", "name": "network-vif-deleted", "tag": "9c492ab5-152c-4f3d-9582-57dc643bfb7f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:05.036831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:05.042677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:05.052761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:05.091154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] Creating event network-vif-deleted:9c492ab5-152c-4f3d-9582-57dc643bfb7f for instance 93c3254f-6563-4c0d-8167-c4c7999deaab on n-h1-855649-4 Nov 02 12:05:05.105467 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1b2e6b75-5bd1-4790-a003-68333348bbaf req-5ac880ef-fc0b-4eeb-a0f3-85ed34d4e00a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139251 Nov 02 12:05:05.106210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1554/3100] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:05.153527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:05.154277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:05.176350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:05.176350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:05.176627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:05.177196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:05.182727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:05.183751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:05.989803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:06.012387 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95a38df7-13ee-46a0-9ed9-418057ff2d3e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.900445 Nov 02 12:05:06.013375 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1555/3101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:05 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:06.028689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:06.029684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:06.044090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.047212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.047813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:06.048912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.050723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.053205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:06.347450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:06.363520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37132176-e260-488e-a508-a4bc3eff54dd tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1287 microversion: 2.1 time: 0.343514 Nov 02 12:05:06.364278 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1556/3102] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:06 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1287 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:06.379027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:06.381802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:06.401345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.402485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.403019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:06.407938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:06.409853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:06.413675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.554559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:07.571863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:07.577577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:07.577577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:07.577577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:07.577577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:07.590098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.590739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.591503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.593239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.593807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.594708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.616731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:07.625399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Getting quotas for user e61ff49dd4424227ab6c623289ef4a14 and project abd90f20f33c485cad027be5f3c9f296. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:07.641459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:07.644335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:07.667824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:07.677166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52119a6e-2f64-4828-8f03-b349ff4fc464 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1472 microversion: 2.1 time: 1.311604 Nov 02 12:05:07.678122 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1557/3103] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:06 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1472 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:07.696937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:07.697992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:07.708117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.708947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.710049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.711115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.712972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.713410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.845020 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa8827ec-a4ba-4abc-ab14-2045045c9f7d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.888580 Nov 02 12:05:07.853644 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1547/3104] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:05:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 3905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:07.858957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:07.859897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:07.881288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:08.161621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:08.202847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-884ed9d5-ce84-453a-a2e3-dedc85567d5a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1275 microversion: 2.1 time: 0.347741 Nov 02 12:05:08.204192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1548/3105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:07 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1275 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:08.219742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce99584-3d11-4914-acac-d74eb6023bd8", "name": "network-vif-deleted", "tag": "8faf2ed7-d526-43e1-b475-5d6af7a87830"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:08.235865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:08.236573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:08.240363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:08.265395 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] Creating event network-vif-deleted:8faf2ed7-d526-43e1-b475-5d6af7a87830 for instance 0ce99584-3d11-4914-acac-d74eb6023bd8 on n-h1-855649-4 Nov 02 12:05:08.275831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e7546674-bd42-4e43-925b-ec96b81ebf3c req-53ff1f15-3989-4888-aa3d-352d649d4f64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068753 Nov 02 12:05:08.277338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1549/3106] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:08.285703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e807ea0-1dd7-4f08-ab1f-38bc0d0e0b67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:08.286756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e807ea0-1dd7-4f08-ab1f-38bc0d0e0b67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:08.479225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e807ea0-1dd7-4f08-ab1f-38bc0d0e0b67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:08.481113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:08.492848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:08.495750 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e807ea0-1dd7-4f08-ab1f-38bc0d0e0b67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1246 microversion: 2.1 time: 0.216706 Nov 02 12:05:08.500781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da571bda-3421-45c8-9d2f-ef5f6b7acbd0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.819458 Nov 02 12:05:08.502204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1558/3107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:07 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:08.515633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1550/3108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:08 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1246 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:08.715431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:08.716063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:08.759590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:08.760037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:08.760649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:08.761613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:08.763263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:08.765625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:08.827154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:08.828138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:08.828741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:08.829398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lazy-loading 'fault' on Instance uuid 0ce99584-3d11-4914-acac-d74eb6023bd8 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:05:08.975074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:09.011443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-196ace92-f1fe-4fd1-9d9a-44971cc14558 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1306 microversion: 2.1 time: 0.310695 Nov 02 12:05:09.031983 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1559/3109] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:08 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1306 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:09.233537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:09.234326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:09.264841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.266479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.267481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.280830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.281765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.282629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.524419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-626ddecc-6fc2-42bc-8e87-716e97887a99 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:09.525495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-626ddecc-6fc2-42bc-8e87-716e97887a99 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:09.582487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:09.602124 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffd4645e-5ea1-45c7-934d-168778aad12a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1275 microversion: 2.1 time: 0.372898 Nov 02 12:05:09.605664 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1551/3110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:09 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:09.614229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:09.614869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:09.633682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.634220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.638471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.638471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:09.639008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:09.639663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:09.695470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-626ddecc-6fc2-42bc-8e87-716e97887a99 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:09.707698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-626ddecc-6fc2-42bc-8e87-716e97887a99 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1246 microversion: 2.1 time: 0.188397 Nov 02 12:05:09.708667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1560/3111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:09 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:10.008041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:10.020904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-737ba011-2db5-4e2c-90aa-f4413fa73ab2 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.413776 Nov 02 12:05:10.022309 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1552/3112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:09 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:10.041691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:10.042356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:10.052236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.052728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.053358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.057023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.057023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.057023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.137304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.159702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.159702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.159702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lazy-loading 'fault' on Instance uuid 0ce99584-3d11-4914-acac-d74eb6023bd8 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:05:10.447145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95281deb7084a52a5c2e8d5bfef9eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca6e43e30b14de69b5298d806679f45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:10.451958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf42114-010f-4c8d-bae2-05a5a3388c79", "tag": "defb9c59-2677-49fe-a5bc-d60ee4404d4e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:10.457241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c610b9-1f3b-4a95-94cb-319e25a2dcb2 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 200 len: 1306 microversion: 2.1 time: 0.418592 Nov 02 12:05:10.458995 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1561/3113] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:10 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 1306 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:10.470624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.471565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.472166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.531769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] Creating event network-changed:defb9c59-2677-49fe-a5bc-d60ee4404d4e for instance bbf42114-010f-4c8d-bae2-05a5a3388c79 on n-h2-855649-4 Nov 02 12:05:10.540156 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-286e4da8-1a4e-4af5-b09c-36b54d9ecd10 req-519843a9-cceb-4260-81fc-93217e674f48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092326 Nov 02 12:05:10.541843 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1553/3114] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:05:10.635211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:10.636056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:10.665339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.666181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.666859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.672389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.673012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.674647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.683651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:10.686408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.687178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.687636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.688424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.690237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.690676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.759241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dac71805-8155-4d88-bf77-8999214004cf tempest-AZV2TestJSON-2061267524 tempest-AZV2TestJSON-2061267524-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.298057 Nov 02 12:05:10.761590 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1562/3115] 10.222.0.48 () {58 vars in 1164 bytes} [Wed Nov 2 12:05:10 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:05:10.768506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:10.769790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:10.789148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.790168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.793852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:10.794854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:10.796270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:10.796925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.085375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:11.096260 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00bda339-6278-4843-bfee-e8d1de42fac2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1242 microversion: 2.1 time: 0.333073 Nov 02 12:05:11.097728 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1563/3116] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:10 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1242 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:11.104595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:11.109346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:11.112814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.113573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.114212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.115184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.115853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.116566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.344050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:11.354767 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb28d6a6-2bde-4c98-aab0-e3e3a53fbc11 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.726048 Nov 02 12:05:11.368514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1554/3117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:10 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:11.481924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:11.482636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] [instance: 0ce99584-3d11-4914-acac-d74eb6023bd8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:11.493831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.495660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.496463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.499196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:11.500840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:11.501519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:11.543965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] HTTP exception thrown: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Request method failure captured: Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 HTTP/1.1 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlwpCZNpn7Xmzbv8kyfupZOjcSA0_D1K8IqMmz_P3pu4A6K5vlThVvkQHWGhUOpF3fVwUd9rh2t-3OOrs6-MeiIU1l3POVczHapQ9kafrE6u1vwbdaWdtiBs6-28Y_JQuIiY-zpEgyJUbDe-ebb5doGfG4GePEpyvja2re4tXYAvZs0 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dca6e43e30b14de69b5298d806679f45 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dca6e43e30b14de69b5298d806679f45", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca6e43e30b14de69b5298d806679f45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dca6e43e30b14de69b5298d806679f45 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-778785838 Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ListImageFiltersTestJSON-778785838-project Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e95281deb7084a52a5c2e8d5bfef9eeb Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ListImageFiltersTestJSON-778785838-project Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '0ce99584-3d11-4914-acac-d74eb6023bd8'} Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:11.553555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Returning 404 to user: Instance 0ce99584-3d11-4914-acac-d74eb6023bd8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-786ffc1f-0b4c-4f49-bade-12ff830f0f4c tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8" status: 404 len: 111 microversion: 2.1 time: 0.084053 Nov 02 12:05:11.565399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1555/3118] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:11 2022] GET /compute/v2.1/servers/0ce99584-3d11-4914-acac-d74eb6023bd8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:05:11.579638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be45bd82-37f9-4911-a67f-92339608b723 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b333fc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:11.863821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:11.879733 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e292a84-0991-4cab-97fe-d66d1caeb608 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.780447 Nov 02 12:05:11.883518 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1564/3119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:11 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:12.133090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:12.140199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:12.157876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.159385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.164752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.164752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.164752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.164752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.476950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be45bd82-37f9-4911-a67f-92339608b723 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9" status: 204 len: 0 microversion: 2.1 time: 0.905792 Nov 02 12:05:12.478257 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1556/3120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:11 2022] DELETE /compute/v2.1/images/66d74604-59a3-4686-a45d-5634a5964bd9 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:12.487026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:12.490135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:12.515662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.516691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.521265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.527893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:12.527893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:12.527893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:12.762269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:12.771776 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df955ccf-6b1a-4985-86f6-239b655c7ad0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1304 microversion: 2.1 time: 0.653805 Nov 02 12:05:12.788133 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1565/3121] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:12 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1304 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:12.796514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-301737ef-c1b6-4cc1-b0c7-d01b8fdcda75 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b2fe1dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:13.116791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:13.130352 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acd02803-5310-48df-9a6c-a5814786dd46 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.650487 Nov 02 12:05:13.131946 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1557/3122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:12 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:13.142588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:13.143855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:13.161044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:13.161558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:13.162003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:13.162755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:13.163253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:13.163699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:13.426196 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-301737ef-c1b6-4cc1-b0c7-d01b8fdcda75 tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292" status: 204 len: 0 microversion: 2.1 time: 0.636175 Nov 02 12:05:13.430479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1566/3123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:12 2022] DELETE /compute/v2.1/images/4648c332-d05f-4df7-8ad6-ee2e4e91f292 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:13.437289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-329c9110-3f13-42fb-9086-472644e36c9b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] Calling method '.version_select at 0x7ff1b2ff29d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:14.142889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:14.158349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfb58830-feef-40da-bbea-5c3a93f6f2dc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 1.021150 Nov 02 12:05:14.161416 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1558/3124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:13 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:14.169671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:14.174264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:14.193194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.194080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.197563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.202579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.204315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.205833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.416641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:14.429173 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b0e70b4-e87f-42dd-83c2-0bbc43104ddf tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1304 microversion: 2.1 time: 0.266321 Nov 02 12:05:14.430009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1559/3125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:14 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1304 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:14.440361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:14.442038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:14.450273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.451105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.451980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.452940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.453578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.454185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.470511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-329c9110-3f13-42fb-9086-472644e36c9b tempest-ListImageFiltersTestJSON-778785838 tempest-ListImageFiltersTestJSON-778785838-project] 10.222.0.48 "DELETE /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab" status: 204 len: 0 microversion: 2.1 time: 1.037708 Nov 02 12:05:14.475638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1567/3126] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:13 2022] DELETE /compute/v2.1/images/330c3e93-d5d7-43c8-a7ad-5febe5791aab => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:14.775921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe90ad8-2d1f-42bc-92cb-6de3927b630f", "tag": "400fbf82-0dd7-4a81-933d-0cd223cf7471"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:14.783961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:14.792032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:14.792959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:14.793781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:14.810362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] Creating event network-changed:400fbf82-0dd7-4a81-933d-0cd223cf7471 for instance efe90ad8-2d1f-42bc-92cb-6de3927b630f on n-h1-855649-4 Nov 02 12:05:14.817275 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-927b7873-b9c9-4e95-aa1d-e8695ab2c9f8 req-893046cd-90bc-4b6c-8c3a-36126ae17044 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047385 Nov 02 12:05:14.818643 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1568/3127] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:14.891213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:14.907495 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0898fbe5-b84d-4def-9ae6-9da98e504f73 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.475359 Nov 02 12:05:14.908432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1560/3128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:14 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:15.284715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:15.286261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:15.301866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.303889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.308048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:15.309261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.312870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.314276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:15.464547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:15.465170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:15.473836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.474335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.488301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:15.492615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:15.495975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:15.496673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:16.159118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:16.168727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72890f1e-63be-4ead-8df0-182057f0ac6b tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.892476 Nov 02 12:05:16.186787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1569/3129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:15 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:16.186787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:16.186787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:16.193100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:16.193593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:16.194030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:16.194745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:16.195282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:16.199515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:16.459135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:16.469596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86b9ea02-db7a-4f7e-96b1-3e6bd7d55003 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 1.013098 Nov 02 12:05:16.473301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1561/3130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:15 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:16.826574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:16.834363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7285079e-f2e2-4876-acf2-6de5453246e3 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.656629 Nov 02 12:05:16.834955 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1570/3131] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:16 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:17.195193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:17.196245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:17.208726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.219528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.220188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.221053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.221611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.222139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.497472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:17.498850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:17.507169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.508014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.508741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.509698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:17.510600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:17.511276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:17.603817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:18.361894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:18.374249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71c159fc-05d6-46df-bab6-fe5cb6506238 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 1.183784 Nov 02 12:05:18.378430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1562/3132] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:17 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:18.390925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:18.391595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:18.406270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:18.410184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:18.410630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:18.411435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:18.411904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:18.414659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:18.485216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=32 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:18.645872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:18.662570 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0dca836d-184a-4669-8b58-a2ad88b773ee tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 1.168918 Nov 02 12:05:18.665458 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1571/3133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:17 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:19.009604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:19.020074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84aca884-7973-4cbd-a084-6fab56f321e2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.639973 Nov 02 12:05:19.020677 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1563/3134] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:18 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:19.108505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65cb5482-b425-4130-bca0-1a2d4673b1fe tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b3026700>, body: {"keypair": {"name": "tempest-keypair-1604617595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuQc7CVbASE1xZLg2Uf78Vhxmd6vV0nRzLokHyE4LUBb9DvDCeR1oOYOtO+3oeFV8jMWsYjB5RZdbi9koSLXP7cK8UvLmBH7wbZ5ifnGHxpm1ufmLY5U7ZcMcqae/5RPA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:19.121884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=35 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:19.125406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-65cb5482-b425-4130-bca0-1a2d4673b1fe tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:19.131358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-65cb5482-b425-4130-bca0-1a2d4673b1fe tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:19.230835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65cb5482-b425-4130-bca0-1a2d4673b1fe tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.566051 Nov 02 12:05:19.232392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1572/3135] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:19.250414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f19b5c37-d47a-4108-b19b-5327007f5bc1 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1bb9b2790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.276394 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f19b5c37-d47a-4108-b19b-5327007f5bc1 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1604617595" status: 200 len: 498 microversion: 2.1 time: 0.034614 Nov 02 12:05:19.277830 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1564/3136] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:05:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1604617595 => generated 498 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:19.312405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-005d4633-6744-4002-a73f-010b375351da tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b2fe1310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.409532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.411300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:19.422666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.423720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.424427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.425485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.426650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.427511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.440773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-005d4633-6744-4002-a73f-010b375351da tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604617595" status: 202 len: 0 microversion: 2.1 time: 0.140813 Nov 02 12:05:19.441709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1573/3137] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604617595 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:19.458800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e6cdd64-56d4-4e62-91ae-05018510adbf tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b2fe1c10>, body: {"keypair": {"name": "tempest-keypair-429446823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfuE/8yO4R1xUFr+i6knkVLlfFk2hwv3W6W5qT9CTYO4im2eVdY+2ezcrSFB5S9yulsv+Yw9wQPcCvhg/hFE+iCPoj+W5hVPgT1uD12VnEbDQlBBZPvJs36+TityxuO0g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:19.499740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4e6cdd64-56d4-4e62-91ae-05018510adbf tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:19.510323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4e6cdd64-56d4-4e62-91ae-05018510adbf tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:19.662186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e6cdd64-56d4-4e62-91ae-05018510adbf tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207044 Nov 02 12:05:19.662186 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1574/3138] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:19.665355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:19.711265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.714052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.715450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.743958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] Creating event network-changed:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:05:19.751058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7852537e-1721-438d-9bb4-f9c5ceef10c0 req-48e818b0-c662-479c-a7de-c35a8412d86e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090624 Nov 02 12:05:19.752746 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1575/3139] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:19.764619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51921f2a-5e89-4e02-bb37-48454301ffb8 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b302c9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.924996 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51921f2a-5e89-4e02-bb37-48454301ffb8 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429446823" status: 202 len: 0 microversion: 2.1 time: 0.170221 Nov 02 12:05:19.930055 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1576/3140] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429446823 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:19.933273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:19.934027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:19.947373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.947896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.948573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:19.949312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:19.949773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:19.953251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.411884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:20.416934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:20.425903 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30f47d41-88f8-4f3a-9898-640407142538 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 1.023685 Nov 02 12:05:20.427174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1565/3141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:19 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:20.440166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-819bc9a7-c829-45d6-8078-afb4eb14f7de tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b32824c0>, body: {"keypair": {"name": "tempest-keypair-1316421008", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:20.482454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-819bc9a7-c829-45d6-8078-afb4eb14f7de tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:20.489413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-819bc9a7-c829-45d6-8078-afb4eb14f7de tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:20.664603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-819bc9a7-c829-45d6-8078-afb4eb14f7de tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.234432 Nov 02 12:05:20.665735 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1566/3142] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:20 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:20.671462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:20.672575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:20.678091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:20.684095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b39da59-1848-44a5-990c-03df7ed12b18 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 0.756991 Nov 02 12:05:20.697615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.700297 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1577/3143] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:19 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:20.706283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.707669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.708369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf42114-010f-4c8d-bae2-05a5a3388c79", "name": "network-vif-plugged", "status": "completed", "tag": "defb9c59-2677-49fe-a5bc-d60ee4404d4e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:20.709750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.711210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.715604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.721181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:20.723766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:20.725125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:20.725864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:20.741161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] Creating event network-vif-plugged:defb9c59-2677-49fe-a5bc-d60ee4404d4e for instance bbf42114-010f-4c8d-bae2-05a5a3388c79 on n-h2-855649-4 Nov 02 12:05:20.748637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a5f10443-6afc-45e7-b85b-ccfb9fa8acfd req-7275994a-10d9-4f66-be00-9e93d7116163 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046465 Nov 02 12:05:20.750138 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1578/3144] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:20.755832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1b07a75-a636-40ee-84f0-f41ff20b357f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b2fd7f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:20.891986 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1b07a75-a636-40ee-84f0-f41ff20b357f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316421008" status: 202 len: 0 microversion: 2.1 time: 0.139813 Nov 02 12:05:20.896678 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1579/3145] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:05:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316421008 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:20.906795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ae703c4-d8a7-4f82-a2fe-edd2e408837f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b2ff8dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1800601800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfvQIFPrZuhdwzFX+cQ2yKEo5i67nITPYoRoBWWSgEfggpTmAaZungrBijxGbfj49C5WuIoCHROvSFdfvsPU85jSxd0JyEtQF/O/I7DjZg9VdNvyl2wDo8a88k4xUiNLQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:20.926527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8ae703c4-d8a7-4f82-a2fe-edd2e408837f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:20.937983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8ae703c4-d8a7-4f82-a2fe-edd2e408837f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:21.085479 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ae703c4-d8a7-4f82-a2fe-edd2e408837f tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.183468 Nov 02 12:05:21.095498 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1580/3146] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:05:21.100792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9383d7cb-74ec-4715-aa7d-a3781e532af3 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b2fe53a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1066844621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgqYdyOTJb2vFFZEzQFtkLtF7SEYLu310LD/GZSjSmeV/ia3AhKrJUDcL4LQElHW10mrKfj0sFtKOnqMNwV6aewsvmSTnmDb4yFltCcJU7dNczF7Cy8QTSRpuoHrW6O1Q=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:21.118820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9383d7cb-74ec-4715-aa7d-a3781e532af3 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:21.124656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9383d7cb-74ec-4715-aa7d-a3781e532af3 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:21.141896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:21.159469 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cf62459-8a72-4571-9fd0-efd15b6a271a tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.485308 Nov 02 12:05:21.160965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1567/3147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:20 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:21.246367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9383d7cb-74ec-4715-aa7d-a3781e532af3 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.149440 Nov 02 12:05:21.247010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1581/3148] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:05:21.261647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0501e17-9827-492f-b6e3-c09a651eec95 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Action: 'create', calling method: .version_select at 0x7ff1b3a79940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1190595039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9BKrouNETsLybNTx5rTP6xPJ4AHjAXZ/8ncT2ta12E2oOqwwG2y+XMDa6SOrz2X5vr+06AdpMlyUwwZksRI5du11G3UlKlJaHyPx/0Y+wlsWm1azoCYoc8u6YnLoEgXw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:21.270702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:21.280392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a0501e17-9827-492f-b6e3-c09a651eec95 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:21.286632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a0501e17-9827-492f-b6e3-c09a651eec95 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Getting quotas for user c66a7cf7c976449186d4bf80173ebce7 and project a24b94f94e4e4ce9b6b58bf3b5749e37. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:21.421868 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0501e17-9827-492f-b6e3-c09a651eec95 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.158452 Nov 02 12:05:21.421868 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1568/3149] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:05:21.428995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b07408d-d01c-4e1f-867e-4cf23f084814 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b2fd75e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:21.434098 n-d-855649-4 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-5b07408d-d01c-4e1f-867e-4cf23f084814 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:05:21.441168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b07408d-d01c-4e1f-867e-4cf23f084814 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.016395 Nov 02 12:05:21.458967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:21.460050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:21.463798 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1582/3150] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:05:21 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:21.483341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:21.484417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b566e5d-b39c-474b-881e-3dee4f470fba tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b2ff9310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:21.485225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:21.491036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:21.497766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:21.498510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:21.499093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:21.629657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b566e5d-b39c-474b-881e-3dee4f470fba tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1190595039" status: 202 len: 0 microversion: 2.1 time: 0.162145 Nov 02 12:05:21.643187 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1583/3151] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 12:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1190595039 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:21.661408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c6418cc-f006-4aae-90ba-203fd438a782 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b2fe1550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:21.774968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c6418cc-f006-4aae-90ba-203fd438a782 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1066844621" status: 202 len: 0 microversion: 2.1 time: 0.122628 Nov 02 12:05:21.775902 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1584/3152] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 12:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1066844621 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:21.787353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:21.790592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:21.804064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:21.804064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:21.804064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:21.804064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:21.804064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:21.804437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:21.892724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:21.908350 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38e55aea-27ad-43af-a5c2-88f7df231681 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1316 microversion: 2.1 time: 0.454582 Nov 02 12:05:21.909164 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1569/3153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:21 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:21.930031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db6e28fc-1aa6-41db-8736-06c25233e2e1 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] Calling method '.version_select at 0x7ff1b3335ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:22.052834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db6e28fc-1aa6-41db-8736-06c25233e2e1 tempest-KeyPairsV2TestJSON-263411725 tempest-KeyPairsV2TestJSON-263411725-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1800601800" status: 202 len: 0 microversion: 2.1 time: 0.124507 Nov 02 12:05:22.054510 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1570/3154] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 12:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1800601800 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:22.186187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:22.186830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:22.203710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.204078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.217496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:22.228342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.228342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.229851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:22.552608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:22.562309 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad3b3de7-3037-4e1e-bcf2-21083a75e9d2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 0.780972 Nov 02 12:05:22.563365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1585/3155] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:21 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:22.579723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:22.592668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fab3c9c-e604-47f3-b490-0a1f9e732ddf tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.410897 Nov 02 12:05:22.593890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1571/3156] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:22 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:22.936727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:22.937408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:22.947918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.948324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.951894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:22.957121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:22.958109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:22.958729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.291507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:23.299754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76cad984-9a52-4c31-b847-3bfcc5321f71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1504 microversion: 2.1 time: 0.366783 Nov 02 12:05:23.310285 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1586/3157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:22 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:23.338797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1516017752"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:23.339767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:23.347311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.349286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.349286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.349286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.350124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.350849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.598426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:23.598567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Adding security group d3620845-e881-4d0e-971b-d981693a4e93 to port defb9c59-2677-49fe-a5bc-d60ee4404d4e Nov 02 12:05:23.599078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:23.608562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.609836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.610513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:23.612576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:23.613475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:23.614151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:24.655837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:24.668814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d93d4fbd-5c13-4737-8605-c13eb11a1c5e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 1.076947 Nov 02 12:05:24.679989 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1587/3158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:23 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:24.685728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:24.686638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:24.701335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:24.703701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:24.704980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:24.710562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:24.712022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:24.716113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:25.156667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:25.183142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7df8b528-a902-4dbc-9ae3-dc1e812f9667 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.499788 Nov 02 12:05:25.186184 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1588/3159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:24 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:25.263607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe90ad8-2d1f-42bc-92cb-6de3927b630f", "name": "network-vif-plugged", "status": "completed", "tag": "400fbf82-0dd7-4a81-933d-0cd223cf7471"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:25.299894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:25.300299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:25.308773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:25.351886 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] Creating event network-vif-plugged:400fbf82-0dd7-4a81-933d-0cd223cf7471 for instance efe90ad8-2d1f-42bc-92cb-6de3927b630f on n-h1-855649-4 Nov 02 12:05:25.365619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-267b6d93-1d6f-4850-af24-91195678bec3 req-0ccd33b8-65aa-40b4-b054-292e0d0fda48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103310 Nov 02 12:05:25.368894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1589/3160] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:25.595665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f216159-3ff9-4ef3-ab4a-ae6e4d05b42e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action" status: 202 len: 0 microversion: 2.1 time: 2.263303 Nov 02 12:05:25.596310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1572/3161] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:05:23 2022] POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action => generated 0 bytes in 2265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:25.605350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3335f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:25.638543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1652761611", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:25.759156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:05:26.114130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG neutronclient.v2_0.client [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use.", "detail": ""}} {{(pid=127568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:26.115217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.115217 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93 HTTP/1.1 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: exception: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd3620845-e881-4d0e-971b-d981693a4e93'} Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:26.121264 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 400 to user: Security Group d3620845-e881-4d0e-971b-d981693a4e93 in use. Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: Neutron server returns request_ids: ['req-fcf0b040-66cd-44bf-ab67-5167c941d13c'] {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9f62095-ac6b-4f93-bd1a-70a8abce3167 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93" status: 400 len: 185 microversion: 2.1 time: 0.518653 Nov 02 12:05:26.125166 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1573/3162] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:25 2022] DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93 => generated 185 bytes in 520 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:05:26.128744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf42114-010f-4c8d-bae2-05a5a3388c79", "tag": "defb9c59-2677-49fe-a5bc-d60ee4404d4e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:26.142928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.144536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.145226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.160636 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] Creating event network-changed:defb9c59-2677-49fe-a5bc-d60ee4404d4e for instance bbf42114-010f-4c8d-bae2-05a5a3388c79 on n-h2-855649-4 Nov 02 12:05:26.168773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b868064c-67db-4dcf-9483-0e4186693a25 req-9fa869ca-5f2c-4b4b-92f1-e7c377a3812b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043616 Nov 02 12:05:26.170750 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1574/3163] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:26.178489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:26.179607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:26.188387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.189266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.190065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.191512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.192216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.192936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.465618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:26.466367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:26.467251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:26.467822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:26.468415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:26.491102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.493275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.493847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.497633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.498395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.500480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.543334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:26.545659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:26.551729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:26.584300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:26.587435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:26.678939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:26.693952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f6e954a-9802-40b3-bc91-68a05699a837 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 0.522367 Nov 02 12:05:26.694490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1575/3164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:26 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:26.711401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:26.718133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:26.735033 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfe125f4-3a3f-466d-b6ba-46ca90935cb0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348719 Nov 02 12:05:26.735247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.737517 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1590/3165] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:26.745021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.745021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.745021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.746082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.746584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.758278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:26.759488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:26.767831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.768343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.768792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:26.769562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:26.770019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:26.770603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:27.189349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4787e6f4-bf20-451a-903c-abedbe676371 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action" status: 202 len: 0 microversion: 2.1 time: 0.488442 Nov 02 12:05:27.193813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1576/3166] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:05:26 2022] POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:27.202514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b79bf402-f9a9-407c-a8e6-522aecd9bd0c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:27.207021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b79bf402-f9a9-407c-a8e6-522aecd9bd0c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:27.331835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:27.342172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:27.348610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a49d215-7746-4b78-bff4-bc13912414cc tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1317 microversion: 2.1 time: 0.596281 Nov 02 12:05:27.350752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1591/3167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:26 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:27.364390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:27.365004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:27.378455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:27.385846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:27.385846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:27.385846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:27.385846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:27.388162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:27.478320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b79bf402-f9a9-407c-a8e6-522aecd9bd0c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:27.488057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b79bf402-f9a9-407c-a8e6-522aecd9bd0c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1213 microversion: 2.1 time: 0.296259 Nov 02 12:05:27.507424 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1577/3168] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:27 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:27.513795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "name": "network-vif-plugged", "status": "completed", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:27.524832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:27.525706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:27.526336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:27.540261 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] Creating event network-vif-plugged:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:05:27.546351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ffebd137-48bb-4495-a13d-c6535d0e6f0b req-c526e9bf-dc38-43bb-9455-4d472f75a37c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036635 Nov 02 12:05:27.547702 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1578/3169] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:27.721279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:27.722068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:27.734617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:27.736535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:27.736535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:27.739598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:27.741363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:27.742418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:28.241054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:28.252505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-874ed4f6-877c-42c4-befc-16c5a9a663af tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 0.538154 Nov 02 12:05:28.259159 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1579/3170] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:27 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:28.375926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:28.376565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:28.395262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:28.395807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:28.403857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:28.403857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:28.403857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:28.403857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:28.499487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:28.508034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bf727e1-5105-48a1-9007-2d54716eb190 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1575 microversion: 2.1 time: 1.156066 Nov 02 12:05:28.514509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1592/3171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:27 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1575 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:28.519525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-076ff0d5-6c5a-47c6-9996-267acd5a62f2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:28.530526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-076ff0d5-6c5a-47c6-9996-267acd5a62f2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:28.750609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-076ff0d5-6c5a-47c6-9996-267acd5a62f2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:28.761718 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-076ff0d5-6c5a-47c6-9996-267acd5a62f2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1213 microversion: 2.1 time: 0.245724 Nov 02 12:05:28.763426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1593/3172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:28 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:28.894489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:28.919431 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c0b50ec-0f8f-448b-a144-f2c3c5a19ad0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1507 microversion: 2.1 time: 0.546819 Nov 02 12:05:28.936522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1580/3173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:28 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:28.969822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:28.970477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:28.981902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:28.986399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:28.988140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:28.989741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:28.991571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:28.993439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:29.291337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-598081987", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "709b733a-87a4-4cc3-89b2-3fd70602f30f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:29.362240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] validate_networks() for [('709b733a-87a4-4cc3-89b2-3fd70602f30f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:05:29.542162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:29.566130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a253964-f184-4ee1-b790-425c64806624 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1507 microversion: 2.1 time: 0.600840 Nov 02 12:05:29.579927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1594/3174] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:28 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:29.599702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:29.600833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:29.611470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:29.611967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:29.612471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:29.614057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:29.614574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:29.615023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:29.977925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:29.997236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08ed4a5e-41a4-4b90-91f0-bf7cb1b195da tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1372 microversion: 2.1 time: 0.401423 Nov 02 12:05:29.997236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1595/3175] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:29 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:30.001570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:30.002546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:30.009479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.010445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.011316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.012347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.014706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.015720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.364237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:30.364806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:30.365143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:30.365755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:30.366377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:30.382394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.383263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.390571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.391793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.392514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.393160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.415350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Getting quotas for project 8249794035d64775991c8f61bd3d48a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:30.429530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Getting quotas for user 9729d86938d94f70adf295bf8dc7374f and project 8249794035d64775991c8f61bd3d48a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:30.454463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:30.457735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:30.528375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:30.537523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9161fb15-e42d-476c-8988-b5291e0998fd tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1575 microversion: 2.1 time: 0.541494 Nov 02 12:05:30.538422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1596/3176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:29 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1575 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:30.550224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:30.552992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:30.567214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.568268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.573311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.573311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.573311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.573311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.625600 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d0de604-0be0-4c6d-a760-85da48754d7a tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504141 Nov 02 12:05:30.635878 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1581/3177] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:30.650448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:30.651548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:30.683275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.683981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.684601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.685493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.686239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.687389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.787169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-022c6a0e-bf15-41a7-a8d9-ce87d3d9bee6 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "PUT /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1079 microversion: 2.1 time: 0.247122 Nov 02 12:05:30.792306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1597/3178] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:05:30 2022] PUT /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1079 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:30.807402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:30.809215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43aca859-be9b-4dd0-924b-1b4483342f18 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:30.809855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43aca859-be9b-4dd0-924b-1b4483342f18 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:30.823334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36471a2c-ae09-41e5-a018-8bc180189988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1273 microversion: 2.1 time: 0.181105 Nov 02 12:05:30.825098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1582/3179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:30 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:30.836227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:30.844802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:30.869608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.874589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.877681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.883832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:30.889835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:30.904865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:30.926357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43aca859-be9b-4dd0-924b-1b4483342f18 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:30.940141 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43aca859-be9b-4dd0-924b-1b4483342f18 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1224 microversion: 2.1 time: 0.146423 Nov 02 12:05:30.942157 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1598/3180] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:30 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:31.018919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:31.020111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:31.035207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.036814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.037535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:31.039102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.039906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.040747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:31.888437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:31.901600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93d90867-9271-4bca-af5f-f14ae991f6b2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1566 microversion: 2.1 time: 0.887517 Nov 02 12:05:31.904347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1599/3181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:31 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1566 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:31.911279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:31.922577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:31.927923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:31.928089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-397a4293-e9a9-48a1-9f28-3e7067a61530 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1505 microversion: 2.1 time: 1.098007 Nov 02 12:05:31.928089 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1583/3182] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:30 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1505 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:31.935118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:31.935653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.936159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.936610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:31.937011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:31.937316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.938289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.938289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:31.967888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.968500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.969145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:31.969960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:31.972035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:31.972653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:32.288061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:32.307485 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64ae0a4e-825a-43d3-a45e-715054a728da tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1271 microversion: 2.1 time: 0.377719 Nov 02 12:05:32.307485 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1584/3183] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:31 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1271 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:32.329761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:32.330099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:32.342264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:32.356628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:32.357290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:32.358123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:32.359117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:32.359579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:32.555952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:32.568736 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0c7d2ba-09f8-4d8f-90cc-808ee6ea5e98 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1580 microversion: 2.1 time: 0.662776 Nov 02 12:05:32.583658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1600/3184] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:31 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1580 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:32.589879 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7a1e0d1-417f-46fc-b0ef-47043b26e617 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.280792 Nov 02 12:05:32.590486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1585/3185] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:05:32 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:32.592225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:32.595924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:32.599524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:32.600232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:32.600886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:32.601801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:32.602501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:32.603288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b479c82-c60e-4475-a910-8d681de9e809 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:32.603592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:32.603930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b479c82-c60e-4475-a910-8d681de9e809 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:33.301441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b479c82-c60e-4475-a910-8d681de9e809 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:33.316360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b479c82-c60e-4475-a910-8d681de9e809 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1224 microversion: 2.1 time: 0.717764 Nov 02 12:05:33.317301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1586/3186] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:32 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1224 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:33.342619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:33.343701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:33.351616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.352456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.353143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.354082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.354756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.355477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.570065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:33.579318 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d69bc425-574c-4543-8f63-3ae6925da802 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1271 microversion: 2.1 time: 0.246278 Nov 02 12:05:33.579926 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1587/3187] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:33 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:33.608856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:33.609748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:33.622300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.622300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.622300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.625213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.625703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.626169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.684549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:33.700580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0b8d7e3-b2d7-494e-b300-bec9ffba347b tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1505 microversion: 2.1 time: 1.112968 Nov 02 12:05:33.705319 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1601/3188] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:32 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1505 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:33.726374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:33.730388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:33.738584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.739343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.740180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.741383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.742021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.743280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.923218 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07a5ea05-061c-47bc-97e2-9d379e0c8717 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "PUT /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1081 microversion: 2.1 time: 0.189362 Nov 02 12:05:33.923218 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1602/3189] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:05:33 2022] PUT /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1081 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:33.934209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:33.936502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:33.949241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.950070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.950697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:33.951919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:33.952949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:33.953603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.501286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:34.519842 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff655c4a-a6b0-4402-907b-ca249db12882 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1573 microversion: 2.1 time: 0.915428 Nov 02 12:05:34.524917 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1588/3190] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:33 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1573 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:34.536486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:34.537133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:34.559549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.561678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.562390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.586039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.591471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.598797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.799630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:34.809393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:34.816152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4880377f-1899-46a8-8b20-cbfff14c4d37 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1276 microversion: 2.1 time: 0.288234 Nov 02 12:05:34.821133 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1589/3191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:34 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:34.821321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be5650b8-a116-47ad-8aae-063e74931872 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1507 microversion: 2.1 time: 0.890547 Nov 02 12:05:34.823783 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1603/3192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:33 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1507 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:34.830635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:34.831295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:34.831774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451703513"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:34.833478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:34.849229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.849581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.852395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.852573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.853080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.853875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.855839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.856611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:34.857009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.857215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:34.857511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.862780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:34.865364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:35.090866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:35.106265 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33467556-af02-48e2-a06b-de3f4f653258 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1271 microversion: 2.1 time: 0.281206 Nov 02 12:05:35.108089 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1604/3193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:34 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:35.119937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:35.122046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:35.130399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:35.132026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:35.132730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:35.133946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:35.134592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:35.136261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:35.693228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Adding security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb to port defb9c59-2677-49fe-a5bc-d60ee4404d4e Nov 02 12:05:36.527545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:36.823105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:36.836907 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26cf61f2-7dc8-43c8-8d74-dc56256516ba tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1507 microversion: 2.1 time: 1.726876 Nov 02 12:05:36.837721 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1605/3194] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:35 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1507 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:36.851407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:36.852617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:36.877008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:36.877484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:36.877933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:36.878662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:36.879265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:36.879667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:37.139461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:37.156971 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52614a76-c8a8-4051-a51b-e2a393af3ce2 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1282 microversion: 2.1 time: 0.312005 Nov 02 12:05:37.156971 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1606/3195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:36 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:37.157995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:37.158633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:37.170785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:37.171410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:37.171933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:37.172738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:37.173277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:37.176826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:37.863473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:37.877138 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9861657-bead-4e57-a283-32e8402f5769 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.724144 Nov 02 12:05:37.893839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1607/3196] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:37 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:37.900536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:37.901513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:37.910346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:37.911757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:37.913000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:37.913953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:37.914624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:37.915494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:37.963033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:37.999851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:38.294032 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a44ac90-56a9-4457-9a0e-b948a758edb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action" status: 202 len: 0 microversion: 2.1 time: 3.470331 Nov 02 12:05:38.295629 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1590/3197] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:05:34 2022] POST /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79/action => generated 0 bytes in 3477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:38.306863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:38.336799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:38.339710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:38.352964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:38.400026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] Creating event network-changed:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:05:38.417256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4b34fb2e-56a0-477a-91c9-5138bf39dc1f req-b40d0c19-fb50-406d-a21f-4d3c075d8ecc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116369 Nov 02 12:05:38.418750 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1591/3198] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:38.429388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:38.431914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:38.444872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:38.446610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:38.447348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:38.450010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:38.451246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:38.453009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:38.497828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a68879aa-a3c5-46a8-ae08-e96e9914505e tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 204 len: 0 microversion: 2.1 time: 0.602086 Nov 02 12:05:38.504522 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1608/3199] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:37 2022] DELETE /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:38.511651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b2fe18b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:38.660192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:38.676519 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9940904-570f-4a66-84bb-fa7105d2f98d tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1282 microversion: 2.1 time: 0.256380 Nov 02 12:05:38.694898 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1592/3200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:38 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:38.703665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:38.711373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:38.711373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:38.715420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:38.715996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:38.716826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:38.717493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:38.717943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:38.833394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:39.019613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Instance is already in deleting state, ignoring this request Nov 02 12:05:39.025571 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db3c9284-2091-4518-9a69-302a1ca04db0 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 204 len: 0 microversion: 2.1 time: 0.324379 Nov 02 12:05:39.036160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1593/3201] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:38 2022] DELETE /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:39.041980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:39.042865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:39.050296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.051149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.051761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.052817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.053521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.054119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.178274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use.", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:39.182743 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.182743 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb HTTP/1.1 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: exception: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '60f41417-e09c-4d0f-baf5-c36c25fd76fb'} Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:39.186782 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] Nov 02 12:05:39.192511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:39.203148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 400 to user: Security Group 60f41417-e09c-4d0f-baf5-c36c25fd76fb in use. Nov 02 12:05:39.203148 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-7b6e44e4-cb32-4390-8e8d-d04c65bb9fdc'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:39.203148 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-501f3bae-5e80-4a38-bb2b-54b012b6a115 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb" status: 400 len: 185 microversion: 2.1 time: 0.692821 Nov 02 12:05:39.203148 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1609/3202] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:38 2022] DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb => generated 185 bytes in 694 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:05:39.223025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:39.224655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:39.241563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.246663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.246663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.247471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.248321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.249816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.724219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:39.739383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf23a085-4d09-4368-9fd9-7d77d8b506a6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.699880 Nov 02 12:05:39.740745 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1594/3203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:39 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:39.771659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:39.771659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:39.793037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.801138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.801138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.801138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:39.801138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:39.801138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:39.809734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:39.822622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f00dccd-cb9b-47c8-9a35-96fceaf36029 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1513 microversion: 2.1 time: 0.617566 Nov 02 12:05:39.827044 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1610/3204] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:39 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1513 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:39.869952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:39.918415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e3c2c7f-26ff-4189-95b2-ed2e832d82d3 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Action: 'create', calling method: .version_select at 0x7ff1b304f8b0>, body: {"keypair": {"name": "tempest-keypair-502584480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6FJhYDGvEviU9nYJHNdHCNAZmI4J0rlYo+VBcbOOkOZlKmedQTXGzjDbfAeHTPj73VlnLSIuY+oBj14cl2h2Pvnxci1ra0yOrsYu2ZScuzap/l+RmPu0bUhKweg3YePQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:39.943853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1e3c2c7f-26ff-4189-95b2-ed2e832d82d3 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:39.951491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1e3c2c7f-26ff-4189-95b2-ed2e832d82d3 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for user f18c4bd23b6840cf9fa52a33e6bd4022 and project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:40.105189 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e3c2c7f-26ff-4189-95b2-ed2e832d82d3 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264818 Nov 02 12:05:40.106445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1611/3205] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:05:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:40.111468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:40.112373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:40.123237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:40.123970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:40.124660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.125790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:40.126591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:40.127258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.344045 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc539dba-d11d-4662-a667-969a92844f9a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 204 len: 0 microversion: 2.1 time: 0.595933 Nov 02 12:05:40.344045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1595/3206] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:39 2022] DELETE /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:40.350486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:40.351528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:40.363125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:40.368118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:40.368808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.370020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:40.370993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:40.372676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:40.436239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:41.434912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:41.448424 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6194ab0d-cde2-4ff2-9a63-0a8a025de9a7 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 1.340670 Nov 02 12:05:41.463625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1612/3207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:40 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:41.463625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf42114-010f-4c8d-bae2-05a5a3388c79", "tag": "defb9c59-2677-49fe-a5bc-d60ee4404d4e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:41.488376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:41.488960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:41.491860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:41.514649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] Creating event network-changed:defb9c59-2677-49fe-a5bc-d60ee4404d4e for instance bbf42114-010f-4c8d-bae2-05a5a3388c79 on n-h2-855649-4 Nov 02 12:05:41.518827 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ef3cea8c-1c12-4b95-842a-f0a956bb353b req-78fe7c37-b377-4290-8777-11a6d21720b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065179 Nov 02 12:05:41.520211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1613/3208] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:41.527153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:41.528269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:41.537048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:41.544275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:41.545154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:41.546191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:41.547028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:41.547719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:41.607407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:41.616725 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25736537-9706-4d29-990a-e3bceb530ec1 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1647 microversion: 2.1 time: 1.270598 Nov 02 12:05:41.622614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1596/3209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:40 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1647 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:41.633692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:41.634331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:41.644188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:41.644961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:41.645647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:41.646739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:41.647641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:41.648266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:42.131609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:42.139541 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7998dd6f-bde7-4d6a-b71b-b6a2bceb6ef2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.615638 Nov 02 12:05:42.142795 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1614/3210] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:41 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:42.320168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:42.329007 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07343899-8a1c-4be3-9865-2a31946cf7d4 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1513 microversion: 2.1 time: 0.702521 Nov 02 12:05:42.350354 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1597/3211] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:41 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1513 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:42.480331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:42.481110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:42.488229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:42.489023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:42.490139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:42.491123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:42.491700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:42.492790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:42.640361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:42.640992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:42.649121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:42.649121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:42.649614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:42.650569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:42.651101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:42.651502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.213017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:43.236952 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3879f9f-1c53-4312-895f-602c1762dd6f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.760990 Nov 02 12:05:43.238715 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1615/3212] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:42 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:43.247543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:43.249145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.262355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.311036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:43.857897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:43.871109 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50d721d0-57bf-406d-b244-28a5b7d6794f tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1647 microversion: 2.1 time: 1.234377 Nov 02 12:05:43.872436 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1598/3213] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:42 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1647 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:43.878498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:43.879521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:43.896674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.897608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.898312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:43.900104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:43.900871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:43.901671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:44.217625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:44.222477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:44.227210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15906d2b-d152-4679-b142-de250e8c4712 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1471 microversion: 2.1 time: 0.352714 Nov 02 12:05:44.229663 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1599/3214] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:43 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:44.249625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a50b30b1-29c3-4cf5-93a0-ac2db939989f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 1.009182 Nov 02 12:05:44.250971 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1616/3215] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:43 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:44.251793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:44.264188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:44.265059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:44.265789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:44.273870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:44.297494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] Creating event network-changed:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h2-855649-4 Nov 02 12:05:44.301214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:44.309503 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-84ac0181-7cd8-4dbf-a636-129ef338c323 req-2c97105e-8423-4f8f-85d8-8216e4d4b349 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076116 Nov 02 12:05:44.309911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:44.310317 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1600/3216] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:44.310582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:44.311051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:44.311768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:44.312223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:44.312650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:44.901452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:44.902968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:44.911402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:44.916389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:44.916892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:44.917338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:44.927562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:44.928257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:44.928716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.549902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:45.564772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-262fa0c9-edea-49da-9af7-669827bc1823 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 1.294788 Nov 02 12:05:45.566097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1617/3217] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:44 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:45.571536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:45.573181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:45.580425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:45.581289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:45.581966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.583094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:45.583568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:45.584083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.659714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:45.669656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:45.670247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:45.671301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.674650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lazy-loading 'fault' on Instance uuid efe90ad8-2d1f-42bc-92cb-6de3927b630f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:05:45.683247 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b959d05-71a8-4096-be06-34261bddb793 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1647 microversion: 2.1 time: 0.783063 Nov 02 12:05:45.687582 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1601/3218] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:44 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1647 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:45.696663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:45.698045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:45.709237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:45.710430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:45.711921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.712873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:45.714285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:45.715213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:45.762013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b233c50171014c42bb2c87016c696e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dcc8ae2734b40baa89abdf7d57c5fe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:45.775702 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f793afc7-26bd-46f3-b1ef-f6a1502d8fe7 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 200 len: 1307 microversion: 2.1 time: 0.205318 Nov 02 12:05:45.776356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1618/3219] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:45 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:45.786239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1713541973", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3d1d3bfc-6283-4588-bd1e-1a5b4d67aa44"}], "security_groups": [{"name": "tempest-securitygroup--1165872120"}], "key_name": "tempest-keypair-502584480", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:46.074308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] validate_networks() for [('3d1d3bfc-6283-4588-bd1e-1a5b4d67aa44', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:05:46.110099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:46.118589 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad4084f7-0caf-4fa1-ad59-c6b3b5e90997 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.428799 Nov 02 12:05:46.119218 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1602/3220] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:45 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:46.592242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:46.592944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:46.600209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.600714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.603793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:46.603793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.603793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.603793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:46.723951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:46.743464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for user f18c4bd23b6840cf9fa52a33e6bd4022 and project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: dict_keys(['metadata_items']) {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:46.767905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:05:46.768585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:05:46.769235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:05:46.775506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:05:46.775946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:05:46.801578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.802169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.802683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:46.803555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.810254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.810824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:46.831579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:46.853962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:05:46.864182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Getting quotas for user f18c4bd23b6840cf9fa52a33e6bd4022 and project 781b7cdf3f3748e08840033e7b2d4fb9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:05:46.880394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:05:46.883961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:05:46.897638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:46.916145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-135081d6-1ce2-4227-8cde-9ebd3ab13bcd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.327779 Nov 02 12:05:46.917393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1603/3221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:46 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:46.929306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:46.933406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:46.952166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.952968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.954029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:46.955177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:46.955827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:46.956497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.086482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:47.103710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a15d25a8-255d-45ee-a4c4-39d4db51f191 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1468 microversion: 2.1 time: 0.184988 Nov 02 12:05:47.104942 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1604/3222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:46 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:47.110246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.111554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: efe90ad8-2d1f-42bc-92cb-6de3927b630f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.118436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.119211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.119807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.120729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.121345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.121950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.142404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fc8d775-8868-4869-931c-fe49c594bea0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.364863 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] HTTP exception thrown: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Request method failure captured: Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f HTTP/1.1 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlw-quunAKP3tA3WQA4Bciu0xMd4fWfBRuVnH3wT2O-JmYSj8SQwvaC-nXv12C63NnFL-WxhJ18QEyOZXi-CHMgavBoMw4gXNR0sk6Ezux6vpKrEML-O9alH_mNKev5BzkDP1JdzNLH-vQAVb5s3zq43ZGHHVhxoPwM5WbLiWnR0ZHo Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dcc8ae2734b40baa89abdf7d57c5fe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b233c50171014c42bb2c87016c696e01 Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'efe90ad8-2d1f-42bc-92cb-6de3927b630f'} Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:47.149603 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Returning 404 to user: Instance efe90ad8-2d1f-42bc-92cb-6de3927b630f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ace9596-65bc-4475-aff1-db5a073b29f2 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f" status: 404 len: 111 microversion: 2.1 time: 0.043453 Nov 02 12:05:47.154605 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1605/3223] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/efe90ad8-2d1f-42bc-92cb-6de3927b630f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:47.157988 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1619/3224] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:05:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:05:47.160934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe90ad8-2d1f-42bc-92cb-6de3927b630f", "name": "network-vif-deleted", "tag": "400fbf82-0dd7-4a81-933d-0cd223cf7471"}, {"server_uuid": "bbf42114-010f-4c8d-bae2-05a5a3388c79", "name": "network-vif-deleted", "tag": "defb9c59-2677-49fe-a5bc-d60ee4404d4e"}, {"name": "network-changed", "server_uuid": "a27937e2-00f0-40d7-b6f6-666705ca5d22", "tag": "4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:47.161734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.162529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.175654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.176296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.176880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.182218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:47.186374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.193571 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Creating event network-vif-deleted:400fbf82-0dd7-4a81-933d-0cd223cf7471 for instance efe90ad8-2d1f-42bc-92cb-6de3927b630f on n-h1-855649-4 Nov 02 12:05:47.194187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Creating event network-vif-deleted:defb9c59-2677-49fe-a5bc-d60ee4404d4e for instance bbf42114-010f-4c8d-bae2-05a5a3388c79 on n-h2-855649-4 Nov 02 12:05:47.194705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] Creating event network-changed:4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc for instance a27937e2-00f0-40d7-b6f6-666705ca5d22 on n-h1-855649-4 Nov 02 12:05:47.200378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.201991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.206734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.207903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.208659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.216837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-53797805-919a-4f7a-bb00-ed2fe401a5bc req-88ee0cbe-013f-4982-b269-6dcd334bd34f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.060626 Nov 02 12:05:47.221304 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1606/3225] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:47.233466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5afbd909-50f2-437e-bd09-cdc71d09970d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.238789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5afbd909-50f2-437e-bd09-cdc71d09970d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.363945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5afbd909-50f2-437e-bd09-cdc71d09970d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:47.378839 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5afbd909-50f2-437e-bd09-cdc71d09970d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1269 microversion: 2.1 time: 0.153462 Nov 02 12:05:47.391447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1607/3226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:47.405163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.405163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.406877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.407311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.407763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.408505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.409042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.409457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.449934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] HTTP exception thrown: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Request method failure captured: Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab HTTP/1.1 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlw-quunAKP3tA3WQA4Bciu0xMd4fWfBRuVnH3wT2O-JmYSj8SQwvaC-nXv12C63NnFL-WxhJ18QEyOZXi-CHMgavBoMw4gXNR0sk6Ezux6vpKrEML-O9alH_mNKev5BzkDP1JdzNLH-vQAVb5s3zq43ZGHHVhxoPwM5WbLiWnR0ZHo Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dcc8ae2734b40baa89abdf7d57c5fe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b233c50171014c42bb2c87016c696e01 Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '93c3254f-6563-4c0d-8167-c4c7999deaab'} Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:47.452434 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.457154 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.461865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Returning 404 to user: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:47.463024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef41253e-a868-4ca9-a7a1-f5a46c33722c tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 404 len: 111 microversion: 2.1 time: 0.070446 Nov 02 12:05:47.464201 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1608/3227] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:47 2022] DELETE /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:47.480502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.483385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 93c3254f-6563-4c0d-8167-c4c7999deaab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.496941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.498283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.499250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.500305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.501196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.501322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.519484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] HTTP exception thrown: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Request method failure captured: Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab HTTP/1.1 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlw-quunAKP3tA3WQA4Bciu0xMd4fWfBRuVnH3wT2O-JmYSj8SQwvaC-nXv12C63NnFL-WxhJ18QEyOZXi-CHMgavBoMw4gXNR0sk6Ezux6vpKrEML-O9alH_mNKev5BzkDP1JdzNLH-vQAVb5s3zq43ZGHHVhxoPwM5WbLiWnR0ZHo Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dcc8ae2734b40baa89abdf7d57c5fe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b233c50171014c42bb2c87016c696e01 Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '93c3254f-6563-4c0d-8167-c4c7999deaab'} Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.521285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Returning 404 to user: Instance 93c3254f-6563-4c0d-8167-c4c7999deaab could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:47.526575 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2df9aa4-ea2c-48ec-a173-8c9437cb0bb9 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab" status: 404 len: 111 microversion: 2.1 time: 0.054461 Nov 02 12:05:47.532633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1609/3228] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/93c3254f-6563-4c0d-8167-c4c7999deaab => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:47.532633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.532936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.542562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.543197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.543754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.544365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.544826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.545258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.548611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:47.561711 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b03e3999-9b8f-4881-9561-59620e85503f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.404707 Nov 02 12:05:47.562826 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1620/3229] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] HTTP exception thrown: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Request method failure captured: Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a HTTP/1.1 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlw-quunAKP3tA3WQA4Bciu0xMd4fWfBRuVnH3wT2O-JmYSj8SQwvaC-nXv12C63NnFL-WxhJ18QEyOZXi-CHMgavBoMw4gXNR0sk6Ezux6vpKrEML-O9alH_mNKev5BzkDP1JdzNLH-vQAVb5s3zq43ZGHHVhxoPwM5WbLiWnR0ZHo Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dcc8ae2734b40baa89abdf7d57c5fe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b233c50171014c42bb2c87016c696e01 Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '64f4b294-ab0d-41f0-84aa-89b3227d546a'} Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:05:47.580089 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Returning 404 to user: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-000fd5f1-35a8-4c26-b5cf-48fc6b3da794 tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "DELETE /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 404 len: 111 microversion: 2.1 time: 0.050364 Nov 02 12:05:47.584693 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1610/3230] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:47 2022] DELETE /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:47.588941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.589565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] [instance: 64f4b294-ab0d-41f0-84aa-89b3227d546a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.595739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.597389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.597389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.597389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.598090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.598425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.615053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] HTTP exception thrown: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Request method failure captured: Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a HTTP/1.1 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlw-quunAKP3tA3WQA4Bciu0xMd4fWfBRuVnH3wT2O-JmYSj8SQwvaC-nXv12C63NnFL-WxhJ18QEyOZXi-CHMgavBoMw4gXNR0sk6Ezux6vpKrEML-O9alH_mNKev5BzkDP1JdzNLH-vQAVb5s3zq43ZGHHVhxoPwM5WbLiWnR0ZHo Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5dcc8ae2734b40baa89abdf7d57c5fe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5dcc8ae2734b40baa89abdf7d57c5fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5dcc8ae2734b40baa89abdf7d57c5fe6 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1193616475 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b233c50171014c42bb2c87016c696e01 Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiskConfigTestJSON-1193616475-project Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '64f4b294-ab0d-41f0-84aa-89b3227d546a'} Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:47.617072 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] Returning 404 to user: Instance 64f4b294-ab0d-41f0-84aa-89b3227d546a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-376ad03e-3121-4702-8563-990a414e47bb tempest-ServerDiskConfigTestJSON-1193616475 tempest-ServerDiskConfigTestJSON-1193616475-project] 10.222.0.48 "GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a" status: 404 len: 111 microversion: 2.1 time: 0.034084 Nov 02 12:05:47.624385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1621/3231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/64f4b294-ab0d-41f0-84aa-89b3227d546a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:47.945737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:47.947151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:47.954895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.955612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.956147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:47.958463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:47.959211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:47.959771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:48.131030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:48.131665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:48.141246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:48.142256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:48.143103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:48.144026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:48.144669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:48.145273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:48.253738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:48.262303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bc94468-7ceb-4780-808e-afdf1923e118 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.321484 Nov 02 12:05:48.262969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1611/3232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:47 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:48.279015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:48.290145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09e822c8-3ce8-4234-af68-b46cfec1c42a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1468 microversion: 2.1 time: 0.164762 Nov 02 12:05:48.291072 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1622/3233] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:48 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1468 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:48.403638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bb70efd-614d-46de-af5e-8a819ff6254a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:48.404281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bb70efd-614d-46de-af5e-8a819ff6254a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:48.465000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bb70efd-614d-46de-af5e-8a819ff6254a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:48.476477 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bb70efd-614d-46de-af5e-8a819ff6254a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1269 microversion: 2.1 time: 0.077238 Nov 02 12:05:48.494569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1612/3234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:48 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1269 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:48.585912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:48.587014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:48.593854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:48.594448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:48.594998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:48.595815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:48.596347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:48.596975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:48.998661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:49.008505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46dfb157-3356-4acf-ae26-3d8ba68e2003 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.426806 Nov 02 12:05:49.009647 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1623/3235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:48 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:49.305677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:49.306324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:49.314853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:49.315526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:49.329977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.330479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.330934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.331704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.332181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.332620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.340142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.340663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.341126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.341862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.342517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.343183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.388298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.388791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.389446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.390188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lazy-loading 'fault' on Instance uuid bbf42114-010f-4c8d-bae2-05a5a3388c79 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:05:49.605092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:49.622737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0de5dc9-76e5-4691-9961-055d6e8fff77 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 200 len: 1306 microversion: 2.1 time: 0.312016 Nov 02 12:05:49.628836 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1624/3236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:49 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:49.656220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:49.663617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:49.681903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.682703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.683394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.684376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:49.685468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:49.686291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:49.909372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:49.923271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc1e3921-8d09-421e-99b1-0b1fde1406f0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1321 microversion: 2.1 time: 0.292039 Nov 02 12:05:49.924918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1625/3237] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:49 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:50.012376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:50.028353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-520c83f8-35e3-4a4d-bf33-008e96dbdd0e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.741066 Nov 02 12:05:50.029493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1613/3238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:49 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:50.050344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:50.051018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:50.059258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.059965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.060412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:50.061127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.061782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.062376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:50.561436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:50.569546 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57155f57-3795-478f-a8a4-cae9406d7c22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.524979 Nov 02 12:05:50.585759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1626/3239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:50 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:50.656336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:50.670999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:50.729813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.730113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.730477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:50.731580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.732348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.732549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:50.760117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 HTTP/1.1 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'bbf42114-010f-4c8d-bae2-05a5a3388c79'} Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:50.761847 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f7d37ea-f10a-4490-8ac7-b9ece3329657 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 404 len: 111 microversion: 2.1 time: 0.113781 Nov 02 12:05:50.766353 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1614/3240] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:50 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:50.772945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46a3740a-f8a7-4424-b27f-cf736e80ce0c tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb947b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:50.949874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:50.950495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:50.957967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.958796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.968513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:50.970117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:50.970653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:50.980797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:51.109789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:51.121873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a60ee988-1fc2-4dec-bea6-48a48c96c420 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1327 microversion: 2.1 time: 0.175199 Nov 02 12:05:51.122251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1615/3241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:50 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:51.129173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:51.130083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:51.138153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:51.138928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:51.139940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:51.140839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:51.141481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:51.141958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:51.814387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:51.828696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21b7cabf-349e-423d-be56-44b92dbe82cd tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.704987 Nov 02 12:05:51.830264 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1616/3242] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:51 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:51.836031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:51.837922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:51.845112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:51.846105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:51.847398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:51.848410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:51.849118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:51.849932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:52.112574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46a3740a-f8a7-4424-b27f-cf736e80ce0c tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93" status: 202 len: 0 microversion: 2.1 time: 1.343883 Nov 02 12:05:52.113783 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1627/3243] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:50 2022] DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93 => generated 0 bytes in 1346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:52.121998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-365806bb-092a-412d-9082-1da5bf1706e9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b2fd1820>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:52.270013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:52.285393 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d47c2236-2121-4180-8025-170c44fbc0b7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.452404 Nov 02 12:05:52.313278 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1617/3244] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:51 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:52.322201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:52.325347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:52.336957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:52.337844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:52.338504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:52.339790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:52.340609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:52.341358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:52.749782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:52.760720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7cd77e4-247a-44e7-81d6-a99285f76b9f tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1327 microversion: 2.1 time: 0.445802 Nov 02 12:05:52.761902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1618/3245] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:52 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1327 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:52.767708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "name": "network-vif-plugged", "status": "completed", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:52.789291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:52.790194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:52.790858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:52.807888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] Creating event network-vif-plugged:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h2-855649-4 Nov 02 12:05:52.817592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d882ee02-ac4f-4a13-b7f8-aaafa878f167 req-f87783b3-c70d-4a7f-8d2e-22ffbbbec0ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051561 Nov 02 12:05:52.817592 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1619/3246] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:52.859522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:52.860397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:52.878678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:52.880250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:52.880988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:52.881991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:52.884972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:52.885880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:53.430918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:53.442617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d8be89c-39ce-4c2e-a6b4-344efe18d66f tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.590154 Nov 02 12:05:53.444011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1620/3247] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:52 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:53.449276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:53.450194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:53.457003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:53.459279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:53.459279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:53.459279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:53.461710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:53.462408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:53.554875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-365806bb-092a-412d-9082-1da5bf1706e9 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb" status: 202 len: 0 microversion: 2.1 time: 1.436869 Nov 02 12:05:53.560882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1628/3248] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:52 2022] DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb => generated 0 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:05:53.577431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6f78207-fee1-445e-9f0b-55d43f7d1e44 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'create', calling method: .version_select at 0x7ff1b2fd19d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-924249776", "description": "tempest-description-123415584"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:53.854058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:53.863922 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ee3731d-d55b-4d75-a7e2-7e1ae7b595ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1313 microversion: 2.1 time: 0.418533 Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1621/3249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:53 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:53.884014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:54.302675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:54.325545 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-857b228d-60ec-41a1-877b-2dee3653419a tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.459029 Nov 02 12:05:54.327013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1622/3250] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:53 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:54.467052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:54.467644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:54.475314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:54.478176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:54.478932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:54.479934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:54.484046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:54.484818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:54.686425 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6f78207-fee1-445e-9f0b-55d43f7d1e44 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.114226 Nov 02 12:05:54.696576 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1629/3251] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:05:53 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:05:54.704403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3b4a704-7515-4f4f-8d7e-7b514fbad6b4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Action: 'update', calling method: .version_select at 0x7ff1bb9478b0>, body: {"security_group": {"name": "tempest-sg-hth-1581766174", "description": "tempest-description-hth-92326746"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:55.018582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:55.027145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ae3166e-0193-4ade-8760-981d5c5e1dba tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.564399 Nov 02 12:05:55.033798 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1623/3252] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:54 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:55.037056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27937e2-00f0-40d7-b6f6-666705ca5d22", "name": "network-vif-plugged", "status": "completed", "tag": "4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:55.075412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:55.080426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:55.081066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:55.104081 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] Creating event network-vif-plugged:4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc for instance a27937e2-00f0-40d7-b6f6-666705ca5d22 on n-h1-855649-4 Nov 02 12:05:55.115650 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d1eb8e97-1496-4826-bd37-c8ebac7cc4fc req-2ddb365a-00e1-4243-a336-1ed2ee7ca422 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080026 Nov 02 12:05:55.144457 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1624/3253] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:55.156667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:55.157769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:55.169009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:55.169979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:55.170676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:55.172365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:55.173160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:55.173923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:55.600174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3b4a704-7515-4f4f-8d7e-7b514fbad6b4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30" status: 200 len: 216 microversion: 2.1 time: 0.901999 Nov 02 12:05:55.603499 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1630/3254] 10.222.0.48 () {60 vars in 1290 bytes} [Wed Nov 2 12:05:54 2022] PUT /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30 => generated 216 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:55.627474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:55.628896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:55.637383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:55.637599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:55.641535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:55.645978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:55.645978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:55.645978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:55.645978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:55.652457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-009f4525-d605-4909-be23-5999d5c56e20 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1463 microversion: 2.1 time: 0.505469 Nov 02 12:05:55.668029 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1625/3255] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:55 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1463 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:55.678853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:55.683210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d63492cc-afe4-4933-98c6-fe71b5f99b6e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b39f0280>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:55.850456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d63492cc-afe4-4933-98c6-fe71b5f99b6e tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30" status: 200 len: 216 microversion: 2.1 time: 0.180923 Nov 02 12:05:55.851425 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1626/3256] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:05:55 2022] GET /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30 => generated 216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:56.010115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:56.011399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:56.023461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:56.024172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:56.025722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:56.026912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:56.027516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:56.028062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:56.060703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:56.070960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e240ab71-c8d2-47b7-9008-0b170f85199d tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.461700 Nov 02 12:05:56.076450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1631/3257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:55 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:56.088862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2537f4df-44c6-4bcc-8ab9-51e207634fb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb995c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:56.749426 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2537f4df-44c6-4bcc-8ab9-51e207634fb6 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30" status: 202 len: 0 microversion: 2.1 time: 0.671492 Nov 02 12:05:56.753172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1632/3258] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:56 2022] DELETE /compute/v2.1/os-security-groups/91e12bd9-7c37-4fb8-9886-66692f296e30 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:56.758326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:56.758965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:56.770099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:56.770601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:56.771087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:56.771801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:56.772264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:56.772689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:56.847804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:56.873165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=39 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:57.027557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-006582e7-768e-4702-a477-109877b89cae tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1614 microversion: 2.1 time: 1.174176 Nov 02 12:05:57.029042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1627/3259] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:55 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1614 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:57.038137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1", "tag": "e0543e3e-e629-4d86-aa5d-2aee035e82de"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:57.059844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.061124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.062247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.115822 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] Creating event network-changed:e0543e3e-e629-4d86-aa5d-2aee035e82de for instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 on n-h1-855649-4 Nov 02 12:05:57.136302 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-87c67208-d669-4e63-8506-a3eaaedcd8d2 req-a4012ebb-ebab-4e7c-be50-af9cf20d709a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103470 Nov 02 12:05:57.143232 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1628/3260] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:05:57.154738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.155522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:57.163133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.163637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.164303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.165188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.166195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.166915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.185046 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 HTTP/1.1 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'bbf42114-010f-4c8d-bae2-05a5a3388c79'} Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:57.187210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.192035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.194556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.196248 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afa873da-5f86-4665-998e-3c2c38396f45 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 404 len: 111 microversion: 2.1 time: 0.051150 Nov 02 12:05:57.197432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1629/3261] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:57.202608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:05:57.203473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:57.209989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.216607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.216607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.216607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.216607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.216607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.290685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:57.316082 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08836312-e8d8-4a1f-9103-c879580585ef tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1324 microversion: 2.1 time: 0.561461 Nov 02 12:05:57.322402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1633/3262] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:56 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:57.336729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.343913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:57.361518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.362417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.363195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.364352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.365098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.365867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.380537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '541ab607babc497eb4c129b0a9ce309b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099b2a539d384ababf54e39b0c469406', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:57.381285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] flavor_id is None. Assuming migration. {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:05:57.381843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:05:57.644422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:57.663337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d12733c-1f09-45e6-9a05-1832530c756b tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.339463 Nov 02 12:05:57.665226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1634/3263] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:57 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:57.682568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.683555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: bbf42114-010f-4c8d-bae2-05a5a3388c79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:57.701897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.703200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.704086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.705246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:57.706735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:57.707706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:57.746170 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 HTTP/1.1 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'bbf42114-010f-4c8d-bae2-05a5a3388c79'} Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.748164 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.755356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Instance bbf42114-010f-4c8d-bae2-05a5a3388c79 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.756073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08f2a086-0e1c-4359-9b73-f2b1e95e8bbc tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79" status: 404 len: 111 microversion: 2.1 time: 0.089919 Nov 02 12:05:57.759602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1635/3264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:57 2022] GET /compute/v2.1/servers/bbf42114-010f-4c8d-bae2-05a5a3388c79 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:57.766869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb961040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.806462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:57.806615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:57.806615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:57.806615 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.806615 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb HTTP/1.1 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '60f41417-e09c-4d0f-baf5-c36c25fd76fb'} Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:57.809367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 60f41417-e09c-4d0f-baf5-c36c25fd76fb does not exist Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-41cde125-dbcc-43b3-abd9-e14f42a88bd9'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.814086 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f97014e7-3208-4563-8fc7-36d1b203c4c7 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb" status: 404 len: 194 microversion: 2.1 time: 0.050075 Nov 02 12:05:57.817117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1636/3265] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/os-security-groups/60f41417-e09c-4d0f-baf5-c36c25fd76fb => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:57.823545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3df2280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.854266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:57.855216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group d3620845-e881-4d0e-971b-d981693a4e93 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:57.856011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.856011 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93 HTTP/1.1 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd3620845-e881-4d0e-971b-d981693a4e93'} Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:57.858753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group d3620845-e881-4d0e-971b-d981693a4e93 does not exist Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-2062d28a-74e4-4650-8941-441a9467fdce'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e08c31b2-b2a0-414a-9a40-9792e3d75cd4 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93" status: 404 len: 194 microversion: 2.1 time: 0.042003 Nov 02 12:05:57.865278 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1637/3266] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/os-security-groups/d3620845-e881-4d0e-971b-d981693a4e93 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:57.870208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb961280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.907122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:57.907966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:57.908636 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.908636 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8 HTTP/1.1 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '79085329-ed30-48ff-bdb2-67f7ea3508c8'} Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:57.910878 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 79085329-ed30-48ff-bdb2-67f7ea3508c8 does not exist Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-79261860-2efc-4fec-8c17-458dc7b7f18b'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36bbfcab-50be-4dd3-9f4f-1d70d05970e5 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8" status: 404 len: 194 microversion: 2.1 time: 0.047055 Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1638/3267] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/os-security-groups/79085329-ed30-48ff-bdb2-67f7ea3508c8 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:57.922786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3df2310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:57.953604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:57.954305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 6aae5eca-64c4-46f6-a666-f19088b9939d not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:57.954878 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.954878 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d HTTP/1.1 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '6aae5eca-64c4-46f6-a666-f19088b9939d'} Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:57.956985 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 6aae5eca-64c4-46f6-a666-f19088b9939d does not exist Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-6f2623a1-0f99-4801-800d-3419e8d9ceee'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:57.962852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88f1f604-2066-4742-bdfe-58e910fd0f38 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d" status: 404 len: 194 microversion: 2.1 time: 0.041731 Nov 02 12:05:57.967072 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1639/3268] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/os-security-groups/6aae5eca-64c4-46f6-a666-f19088b9939d => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:05:57.978823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb961f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.045392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e358a740-694c-4bf8-aba3-0d9af7c79af2 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e/action" status: 202 len: 0 microversion: 2.1 time: 0.844450 Nov 02 12:05:58.045392 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1630/3269] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:05:57 2022] POST /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:05:58.056948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.058042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:58.063259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:58.063891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 629caf0d-0730-423a-aea8-74c10826aa57 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:58.064589 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.064589 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.072319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.072319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.072319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.073486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57 HTTP/1.1 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '629caf0d-0730-423a-aea8-74c10826aa57'} Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:58.073665 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 629caf0d-0730-423a-aea8-74c10826aa57 does not exist Nov 02 12:05:58.084961 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-d71d62b2-b270-40fd-8b62-eeb1f86d5737'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:58.106484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.106585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ebbad33-ed8e-4cb8-b486-0cab966be072 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57" status: 404 len: 194 microversion: 2.1 time: 0.103238 Nov 02 12:05:58.106585 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1640/3270] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:57 2022] DELETE /compute/v2.1/os-security-groups/629caf0d-0730-423a-aea8-74c10826aa57 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:05:58.106740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.106905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1bb947e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.230546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG neutronclient.v2_0.client [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist", "detail": ""}} {{(pid=127567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:05:58.231218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.security_group_api [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Neutron security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 not found {{(pid=127567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:05:58.231832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.231832 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 HTTP/1.1 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: exception: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '7c95332d-56b1-495d-82da-adcce4d6b3e7'} Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:05:58.234970 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] Nov 02 12:05:58.241510 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:58.251564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Security group 7c95332d-56b1-495d-82da-adcce4d6b3e7 does not exist Nov 02 12:05:58.251564 n-d-855649-4 devstack@n-api.service[127567]: Neutron server returns request_ids: ['req-9e0e74c1-3ec9-4abf-8976-9f52a63a9966'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:58.251564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd2ecf0e-ab15-46ca-85aa-d97ed6fa9eeb tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7" status: 404 len: 194 microversion: 2.1 time: 0.160216 Nov 02 12:05:58.251564 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1641/3271] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:05:58 2022] DELETE /compute/v2.1/os-security-groups/7c95332d-56b1-495d-82da-adcce4d6b3e7 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:58.260992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.261671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:58.272094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.272759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.273452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.291754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.292444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.292946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.329235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:58.434486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:58.442747 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-019dd96c-468c-40f9-945f-b780aeafc269 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1472 microversion: 2.1 time: 0.392179 Nov 02 12:05:58.443723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1631/3272] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:58 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:58.476235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.476896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:58.479527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:05:58.485591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.486115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.486563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.487546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.488067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.488434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.672085 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d2edd16-c75e-4f1d-b6ef-ecae8eb2d312 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 204 len: 0 microversion: 2.1 time: 0.418088 Nov 02 12:05:58.672751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1642/3273] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:58 2022] DELETE /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:05:58.682383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.686092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:58.698239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.698239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.698239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.698239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.698239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.698830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.743221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:58.756089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e2b3097-8ffb-4368-879b-db40d252edcb tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1521 microversion: 2.1 time: 0.292293 Nov 02 12:05:58.760894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1632/3274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:58 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:58.770450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:58.772881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:58.781772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.782584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.783375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:58.784448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:58.785246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:58.786020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.166971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:59.171541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:59.181829 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a13cc158-1da7-4015-a96d-c1c39a411d20 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.419492 Nov 02 12:05:59.183514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1633/3275] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:58 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:05:59.206341 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc3db492-1f0d-4dec-b6a3-a912d19c180a tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1647 microversion: 2.1 time: 0.527952 Nov 02 12:05:59.227221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:59.227221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:59.227633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1643/3276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:58 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1647 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.227730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.279359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] HTTP exception thrown: Action 999 not found Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Request method failure captured: Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22/os-instance-actions/999 HTTP/1.1 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0I_JHOBd0aj_Zi18lr8fwo0j_Dv-dcTZOS0sgt6_LBabtZ31npbkQ3OODcn18X4zsnVxXs3MI6gUtHZXLTLB0zqQZrWm1JcCZOKwYUscG06c0dHTeLe1fmkTohoa-zQ7_zYwLY2us_Bx-WN4oIyj7aPE1_loDJ-NfqX9bPxS14ZJQ Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8249794035d64775991c8f61bd3d48a0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9729d86938d94f70adf295bf8dc7374f Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: exception: Action 999 not found Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': 'a27937e2-00f0-40d7-b6f6-666705ca5d22', 'id': '999'} Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 12:05:59.303128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.308447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Returning 404 to user: Action 999 not found {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:59.309609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7877311-5f81-476d-903a-5be45f62eb20 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.124618 Nov 02 12:05:59.310633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1634/3277] 10.222.0.48 () {58 vars in 1308 bytes} [Wed Nov 2 12:05:59 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22/os-instance-actions/999 => generated 66 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:05:59.323597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '.version_select at 0x7ff1b304fe50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:59.325944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:59.332494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] HTTP exception thrown: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Request method failure captured: Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9f1697e3-2cf1-4ed9-9fba-e15b3c56e747/os-instance-actions HTTP/1.1 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl0I_JHOBd0aj_Zi18lr8fwo0j_Dv-dcTZOS0sgt6_LBabtZ31npbkQ3OODcn18X4zsnVxXs3MI6gUtHZXLTLB0zqQZrWm1JcCZOKwYUscG06c0dHTeLe1fmkTohoa-zQ7_zYwLY2us_Bx-WN4oIyj7aPE1_loDJ-NfqX9bPxS14ZJQ Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8249794035d64775991c8f61bd3d48a0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9729d86938d94f70adf295bf8dc7374f Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '9f1697e3-2cf1-4ed9-9fba-e15b3c56e747'} Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:05:59.335740 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Returning 404 to user: Instance 9f1697e3-2cf1-4ed9-9fba-e15b3c56e747 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37bf7436-3126-482f-9df5-ee3c8e2557cc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/9f1697e3-2cf1-4ed9-9fba-e15b3c56e747/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.020877 Nov 02 12:05:59.340415 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1644/3278] 10.222.0.48 () {58 vars in 1296 bytes} [Wed Nov 2 12:05:59 2022] GET /compute/v2.1/servers/9f1697e3-2cf1-4ed9-9fba-e15b3c56e747/os-instance-actions => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:05:59.355203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:59.362200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:59.373405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.376370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.376370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.376370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.376370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.377011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.431979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:05:59.477156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:59.477800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:59.492853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.493851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.494404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.496094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.496716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.497331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.715766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:05:59.730672 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95b978f5-881d-41b8-9667-e2d0f66960a7 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1472 microversion: 2.1 time: 0.258564 Nov 02 12:05:59.743901 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1645/3279] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:59 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:05:59.852456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c44f6eb-b7a8-478d-8310-a5bc133fb8fc tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 204 len: 0 microversion: 2.1 time: 0.504188 Nov 02 12:05:59.853346 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1635/3280] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:05:59 2022] DELETE /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:05:59.865556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:05:59.866276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:05:59.873654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.874137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.874811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:05:59.875791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:05:59.876261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:05:59.876925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.168778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:00.177190 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-543f2a06-77f5-47cd-bb69-41a47018171e tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1527 microversion: 2.1 time: 0.318775 Nov 02 12:06:00.178045 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1646/3281] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:05:59 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1527 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:00.210376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:00.213089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:00.220752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.221370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.221911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.222835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.223548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.224053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.254879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:00.256151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:00.268189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.269482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.270630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.274861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.276237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.286611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.513522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:00.544761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbe5dc24-d4e2-4aee-b681-2f8b25e77b89 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.340239 Nov 02 12:06:00.558773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1636/3282] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:00 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:00.594347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:00.603563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79cb90b8-c790-4d58-9646-cd75654cab20 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1647 microversion: 2.1 time: 0.363762 Nov 02 12:06:00.604152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1647/3283] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:00 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1647 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:00.769869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:00.770907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:00.778314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.779143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.779841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:00.780625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:00.781284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:00.782070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:01.021557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:01.030418 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dcd3c66-15f8-4c67-bf5e-f602055f8542 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1472 microversion: 2.1 time: 0.264521 Nov 02 12:06:01.031025 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1637/3284] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:00 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:01.211324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:01.212531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:01.239635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:01.242694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:01.243518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:01.244785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:01.245712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:01.246422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:01.575127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:01.577965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:01.590067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:01.600128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:01.600128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:01.600128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:01.600128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:01.600128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:02.385428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:02.402762 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e648ffe-b0c8-4d01-a1ba-cdc27002d750 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1527 microversion: 2.1 time: 1.201935 Nov 02 12:06:02.402762 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1648/3285] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:01 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1527 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:02.409595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:02.410764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:02.419288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:02.419900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:02.421196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:02.430351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:02.431214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:02.431987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:02.808258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:02.838773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e85fb1f-243a-4862-b5bb-824b70232045 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 1.273297 Nov 02 12:06:02.839517 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1638/3286] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:01 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:02.847250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:02.848878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:02.859333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:02.859945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:02.860701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:02.861639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:02.862300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:02.862826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.102149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:03.112771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1c6c283-54b1-4cb0-87fb-0f1bd30070a0 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1647 microversion: 2.1 time: 0.708519 Nov 02 12:06:03.113703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1649/3287] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:02 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1647 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:03.282306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:03.304579 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0a8f52c-d93e-409f-8c04-8b565b74ee51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1472 microversion: 2.1 time: 0.463036 Nov 02 12:06:03.305784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1639/3288] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:02 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:03.354431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1", "name": "network-vif-plugged", "status": "completed", "tag": "e0543e3e-e629-4d86-aa5d-2aee035e82de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:03.372592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.374181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.374930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.396504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] Creating event network-vif-plugged:e0543e3e-e629-4d86-aa5d-2aee035e82de for instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 on n-h1-855649-4 Nov 02 12:06:03.403189 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-16821249-8ce2-449b-9f42-a7cd3040da73 req-d7f4dcc4-4e22-4bde-b379-26fe02cf0950 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055653 Nov 02 12:06:03.408847 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1650/3289] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:03.442755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:03.444300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:03.464043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.464537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.465048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.468538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.469896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.471999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.739380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024ac85c-57a5-4779-8e40-789a4330e60c", "name": "network-vif-deleted", "tag": "d326e7d2-a469-42e1-976c-050cdeb4efa2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:03.790439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.791835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.793412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.826208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] Creating event network-vif-deleted:d326e7d2-a469-42e1-976c-050cdeb4efa2 for instance 024ac85c-57a5-4779-8e40-789a4330e60c on n-h1-855649-4 Nov 02 12:06:03.833914 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-92d59c54-6888-4723-b84f-446504a6d877 req-1c68119e-9f46-47fc-8efa-85fc07e63991 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103573 Nov 02 12:06:03.837071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1651/3290] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:06:03.867970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:03.868741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:03.877456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.877952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.878513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:03.879379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:03.880606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:03.881274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:04.076992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:04.090720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-598c9f7b-01eb-49d2-89a3-c74d037ec023 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1527 microversion: 2.1 time: 0.652622 Nov 02 12:06:04.095085 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1640/3291] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:03 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1527 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:04.154307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:04.156412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:04.166365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:04.167041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:04.167504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:04.168229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:04.168694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:04.169211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:04.225768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:04.241296 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-202c62a7-64b4-4a5c-be7b-beab25214afb tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.380094 Nov 02 12:06:04.242280 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1652/3292] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:03 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:04.330966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:04.337063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:04.349058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:04.349496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:04.349949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:04.350688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:04.351224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:04.351898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:04.433293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:04.445661 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00b14653-7678-4e75-a2e1-8930d036f59d tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1301 microversion: 2.1 time: 0.301650 Nov 02 12:06:04.445661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1641/3293] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:04 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1301 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:04.707449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:04.725727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a449b3f-a552-487f-83bf-5720e8b9f80f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1472 microversion: 2.1 time: 0.394612 Nov 02 12:06:04.725727 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1653/3294] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:04 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:05.132257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:05.135676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:05.165360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.166036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.166580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.173994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.174918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.175619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.269664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:05.271336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:05.306550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.312827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.313422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.314185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.314944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.317073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.374010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:05.390722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25fb58d9-36d4-4647-9089-ddc8dbbf2f98 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1309 microversion: 2.1 time: 0.277035 Nov 02 12:06:05.392129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1642/3295] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:05 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:05.468547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:05.469297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:05.495727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.496255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.496785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.497449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.505657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.506111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.562188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.563468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.564164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.565134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lazy-loading 'fault' on Instance uuid 024ac85c-57a5-4779-8e40-789a4330e60c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:06:05.720205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4b9b23379b4029b0ae12cc6620bd93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd28d11d0d4a46f09bcd37ce4df337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:05.756444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73482ae5-19cb-4bbc-a453-5aef87b33b07 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 200 len: 1306 microversion: 2.1 time: 0.292034 Nov 02 12:06:05.758377 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1643/3296] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:05 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 1306 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:05.782141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:05.782799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:05.783748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:05.790818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.791906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.792538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.793362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-284d3c5d-e5b0-42c7-a8f0-b0f1600c6e7e tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1395 microversion: 2.1 time: 0.527605 Nov 02 12:06:05.793636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.794425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1654/3297] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:05 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1395 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:05.800172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.803437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.900888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27937e2-00f0-40d7-b6f6-666705ca5d22", "name": "network-vif-deleted", "tag": "4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:05.911646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:05.912442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:05.912880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:05.929035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] Creating event network-vif-deleted:4ac8c6e8-e9b1-460f-a63e-aaeb220ae7bc for instance a27937e2-00f0-40d7-b6f6-666705ca5d22 on n-h1-855649-4 Nov 02 12:06:05.935061 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-89a1faa3-a714-4fff-bc9d-4f030a0cd6da req-bec11501-e406-4890-85a0-d3fbc66e6cda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039284 Nov 02 12:06:05.936295 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1655/3298] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:06.073530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:06.079479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:06.086773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4adaf20-c62b-473c-90bb-593350ee4e23 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.326023 Nov 02 12:06:06.089283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1644/3299] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:05 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:06.420400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:06.421482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:06.439633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.442522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.442522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.442522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.447266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.449708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.511140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.516068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.516068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.516068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lazy-loading 'fault' on Instance uuid a27937e2-00f0-40d7-b6f6-666705ca5d22 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:06:06.641875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9729d86938d94f70adf295bf8dc7374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8249794035d64775991c8f61bd3d48a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:06.651362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:06.673781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f03df39-eb1d-4647-ae53-281d0ad3d921 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 200 len: 1314 microversion: 2.1 time: 0.243000 Nov 02 12:06:06.680392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1656/3300] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:06 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:06.787057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:06.787692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] [instance: 024ac85c-57a5-4779-8e40-789a4330e60c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:06.794741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:06.807490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.808022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.808470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.809205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.816071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:06.817418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:06.825048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.833610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.834802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.836065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.839513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.842484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:06.843588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:06.848144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:06.870027 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] HTTP exception thrown: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Request method failure captured: Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c HTTP/1.1 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlyw7NwMa6n2mhbyKBD0je76G7Z6YFmqfMqqdRgw3V8oWBTlc4LzcHmbyDAjHr_ssr_SRoxqWsTkieSo8ci14EjKm8eHmBdHV5Xxh1jtkwHPbQ0g-uT0fND0_gWB5nOMHOKN-PtcLN5ivcMzuziSfOjco0JVRlFIPp7Jq_KkX9wTnB8 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd28d11d0d4a46f09bcd37ce4df337c3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd28d11d0d4a46f09bcd37ce4df337c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fd28d11d0d4a46f09bcd37ce4df337c3 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-162896589 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bb4b9b23379b4029b0ae12cc6620bd93 Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-SecurityGroupsTestJSON-162896589-project Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '024ac85c-57a5-4779-8e40-789a4330e60c'} Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:06.877128 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. Nov 02 12:06:06.884421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:06.892507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Returning 404 to user: Instance 024ac85c-57a5-4779-8e40-789a4330e60c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:06:06.897233 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2bbe050-cdb1-4e37-8cda-f7fff530be71 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c" status: 404 len: 111 microversion: 2.1 time: 0.117997 Nov 02 12:06:06.901672 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1645/3301] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:06 2022] GET /compute/v2.1/servers/024ac85c-57a5-4779-8e40-789a4330e60c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:06:06.911006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e92185f9-0acf-4597-858f-600c172e4104 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b314e8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:07.313440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:07.325765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9bdafef-1b9d-4524-b93a-98a324cfc665 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1575 microversion: 2.1 time: 0.512484 Nov 02 12:06:07.339873 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1657/3302] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:06 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1575 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:07.350951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:07.351991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:07.359623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.360504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.361249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.362385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.363187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.363853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.499449 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e92185f9-0acf-4597-858f-600c172e4104 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ec6cee3a-b3ef-4cf8-bd82-a848971f13e2" status: 202 len: 0 microversion: 2.1 time: 0.595994 Nov 02 12:06:07.502455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1646/3303] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:06:06 2022] DELETE /compute/v2.1/os-security-groups/ec6cee3a-b3ef-4cf8-bd82-a848971f13e2 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:06:07.510942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:07.512197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:07.525722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.528533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.530840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.536041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.539268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.540221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.557574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:07.571136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f10ffbd3-8a26-4e53-ae10-36d78cd8c22f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.229544 Nov 02 12:06:07.575175 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1658/3304] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:07 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:07.579584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6cda2c1-23d5-4e9a-bb35-ed5a4dc7e3f8 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] Calling method '.version_select at 0x7ff1b3714ee0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:07.702627 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-065b76de-4e6a-41ff-af7a-947dfb1c6092 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198623 Nov 02 12:06:07.707297 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1647/3305] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:06:07 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:07.712901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:07.713904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] [instance: a27937e2-00f0-40d7-b6f6-666705ca5d22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:07.728484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.728901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.729346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.730377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:07.730773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:07.731234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:07.753161 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] HTTP exception thrown: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Request method failure captured: Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 HTTP/1.1 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0I_JHOBd0aj_Zi18lr8fwo0j_Dv-dcTZOS0sgt6_LBabtZ31npbkQ3OODcn18X4zsnVxXs3MI6gUtHZXLTLB0zqQZrWm1JcCZOKwYUscG06c0dHTeLe1fmkTohoa-zQ7_zYwLY2us_Bx-WN4oIyj7aPE1_loDJ-NfqX9bPxS14ZJQ Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8249794035d64775991c8f61bd3d48a0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8249794035d64775991c8f61bd3d48a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8249794035d64775991c8f61bd3d48a0 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1535471460 Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9729d86938d94f70adf295bf8dc7374f Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1535471460-project Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a27937e2-00f0-40d7-b6f6-666705ca5d22'} Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:07.759778 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] Returning 404 to user: Instance a27937e2-00f0-40d7-b6f6-666705ca5d22 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49c3048c-cd06-4dc4-8acf-c513347467b3 tempest-InstanceActionsNegativeTestJSON-1535471460 tempest-InstanceActionsNegativeTestJSON-1535471460-project] 10.222.0.48 "GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22" status: 404 len: 111 microversion: 2.1 time: 0.055063 Nov 02 12:06:07.774336 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1648/3306] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:07 2022] GET /compute/v2.1/servers/a27937e2-00f0-40d7-b6f6-666705ca5d22 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:06:08.066139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb364314-2f49-4743-85b5-a0d65d85b82f"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:08.070216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:08.080234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:08.081030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:08.081805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:08.083224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:08.083935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:08.084820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:08.125521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6cda2c1-23d5-4e9a-bb35-ed5a4dc7e3f8 tempest-SecurityGroupsTestJSON-162896589 tempest-SecurityGroupsTestJSON-162896589-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3762c0fb-88a5-4e3c-937f-f74d6badf948" status: 202 len: 0 microversion: 2.1 time: 0.551857 Nov 02 12:06:08.126107 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1659/3307] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:06:07 2022] DELETE /compute/v2.1/os-security-groups/3762c0fb-88a5-4e3c-937f-f74d6badf948 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:06:08.598025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:08.598691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:08.619537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:08.620549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:08.621172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:08.621998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:08.622856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:08.623555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:09.211391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00e4de92-0720-4f68-84bb-17f1d00cfcb8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.146337 Nov 02 12:06:09.214901 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1649/3308] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:06:08 2022] POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 194 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:09.505956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:09.517007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee4a3985-648a-477b-82b2-4204c47746d9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.923783 Nov 02 12:06:09.532013 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1660/3309] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:08 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:10.544408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:10.545127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:10.563088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:10.567618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:10.567618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:10.567618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:10.567618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:10.567618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:10.776457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:10.777158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:10.786292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:10.787190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:10.787851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:10.789412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:10.790072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:10.791483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:11.580024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:11.592274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-344a67d3-3415-45c2-9404-34675487db19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 1.053342 Nov 02 12:06:11.610006 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1650/3310] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:10 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:11.620471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1", "tag": "e0543e3e-e629-4d86-aa5d-2aee035e82de"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:11.638319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:11.639146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:11.639745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:11.656411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] Creating event network-changed:e0543e3e-e629-4d86-aa5d-2aee035e82de for instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 on n-h1-855649-4 Nov 02 12:06:11.666772 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0ec106ab-e3d8-44f5-a7e7-00bde06810e1 req-55c00ed6-64f3-43ef-bce9-8f6805c1f34c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051923 Nov 02 12:06:11.668371 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1651/3311] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:12.039381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:12.051914 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c58b5bee-b4a7-4ab8-9bd9-bb6905e62e76 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1575 microversion: 2.1 time: 1.279918 Nov 02 12:06:12.067696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1661/3312] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:10 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1575 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:12.629562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:12.630900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:12.642846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:12.646825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:12.647464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:12.648441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:12.650412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:12.651779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:13.903427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:13.940738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ad7bece-1ca6-4716-82fa-5a962f4f12b9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 1.304966 Nov 02 12:06:13.945923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1652/3313] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:12 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:14.974175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:14.974822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:14.981571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:14.982066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:14.982501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:14.988635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:14.994115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:14.994115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:16.282386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:16.295978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8aa3d7a-7985-4b0b-a62c-012b53eb816b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 1.325538 Nov 02 12:06:16.298867 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1662/3314] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:14 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:17.331228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:17.331228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:17.345571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:17.346068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:17.346549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:17.347434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:17.348305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:17.348908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:17.704443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:17.717832 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0b66f52-927f-4665-93da-4bd54efe7a11 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.396994 Nov 02 12:06:17.721629 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1653/3315] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:17 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:18.456021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1960717018", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6ba01373-182d-4325-b40e-5443d27a7ec4"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:18.568488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] validate_networks() for [('6ba01373-182d-4325-b40e-5443d27a7ec4', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:06:18.753897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:18.754848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:18.778131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:18.778667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:18.779165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:18.779888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:18.780372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:18.783903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:19.435063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:19.449305 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88f9605c-9422-47ae-84b8-7d90a3499d44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.700007 Nov 02 12:06:19.455040 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1654/3316] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:18 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:19.645427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:06:19.646099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:06:19.646847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:06:19.648260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:06:19.648981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:06:19.662829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:19.680774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:19.685469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:19.686289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:19.687364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:19.690630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:19.691359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:19.736393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Getting quotas for project 72cee90393784adb9cdd0731d890538f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:06:19.743741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Getting quotas for user f6fefc0d121941199602f576f1293944 and project 72cee90393784adb9cdd0731d890538f. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:06:19.764418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:06:19.768822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:06:19.966383 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7ccf4f3-3516-485c-9471-72e6249056c8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890119 Nov 02 12:06:19.975761 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1663/3317] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:06:19.979547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b620818c-7ef6-4d07-a2b9-55d6301e9c1b tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:19.980964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b620818c-7ef6-4d07-a2b9-55d6301e9c1b tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:20.110071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b620818c-7ef6-4d07-a2b9-55d6301e9c1b tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:20.129230 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b620818c-7ef6-4d07-a2b9-55d6301e9c1b tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1217 microversion: 2.1 time: 0.153787 Nov 02 12:06:20.131378 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1655/3318] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:19 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:20.486208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:20.498116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:20.518517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:20.519842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:20.520927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:20.523192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:20.524039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:20.524835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:21.159324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a9b54d8-04a6-4123-af77-80320424193d tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:21.165010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a9b54d8-04a6-4123-af77-80320424193d tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:21.497870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a9b54d8-04a6-4123-af77-80320424193d tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:21.506034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a9b54d8-04a6-4123-af77-80320424193d tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1217 microversion: 2.1 time: 0.350668 Nov 02 12:06:21.510309 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1656/3319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:21 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:21.518284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:21.539658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f28fd4f6-7190-4cd4-9854-1d36a0596e91 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 1.062394 Nov 02 12:06:21.540467 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1664/3320] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:20 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:22.539028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:22.540387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:22.553217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:22.553791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:22.554261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:22.558407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:22.559165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:22.559773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:22.566423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:22.572394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:22.590941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:22.592076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:22.597055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:22.598141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:22.598969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:22.602010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:22.721440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:22.734239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-595dda54-2144-43da-8b25-a9b00f4216ed tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1269 microversion: 2.1 time: 0.201375 Nov 02 12:06:22.734870 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1657/3321] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:22 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:22.927358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:22.955499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db50cc77-6aee-486a-9630-23318212a829 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.393558 Nov 02 12:06:22.964713 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1665/3322] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:22 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:23.761045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:23.761670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:23.769859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:23.770861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:23.771693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:23.772801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:23.773491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:23.774269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:23.865333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:23.877876 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04a75c5a-3b65-4662-95dd-3ab6fa5d8645 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1277 microversion: 2.1 time: 0.120483 Nov 02 12:06:23.879764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1658/3323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:23 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:23.989618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:23.990318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:24.009095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:24.009744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:24.010491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:24.011415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:24.011886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:24.012479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:24.773988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:24.782436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86f6cc58-64df-4f1f-8e6c-f2611c3fd913 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.797183 Nov 02 12:06:24.783770 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1666/3324] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:23 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:24.909016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:24.909647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:24.926117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:24.928828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:24.928828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:24.928828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:24.928828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:24.930846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.033716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:25.049135 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6019b75f-4f0c-4f32-a9b4-b995aa608ed0 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1275 microversion: 2.1 time: 0.144207 Nov 02 12:06:25.050184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1659/3325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:24 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:25.262731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:25.266425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:25.274585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.275577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.276030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.276759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.277224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.277656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.308545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'flavor' on Instance uuid 12665a7e-888c-44ae-b448-bfb5954a9174 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:06:25.807193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:25.807847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:25.814850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.815369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.815812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.816518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.817072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.817798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.850214 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85d28637-fc8a-49f1-a812-49ce183dddd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/action" status: 200 len: 32 microversion: 2.1 time: 0.593459 Nov 02 12:06:25.860363 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1667/3326] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:06:25 2022] POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/action => generated 32 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:06:25.866815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:25.871656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:25.874475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.875002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.875445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:25.876171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:25.876629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:25.877108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:26.254443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:26.270021 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97b9006e-d449-437d-b008-9a5de3c7acb9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.465654 Nov 02 12:06:26.273389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1660/3327] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:25 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:26.282271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:26.283298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:26.289750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:26.290490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:26.291354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:26.292558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:26.293186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:26.293784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:26.438732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:26.456240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-264dd9e4-b31c-41bd-b0a7-6823457e6dad tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.594159 Nov 02 12:06:26.458927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1668/3328] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:25 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:26.900371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:26.910818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24f14b2f-7be6-40a6-b5ac-68c7173b1df1 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.636042 Nov 02 12:06:26.920330 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1661/3329] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:26 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:27.297883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:27.299391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:27.308017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.308623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.309076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:27.309876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.310341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.310782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:27.483567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:27.484329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:27.494130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.494954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.495549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:27.496516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.497082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.497616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:27.840461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:27.853909 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1d2f355-0128-4d0a-b858-d36c6e641879 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1477 microversion: 2.1 time: 0.559871 Nov 02 12:06:27.856341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1669/3330] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:27 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:27.937869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:27.948764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:27.951361 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f4cb6b6-b5f5-42e4-b582-2277f29ae903 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.473824 Nov 02 12:06:27.951523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:27.956618 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1662/3331] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:27 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:27.980673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.986187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.986932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:27.988092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:27.988841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:27.989449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:28.424619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:28.436723 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ca8d435-eb89-4fa3-b835-2499e323ab93 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.502543 Nov 02 12:06:28.441579 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1670/3332] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:27 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:28.588478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734b271d-9225-4222-aba2-3fb02036edca", "tag": "11b7e6ac-7077-4883-9081-f58ac7046191"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:28.610559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:28.613388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:28.615759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:28.643096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] Creating event network-changed:11b7e6ac-7077-4883-9081-f58ac7046191 for instance 734b271d-9225-4222-aba2-3fb02036edca on n-h1-855649-4 Nov 02 12:06:28.660063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-33d95cf2-c120-4fa4-8217-653a7c39d6f5 req-f5ac6c47-f60f-4936-8744-54bb5b768af6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076358 Nov 02 12:06:28.661281 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1663/3333] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:06:28.884301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:28.884965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:28.894212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:28.894704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:28.914226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:28.915237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:28.915742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:28.916147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:28.982486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:28.983519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:28.997049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:29.003425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:29.004209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:29.005314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:29.005954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:29.006723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:29.720018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:29.754041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:29.914176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:29.925169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b80030d5-8d8b-4f1f-af0b-f22f19628b42 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1476 microversion: 2.1 time: 1.045250 Nov 02 12:06:29.941295 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1671/3334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:28 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1476 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:29.949403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:29.950626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:29.957694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:29.958513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:29.959178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:29.960668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:29.961321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:29.961925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:30.022271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:30.050446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d0c42193-5911-460a-a073-a52c3d000185 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 1.070527 Nov 02 12:06:30.054941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1664/3335] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:28 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:30.364287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:30.379220 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87baa66e-31fd-4ea4-957f-8f2afea8f941 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.436212 Nov 02 12:06:30.379833 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1672/3336] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:29 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:30.729559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "name": "network-vif-unplugged", "status": "completed", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:30.751799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:30.759441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:30.759441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:30.798112 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Creating event network-vif-unplugged:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h1-855649-4 Nov 02 12:06:30.826667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] Instance 074cf49c-afef-46a3-9e03-05ee05510a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:06:30.846881 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-eb6c5b5d-c98b-4bfa-ace8-01ba3f8cd654 req-0082b141-9451-43f6-abc2-73025d9c459c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122948 Nov 02 12:06:30.848248 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1665/3337] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:30.956541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:30.957229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:30.964564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:30.965072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:30.965524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:30.966251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:30.966718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:30.967185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:30.985135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:31.081605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:31.082332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:31.097309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:31.097817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:31.098266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:31.103373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:31.103373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:31.103373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:31.164539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:31.506915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:31.695838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:31.713854 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72b5aac9-5e6d-4e67-bcd2-f173afab33ea tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1476 microversion: 2.1 time: 0.761584 Nov 02 12:06:31.715824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1673/3338] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:30 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1476 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:31.740797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:31.741467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:31.748154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:31.749583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:31.750243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:31.751153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:31.751577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:31.751991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:31.752609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:31.770071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9da7c165-cf49-49e4-a042-0fb63df34723 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.695929 Nov 02 12:06:31.783004 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1666/3339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:31 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:32.042361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:32.051854 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db896275-d3a1-498f-b516-662559bd7f1f tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.334553 Nov 02 12:06:32.052880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1674/3340] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:31 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:32.738061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:32.738808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:32.754104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:32.755646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:32.756876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:32.758939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:32.760428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:32.762329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:32.802093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:32.802816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:32.831079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:32.834054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:32.850247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:32.850247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:32.850247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:32.850247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:33.171291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:33.186115 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-405ea12d-0d2f-4d6f-afba-aa352eac0616 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1476 microversion: 2.1 time: 0.447710 Nov 02 12:06:33.187109 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1667/3341] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:32 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:33.201855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:33.220926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:33.221413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:33.221852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:33.254443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Creating event network-changed:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h1-855649-4 Nov 02 12:06:33.275322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] Instance 074cf49c-afef-46a3-9e03-05ee05510a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:06:33.298729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:33.308760 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1acb177b-f830-4010-9565-4a37f8ad3f65 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.510987 Nov 02 12:06:33.311446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-586c2c5d-2ce6-468f-ae93-6cb120c24d7f req-bdb8fb43-28f8-4efb-bb59-033252ce08b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122538 Nov 02 12:06:33.312312 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1668/3342] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:33.312842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1675/3343] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:32 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:33.334140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:33.335235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:33.353373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:33.354213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:33.357190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:33.359773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:33.360606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:33.361334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:33.954414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:33.966027 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2266bfc3-c24c-4d0e-b571-4bb3d2d06ea3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.651797 Nov 02 12:06:33.968529 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1676/3344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:33 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:34.223553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:34.223553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:34.227231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:34.230141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:34.234589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:34.235676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:34.239786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:34.240491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:34.335816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:34.339476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:34.352839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:34.355461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:34.356140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:34.357091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:34.359695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:34.360950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:34.807536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:34.827124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:34.842471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b61e21cb-1e9b-42f7-8f33-fa85c54536c5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.510660 Nov 02 12:06:34.843762 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9236396c-8173-4f76-b77c-7ebe3a9b52ff tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1476 microversion: 2.1 time: 0.631586 Nov 02 12:06:34.844387 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1669/3345] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:34 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1476 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:34.879467 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1677/3346] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:34 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:34.994632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:34.995322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:35.009323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.009847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.011391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:35.012146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.014499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.016361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:35.279637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:35.317386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b1a7e4e-c97a-4c52-bcb5-f8aee648855a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.328433 Nov 02 12:06:35.318463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1670/3347] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:34 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:35.874109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:35.877441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:35.893583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:35.894343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:35.904353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.905386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.905878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.906320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:35.908419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.910687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:35.914370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.916699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.919377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:35.919907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:35.920537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:35.920990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:36.407596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:36.421179 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67a5b26b-85bb-4563-acaa-27766d76e69e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.532429 Nov 02 12:06:36.422051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1671/3348] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:35 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:36.428095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:36.429446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:36.436734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:36.437514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:36.438260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:36.439685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:36.440585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:36.441189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:36.525309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:36.556755 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4e4cc81-2022-48d7-bd7b-341b4354c68a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1474 microversion: 2.1 time: 0.687431 Nov 02 12:06:36.562139 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1678/3349] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:35 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1474 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:36.909945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:36.917561 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-845a6cde-fb4e-4146-897c-3d0a7d1f5469 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.494401 Nov 02 12:06:36.924369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1672/3350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:36 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:36.929916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2079634559", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:37.022868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:06:37.311287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734b271d-9225-4222-aba2-3fb02036edca", "name": "network-vif-plugged", "status": "completed", "tag": "11b7e6ac-7077-4883-9081-f58ac7046191"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:37.322119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:37.322617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:37.323091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:37.336703 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] Creating event network-vif-plugged:11b7e6ac-7077-4883-9081-f58ac7046191 for instance 734b271d-9225-4222-aba2-3fb02036edca on n-h1-855649-4 Nov 02 12:06:37.341929 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5949f309-1224-42c0-b723-09a3809f040e req-23758dd8-970d-4ace-ac92-34355e8f27a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111193 Nov 02 12:06:37.342961 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1673/3351] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:37.448035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:37.451434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:37.465275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:37.466124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:37.466324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:37.467092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:37.467564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:37.468631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.326411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:38.345230 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b420527-c938-4441-832a-fdf4feeec357 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.903680 Nov 02 12:06:38.346251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1674/3352] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:37 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:38.363236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:38.367939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:38.367939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=62 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:38.372552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.373069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.373524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.374311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.374783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.375262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.403629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:06:38.404244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:06:38.404561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:06:38.404985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:06:38.405412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:06:38.417018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.417520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.418023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.418901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.419361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.419939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.444601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:06:38.451171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:06:38.468650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:06:38.479427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:06:38.610787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:38.621456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54a20be1-a142-4759-a983-428c1177b347 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1471 microversion: 2.1 time: 0.274149 Nov 02 12:06:38.630150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1675/3353] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:38 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:38.638634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:38.639534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:38.650910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.652823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.653468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.655384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:38.658579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:38.659267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:38.695348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26660961-9dfb-4196-88a3-93c14f50eefa tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.127755 Nov 02 12:06:38.715928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1679/3354] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:06:38.817710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1200245129", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:38.929652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:06:38.987371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:39.004115 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76ff1d7d-490c-491d-b2d4-000589ac7830 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1317 microversion: 2.1 time: 0.372267 Nov 02 12:06:39.006477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1676/3355] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:38 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:39.022217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:39.025979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:39.041536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.042366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.043074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.044893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.047525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.048371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.356771 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bcf0067-4304-4d01-975c-34ca2d2440e5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e/action" status: 204 len: 0 microversion: 2.1 time: 0.348584 Nov 02 12:06:39.364363 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1677/3356] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:06:39 2022] POST /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e/action => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:06:39.373187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f72aa28-0c41-429d-855a-dc766efbf4c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:39.374356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f72aa28-0c41-429d-855a-dc766efbf4c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:39.489751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f72aa28-0c41-429d-855a-dc766efbf4c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:39.504014 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f72aa28-0c41-429d-855a-dc766efbf4c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1193 microversion: 2.1 time: 0.135656 Nov 02 12:06:39.506461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1678/3357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:39 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:39.519548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:39.520550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:39.532443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.535977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.536585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.537421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.538563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.542296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.643591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:06:39.644809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:06:39.645653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:06:39.646263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:06:39.646891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:06:39.664007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.667597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.670954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.670954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.670954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.673571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.701112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:06:39.712795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:06:39.744630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:06:39.750189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:06:39.930489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:39.940389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5d0cbab-40c3-4d64-878f-1f723bc615e0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1471 microversion: 2.1 time: 0.431404 Nov 02 12:06:39.941681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1679/3358] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:39 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:39.947502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:39.948687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:39.974214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.974904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.975550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:39.976891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:39.977967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:39.978783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.050765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-786987ea-cc71-41d6-8b55-60f6add480e3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322083 Nov 02 12:06:40.068639 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1680/3359] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:06:40.084329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.090805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:40.110183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.111282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.116767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.120145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.120145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.120145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.450379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.471338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73a294cb-94c3-4b6a-97c7-3ac47709eb46 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.520755 Nov 02 12:06:40.472007 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1680/3360] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:39 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:40.494964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abf155d7-4609-4693-98e1-6e4444f6e31e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.495634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abf155d7-4609-4693-98e1-6e4444f6e31e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:40.604253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.635147 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4523b26b-e84c-4a7e-a0a9-cbac09c01b87 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1505 microversion: 2.1 time: 0.570102 Nov 02 12:06:40.635750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1681/3361] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:40.642012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.645680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:40.654154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.654893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.655135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.655873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.656422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.656920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.683021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abf155d7-4609-4693-98e1-6e4444f6e31e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.696265 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abf155d7-4609-4693-98e1-6e4444f6e31e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1215 microversion: 2.1 time: 0.207793 Nov 02 12:06:40.698130 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1681/3362] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:40.715086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.723454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.732428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Searching by: {'deleted': False, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:06:40.745510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.746403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.747103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.748408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.749119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.749797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.793447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:06:40.840902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac971fc1-90e6-48d3-a1fc-e5cbd64ce6ee tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.140581 Nov 02 12:06:40.843262 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1682/3363] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers => generated 334 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:40.848637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.849477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:40.857092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.859553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.860311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.861639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.862417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.864202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.920681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.925017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.932950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28d78cff-829c-4288-b5bb-78812051dfaf tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/os-instance-actions/req-a7ccf4f3-3516-485c-9471-72e6249056c8" status: 200 len: 313 microversion: 2.1 time: 0.077024 Nov 02 12:06:40.935826 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1683/3364] 10.222.0.48 () {58 vars in 1419 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/os-instance-actions/req-a7ccf4f3-3516-485c-9471-72e6249056c8 => generated 313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:40.940426 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-114dbd70-f61a-4aa8-99cc-49fece312cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1197 microversion: 2.1 time: 0.303252 Nov 02 12:06:40.951059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:40.965421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1682/3365] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1197 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:40.965539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:40.965539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Searching by: {'deleted': False, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:06:40.965539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.965539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.965938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:40.966041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.966041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.966041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.966041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.969729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:40.979762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.981117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.981890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:40.982863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:40.983593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:40.985771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.019494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:06:41.029481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:41.091431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:41.101386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.101987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.108844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.429649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3d6e9de-f517-47ac-99cd-ef1833f287eb tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "POST /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/action" status: 202 len: 0 microversion: 2.1 time: 0.473723 Nov 02 12:06:41.430248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1683/3366] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:06:40 2022] POST /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:06:41.443256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:41.444574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:41.457424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.457990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.458572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.459356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.460645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.462861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.637504 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-143d3e62-ff96-4def-9579-848be3a8c6f4 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.700584 Nov 02 12:06:41.638276 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1684/3367] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:06:40 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:41.648764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "name": "network-vif-plugged", "status": "completed", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:41.669039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.669988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.670941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.690377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Creating event network-vif-plugged:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h1-855649-4 Nov 02 12:06:41.703781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] Instance 074cf49c-afef-46a3-9e03-05ee05510a2e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:06:41.727073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ab5ada8e-a2b1-4770-b642-c48a0d0161e2 req-3ea62e49-153a-498d-8338-945bfb38a620 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087419 Nov 02 12:06:41.745478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1685/3368] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:41.754558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:41.755974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:41.771164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.774649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.776801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.777667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.778595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.782203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.946060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:41.972966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b4eb8ed-ff17-4a87-b05d-69e8e5f13341 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1471 microversion: 2.1 time: 0.526608 Nov 02 12:06:41.972966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1684/3369] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:41 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1471 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:41.972966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:41.972966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:41.991665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.992375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.993349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:41.994103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:41.996099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:41.996099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:42.296442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:42.309512 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c92183d9-9418-495e-a6f6-cfbeb42129aa tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1507 microversion: 2.1 time: 0.562548 Nov 02 12:06:42.310444 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1686/3370] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:41 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:42.313893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:42.316350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-159ee69d-79af-4d74-b55e-67bf6d94d519 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:42.326965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-159ee69d-79af-4d74-b55e-67bf6d94d519 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014817 Nov 02 12:06:42.328236 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1687/3371] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:06:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:42.333505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8872a018-e3d3-481b-9949-13cadae8063c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:42.334083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eb4c542-0fbe-4132-a8c4-d656e64c634c tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.370666 Nov 02 12:06:42.334668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8872a018-e3d3-481b-9949-13cadae8063c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:42.359717 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1685/3372] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:41 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:42.382593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:42.382593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:42.394500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:42.396599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:42.397455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:42.401004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:42.402000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:42.403955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:42.454032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8872a018-e3d3-481b-9949-13cadae8063c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:42.462366 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8872a018-e3d3-481b-9949-13cadae8063c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1215 microversion: 2.1 time: 0.132742 Nov 02 12:06:42.464625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1688/3373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:42 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:42.547508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:42.561803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55d838f8-6bde-432e-be04-45177853e0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1245 microversion: 2.1 time: 0.199535 Nov 02 12:06:42.582379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1686/3374] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:42 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1245 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:42.721137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:42.722960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:42.735830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:42.736636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:42.737329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:42.738239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:42.738950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:42.740004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:42.805602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:06:42.998814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.000132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.042186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.042765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.051695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.052703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.053225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.053661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.213974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b83b26ed-05dd-42b5-8aaa-7840cba8e5bf tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 204 len: 0 microversion: 2.1 time: 0.499484 Nov 02 12:06:43.216092 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1689/3375] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:06:42 2022] DELETE /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:06:43.233356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.234305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.242291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.243332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.252447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.252447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.252447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.252447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.346723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:43.371879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-adb3642d-b2a4-4f62-8ead-89b1deb3fdbd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1463 microversion: 2.1 time: 0.387453 Nov 02 12:06:43.372737 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1687/3376] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:42 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:43.400751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.402087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.410463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.411337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.412235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.413186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.413820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.414989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.501918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:43.512804 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd7af98a-ba26-4844-b928-0605fab1ed78 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1700 microversion: 2.1 time: 0.292608 Nov 02 12:06:43.513850 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1690/3377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1700 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:43.520340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.521347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.530057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.530916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.536952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.536952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.536952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.536952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.605091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:43.617901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83ca051c-4b30-4c4b-9493-0b5676bfc3e3 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1512 microversion: 2.1 time: 0.243721 Nov 02 12:06:43.618767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1688/3378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:43.631515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.631515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.646793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.856614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:43.873604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b428d0b-5c73-40fb-915a-1a172d0d5880 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.358226 Nov 02 12:06:43.874477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1691/3379] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:43.890270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01d385fc-df44-4dba-8148-d23f35b136cc tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1614 microversion: 2.1 time: 0.266268 Nov 02 12:06:43.890270 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1689/3380] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1614 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:43.897548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.898555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.898708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:43.899315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:43.909963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.915838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.916513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.917235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.917705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.917863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.919265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.920182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.920312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:43.920770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:43.921626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.923800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:43.929570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:44.062769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:44.070748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:44.073706 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66105dba-ca87-4433-8510-e988ad122ced tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1263 microversion: 2.1 time: 0.180794 Nov 02 12:06:44.074693 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1692/3381] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:44.081020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42df067f-5dea-4ef8-8628-2b22f5963584 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '.version_select at 0x7ff1b31b94c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:44.082828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c682bf9c-3414-4149-ab1d-5db475114031 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1211 microversion: 2.1 time: 0.192601 Nov 02 12:06:44.086131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42df067f-5dea-4ef8-8628-2b22f5963584 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.086815 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1690/3382] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:43 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:44.087460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42df067f-5dea-4ef8-8628-2b22f5963584 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.088096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42df067f-5dea-4ef8-8628-2b22f5963584 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.096221 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42df067f-5dea-4ef8-8628-2b22f5963584 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.019695 Nov 02 12:06:44.096838 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1693/3383] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 12:06:44 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:44.222410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1184637564", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:44.285722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:06:44.542130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:44.546333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:44.550991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.551500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.552133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.553030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.554133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.554720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.621883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:06:44.622671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:06:44.623359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:06:44.623840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:06:44.624614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:06:44.641206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.642066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.642716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.643710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.644185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.644627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.660932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:44.670720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:06:44.677548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:06:44.695432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:06:44.698409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:06:44.931310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-106d14e4-fc22-4ea5-a73b-a8f807224b9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713712 Nov 02 12:06:44.942683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1691/3384] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:06:44.942683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:44.942683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:44.952499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.954077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.954747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:44.955647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:44.956181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:44.956734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.010723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:45.019730 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9620560f-9479-4baa-b4c6-f3baa01ec1ce tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1700 microversion: 2.1 time: 0.484215 Nov 02 12:06:45.022150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1694/3385] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:44 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1700 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:45.027738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:45.028564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:45.035697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.036210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.036663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.037415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.038416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.038852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.701503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:45.710335 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a65025e-1eb3-41e1-9bde-81c5f59487dd tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1505 microversion: 2.1 time: 0.772094 Nov 02 12:06:45.711032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1692/3386] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:44 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:45.716932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f71713ef-fc2e-423a-b0d0-0ac981a2bc52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:45.722644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f71713ef-fc2e-423a-b0d0-0ac981a2bc52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:45.749073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:45.761779 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8b2be98-c4cc-489e-9c18-618d5b18efc6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.740405 Nov 02 12:06:45.763189 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1695/3387] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:45 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:45.771833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:45.772385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:45.778687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.780803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.781428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.782558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.783446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.785121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.901887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f71713ef-fc2e-423a-b0d0-0ac981a2bc52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:45.910460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f71713ef-fc2e-423a-b0d0-0ac981a2bc52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1213 microversion: 2.1 time: 0.198109 Nov 02 12:06:45.911260 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1693/3388] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:45 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:45.930819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:45.931985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:45.938724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.939464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.939918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:45.942490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:45.942490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:45.942490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.107966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:46.117211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3279a54-e9cf-4da9-a424-a77f921146e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1275 microversion: 2.1 time: 0.203901 Nov 02 12:06:46.117905 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1694/3389] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:45 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:46.124952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '.version_select at 0x7ff1b3dd8790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:46.127229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:46.134434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.135646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.136575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.137489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.138151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.138627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.174120 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ffc2a37d-69f3-438d-b456-ea66ee9357d8 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054787 Nov 02 12:06:46.175011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1695/3390] 10.222.0.48 () {58 vars in 1296 bytes} [Wed Nov 2 12:06:46 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca/os-instance-actions => generated 611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:46.182028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:46.183990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:46.190496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.191141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.191974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.196923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.196923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.196923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.420537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:46.429740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f93f5755-d9c6-48be-8f3f-e8f3705c152e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.665417 Nov 02 12:06:46.430365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1696/3391] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:45 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:46.699658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:46.709343 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6d018e5-9c50-4f4b-9445-9bfa222164dc tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1700 microversion: 2.1 time: 0.531469 Nov 02 12:06:46.725620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1696/3392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:46 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1700 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:46.760977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:46.761487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:46.786314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.787626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.788069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.788812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.789278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.789712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.822270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:46.822949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:46.836205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.836483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:06:46.836829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.837139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:46.841843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:46.843624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:46.844783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.252429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.266220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.268235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.270152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b2640bb-a9e0-42e5-9993-1f9dbb5b1ef9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2950 microversion: 2.32 time: 0.827643 Nov 02 12:06:47.270868 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1697/3393] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:06:46 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2950 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:06:47.294503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:47.297305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:47.316861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.318028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.318391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ee27867-5127-46db-9e7a-8ecf6db1f65e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 204 len: 0 microversion: 2.1 time: 0.560861 Nov 02 12:06:47.321051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.321797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1697/3394] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:06:46 2022] DELETE /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:06:47.322907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.324190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.324984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.337078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:47.337078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:47.350684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.352324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.354369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.359594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.360809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.361871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.566336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.576789 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35d8d84b-ccf7-4c17-b81e-b53dddf35010 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1265 microversion: 2.1 time: 0.252570 Nov 02 12:06:47.577814 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1698/3395] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:47 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:47.582786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:47.584212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:47.591773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.592350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.592799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.593510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.593969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.594396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.785638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.795674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4278a69a-f2ca-48ae-8510-f4a21e739613 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1273 microversion: 2.1 time: 0.216895 Nov 02 12:06:47.796273 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1699/3396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:47 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:47.801878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:47.802388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:47.810006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.810504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.810951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.811762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.812231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.812736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.876763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:47.887608 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e73698f-a400-4d61-9eed-28bfddb8ff35 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.615149 Nov 02 12:06:47.891368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1698/3397] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:47 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:47.905258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:47.906007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:47.914865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.915511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.916022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:47.917442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:47.917983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:47.918485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.073046 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86244684-17c6-48be-87a0-6e103513a8e1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.275003 Nov 02 12:06:48.073673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1700/3398] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:06:47 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f/os-interface => generated 1830 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:06:48.078729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:48.079510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:48.086682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.090876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.091412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.092323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.093378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.093674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.562270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:48.591034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d656ff4b-42f8-45ff-bc4b-e1ad0896cf2a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1511 microversion: 2.1 time: 0.695142 Nov 02 12:06:48.592819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1699/3399] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:47 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1511 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:48.620012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:48.623413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:48.646014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.652433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.653172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.654169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.654649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.655592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.688890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:48.711478 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c27c8b78-db1e-4ac3-bc3d-b71ea7ef7c0c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.636658 Nov 02 12:06:48.712667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1701/3400] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:48 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:48.775612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18c4bd23b6840cf9fa52a33e6bd4022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781b7cdf3f3748e08840033e7b2d4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:48.779884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-513ddee8-7dbe-42c5-b126-63a411de77a0 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 200 len: 1632 microversion: 2.1 time: 0.178681 Nov 02 12:06:48.796563 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1700/3401] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:48 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 1632 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:48.805063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:48.806514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:48.813266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.814082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.814698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.815676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.820763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.821292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.960504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1", "name": "network-vif-deleted", "tag": "e0543e3e-e629-4d86-aa5d-2aee035e82de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:48.974514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:48.975684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:48.976134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:48.989190 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] Creating event network-vif-deleted:e0543e3e-e629-4d86-aa5d-2aee035e82de for instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 on n-h1-855649-4 Nov 02 12:06:48.995710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-32544366-0f6d-4488-8a46-d2d7e2ec0f1e req-2bfcbbbb-050e-4d6b-b41e-8b5afced1d1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281141 Nov 02 12:06:48.998332 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1702/3402] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:49.004075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:49.004968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:49.013468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.014357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.015041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:49.016185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.017188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.018561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:49.408901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:49.425126 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c86d07c-3561-45ee-99ea-7358c421c86b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1271 microversion: 2.1 time: 0.625959 Nov 02 12:06:49.426014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1701/3403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:48 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1271 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:49.435964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:49.437869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:49.483202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.484526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.486040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:49.489828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.489828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.489828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:49.495468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:49.666805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:49.679556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b302275e-2a78-498e-a33b-4edd14e09b86 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.681827 Nov 02 12:06:49.680152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1703/3404] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:48 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:49.685192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:49.685815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:49.704522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.704989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.705424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:49.709303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:49.709787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:49.710234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.082868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:50.102925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb57dab0-5183-4bd0-9251-02aabcafb176 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.674582 Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1702/3405] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:49 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.126350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.556586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:50.565445 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bd25dfa-1002-4fdc-b4ca-840f9ef2dc1c tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1511 microversion: 2.1 time: 0.884079 Nov 02 12:06:50.566487 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1704/3406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:49 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:50.572042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:50.572966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] [instance: b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:50.584129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.585619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.586767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.587791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.588498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.589108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.607970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] HTTP exception thrown: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Request method failure captured: Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 HTTP/1.1 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl0TF-L-gxTN9fbSO8jfwV-WexBT82xQiaN_ScVDolv2nlRDhplG6Rin8pxyPfsxvr6AHV39sDp8oB00nMRKho54fwyNZZj--K0DHkbJ3XPbSvPr7GS604AJ8f6ecTAj1nAd8Wt59JjnQXJMg7h2avoQEOpYuXRODhkuPvuqpSmi5sk Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 781b7cdf3f3748e08840033e7b2d4fb9 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-878402795 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781b7cdf3f3748e08840033e7b2d4fb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781b7cdf3f3748e08840033e7b2d4fb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781b7cdf3f3748e08840033e7b2d4fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781b7cdf3f3748e08840033e7b2d4fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-878402795 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 781b7cdf3f3748e08840033e7b2d4fb9 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-878402795 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-878402795-project Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f18c4bd23b6840cf9fa52a33e6bd4022 Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-878402795-project Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1'} Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:50.609829 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:50.615480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Returning 404 to user: Instance b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:06:50.616261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ecf1f7-5800-4393-bcb2-2c8b4eac48c6 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1" status: 404 len: 111 microversion: 2.1 time: 0.047458 Nov 02 12:06:50.617411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1705/3407] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:50 2022] GET /compute/v2.1/servers/b3576aa6-5bba-42b6-9f2c-5cf2d8ee25f1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:06:50.625786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:50.626509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:50.658277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.659745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.663029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.665421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.667265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.667901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.726395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:50.744285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8082323e-afcc-45c0-b824-c8289a475e0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.638452 Nov 02 12:06:50.744285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1703/3408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:50 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:50.748975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-202b00c6-9af5-44b8-ae62-fc063abd9cc5 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] Calling method '.version_select at 0x7ff1b35cc790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:50.888482 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-202b00c6-9af5-44b8-ae62-fc063abd9cc5 tempest-ServersTestJSON-878402795 tempest-ServersTestJSON-878402795-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502584480" status: 202 len: 0 microversion: 2.1 time: 0.143158 Nov 02 12:06:50.889902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1704/3409] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502584480 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:06:50.897755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:50.898740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:50.907824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.909477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.910088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.910968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:50.911613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:50.918065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:50.922286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:50.934667 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e42a11fa-40dd-4f80-816d-66523ea98584 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1271 microversion: 2.1 time: 0.315022 Nov 02 12:06:50.943456 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1706/3410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:50 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1271 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:50.983244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:51.133781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:51.134408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:51.150024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.151025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.151651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.152551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.153188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.153982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.550536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:51.563646 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fee0a8f-dcae-4bed-9b31-66d2f54c2258 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.672927 Nov 02 12:06:51.583128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1705/3411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:50 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:51.589028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c876ade2-ded4-4f9f-b3ea-bad18284204c", "tag": "370eff64-47a4-40a7-9f63-2aa3a22a5ed0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:51.609994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.610617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.611099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.638343 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] Creating event network-changed:370eff64-47a4-40a7-9f63-2aa3a22a5ed0 for instance c876ade2-ded4-4f9f-b3ea-bad18284204c on n-h1-855649-4 Nov 02 12:06:51.645981 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8c3a5652-4fe3-4bfe-8f1d-ac5b798c79d2 req-d5f09f86-da3e-4b50-bd9b-956272f13029 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061207 Nov 02 12:06:51.647130 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1706/3412] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:51.656099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:51.657198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:51.668214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.669592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.670308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.671441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.672202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.673816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.792295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:51.801844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd781490-879f-4e02-84b4-d3db45dde7ac tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.674083 Nov 02 12:06:51.814642 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1707/3413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:51 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:51.814642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:51.814642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:51.817817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.823891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.825106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.833394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:51.835634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.836485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.837165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.850531 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cf00c4e-80ea-4478-b70f-399efc42df6a tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1469 microversion: 2.1 time: 0.201739 Nov 02 12:06:51.854822 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1707/3414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:51 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:51.931879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:51.983361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:51.984690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:51.994926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.995762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.996970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:51.998020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:51.998680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:51.999402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:52.463787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:52.836515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:52.841271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:52.873136 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fdc82e5-9e71-433d-bbc4-5863d0e0446b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.910822 Nov 02 12:06:52.873755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1708/3415] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:51 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:52.874894 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f9dab8f-cd2f-4315-a3f3-f30366bebc51 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 1.070942 Nov 02 12:06:52.877151 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1708/3416] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:51 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:52.887170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:52.888325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:52.893300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:52.895030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:52.902716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:52.904264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:52.904729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:52.906788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:52.907412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:52.912103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:52.914033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:52.914817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:52.915529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:52.916908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:52.919334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:52.919903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.475649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:53.483265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:53.485972 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e81a0bf4-157d-4ee7-97b4-3a3b95a11b02 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.604800 Nov 02 12:06:53.486682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1709/3417] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:52 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:53.491573 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e60dd9c-0a2b-4b1a-a24e-c669fd1fcae8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.611132 Nov 02 12:06:53.492509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1709/3418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:52 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:53.507127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:53.507127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:53.520027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.520626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.521308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.522151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.522666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.523318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.564161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.564661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.565107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.565566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lazy-loading 'fault' on Instance uuid 734b271d-9225-4222-aba2-3fb02036edca {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:06:53.696727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734b271d-9225-4222-aba2-3fb02036edca", "name": "network-vif-deleted", "tag": "11b7e6ac-7077-4883-9081-f58ac7046191"}, {"name": "network-changed", "server_uuid": "79ad3ff9-ee40-447f-b112-b23280e5b752", "tag": "63154887-0a22-4737-be95-3cc2ee91bfda"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:53.719633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.720435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.720870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.734583 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Creating event network-vif-deleted:11b7e6ac-7077-4883-9081-f58ac7046191 for instance 734b271d-9225-4222-aba2-3fb02036edca on n-h1-855649-4 Nov 02 12:06:53.735425 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] Creating event network-changed:63154887-0a22-4737-be95-3cc2ee91bfda for instance 79ad3ff9-ee40-447f-b112-b23280e5b752 on n-h1-855649-4 Nov 02 12:06:53.743203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7a0a8316-d1f0-46b0-a69d-ee27f33738bd req-723a8cf9-a012-4076-9374-d87f5df397b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050575 Nov 02 12:06:53.744119 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1710/3419] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:06:53.781129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6fefc0d121941199602f576f1293944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72cee90393784adb9cdd0731d890538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:53.789902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bff54d61-19e6-4b0a-b6d3-61fd4597d55e tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 200 len: 1307 microversion: 2.1 time: 0.301820 Nov 02 12:06:53.790489 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1710/3420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:53 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:53.898415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:53.899597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:53.903724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:53.904616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:53.913700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.913932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.914225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.914665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.914816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.915431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.915636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.915891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.916321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:53.916653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:53.917239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:53.917778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:54.258673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:54.270052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd5f889d-4159-4ae3-9b15-78236784d710 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.376480 Nov 02 12:06:54.271479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1711/3421] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:53 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:54.372471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:54.385196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cf53509-e7ee-4a88-937c-ff7dcc5a0399 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.485303 Nov 02 12:06:54.385963 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1711/3422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:53 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:54.539265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:54.541215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:54.546918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:54.548141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:54.590672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:54.592978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:54.604469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:54.604700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:54.604700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:54.606136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:54.607431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:54.611059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:54.611673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:54.612487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:54.613131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:54.618476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:54.661814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:55.509414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:55.538160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1570a096-e87a-41df-a5e7-61862760608d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 1.022275 Nov 02 12:06:55.539245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1712/3423] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:54 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:55.550366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:55.562768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42268737-2207-4fa5-8248-d46cc9ab3ca9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 1.042647 Nov 02 12:06:55.570766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:55.572552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] [instance: 734b271d-9225-4222-aba2-3fb02036edca] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:55.573016 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1712/3424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:54 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:55.585459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:55.587459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.588467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.589078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:55.589687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.594047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.594836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.595487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.604886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.605681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.607517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.612179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.612896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.613541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.637165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] HTTP exception thrown: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Request method failure captured: Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca HTTP/1.1 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl056IrCWXcPIHjAoQJVO1wrvLYDhn6O95yYrqT2Ag1tIxsIG1envYX2eCeq9kOffDcDH2PHiDila1IodDiwURv3QdiLY9oPseTzPMRFTIFps2lunyE-x7bmUXHkaKxFTqtZRaLA-N8zF-EvDfv12uYXfSSjQfKuVhGTNGfuV3V_W-0 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 72cee90393784adb9cdd0731d890538f Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsTestJSON-821735450 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72cee90393784adb9cdd0731d890538f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_72cee90393784adb9cdd0731d890538f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/72cee90393784adb9cdd0731d890538f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72cee90393784adb9cdd0731d890538f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsTestJSON-821735450 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 72cee90393784adb9cdd0731d890538f Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsTestJSON-821735450 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsTestJSON-821735450-project Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f6fefc0d121941199602f576f1293944 Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsTestJSON-821735450-project Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '734b271d-9225-4222-aba2-3fb02036edca'} Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:55.638883 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] Returning 404 to user: Instance 734b271d-9225-4222-aba2-3fb02036edca could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:06:55.643449 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e0a2ab9-c17c-4076-ae81-707c1233f190 tempest-InstanceActionsTestJSON-821735450 tempest-InstanceActionsTestJSON-821735450-project] 10.222.0.48 "GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca" status: 404 len: 111 microversion: 2.1 time: 0.100995 Nov 02 12:06:55.652041 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1713/3425] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:55 2022] GET /compute/v2.1/servers/734b271d-9225-4222-aba2-3fb02036edca => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:06:55.655970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:55.656591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:55.692219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.692720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.693162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.694587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:55.711204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:55.711823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:55.908167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:56.213257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:56.227282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1184eb28-c6f3-47d3-bbff-335595db87c3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.647950 Nov 02 12:06:56.229364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1713/3426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:55 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:56.243107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:56.264336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:56.271857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:56.272584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:56.295607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:56.297946 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] Creating event network-changed:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h2-855649-4 Nov 02 12:06:56.310295 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db35c0cd-f709-47cb-a271-40caf3e002a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.658141 Nov 02 12:06:56.311156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1714/3427] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:55 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:56.338353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-db04b00d-d563-414d-b74e-60aa1340c821 req-dd2b37cd-b72f-4e4c-ba6b-bb5e5737b0a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108755 Nov 02 12:06:56.347437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1714/3428] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:56.566796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:56.571169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:56.584928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:56.585431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:56.585877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:56.586621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:56.587411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:56.593335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:56.599554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:56.601351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:56.609269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:56.609934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:56.610521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:56.611816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:56.613070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:56.613536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:57.193421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:57.204213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-735a91e9-2929-4662-99f9-8b36b07f5542 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1737 microversion: 2.1 time: 0.641261 Nov 02 12:06:57.209443 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1715/3429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:56 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1737 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:57.254603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:57.255316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:57.265864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:57.270537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:57.270537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:57.270537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:57.270537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:57.270537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:57.466157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:57.471262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-122ce392-e5f6-4b2f-9674-9311a68c9ecb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.876938 Nov 02 12:06:57.472011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1715/3430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:56 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:57.494269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c876ade2-ded4-4f9f-b3ea-bad18284204c", "name": "network-vif-plugged", "status": "completed", "tag": "370eff64-47a4-40a7-9f63-2aa3a22a5ed0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:57.505889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:57.509314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:57.510097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:57.526606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] Creating event network-vif-plugged:370eff64-47a4-40a7-9f63-2aa3a22a5ed0 for instance c876ade2-ded4-4f9f-b3ea-bad18284204c on n-h1-855649-4 Nov 02 12:06:57.534372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-90029b30-c23c-4d3d-8334-a97f3f03c12b req-63af9fd6-b6bd-4973-b538-affff0c17934 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060861 Nov 02 12:06:57.535369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1716/3431] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:06:57.542238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:57.543591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:57.546150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:06:57.550111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:57.550601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:57.551064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:57.551779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:57.552236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:57.552665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.000727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:58.016171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ec43896-96f3-49ab-95d0-d3130978d0c4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.765467 Nov 02 12:06:58.021146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1716/3432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:57 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:58.230802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:58.231461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:58.238846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.239326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.239774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.240506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.240972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.241404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.259970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:58.270153 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00026678-a52d-4261-93dd-3acecc0228c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.733392 Nov 02 12:06:58.279512 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1717/3433] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:57 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:06:58.495135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:58.495597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:58.504780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.505202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.505646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.508547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.509293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.510015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.796607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:58.806659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f4e8d44-fd5e-4952-94f1-ccf69a3b5427 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1717 microversion: 2.1 time: 0.579866 Nov 02 12:06:58.807556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1717/3434] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:58 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1717 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:58.951400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:58.951915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:58.958079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.958578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.966604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:58.968087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:58.968880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:58.969553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.058008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:06:59.067422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ad09597-8e8a-49c3-a32d-5fc549c96417 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.576250 Nov 02 12:06:59.068752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1718/3435] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:58 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:06:59.075071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:59.076235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:59.083226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.083952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.084678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.085854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.086941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.087781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.099048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Cannot 'detach_volume' instance 12665a7e-888c-44ae-b448-bfb5954a9174 while it is in vm_state rescued Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments/fb364314-2f49-4743-85b5-a0d65d85b82f HTTP/1.1 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'detach_volume' instance 12665a7e-888c-44ae-b448-bfb5954a9174 while it is in vm_state rescued Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '12665a7e-888c-44ae-b448-bfb5954a9174', 'id': 'fb364314-2f49-4743-85b5-a0d65d85b82f'} Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 12665a7e-888c-44ae-b448-bfb5954a9174 while it is in vm_state rescued Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:59.101144 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 12665a7e-888c-44ae-b448-bfb5954a9174 while it is in vm_state rescued Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 409 to user: Cannot 'detach_volume' instance 12665a7e-888c-44ae-b448-bfb5954a9174 while it is in vm_state rescued {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e706fd9-b554-43fb-8a5f-21223618eb6a tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments/fb364314-2f49-4743-85b5-a0d65d85b82f" status: 409 len: 152 microversion: 2.1 time: 0.156902 Nov 02 12:06:59.105933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1718/3436] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:06:58 2022] DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments/fb364314-2f49-4743-85b5-a0d65d85b82f => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:06:59.133674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:06:59.134505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:59.142034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.142625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.143161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.143940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.148149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.148149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.420689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5683a345-7389-4780-b5fb-6132879e787d tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/action" status: 202 len: 0 microversion: 2.1 time: 0.302294 Nov 02 12:06:59.421356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1719/3437] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:06:59 2022] POST /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:06:59.428029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:06:59.428749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:06:59.437071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.437569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.438010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:06:59.438726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:06:59.439210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:06:59.439639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:00.019292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:00.027745 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30dbeacd-4c7f-4ed1-8c49-9f5747fed02d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.957695 Nov 02 12:07:00.028596 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1719/3438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:59 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:00.046464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:00.048975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:00.057713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:00.058551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:00.059258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:00.060085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:00.060694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:00.061233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:00.100102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:00.109392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73b076e6-c128-4553-af83-2573dfccb0ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1293 microversion: 2.1 time: 0.686571 Nov 02 12:07:00.111287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1720/3439] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:06:59 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1293 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:00.131728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:00.132552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:00.139071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:00.139580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:00.140028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:00.140742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:00.141495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:00.142342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:00.414271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:00.425781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2eef73d-279e-4cf4-a6e4-65189c6c0f87 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1725 microversion: 2.1 time: 0.384973 Nov 02 12:07:00.428918 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1720/3440] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:00 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1725 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:00.550134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:00.565337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff46bb6c-942e-4dc5-a66c-7d26b58313af tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.437170 Nov 02 12:07:00.582458 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1721/3441] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:00 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:01.052585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:01.052585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:01.065013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.071214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.071674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.072629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.072885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.073324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.095285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:01.139951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:01.140514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:01.147718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.148535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.149153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.150090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.150781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.151404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.559471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:01.571710 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42f49b9f-d4b0-4cb4-92b5-cc67fef8924c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.522913 Nov 02 12:07:01.587253 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1721/3442] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:01 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:01.598473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:01.600521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:01.607882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.608796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.609416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.609843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:01.610532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.611818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.612481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.629539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee515648-da9d-44a4-827e-52437daf9ddf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1474 microversion: 2.1 time: 0.491976 Nov 02 12:07:01.633521 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1722/3443] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:01 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1474 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:01.649495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ad3ff9-ee40-447f-b112-b23280e5b752", "name": "network-vif-plugged", "status": "completed", "tag": "63154887-0a22-4737-be95-3cc2ee91bfda"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:01.687820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.688424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.692297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.746750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] Creating event network-vif-plugged:63154887-0a22-4737-be95-3cc2ee91bfda for instance 79ad3ff9-ee40-447f-b112-b23280e5b752 on n-h1-855649-4 Nov 02 12:07:01.772240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-10793cb7-995f-43f1-bfda-f9eb733bf694 req-a2d28c06-ccb1-4bde-942f-183a03a09e7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133941 Nov 02 12:07:01.773410 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1723/3444] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:01.788985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:01.795220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:01.806220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.806730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.807228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:01.807961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:01.808429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:01.808868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:02.282032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:02.310900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:02.326192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed9436df-bc66-44fc-bceb-bce7d9e3a6b7 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1725 microversion: 2.1 time: 0.736523 Nov 02 12:07:02.343140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1722/3445] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:01 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1725 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:02.343562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2643f3f5-6ac7-4bbf-a699-45f93affba0c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.554586 Nov 02 12:07:02.343562 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1724/3446] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:01 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:02.343789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-771011941", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:02.459826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:02.599465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:02.601063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:02.614765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:02.617472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:02.620297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:02.621426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:02.622040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:02.623612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.091017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:03.122709 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9fe7e0b2-e7a4-4efb-bef2-1af894739bbc tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.528653 Nov 02 12:07:03.123658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1725/3447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:02 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:03.367162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:03.367964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:03.383923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.384916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.385567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.386890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.387913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.388583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.395455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:03.403002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:03.404639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:03.405791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:03.406731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:03.407682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:03.435461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.436270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.436940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.437864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.438539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.439211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.491106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:03.504263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:03.531882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:03.537964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:03.661048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:03.672048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e91cca9-18ef-4033-a0a2-8c740dc6a381 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1315 microversion: 2.1 time: 0.312979 Nov 02 12:07:03.672997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1726/3448] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:03 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:03.679639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:03.680503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:03.689503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.690393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.691050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.692889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.693588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:03.694234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:03.733256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08181a40-f1e4-44af-a680-23caa4c79f69 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404902 Nov 02 12:07:03.736593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1723/3449] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:07:03.757960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30b52a7e-d354-486e-9742-7d0bf5e2d464 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:03.758461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30b52a7e-d354-486e-9742-7d0bf5e2d464 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:03.805499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30b52a7e-d354-486e-9742-7d0bf5e2d464 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:07:03.924670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:03.976269 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11b95ac0-10ed-4346-b835-b698d2b86d76 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1731 microversion: 2.1 time: 0.261360 Nov 02 12:07:03.976269 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1727/3450] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:03 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:03.976269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:03.976269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:03.991872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:03.992640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.007813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.009205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:04.010205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.015680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.205995 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0adfe602-794a-4627-b95d-712492cd06fa tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.249357 Nov 02 12:07:04.215728 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1728/3451] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:07:03 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:07:04.221112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:04.221995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:04.260359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:04.273685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.274533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.275514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:04.276195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.281586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.562792 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30b52a7e-d354-486e-9742-7d0bf5e2d464 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20" status: 204 len: 0 microversion: 2.1 time: 0.811310 Nov 02 12:07:04.567861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:04.569073 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1724/3452] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:07:03 2022] DELETE /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:07:04.572597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:04.573313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:04.575566 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-158811b5-6d90-4ffe-90cd-17b3d87842a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.357144 Nov 02 12:07:04.587737 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1729/3453] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:04 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:04.651224 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 HTTP/1.1 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ef7da13b-6a84-4612-905f-46e1a05f1d20'} Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance ef7da13b-6a84-4612-905f-46e1a05f1d20 Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:04.661714 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:04.667216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dea8768f-e781-4e5d-af8e-1ffccb3e7c73 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20" status: 404 len: 111 microversion: 2.1 time: 0.096129 Nov 02 12:07:04.674084 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1725/3454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:04 2022] GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:07:04.705833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:04.708481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:04.719196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:04.727592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.728255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.729246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:04.730543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:04.736594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:04.861641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1154056313", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:04.985218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:05.810917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:05.826407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b2a1b16-1001-48fb-9df3-905646e149f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1503 microversion: 2.1 time: 1.128270 Nov 02 12:07:05.831464 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1730/3455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:04 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1503 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:05.841539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "name": "network-vif-plugged", "status": "completed", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:05.867136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:05.873109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:05.873906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:05.899114 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] Creating event network-vif-plugged:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h2-855649-4 Nov 02 12:07:05.916198 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a98fa3ae-13b3-41d4-9193-dee4eea54038 req-d6fdb5f2-ad30-427c-aa6f-3a38f1979c1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083039 Nov 02 12:07:05.921027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1731/3456] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:05.940481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:05.941604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:05.948324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:05.950476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:05.951393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:05.952043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:05.952978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:05.953636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:05.954259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:06.663871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:06.674034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a00ea25-e1d0-4bb7-9bc0-b1ddadcccf88 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.749494 Nov 02 12:07:06.677345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1732/3457] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:05 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:06.692980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:06.693873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:06.707752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:06.708640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:06.709350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:06.710355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:06.711125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:06.711795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:06.792213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:07:07.157982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:07.157982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:07.157982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:07.157982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:07.157982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:07.184045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.195032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.196049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:07.197192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.197940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.198392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:07.246911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:07.264402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:07.290409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:07.298322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:07.412298 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faa05759-5fc2-4872-b523-306290a64635 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 204 len: 0 microversion: 2.1 time: 0.732154 Nov 02 12:07:07.417281 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1733/3458] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:07:06 2022] DELETE /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:07:07.423210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:07.424362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:07.432913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.433747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.434376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:07.435790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.436421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.437029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:07.511723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f776679-e897-40bd-a1ae-83f9c64f8cc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654933 Nov 02 12:07:07.523050 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1726/3459] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:07:07.528664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d79e353b-9ad0-4f9d-a17c-f874a058c7a8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:07.532200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d79e353b-9ad0-4f9d-a17c-f874a058c7a8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:07.881493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d79e353b-9ad0-4f9d-a17c-f874a058c7a8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:07.891510 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d79e353b-9ad0-4f9d-a17c-f874a058c7a8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1221 microversion: 2.1 time: 0.364475 Nov 02 12:07:07.897477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1727/3460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:07 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1221 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:07.920206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:07.921295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:07.940611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.941311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.953511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:07.956098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:07.957428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:07.957940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:08.380293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:08.397241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11fac1bc-100c-4d2e-804d-a8bbee29320d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1509 microversion: 2.1 time: 0.977676 Nov 02 12:07:08.399692 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1734/3461] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:07 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1509 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:08.505820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:08.516952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f5d5ce9-392e-45c9-8b61-804728bd4077 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1313 microversion: 2.1 time: 0.617530 Nov 02 12:07:08.535345 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1728/3462] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:07 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1313 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:08.666720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:08.678522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:08.679439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:08.681641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:08.706939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] Creating event network-changed:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:07:08.749544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ab59f10d-901e-41b9-bd8d-2905f7eab7f4 req-bbe47967-f000-4881-829c-a7e9b8b8d8bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093524 Nov 02 12:07:08.757636 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1735/3463] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:08.930346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef9b2a7f-575d-43ea-a118-f8ce36627f66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:08.931070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef9b2a7f-575d-43ea-a118-f8ce36627f66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:09.104667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef9b2a7f-575d-43ea-a118-f8ce36627f66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:09.114219 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef9b2a7f-575d-43ea-a118-f8ce36627f66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1221 microversion: 2.1 time: 0.197794 Nov 02 12:07:09.116740 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1729/3464] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:08 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:09.431469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:09.432189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:09.448963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:09.449706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:09.450348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:09.451260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:09.451902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:09.452486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:09.548965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:09.550077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:09.573085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:09.575080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:09.575816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:09.576709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:09.577334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:09.577926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:10.714590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:10.722675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-877046f3-6ec1-4db9-971e-c9fb94a72933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1509 microversion: 2.1 time: 1.298355 Nov 02 12:07:10.723292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1736/3465] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:09 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1509 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:10.728423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:10.729044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:10.735187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:10.735896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:10.736351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:10.737064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:10.737809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:10.738474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:10.768503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:10.782729 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-813a7b81-6eb4-42ec-82f4-3bedbf62aec9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1463 microversion: 2.1 time: 1.243134 Nov 02 12:07:10.782729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1730/3466] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:09 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1463 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:10.804280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:10.814785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:10.826268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:10.826268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:10.830028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] Creating event network-changed:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:07:10.830341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:10.838450 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c7a4b9ef-aeb1-45ec-8fd0-d1b261acbeff req-97ddbd8e-d94e-4576-b909-2cc13625c2db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Nov 02 12:07:10.839103 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1731/3467] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:10.845845 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb572329-6114-458a-ba08-ac04889be66f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1217 microversion: 2.1 time: 0.121445 Nov 02 12:07:10.846454 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1737/3468] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:10 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:10.866897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:10.873768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:10.885051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:10.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:10.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:10.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:10.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:10.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.424472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:11.439309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:07:11.462476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:11.465388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:11.466299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:11.466997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:11.471647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:11.748524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:11.749338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:11.778872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:11.779449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:11.783113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.785028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:11.796277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:11.797425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.822231 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d03a4ccc-710e-4a49-87a2-8d4a097c5630 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450/action" status: 202 len: 0 microversion: 2.1 time: 0.980512 Nov 02 12:07:11.827647 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1732/3469] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:07:10 2022] POST /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450/action => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:07:11.848616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:11.854499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:11.879041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:11.880956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:11.885419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.885419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:11.899377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:11.904899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.958518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:11.959357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:11.959549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:11.960020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'fault' on Instance uuid 79ad3ff9-ee40-447f-b112-b23280e5b752 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:07:12.346922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:12.363622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d74845c2-d9bc-43c1-bfb2-a7b659e5797f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 200 len: 1305 microversion: 2.1 time: 0.619395 Nov 02 12:07:12.364849 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1738/3470] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:11 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 1305 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:12.373737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:12.377929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:12.395144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:12.395947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:12.397097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:12.398352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:12.398801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:12.399253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:12.654410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:12.669319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1dd4649-9cd9-4cf2-8e38-c0d876bd61d6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1281 microversion: 2.1 time: 0.302960 Nov 02 12:07:12.683506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1739/3471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:12 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:12.876607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ad3ff9-ee40-447f-b112-b23280e5b752", "name": "network-vif-deleted", "tag": "63154887-0a22-4737-be95-3cc2ee91bfda"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:12.891783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:12.900969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-637a83ac-bb43-442a-bc12-ada6d79a1218 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1472 microversion: 2.1 time: 1.067642 Nov 02 12:07:12.901567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1733/3472] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:11 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1472 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:12.941310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:12.942872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:12.943399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:12.990177 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] Creating event network-vif-deleted:63154887-0a22-4737-be95-3cc2ee91bfda for instance 79ad3ff9-ee40-447f-b112-b23280e5b752 on n-h1-855649-4 Nov 02 12:07:12.996756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-37a19c7b-5f26-4b43-983e-8e20f2e05204 req-4a4e973c-da89-4e9c-98c7-fdc2bc38edb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141564 Nov 02 12:07:12.999935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1740/3473] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:13.389679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:13.390891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:13.411067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:13.412953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:13.413605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:13.415323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:13.423538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:13.423538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:13.468722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 HTTP/1.1 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '79ad3ff9-ee40-447f-b112-b23280e5b752'} Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:13.472836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:13.485028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b075017e-bafc-4baf-8cad-eecf2121c63f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 404 len: 111 microversion: 2.1 time: 0.093331 Nov 02 12:07:13.488080 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1734/3474] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:13 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:07:13.672010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1342385335", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:13.694772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:13.695911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:13.713273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:13.714381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:13.715890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:13.718890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:13.719611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:13.720225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:13.784351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:13.979182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:13.995861 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41c3639a-ffa6-460e-8d09-d64a2d7ca36e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1279 microversion: 2.1 time: 0.305858 Nov 02 12:07:13.996448 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1735/3475] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:13 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1279 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:14.001558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:14.002459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:14.018548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:14.019754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:14.020390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:14.021353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:14.022040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:14.022640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:14.803603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:14.807458 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3cd72db-cf02-4e4d-8307-8c4d0d016815 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1472 microversion: 2.1 time: 0.809566 Nov 02 12:07:14.808493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1736/3476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:13 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1472 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:15.028617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:15.029679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:15.037727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:15.042366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:15.047492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:15.048422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:15.049016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:15.049598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:15.237059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:15.250147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92af9f74-c059-4fd3-95f4-258d268dde9a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1279 microversion: 2.1 time: 0.225905 Nov 02 12:07:15.250759 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1737/3477] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:15 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:15.411395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1364988684", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "45ab10e8-748e-468b-ac5c-fe13f2a96409"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:15.486972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] validate_networks() for [('45ab10e8-748e-468b-ac5c-fe13f2a96409', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:15.825016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:15.825673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:15.825929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:15.826354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:15.826773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:15.859327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:15.859828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:15.860274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:15.864612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:15.865137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:15.865579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:15.913165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:15.924873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:15.964681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:15.981375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:16.150308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-745d8824-f9f2-42d9-906b-c0e8a58c4cfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.485309 Nov 02 12:07:16.158283 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1741/3478] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:07:16.167674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:16.167674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:16.183799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:16.196913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:16.196913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:16.196913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:16.196913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:16.196913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:17.068739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:17.088041 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03636059-f090-462a-8ebe-02d85c62a577 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1472 microversion: 2.1 time: 0.928182 Nov 02 12:07:17.088665 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1742/3479] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:16 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1472 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:17.094491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55259df3-3012-4bba-a2cf-f95c579fa76f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:17.095551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55259df3-3012-4bba-a2cf-f95c579fa76f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:17.206267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:17.291907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55259df3-3012-4bba-a2cf-f95c579fa76f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:17.308742 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55259df3-3012-4bba-a2cf-f95c579fa76f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1215 microversion: 2.1 time: 0.218721 Nov 02 12:07:17.309329 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1743/3480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:17 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:17.325813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:17.326529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:17.336527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:17.337114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:17.337921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:17.338716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:17.339623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:17.340177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:17.581027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:17.581604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:17.582096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:17.582516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:17.582939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:17.610843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:17.611387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:17.611851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:17.619215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:17.620646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:17.621382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:17.657429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:17.666297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Getting quotas for project b45bec46b4a54d3586b666a3dd28602c. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:17.672550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Getting quotas for user bfca7598595a41cba9672e9a6e57e82a and project b45bec46b4a54d3586b666a3dd28602c. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:17.689325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:17.694506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:17.930122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6219df6a-670a-48eb-9356-0b5a8a2cc3ab tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.588768 Nov 02 12:07:17.938062 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1738/3481] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:07:17.951344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:17.952328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:18.003151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.008369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:18.017830 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4f0b86b-e184-47f1-9859-397c186e0640 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.707233 Nov 02 12:07:18.021621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1744/3482] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:17 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:18.114123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:18.116002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:18.144886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:18.151071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:18.158179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:18.158179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:18.158179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:18.162637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:18.305366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.333236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.338736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.342091 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c269d0b-7e1f-46b9-ba5e-8a9c8d254650 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1259 microversion: 2.21 time: 0.399101 Nov 02 12:07:18.343660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1739/3483] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:17 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:18.358075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:18.358972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:18.381779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:18.383986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:18.384607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:18.386750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:18.389389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:18.389948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:18.672423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.691140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6eaa9e8d-2118-4ecc-b5b4-c9d6983901a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1267 microversion: 2.1 time: 0.343987 Nov 02 12:07:18.701785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1740/3484] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:18 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:18.890275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:18.931338 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-178151f6-2b9d-4f2f-ac3b-eab23598708b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1472 microversion: 2.1 time: 0.822407 Nov 02 12:07:18.936185 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1745/3485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:18 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1472 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:19.047229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:19.048380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:19.067585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:19.068152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:19.072084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:19.072958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:19.073423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:19.079620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:19.373691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:19.377842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:19.839770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:19.865493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:19.868541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:19.870654 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed2358fb-b37a-4cec-9313-b721ac986336 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1259 microversion: 2.21 time: 0.502255 Nov 02 12:07:19.872332 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1746/3486] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:19 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1259 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:19.881165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:19.882259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:19.900287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:19.900287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:19.900287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:19.901586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:19.902299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:19.914633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:19.930958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:19.952089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7ab148d-7469-445d-a7d4-56757cc31535 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.906273 Nov 02 12:07:19.953820 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1741/3487] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:19 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:19.972888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:19.973518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:20.011641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.012066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:20.012530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:20.013249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.020031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:20.020451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:20.367826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:20.401389 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9beab095-fa2c-4b70-ba97-5d27601eaba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1285 microversion: 2.1 time: 0.524135 Nov 02 12:07:20.403278 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1747/3488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:19 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1285 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:20.754553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:20.767642 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a891ac3f-f296-4501-93fc-3c6f680c2ed6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.798720 Nov 02 12:07:20.768931 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1742/3489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:19 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:20.901016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:20.904415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:20.928178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.943609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:20.945776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:20.946663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.952714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:20.957792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:20.978192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:20.979021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:20.990897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.992443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:20.992443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:20.995047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:20.995808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.010927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:21.302800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:21.314156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:21.317731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:21.319773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ff7373f-59c0-430b-a123-7b77d905b66f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1311 microversion: 2.21 time: 0.423591 Nov 02 12:07:21.323296 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1748/3490] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:20 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1311 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:21.328142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7e6380-6b10-41a0-b7a1-30f9a1e9b182", "tag": "b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:21.340135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:21.340624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.341062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:21.353331 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] Creating event network-changed:b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142 for instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 on n-h1-855649-4 Nov 02 12:07:21.362105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8530e844-4959-4950-8f6e-e0e0fda07ab7 req-d9b819ed-c235-4c9f-9470-912f4c122f36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039633 Nov 02 12:07:21.363153 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1749/3491] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:21.437111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:21.438609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:21.450638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:21.451477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.452105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:21.453073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:21.453882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.454735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:21.633431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:21.642637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92453b87-e27b-4615-8100-c60fd4b406b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.668678 Nov 02 12:07:21.662775 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1743/3492] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:20 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:21.684808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:21.697786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b07c902-61b8-4e9b-8bc6-50d4a34d0830 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1273 microversion: 2.1 time: 0.271419 Nov 02 12:07:21.702678 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1750/3493] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:21 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:21.800533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:21.801200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:21.819051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:21.819623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.820142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:21.820858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:21.821506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:21.822103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:22.348035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:22.348777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:22.362824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:22.363543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:22.364800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:22.368367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:22.370502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:22.382830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:22.845900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:22.868261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:22.873467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:22.873901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0cdf758-da0e-44ca-846e-df0910bd348d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1329 microversion: 2.21 time: 0.530343 Nov 02 12:07:22.874496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1751/3494] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:22 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1329 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:07:22.889236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:22.897366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:22.917899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:22.925987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:22.925987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:22.925987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:22.925987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:22.925987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:23.095066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:23.111362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86d0b7f2-0442-4a36-b379-221c1a046e60 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 1.318344 Nov 02 12:07:23.112209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1744/3495] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:21 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:23.132317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:23.133266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:23.140309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:23.143352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:23.143352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:23.143352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:23.143352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:23.143352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:23.147001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:23.373718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:23.386057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b381bdba-0719-41e8-bd24-736551808682 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1273 microversion: 2.1 time: 0.257869 Nov 02 12:07:23.389724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1745/3496] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:23 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:23.861948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:23.883719 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac9efdc9-9e21-4efe-a9dc-2b7355d03476 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.998347 Nov 02 12:07:23.885928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1752/3497] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:22 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:23.905734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:23.906649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:23.914455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:23.915977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:23.916615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:23.917573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:23.918282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:23.918880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.070596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:24.083306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:24.085870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:24.089170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3b2982e-dab1-454f-99fd-697b602c0aff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1317 microversion: 2.21 time: 0.187221 Nov 02 12:07:24.090554 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1746/3498] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:23 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:24.141209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:24.142510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:24.155408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.156173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.159011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.160120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.161880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.162446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.421565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:24.422238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:24.436840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.437636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.438294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.439250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.439872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.441655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.557400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:24.568813 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-029fa55b-60e8-4fda-83ba-752179d59f44 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.432493 Nov 02 12:07:24.574481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1753/3499] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:24 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:24.881284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:24.891219 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-659b0413-0d27-4aed-8142-05528b134dc8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.474498 Nov 02 12:07:24.900095 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1747/3500] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:24 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:24.908960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:24.910068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:24.920994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.921410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.924500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:24.926503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:24.928552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:24.929215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:25.118538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:25.119313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:25.133052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:25.134535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:25.135510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:25.138737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:25.151091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:25.151959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:25.562553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:25.576172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:25.578319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:25.580273 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36d36b5c-8fbe-4986-9868-b116783e33a1 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.466024 Nov 02 12:07:25.599193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1748/3501] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:25 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:25.607459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:25.622193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a699e47e-9168-4335-8a50-dc59aa8571be tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.716671 Nov 02 12:07:25.624286 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1754/3502] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:24 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:25.629976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:25.631548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:25.638072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:25.639313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:25.639775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:25.640497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:25.641153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:25.642034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:25.736749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-521347733", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8f6b568a-6195-45d4-a37a-9ee31726565e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:25.839908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] validate_networks() for [('8f6b568a-6195-45d4-a37a-9ee31726565e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:25.887477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:26.336490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:26.356223 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4372ecbb-eefb-4e13-8015-ecce8767e8b6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.730499 Nov 02 12:07:26.361814 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1755/3503] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:25 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:26.373040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:26.373714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:26.380646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:26.381140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:26.381578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:26.382428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:26.382903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:26.395364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.372421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:27.385725 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d31a2bf7-a9a6-407c-8534-2a0b76f8b918 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 1.022509 Nov 02 12:07:27.386322 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1756/3504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:26 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:27.392394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:27.397494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:27.418475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.419045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.422938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.422938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.422938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.422938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.769347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:27.770384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:27.771914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:27.772547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:27.773181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:27.788702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.789205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.789652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.790399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.790860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.797695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.846707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Getting quotas for project e8bda9de9c7f4da9b5e067e9dd5fea75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:27.856629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:27.861903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Getting quotas for user 43bcdaf8c1af4d32bede55e61ec61fbc and project e8bda9de9c7f4da9b5e067e9dd5fea75. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:27.866340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:27.868054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:27.869391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1c880a4-050e-480c-bd0e-78d2bfeb542a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.481354 Nov 02 12:07:27.870444 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1757/3505] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:27 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:27.875378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:27.876184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:27.882787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.883488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.884469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.885347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:27.885968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:27.886558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:27.889679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Going to run 3 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:27.892048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:28.038743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=780904df-9fe0-4440-a82e-a568deab6e04,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:28.219419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=31c5d9b1-1d33-4a6d-984a-63c82ac2b517,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:28.262572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:28.279737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a60b69d-65af-4176-97e4-a7520587ce32 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.407763 Nov 02 12:07:28.280345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1758/3506] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:27 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:28.285254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:28.288958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:28.301548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.302408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.305645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.306589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.307259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.307883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.456863 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71d8e19a-0b8a-40a5-b4cd-51fe0e4b5f2b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.856102 Nov 02 12:07:28.457861 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1749/3507] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:07:28.463836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:28.464820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:28.473587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.474642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.475293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.476393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.477057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.479757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.779916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:28.796119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e83dc37-6468-4a67-bf27-53807fad1ba4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.514510 Nov 02 12:07:28.799032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1759/3508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:28 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:28.803096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:28.811888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:28.814013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:07:28.838542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.839083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.839722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.840470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.840933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.841408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.868200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20afc7ff-5cd2-4fed-9d12-db775ac65d3e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.069958 Nov 02 12:07:28.868891 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1760/3509] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:07:28 2022] GET /compute/v2.1/servers => generated 1015 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:28.873954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09ad267-c38d-44d2-883f-ba3e8e9b2467", "tag": "8ac21ae8-34c4-4787-b985-c29d472c1122"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:28.886159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:28.886829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:28.887440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:28.900616 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] Creating event network-changed:8ac21ae8-34c4-4787-b985-c29d472c1122 for instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 on n-h1-855649-4 Nov 02 12:07:28.905832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8bdf1f06-13a0-4da5-b27d-fce23fbe383e req-90b87311-9a5d-46ff-b622-086cfc4526b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035690 Nov 02 12:07:28.906431 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1761/3510] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:28.912607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b38d9f5-5299-485c-b67f-37f5de0ed9f3 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:28.913385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b38d9f5-5299-485c-b67f-37f5de0ed9f3 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:28.976961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:28.990914 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee215970-ad33-407d-8fe0-7fd26bf54889 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.530746 Nov 02 12:07:28.991533 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1750/3511] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:28 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:28.996371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:28.997206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:29.004601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.005968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.006574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.008342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.009182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.009610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.019823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b38d9f5-5299-485c-b67f-37f5de0ed9f3 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:29.034121 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b38d9f5-5299-485c-b67f-37f5de0ed9f3 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1222 microversion: 2.1 time: 0.126277 Nov 02 12:07:29.050533 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1762/3512] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:28 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1222 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:29.312802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:29.313639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:29.324557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.325171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.325859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.326779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.327374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.328178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.342224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:29.355850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:29.357344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:29.359010 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f22345be-ae87-46c9-b71f-72479ef0368f tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.365838 Nov 02 12:07:29.359169 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1751/3513] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:28 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:29.692779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:29.714442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f085fd18-52ea-46d2-b4dd-866f8cd2049a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.405922 Nov 02 12:07:29.715681 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1763/3514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:29 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:29.772408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7e6380-6b10-41a0-b7a1-30f9a1e9b182", "name": "network-vif-plugged", "status": "completed", "tag": "b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:29.784532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.785157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.785671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.800725 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] Creating event network-vif-plugged:b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142 for instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 on n-h1-855649-4 Nov 02 12:07:29.806177 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-485eae3a-f436-46a2-829c-3d8fdd4734cc req-61bffa18-083a-4e2c-bf5c-6cd18ac2cf86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Nov 02 12:07:29.806931 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1752/3515] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:29.825310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:29.827519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:29.835668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.836419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.836983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:29.838329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:29.839103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:29.843822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.016830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:30.018214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:30.026034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.026034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.030460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.031353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.031839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.035400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.142816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.158193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c29b7ace-2b71-47a0-bcdd-045e24617181 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.336946 Nov 02 12:07:30.161117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1764/3516] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:29 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:30.171810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18dcd5eb-2b0f-49f9-9650-8b84fd3cb61b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:30.172481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18dcd5eb-2b0f-49f9-9650-8b84fd3cb61b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:30.241512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.255420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a97991f5-15bf-4634-8f1d-1ecfb94830b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.242555 Nov 02 12:07:30.256148 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1753/3517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:30 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:30.262539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18dcd5eb-2b0f-49f9-9650-8b84fd3cb61b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.270412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18dcd5eb-2b0f-49f9-9650-8b84fd3cb61b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1222 microversion: 2.1 time: 0.107556 Nov 02 12:07:30.271766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1765/3518] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:30 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:30.385180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:30.385795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:30.396784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.397279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.399292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.400056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.400524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.400961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.588528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.597541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.599077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:30.600444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0a50452-c2fd-4966-b84f-f2d3145ffaae tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.219245 Nov 02 12:07:30.600999 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1754/3519] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:30 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:30.739314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:30.740547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:30.748563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.749139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.749584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.750361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.750824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.751412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.776981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:30.940441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58387d5e-7002-47ee-8ffb-5c2d669610c5", "tag": "e9ac9566-25a1-4708-9795-8ad995f75fbe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:30.956149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:30.957250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:30.958705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:30.971337 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] Creating event network-changed:e9ac9566-25a1-4708-9795-8ad995f75fbe for instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 on n-h1-855649-4 Nov 02 12:07:30.981371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-fd055ad2-3298-401b-9e5d-0a55a98979f4 req-2585778f-92a8-43db-8cdd-ccbeb2be602d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048187 Nov 02 12:07:30.984544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1755/3520] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:07:31.076648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.098241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab912144-65ae-494c-821b-63c11654dc3a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.362769 Nov 02 12:07:31.102028 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1766/3521] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:30 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:31.184760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:31.188231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:31.192049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.192574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.193018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.193718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.194198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.194628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.284630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:31.285192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:31.295535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:31.297904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.298781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.299550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.300518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.301169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.301773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.457828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.467939 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a85fe966-bfa0-49f2-a616-39df799c6a95 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.288451 Nov 02 12:07:31.472603 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1756/3522] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:31 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:31.484910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acce0764-34bf-44df-b70d-9c238a86f222 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:31.485532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acce0764-34bf-44df-b70d-9c238a86f222 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:31.524364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.534799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da8e5a18-af2d-4090-a736-db872bb0d293 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.254337 Nov 02 12:07:31.535595 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1767/3523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:31 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:31.554789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acce0764-34bf-44df-b70d-9c238a86f222 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.563305 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acce0764-34bf-44df-b70d-9c238a86f222 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1222 microversion: 2.1 time: 0.089264 Nov 02 12:07:31.564278 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1757/3524] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:31 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:31.625490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:31.626101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:31.640320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.640929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.641430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.642314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:31.642777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:31.643236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:31.912977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.922347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.928046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:31.931496 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13974907-6af7-4fde-99c4-9fce7f0f4a27 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.309796 Nov 02 12:07:31.932603 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1768/3525] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:31 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:32.124405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:32.124405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:32.132471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.133081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.133514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.134420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.135070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.135525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.272679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:32.280497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65a1a948-3605-47b5-b980-1b60679392cd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.160582 Nov 02 12:07:32.281065 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1758/3526] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:32 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:32.492570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:32.493182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:32.500025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.500547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.500982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.501679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.502130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.502551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.557961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:32.558681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:32.564996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.565501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.565920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.566615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.567143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.567560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.705364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:32.714179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46aca703-5f76-41cd-9f23-a0479dfa782f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.225513 Nov 02 12:07:32.727776 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1769/3527] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:32 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:32.727776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:32.727776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:32.738456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.739062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.740095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.740866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.741363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.741847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.853555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:32.865460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36b9512e-f0a3-40b1-b5fc-cadd35719026 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.310873 Nov 02 12:07:32.867226 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1759/3528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:32 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:32.921127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:32.936474 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-883a5c37-9c6c-4751-80e1-7fd574874d4c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1218 microversion: 2.1 time: 0.220550 Nov 02 12:07:32.937741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1770/3529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:32 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:32.962879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:32.963966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:32.972863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.973342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.974267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:32.975034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:32.975642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:32.976106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:33.309636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:33.313957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:33.320017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:33.321297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:33.322012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:33.322752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:33.323519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:33.324215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:33.962823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:33.978925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:33.982276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:33.987008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6856ba7-1bd9-40cc-a1c6-e2595d72676e tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 1.029564 Nov 02 12:07:33.992018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1760/3530] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:32 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:34.002144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:34.003248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:34.017887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.018551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.019118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.019993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.025353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.025935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.171468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:34.181416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e4696a6-ce37-4691-8911-cecf54de01a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1321 microversion: 2.1 time: 0.880121 Nov 02 12:07:34.182632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1771/3531] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:33 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:34.187919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:34.188804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:34.197010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.197821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.198468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.199868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.200579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.201190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.541778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:34.552859 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2680a982-54e4-48ce-8537-8994c6244d6a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.558949 Nov 02 12:07:34.553813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1761/3532] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:33 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:34.572094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:34.576495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:34.592665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.593224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.593890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.595526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:34.595962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:34.596475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:34.739893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:34.750164 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5032fba7-4cbe-49fa-90e5-be4eed2c6b78 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1274 microversion: 2.1 time: 0.195099 Nov 02 12:07:34.750939 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1762/3533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:34 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:34.754241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:34.776779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51fccab8-8329-45bc-8bf8-a3a13bfbf4fb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.592733 Nov 02 12:07:34.778371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1772/3534] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:34 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:35.023244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:35.024168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:35.030561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.031164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.032001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.032786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.033509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.034044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.222382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:35.225435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:35.233798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.234293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.234732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.235845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.236305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.237023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.413292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:35.424079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:35.424523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:35.425714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-920055ac-de14-4596-9925-0d1b8ef81391 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.409198 Nov 02 12:07:35.426786 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1763/3535] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:35 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:35.482679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09ad267-c38d-44d2-883f-ba3e8e9b2467", "name": "network-vif-plugged", "status": "completed", "tag": "8ac21ae8-34c4-4787-b985-c29d472c1122"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:35.485849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:35.492987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.493790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.494595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.499826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69fc4a3b-4b60-4d86-ab4b-807e7b6bd6fc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1503 microversion: 2.1 time: 0.288332 Nov 02 12:07:35.500940 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1773/3536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:35 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:35.518276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] Creating event network-vif-plugged:8ac21ae8-34c4-4787-b985-c29d472c1122 for instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 on n-h1-855649-4 Nov 02 12:07:35.525634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:35.525884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-773b6188-9749-451f-8b04-0631018e2b89 req-2396a9b3-f374-444b-a8e9-97b5d5317116 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051322 Nov 02 12:07:35.526671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:35.526824 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1764/3537] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:07:35.534951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.535789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.536290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.537809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.538854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.539497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.592441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:35.594768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:35.608839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.609841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.610514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.611500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:35.612298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:35.613337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:35.639621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:36.084105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.092164 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bcb0a0b-80a1-4dc8-b8ec-b9f657e1a436 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1503 microversion: 2.1 time: 0.571468 Nov 02 12:07:36.093057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1774/3538] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:35 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:36.098412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:36.104525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:36.106563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.108034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.108699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.109600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.110286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.114942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.116474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.127360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47748865-5320-440b-b4cb-c6ca8e9da203 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1477 microversion: 2.1 time: 0.553797 Nov 02 12:07:36.128920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1765/3539] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:35 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1477 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:36.135163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:36.136724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:36.148226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.149132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.150020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.152392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.153072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.153790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.227368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.235970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6c87008-e0a2-4e48-b910-08c25d626542 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1292 microversion: 2.1 time: 0.141729 Nov 02 12:07:36.236588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1775/3540] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:36 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:36.241250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:36.241863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:36.248997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.249851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.250290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.251008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.251727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.252160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.279789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:07:36.374542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.382516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cfc8830b-8a2e-4a55-b9a7-d428f147fad0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.252285 Nov 02 12:07:36.383261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1766/3541] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:36 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:36.466587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:36.467342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:36.475234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.475994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.476425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.477316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.477854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.478298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.627013 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1011ac35-7db4-4e8c-af50-e92b0936a6c2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 204 len: 0 microversion: 2.1 time: 0.389098 Nov 02 12:07:36.628518 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1776/3542] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:07:36 2022] DELETE /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:07:36.638284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:36.639067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:36.646921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.647445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.647882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.648589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:36.649224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:36.649817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:36.983774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.993924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.995552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:36.997005 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-758e0d59-152a-4432-8e43-314c4d69d180 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.536583 Nov 02 12:07:37.005449 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1767/3543] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:36 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:37.116512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:37.132572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33e007b0-5b0c-495f-8cfa-0d99f74f9f87 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1509 microversion: 2.1 time: 0.498886 Nov 02 12:07:37.133760 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1777/3544] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:36 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:37.178581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:37.181050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:37.194612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.196042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.197125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.198400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.199624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.200407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.261945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:37.262867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:37.270250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.271333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.271776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.272485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.272934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.273356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.757216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:37.765767 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a50dbd49-6ad7-4733-97f1-924d14e813e6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1280 microversion: 2.1 time: 0.508940 Nov 02 12:07:37.766571 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1778/3545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:37 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1280 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:37.771715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:37.772487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:37.778808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.779653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.780302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.782143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.782679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.783331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.826344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:37.877593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:37.886200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f79ddf2c-8d70-410b-b9aa-98fbf176fae9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1476 microversion: 2.1 time: 0.733320 Nov 02 12:07:37.886771 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1768/3546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:37 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1476 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:37.891379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58387d5e-7002-47ee-8ffb-5c2d669610c5", "name": "network-vif-plugged", "status": "completed", "tag": "e9ac9566-25a1-4708-9795-8ad995f75fbe"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:37.910190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:37.910190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:37.910190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:37.918552 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] Creating event network-vif-plugged:e9ac9566-25a1-4708-9795-8ad995f75fbe for instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 on n-h1-855649-4 Nov 02 12:07:37.923748 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f42cac36-c7a0-4fe0-b47a-e7b958274d93 req-1f00c837-9235-4c56-8999-3a17a1e5127d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035745 Nov 02 12:07:37.924366 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1769/3547] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:38.031946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:38.032827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:38.037916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:38.045122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.048095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.048095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.048642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.049182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.049696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.129125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.139444 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35513035-4823-4885-8e90-3f22cf0a1ef4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1315 microversion: 2.1 time: 0.371159 Nov 02 12:07:38.139667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1779/3548] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:37 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:38.190507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:38.191690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:38.202577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.205710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.205710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.205710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.205710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.205710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.539001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.556669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.562101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.564359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a552bd49-d2d6-4224-be95-7bb7861891dd tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.537969 Nov 02 12:07:38.569829 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1770/3549] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:38 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:07:38.801495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:38.802731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:38.809915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.810121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.810550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.811299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.811761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.812186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.842038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.849431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dab56ddb-cace-4e1c-9634-5652b1df8e03 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1509 microversion: 2.1 time: 0.668845 Nov 02 12:07:38.850026 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1780/3550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:38 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1509 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:38.924021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:38.924831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:38.927745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:38.933626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.934127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.934589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.935323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:38.935786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:38.936225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:38.956126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:38.986459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:38.995021 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b851f76-4d29-4bee-9c9e-a5c2db71748c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1280 microversion: 2.1 time: 0.197824 Nov 02 12:07:38.995592 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1771/3551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:38 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1280 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:39.166038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:39.166720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:39.173224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:39.173719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:39.174376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:39.175128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:39.175594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:39.176024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:39.650589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:39.677363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3767a7b6-c3c9-490c-b2d1-64850ba28944 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1476 microversion: 2.1 time: 0.739585 Nov 02 12:07:39.678131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1781/3552] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:38 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:39.684964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:39.686025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:39.695749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:39.697162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:39.697296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:39.698080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:39.698726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:39.699617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:39.986026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:39.995064 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9807b8c-3630-4723-b8c1-01dc8539a621 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1502 microversion: 2.1 time: 0.833678 Nov 02 12:07:39.995665 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1772/3553] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:39 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1502 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:40.001027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "780904df-9fe0-4440-a82e-a568deab6e04", "tag": "913ece96-648e-4b91-9eff-32443537e83f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:40.012842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:40.013771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:40.014531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:40.027377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] Creating event network-changed:913ece96-648e-4b91-9eff-32443537e83f for instance 780904df-9fe0-4440-a82e-a568deab6e04 on n-h2-855649-4 Nov 02 12:07:40.032423 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-14ef87de-f6e1-42a3-86a1-2145776321c2 req-127864e2-ed5f-46c8-ba8f-1656f2a71e02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035162 Nov 02 12:07:40.033499 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1773/3554] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:40.038697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:40.039430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:40.046319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:40.046809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:40.047475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:40.048383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:40.048896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:40.049330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:40.266525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:40.366413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:40.375398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:40.377004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:40.378220 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16b2bbaa-f556-4a94-8247-c16f98b7fb0a tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1359 microversion: 2.21 time: 0.698766 Nov 02 12:07:40.378882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1782/3555] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:39 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1359 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:40.383949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:40.390543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:40.391293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:40.391973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:40.392593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:40.393501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:40.394145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:40.394748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.035768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:41.078213 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7abb660d-500a-4864-a923-62cca6d17c58 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1509 microversion: 2.1 time: 1.034933 Nov 02 12:07:41.098468 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1774/3556] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:40 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1509 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:41.121072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:41.122139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:41.131894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.132769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.133433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.134404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.135217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.135861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.560139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:41.566204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:41.579898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c30b4bcc-b8a6-4879-ab81-8f70bd1394d5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 1.198804 Nov 02 12:07:41.580952 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1783/3557] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:40 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:41.587326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:41.588174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:41.596076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.597223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.598022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.601620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.602242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.602807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.850224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'services' on Instance uuid 12665a7e-888c-44ae-b448-bfb5954a9174 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:07:41.955894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:41.965105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae256837-0bc7-4296-910a-92cf1f18dd78 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1476 microversion: 2.1 time: 0.857239 Nov 02 12:07:41.965856 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1775/3558] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:41 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1476 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:41.970955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:41.971840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:41.980542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.981373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.982400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:41.983980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:41.984662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:41.985819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.139452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70d902e3-13d5-409f-93e8-4badd2019731 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments/fb364314-2f49-4743-85b5-a0d65d85b82f" status: 202 len: 0 microversion: 2.1 time: 0.556866 Nov 02 12:07:42.142423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1784/3559] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:07:41 2022] DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments/fb364314-2f49-4743-85b5-a0d65d85b82f => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:07:42.171466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "name": "network-vif-unplugged", "status": "completed", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}, {"server_uuid": "fc7e6380-6b10-41a0-b7a1-30f9a1e9b182", "name": "network-vif-deleted", "tag": "b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:42.215757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.215757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.215757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.224879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Creating event network-vif-unplugged:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h1-855649-4 Nov 02 12:07:42.225873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Creating event network-vif-deleted:b90cc2e9-88a1-4f4f-a4d1-e100a7cbc142 for instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 on n-h1-855649-4 Nov 02 12:07:42.241485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:07:42.257799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6af527ef-c5b1-4ce3-ad32-74212dde5b72 req-f9893080-b8e0-42b8-b9b8-09abdce1c3bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.099187 Nov 02 12:07:42.258726 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1785/3560] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:42.267048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.267759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:42.274818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.275338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.276021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.276839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.277299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.277724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.331907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.331907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.331907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.331907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lazy-loading 'fault' on Instance uuid fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:07:42.479179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:42.488619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:42.503835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:42.505962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:42.508551 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b491fbd3-bce6-4163-adf4-cd1d8d4bd1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 200 len: 1311 microversion: 2.1 time: 0.247928 Nov 02 12:07:42.509135 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f322182-64d9-4fdf-ab4a-3d5e2a906bfc tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1552 microversion: 2.21 time: 0.541176 Nov 02 12:07:42.510267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1776/3561] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:41 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1552 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:42.511077 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1786/3562] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:42 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:42.538467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.538812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.541912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:42.543379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:42.549378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.549926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.550369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.551295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.552314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.553589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.554618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.557824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.559809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.562170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.562170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.563730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.617125 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cd8c19d-3cd8-41b1-b817-a098de96e059 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089936 Nov 02 12:07:42.619530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1777/3563] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:07:42 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:42.622606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:07:42.624347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.625324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:42.632297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.633037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.633664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.634545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.635263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.635861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.878763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:42.891830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75e44163-04fc-4678-b979-7e50557c53b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.272187 Nov 02 12:07:42.892822 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1778/3564] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:42 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:42.943887 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-322a5b1a-e145-492b-af4f-15c1d716b701 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 204 len: 0 microversion: 2.21 time: 0.409578 Nov 02 12:07:42.944914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1787/3565] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:07:42 2022] DELETE /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:07:42.953958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.954706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:42.961451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.961963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.962410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.963306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:42.964016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:42.964456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:42.995558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:42.996960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:43.029781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.030202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.030674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.031441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.037034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.038377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.264407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:43.275335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:43.277284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:43.279100 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6322d252-bb72-4c78-9565-4d011986e83c tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1558 microversion: 2.21 time: 0.329220 Nov 02 12:07:43.305980 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1779/3566] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:42 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1558 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:43.308074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:43.312658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "807d5b7d-5b81-4243-8d30-7dea95703fab"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:43.315652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:43.317259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd3400bf-8a65-44d6-af2a-14c6bc6d5d05 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1476 microversion: 2.1 time: 0.326560 Nov 02 12:07:43.317870 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1788/3567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:42 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:43.323737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.324845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.325482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.326490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.326948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.328047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.542778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:43.543416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:43.550497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.551011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.551607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.552870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.553325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.553780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.568463 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 HTTP/1.1 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc7e6380-6b10-41a0-b7a1-30f9a1e9b182'} Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:43.570088 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b59ef281-cda7-4279-8a7a-33fe0078abd0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 404 len: 111 microversion: 2.1 time: 0.032948 Nov 02 12:07:43.575680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1789/3568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:43 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:07:43.590140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d554f12a-40ff-4b06-aa59-db2c1b821247 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: .version_select at 0x7ff1b3ac8dc0>, body: {"keypair": {"name": "tempest-key-296692529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQR3jGXZ2iShawloP9nIzG7PP1CfNbYzHnmCdRhu4jaj/WlsJ799xhuHz3WUlCb8yW1ISVQXz4IDuNOVmWVjNoFZGCMIhx+WZuyfQQQsqdQ+bTQxP5oSBaznndpoJ7oTg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:43.606788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d554f12a-40ff-4b06-aa59-db2c1b821247 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:43.612193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d554f12a-40ff-4b06-aa59-db2c1b821247 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:43.870509 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d554f12a-40ff-4b06-aa59-db2c1b821247 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.284271 Nov 02 12:07:43.874007 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1790/3569] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:07:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:43.877157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:43.879565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:43.887112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.887610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.888054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.888789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.889259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.889688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.923473 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7a8e2c2-d5fe-4af5-b92f-d76bdd42b8e8 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050804 Nov 02 12:07:43.924071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1791/3570] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:07:43 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:43.929113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-983283a9-a5b8-4878-9d47-54dc856addb7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '.version_select at 0x7ff1b399b160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:43.933398 n-d-855649-4 devstack@n-api.service[127567]: WARNING oslo_db.sqlalchemy.utils [None req-983283a9-a5b8-4878-9d47-54dc856addb7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:07:43.939347 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-983283a9-a5b8-4878-9d47-54dc856addb7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.014062 Nov 02 12:07:43.940092 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1792/3571] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:07:43 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:43.945089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:43.945717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:43.955951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.956854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.956976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:43.958328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:43.959040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:43.959488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:44.277116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:44.293886 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa552238-b31b-4194-9542-3ef51a995b15 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.352808 Nov 02 12:07:44.295005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1793/3572] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:43 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:44.321289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1063130004", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-key-296692529", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:44.409562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:07:45.068140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1cab24e-db88-4825-9897-14660062610e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.768920 Nov 02 12:07:45.068839 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1780/3573] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:07:43 2022] POST /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467/os-volume_attachments => generated 194 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:45.075986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:45.077140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:45.085581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:45.086206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:45.086663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:45.087566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:45.088049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:45.088543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:46.147774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:46.160859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:46.168601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:46.170081 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8b93c82-cde7-4ee0-ac45-db0b28174fb8 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1558 microversion: 2.21 time: 1.099712 Nov 02 12:07:46.171375 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1781/3574] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:45 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1558 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:46.179858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c5d9b1-1d33-4a6d-984a-63c82ac2b517", "tag": "2187eb95-6507-4002-86b4-fe4d0b4301c4"}, {"name": "network-changed", "server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}, {"name": "network-changed", "server_uuid": "8a54097f-3ef1-4f38-b95f-84fece5a9075", "tag": "e1bcb505-2efa-43ca-b7d8-14f24d6c9073"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:46.193587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:46.194464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:46.195250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:46.199244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:46.216187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Creating event network-changed:2187eb95-6507-4002-86b4-fe4d0b4301c4 for instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 on n-h2-855649-4 Nov 02 12:07:46.217051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Creating event network-changed:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h1-855649-4 Nov 02 12:07:46.217799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Creating event network-changed:e1bcb505-2efa-43ca-b7d8-14f24d6c9073 for instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 on n-h2-855649-4 Nov 02 12:07:46.230634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:07:46.277869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e2d5ea02-e3de-41da-828b-26064c247c98 req-b154b5a1-5a87-47f2-9bad-9880e8b210d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.104630 Nov 02 12:07:46.278674 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1782/3575] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:46.309622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:46.318198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:46.337111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:46.338006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:46.338682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:46.340628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:46.342791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:46.344498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.057700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.067666 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f28e526-4080-42fa-92c5-fb29195c68f6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1474 microversion: 2.1 time: 0.787195 Nov 02 12:07:47.068607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1783/3576] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:46 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1474 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:47.074860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:47.083151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:47.089841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.090842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.091891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.092841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.093490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.094103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.137608 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74d768c8-f18d-4fbe-a6a8-32baeb821b53 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066885 Nov 02 12:07:47.138467 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1784/3577] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:07:47 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:47.144315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:47.145660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:47.153469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.155070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.155070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.155673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.156205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.156640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.183887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:07:47.183887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:07:47.183887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:07:47.184639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:07:47.184639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:07:47.202995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.203519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.204053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.205445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.205927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.206858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.242178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:07:47.248281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:07:47.261768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:07:47.264266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:07:47.417766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d74765f-9ef1-4506-9e09-13695293084c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.121076 Nov 02 12:07:47.420065 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1794/3578] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:07:47.427742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:47.429282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:47.440892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.441632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.442321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.444761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:47.445411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:47.446449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:47.665088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.694818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.701521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.709143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ff7710f-39ae-42f6-93ec-ba249500976d tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1516 microversion: 2.21 time: 0.282944 Nov 02 12:07:47.709410 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1795/3579] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:47 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1516 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:47.719511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55d8dd4a-3930-4013-ac88-44057b381a34 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:47.723269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55d8dd4a-3930-4013-ac88-44057b381a34 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:47.734961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.738190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:47.751527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e92c99c-9be9-49d4-aa6f-1c5a3db75c61 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.611732 Nov 02 12:07:47.753190 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1785/3580] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:47 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:47.819901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55d8dd4a-3930-4013-ac88-44057b381a34 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:47.831976 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55d8dd4a-3930-4013-ac88-44057b381a34 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1228 microversion: 2.1 time: 0.121224 Nov 02 12:07:47.833657 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1796/3581] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:47 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1228 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:48.093872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:48.094612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:48.101395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.101988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.102525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.103470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.103932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.105344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.150707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:48.154365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:48.171098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.171621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.172153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.174266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.177918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.177918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.226712 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fd571ff-121c-4cac-9dbd-bf8c162b83d5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080146 Nov 02 12:07:48.231471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1797/3582] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:07:48 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:07:48.382819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:48.396693 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d56df60c-1bd3-4de5-9009-091083dc0256 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1474 microversion: 2.1 time: 0.307033 Nov 02 12:07:48.397748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1786/3583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:48 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1474 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:48.427846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58387d5e-7002-47ee-8ffb-5c2d669610c5", "name": "network-vif-deleted", "tag": "e9ac9566-25a1-4708-9795-8ad995f75fbe"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:48.444365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.452325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.452325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.465195 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] Creating event network-vif-deleted:e9ac9566-25a1-4708-9795-8ad995f75fbe for instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 on n-h1-855649-4 Nov 02 12:07:48.471164 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3fd1e2e5-04e3-4000-8cbe-b7f5be14c2cb req-1e2989f9-14f4-42f3-9fc2-eda8601fa156 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048122 Nov 02 12:07:48.494236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1798/3584] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:48.732283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:48.732945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:48.746097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.748550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.749437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.750476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.751285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.752031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.782824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:48.784038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:48.791634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.792470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.792653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.793231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.793686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.793814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.794123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lazy-loading 'fault' on Instance uuid 58387d5e-7002-47ee-8ffb-5c2d669610c5 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:07:48.794617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.795331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.795976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.856401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:48.868196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:48.869328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfca7598595a41cba9672e9a6e57e82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45bec46b4a54d3586b666a3dd28602c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:48.870070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99d6020b-af99-446a-9958-df64d3c22745 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 200 len: 1349 microversion: 2.21 time: 0.141772 Nov 02 12:07:48.870710 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1787/3585] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:48 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 1349 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:07:48.879957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:48.886429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:48.888320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.888906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.889404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.890131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:48.890591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:48.891045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:48.993084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:49.012920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8ce4112-92e4-4046-a9f4-df78f781d2ef tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1232 microversion: 2.1 time: 0.136548 Nov 02 12:07:49.014684 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1788/3586] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:48 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1232 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:49.025386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:49.034130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1eecdfc1-8803-4a60-a2af-fb95fcf6d15e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.256285 Nov 02 12:07:49.040204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1799/3587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:48 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:49.245486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:49.248740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.258892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.263830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.264613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.271311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.274066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.275586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.343964 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23187c9c-4c23-4ddc-979a-bfb0d958fc36 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106522 Nov 02 12:07:49.345940 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1789/3588] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:07:49 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:07:49.426499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:49.429400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.471799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.476146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.477263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.480171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.481394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.483670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.541924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:49.544643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.559879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.565820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.565820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.565820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.565820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.565820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.634457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Cannot 'reboot' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action HTTP/1.1 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 28 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: {"reboot": {"type": "HARD"}} Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'reboot' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd9a3838c-a50d-4cc9-ba70-6ed331052732', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:07:49.636801 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.642345 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.644431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 409 to user: Cannot 'reboot' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:49.646327 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18b0e7d2-8536-4dd6-90c5-feb069abb1db tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action" status: 409 len: 145 microversion: 2.1 time: 0.109245 Nov 02 12:07:49.651966 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1790/3589] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:07:49 2022] POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action => generated 145 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:07:49.662275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:49.674821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.684655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.685387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.686267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.687280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.687916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.688625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.721401 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Cannot 'rebuild' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action HTTP/1.1 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 65 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'rebuild' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd9a3838c-a50d-4cc9-ba70-6ed331052732', 'body': {'rebuild': {'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043'}}} Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:07:49.723395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 409 to user: Cannot 'rebuild' instance d9a3838c-a50d-4cc9-ba70-6ed331052732 while it is in vm_state rescued {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:49.729508 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4614a716-39bd-44fe-aa2c-cd4535158115 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action" status: 409 len: 146 microversion: 2.1 time: 0.070839 Nov 02 12:07:49.732346 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1791/3590] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:07:49 2022] POST /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732/action => generated 146 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:07:49.794561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:49.801044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:49.808521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7399375a-69ee-48be-95c8-fdd27d6b66bf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.390917 Nov 02 12:07:49.810871 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1800/3591] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:49 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:49.834197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:49.834743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.841444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.841942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.842381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.843779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.843779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.843995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.904729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:49.905673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:49.913388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.914317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.915134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.916979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:49.917919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:49.918597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:49.955386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:07:50.124699 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-139c1c01-bc5a-49bd-8b62-5f9e9679bb1c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450/action" status: 204 len: 0 microversion: 2.1 time: 0.294415 Nov 02 12:07:50.125700 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1801/3592] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:07:49 2022] POST /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450/action => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:07:50.131554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:50.132555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:50.139620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.140434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.141074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.142171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.142850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.143557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.161329 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] HTTP exception thrown: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Request method failure captured: Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 HTTP/1.1 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1z_WtxsQqhl-M2zS8dzEOz2H3FBeCxAXMoUJS1FsYizOYpIP6-QLOjGAU8wulJG5cGwXmua0xaBwZfZiN1K4s5MdOztGfF_-GuvwXXnqb21__j7fvrBF7odGQTDKUmofACKAsq6UP7gQ0xz9Qu204kNMdy6nr-tvbN_xBO3g_9a24 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b45bec46b4a54d3586b666a3dd28602c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bfca7598595a41cba9672e9a6e57e82a Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '58387d5e-7002-47ee-8ffb-5c2d669610c5'} Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:50.163070 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Returning 404 to user: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdde3b58-97fe-4092-a07e-96f8d1cc5d12 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 404 len: 111 microversion: 2.21 time: 0.037610 Nov 02 12:07:50.168168 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1802/3593] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:50 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:07:50.170098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780904df-9fe0-4440-a82e-a568deab6e04", "name": "network-vif-plugged", "status": "completed", "tag": "913ece96-648e-4b91-9eff-32443537e83f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:50.181230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.181718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.183295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.198508 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] Creating event network-vif-plugged:913ece96-648e-4b91-9eff-32443537e83f for instance 780904df-9fe0-4440-a82e-a568deab6e04 on n-h2-855649-4 Nov 02 12:07:50.207143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f1fbd323-2718-425d-a356-18e05ac7c65d req-9650c8da-6a12-4d44-887b-fe03a6c10474 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040400 Nov 02 12:07:50.207746 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1803/3594] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:50.213645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:50.217581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:50.221987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.222573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.223042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.226547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.227101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.227550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.345533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:50.352840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df1d6070-813c-4db5-9e21-37cb9191e4b1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1280 microversion: 2.1 time: 0.143732 Nov 02 12:07:50.363341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1804/3595] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:50 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:50.380863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:50.381995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:50.391272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.391272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.391272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.391975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.392598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.393189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.416872 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-818499a1-e8f3-4fed-b786-a45fb432c395 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 204 len: 0 microversion: 2.1 time: 0.676579 Nov 02 12:07:50.420758 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1792/3596] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:07:49 2022] DELETE /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:07:50.437796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:50.441580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:50.458666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.459191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.459844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:50.461670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:50.462415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:50.463113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.269007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:51.279498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:51.281398 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad65528e-e6f2-44c9-8c4c-fe38bf3d8600 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.860240 Nov 02 12:07:51.282671 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1793/3597] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:50 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:51.293457 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee1231fb-1186-486b-80a8-946a9327912f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.928996 Nov 02 12:07:51.296689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1805/3598] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:50 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:51.302426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:51.303389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:51.313162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '.version_select at 0x7ff1b28c69d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:51.319727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.320147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.320605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.321344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.321812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.322248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.323486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:51.334420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.335575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.336378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.337976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.339345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.340328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.470840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df4d882f-1570-4429-9872-c7bd51b694ff tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.186674 Nov 02 12:07:51.471701 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1794/3599] 10.222.0.48 () {60 vars in 1337 bytes} [Wed Nov 2 12:07:51 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5/os-instance-actions => generated 611 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:07:51.477146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:51.477778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:51.491376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.492180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.492886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.494049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.495607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.495842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.519253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:51.528953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-975e6f46-0ab4-4bd4-ae16-9c52c5b63ab0 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1691 microversion: 2.1 time: 0.230769 Nov 02 12:07:51.530295 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1806/3600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:51 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:51.536979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:51.537493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:51.546221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.547159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.547832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.548882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.549550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.551188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.574544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] HTTP exception thrown: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Request method failure captured: Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 HTTP/1.1 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1z_WtxsQqhl-M2zS8dzEOz2H3FBeCxAXMoUJS1FsYizOYpIP6-QLOjGAU8wulJG5cGwXmua0xaBwZfZiN1K4s5MdOztGfF_-GuvwXXnqb21__j7fvrBF7odGQTDKUmofACKAsq6UP7gQ0xz9Qu204kNMdy6nr-tvbN_xBO3g_9a24 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b45bec46b4a54d3586b666a3dd28602c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bfca7598595a41cba9672e9a6e57e82a Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '58387d5e-7002-47ee-8ffb-5c2d669610c5'} Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:51.577267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.582121 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.586846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Returning 404 to user: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:51.588084 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b62fd1b6-e01f-48eb-8e83-a82241a67076 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 404 len: 111 microversion: 2.21 time: 0.056502 Nov 02 12:07:51.589293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1807/3601] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:07:51 2022] DELETE /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:07:51.604701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:51.606946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] [instance: 58387d5e-7002-47ee-8ffb-5c2d669610c5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:51.615479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.616388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.617436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.618400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:51.619127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:51.619520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:51.653165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] HTTP exception thrown: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Request method failure captured: Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 HTTP/1.1 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1z_WtxsQqhl-M2zS8dzEOz2H3FBeCxAXMoUJS1FsYizOYpIP6-QLOjGAU8wulJG5cGwXmua0xaBwZfZiN1K4s5MdOztGfF_-GuvwXXnqb21__j7fvrBF7odGQTDKUmofACKAsq6UP7gQ0xz9Qu204kNMdy6nr-tvbN_xBO3g_9a24 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b45bec46b4a54d3586b666a3dd28602c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b45bec46b4a54d3586b666a3dd28602c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b45bec46b4a54d3586b666a3dd28602c Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-515082362 Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bfca7598595a41cba9672e9a6e57e82a Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-InstanceActionsV221TestJSON-515082362-project Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '58387d5e-7002-47ee-8ffb-5c2d669610c5'} Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.654931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] Returning 404 to user: Instance 58387d5e-7002-47ee-8ffb-5c2d669610c5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a37074a6-1a6c-4dd0-baa1-312e390f2942 tempest-InstanceActionsV221TestJSON-515082362 tempest-InstanceActionsV221TestJSON-515082362-project] 10.222.0.48 "GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5" status: 404 len: 111 microversion: 2.21 time: 0.058644 Nov 02 12:07:51.665143 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1808/3602] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:07:51 2022] GET /compute/v2.1/servers/58387d5e-7002-47ee-8ffb-5c2d669610c5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:07:51.678697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:51.704306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-611da1d9-4f66-4894-bcb6-4a59055c5f0d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1280 microversion: 2.1 time: 0.222880 Nov 02 12:07:51.704306 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1795/3603] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:51 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:52.241837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "name": "network-vif-plugged", "status": "completed", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:52.260298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.261639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.262775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.289067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Creating event network-vif-plugged:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h1-855649-4 Nov 02 12:07:52.301789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:07:52.313126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:52.314153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:52.324662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6c19b420-6c7f-46f8-be9c-81f6609444d6 req-581feff1-4047-4730-bd45-5e3ae2dec793 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089167 Nov 02 12:07:52.326314 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1809/3604] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:07:52.338318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:52.341030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:52.346613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.347621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.348661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.350465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.351494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.352194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.355179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.356094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.356827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.358019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.358756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.359642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.652886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:52.660806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:52.665880 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca468fc0-1892-4acb-a44d-c3756dc7bb6f tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 0.335393 Nov 02 12:07:52.669635 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1810/3605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:52 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:52.670170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fb8adff-be0c-45e4-a846-d5182e02ae63 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.365425 Nov 02 12:07:52.677983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:52.683832 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1796/3606] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:52 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:52.684565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:52.695325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.695830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.696525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.697651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.699471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.700374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.738279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:52.739873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:52.755577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.759525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.760470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.764270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:52.774232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:52.774232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:52.929798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:52.938192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:52.942307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2bfcbc83-582c-4194-a0ab-30491eda5d15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1280 microversion: 2.1 time: 0.208609 Nov 02 12:07:52.944069 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1797/3607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:52 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:52.967079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:52.979557 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-371855b0-e1a9-4965-9e91-5beb298c0cf5 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1691 microversion: 2.1 time: 0.308266 Nov 02 12:07:52.981899 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1811/3608] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:52 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1691 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:53.701884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:53.701884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:53.703999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:53.704634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:53.725468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:53.731480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:53.734135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:53.734639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:53.735113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:53.735843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:53.736304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:53.736737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:53.739756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:53.740943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:53.741656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:53.742335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:54.617915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:54.631541 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fe4e840-6f61-4755-a392-553e0e3d8597 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.939372 Nov 02 12:07:54.632589 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1812/3609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:53 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:54.648565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:54.649406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:54.676977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:54.677765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:54.678400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:54.679552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:54.680284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:54.680979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:54.890524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:54.905446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06fd01f4-aa2d-4625-ba3e-4b987327697b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 1.215111 Nov 02 12:07:54.916196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:54.921493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1798/3610] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:53 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:54.939328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8c3b0f4-cdd9-454d-ab7a-a59e5615f1bc tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1286 microversion: 2.1 time: 0.304594 Nov 02 12:07:54.942216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:54.959754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1813/3611] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:54 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1286 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:54.962997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:54.974120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a54097f-3ef1-4f38-b95f-84fece5a9075", "name": "network-vif-plugged", "status": "completed", "tag": "e1bcb505-2efa-43ca-b7d8-14f24d6c9073"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:54.989651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:54.998478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:54.999072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.000117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.009745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.009745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.017038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.027864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.028693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.053294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] Creating event network-vif-plugged:e1bcb505-2efa-43ca-b7d8-14f24d6c9073 for instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 on n-h2-855649-4 Nov 02 12:07:55.067937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-43bfdaf1-d00a-4406-ac79-d5ad53376969 req-dd75e857-0ad9-4e8f-ba35-d4b7a13aaf5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105721 Nov 02 12:07:55.070522 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1814/3612] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:55.658700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:55.659541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:55.670499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.671077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.675063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.676840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.676840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.677619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.752144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:55.765923 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b6425b2-0680-4ba4-b7c2-79e5f2e9acc1 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1691 microversion: 2.1 time: 0.837068 Nov 02 12:07:55.767013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1799/3613] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:54 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1691 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:55.949614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:55.951087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:55.967344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.967344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.967344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:55.972213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:55.972934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:55.974385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:56.266829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:56.275729 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5fff4b9-16fe-4db4-af8e-6cd0d5c81c14 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.621323 Nov 02 12:07:56.309913 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1815/3614] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:55 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:56.317825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:56.318764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:56.326656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:56.327531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:56.328082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:56.328963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:56.329532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:56.330064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:56.954456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:56.964437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f7b82f8-d632-469d-bd25-4bc83309d671 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1286 microversion: 2.1 time: 0.652957 Nov 02 12:07:56.965881 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1816/3615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:56 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1286 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:56.971296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:56.972574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:56.980977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:56.982055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:56.984802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:56.984802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:56.984802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:56.984802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.169663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:57.184257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44da2399-fdc5-48ed-8d8d-7448b9f209fd tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1322 microversion: 2.1 time: 1.238989 Nov 02 12:07:57.188304 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1800/3616] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:55 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1322 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:57.231879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:57.312454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:57.313286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:57.331087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.332260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.332958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.333927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:57.335174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:57.335830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:57.518322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:57.528628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ae8ab86-a753-4dfa-be77-169aef407cd2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1691 microversion: 2.1 time: 0.560668 Nov 02 12:07:57.529238 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1817/3617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:56 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1691 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:57.799100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:57.831713 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72f80e07-2dd0-4b9a-9e7c-1baf3a247f83 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.518267 Nov 02 12:07:57.834463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1801/3618] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:57 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:58.017846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:58.018561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.033675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.154233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:58.215391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-326dd044-447b-4979-8225-a5cd77237327 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1286 microversion: 2.1 time: 0.193537 Nov 02 12:07:58.216185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:58.216900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:58.220226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1818/3619] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:58 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:58.240710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.243442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.244791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.257657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.257657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.257657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.409211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5d9b1-1d33-4a6d-984a-63c82ac2b517", "name": "network-vif-plugged", "status": "completed", "tag": "2187eb95-6507-4002-86b4-fe4d0b4301c4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:58.425293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.429599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.429599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.459839 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] Creating event network-vif-plugged:2187eb95-6507-4002-86b4-fe4d0b4301c4 for instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 on n-h2-855649-4 Nov 02 12:07:58.467660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-803fecc8-c2f1-4fee-b199-1e3e3317c7e2 req-78afe392-a35a-4944-990c-f0040d36ae39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067786 Nov 02 12:07:58.468289 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1819/3620] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:58.554364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:58.555219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:58.565586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.565586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.571798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.572801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.573357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.574255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.881975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:58.893010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:07:58.896842 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b926533-c2e1-4053-8742-394fd22a5f62 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1623 microversion: 2.1 time: 0.344955 Nov 02 12:07:58.897904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1820/3621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:58 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1623 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:58.905262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:58.906216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:58.925102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.927546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.928278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.944026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:58.944669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:58.955207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:58.999177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:59.014839 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f08aa9d-345a-4ade-8bbf-eaab7d6baeb6 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 200 len: 1515 microversion: 2.1 time: 0.802581 Nov 02 12:07:59.026126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1802/3622] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:58 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 1515 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:07:59.049195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:59.050039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:59.080323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.088182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.088182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.088182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.088182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.091455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.741947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:59.751869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea73d8e3-b8a7-4ecf-bca3-5b15b6778305 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1471 microversion: 2.1 time: 0.852060 Nov 02 12:07:59.767279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1821/3623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:58 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1471 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:59.773076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:59.773690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:59.780071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.780571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.781005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.781708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.782161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.782580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.830138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:07:59.852477 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a47e7d2b-b7a3-4909-ab45-a1c78bec3937 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1322 microversion: 2.1 time: 0.809659 Nov 02 12:07:59.857155 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1803/3624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:59 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:07:59.864869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12665a7e-888c-44ae-b448-bfb5954a9174", "name": "network-vif-deleted", "tag": "2a26f607-bf47-405a-a86f-e2f96526d76f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:07:59.890724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.891698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.892529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.908790 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] Creating event network-vif-deleted:2a26f607-bf47-405a-a86f-e2f96526d76f for instance 12665a7e-888c-44ae-b448-bfb5954a9174 on n-h1-855649-4 Nov 02 12:07:59.918816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c62842dc-932b-4061-8d2f-76215812ea2e req-9cce1cb8-101c-42d8-9dae-88c814583c2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059934 Nov 02 12:07:59.919844 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1804/3625] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:07:59.935065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:07:59.935065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:07:59.946443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.947452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.948357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:07:59.949626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:07:59.950322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:07:59.952097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:00.141642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:00.154681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-329c650b-f9c2-404f-bd26-1b3e1e96ff29 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 200 len: 1331 microversion: 2.1 time: 0.230213 Nov 02 12:08:00.191259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1805/3626] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:59 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 1331 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:00.249682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:00.262095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac76bfbb-31bf-4a88-a919-8f5c285815b8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.493075 Nov 02 12:08:00.275018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1822/3627] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:07:59 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:00.777929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:00.779001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:00.796073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:00.797035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:00.797734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:00.798852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:00.803695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:00.807916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:00.886510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:00.887985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:00.917243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:00.917958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:00.920107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:00.924421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:00.925990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:00.927458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:01.917836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:01.930324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c05719a-c745-477a-8131-00622b34db26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1463 microversion: 2.1 time: 1.156506 Nov 02 12:08:01.932021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1806/3628] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:00 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1463 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:01.942621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:01.945058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 12665a7e-888c-44ae-b448-bfb5954a9174] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:01.959382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:01.962933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:01.963728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:01.965759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:01.967573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:01.969430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.007533 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 HTTP/1.1 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '12665a7e-888c-44ae-b448-bfb5954a9174'} Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:02.011587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. Nov 02 12:08:02.016117 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:02.021636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 404 to user: Instance 12665a7e-888c-44ae-b448-bfb5954a9174 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:02.024566 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a6d0f44-5106-4ed7-befc-9748d02812de tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174" status: 404 len: 111 microversion: 2.1 time: 0.090752 Nov 02 12:08:02.025376 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1807/3629] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:01 2022] GET /compute/v2.1/servers/12665a7e-888c-44ae-b448-bfb5954a9174 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:02.034226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:02.035046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:02.040459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:02.042438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.042928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.043404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.044113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.044591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.045038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.109982 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89bd988a-ad74-4dd6-af0d-4a397d82ae90 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1516 microversion: 2.1 time: 1.229035 Nov 02 12:08:02.115775 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1823/3630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:00 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1516 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:02.137380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:02.140212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:02.156359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.157009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.158563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.159418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.161357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.162045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.616677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:02.631094 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a7cb08f-a1e0-4424-8a74-582f92d80460 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.601885 Nov 02 12:08:02.647827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1808/3631] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:02 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:02.655590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0ef06a1-e556-416e-b42f-39f126bebe67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '.version_select at 0x7ff1b35cc790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:02.734249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:02.743928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa6a6206-099d-43b1-81b4-a51091bbd0a5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1463 microversion: 2.1 time: 0.625554 Nov 02 12:08:02.745232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1824/3632] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:02 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1463 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:02.750645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:02.751647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:02.759711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.760545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.761151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.762079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.762700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.763325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.789375 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0ef06a1-e556-416e-b42f-39f126bebe67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749597881" status: 202 len: 0 microversion: 2.1 time: 0.140141 Nov 02 12:08:02.793755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1809/3633] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749597881 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:08:02.803015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:02.804310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:02.816177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.817389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.818586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.819640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:02.820285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:02.820910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:02.862950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:03.051199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:03.063637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea01aa95-d370-4272-bc30-dd1f6d54026d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 200 len: 1516 microversion: 2.1 time: 0.316839 Nov 02 12:08:03.064656 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1825/3634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:02 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:03.082848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b50c0c-1c29-480c-b19d-abaa92626a6e", "tag": "8ee65e76-8b87-4f46-8751-43c128d09a30"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:03.102824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.103826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.104801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.121011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] Creating event network-changed:8ee65e76-8b87-4f46-8751-43c128d09a30 for instance 94b50c0c-1c29-480c-b19d-abaa92626a6e on n-h1-855649-4 Nov 02 12:08:03.127716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ae0417ec-e0a0-4dd8-bc52-bcfecff6eda9 req-bbc9cf23-363e-4a15-bc35-c66ace37c8df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061057 Nov 02 12:08:03.128742 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1826/3635] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:03.136202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ed1e386-d552-48f7-b67f-914ee3320d51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'create', calling method: .version_select at 0x7ff1b3937b80>, body: {"keypair": {"name": "tempest-keypair-1795868134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfNsnCgz6GVTGQBP0cXuqB/5aQfrVXhNkmrk0in2NaQSsuS3Q59ftRBnLrfodzyBOewPZYjYDNOIy4Ksl0T0YbPG7V7TKjC/gb9ofE9w/AB//sbGKatnXeevGmakk7mCg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:03.155600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1ed1e386-d552-48f7-b67f-914ee3320d51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:03.166087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1ed1e386-d552-48f7-b67f-914ee3320d51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:03.340922 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b84c177-2572-4571-a7f6-85009d2ca4a7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 204 len: 0 microversion: 2.1 time: 0.545506 Nov 02 12:08:03.342338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1810/3636] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:02 2022] DELETE /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:03.345878 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ed1e386-d552-48f7-b67f-914ee3320d51 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.215537 Nov 02 12:08:03.353716 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1827/3637] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:08:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:03.357041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:03.357841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:03.359960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:03.360907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:03.367027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.368378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.371874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.372079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.372238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.372348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.372459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.372561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.372687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.372793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.372793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.373113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.572345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:03.587388 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6e0b51f-ea3c-4a62-babc-a4283994bf1b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1554 microversion: 2.1 time: 0.238850 Nov 02 12:08:03.589979 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1828/3638] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:03 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:03.666145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:03.666145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:03.678731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.682608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.683253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.686202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:03.688730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:03.689305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:03.816082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:03.979769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:03.988238 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8eb423d-e6c4-4c3b-a070-395d74e0b79a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.330501 Nov 02 12:08:03.988862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1829/3639] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:03 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:04.207124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:04.355594 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6be6e42-64f2-486c-ace8-1ead5d2f397c tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 204 len: 0 microversion: 2.1 time: 1.011239 Nov 02 12:08:04.361869 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1811/3640] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:03 2022] DELETE /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:04.368541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:04.369538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:04.380776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:04.381564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:04.382516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:04.383882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:04.388384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:04.388384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:04.640091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:04.643557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:04.662961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:04.665487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:04.667226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:04.669135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:04.671032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:04.673978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:04.754941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:04.767726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06dce6c7-2d37-4823-9030-8e993706267a tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 200 len: 1522 microversion: 2.1 time: 0.404866 Nov 02 12:08:04.769853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1830/3641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:04 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:05.013130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:05.014290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:05.032714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:05.037519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:05.038024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:05.042159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:05.050921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:05.050921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:05.132268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:05.144089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6cc96909-683d-46a3-bec7-fba9ed42041d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1554 microversion: 2.1 time: 0.522963 Nov 02 12:08:05.145107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1812/3642] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:04 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1554 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:05.456230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:05.470595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17abb3e1-6616-4d72-bc82-833a1c3aa6f0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.460267 Nov 02 12:08:05.472187 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1831/3643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:05 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:05.821951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:05.831505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:05.873720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:05.875676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:05.877066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:05.878231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:05.878734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:05.879749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:05.930409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:06.178493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:06.181706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:06.246636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:06.249096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:06.257716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:06.264029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:06.268630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:06.269863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:07.818630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:07.851157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f76f0672-3672-4cb7-acb5-8beb36f4fe0e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 200 len: 1522 microversion: 2.1 time: 2.033020 Nov 02 12:08:07.852481 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1813/3644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:05 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 1522 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:07.921006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:07.922925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:07.939284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:07.940369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:07.941181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:07.943229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:07.944308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:07.960448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:08.395945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:08.432199 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c975b89c-39c4-4f15-bfe6-414fc202dfaa tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1554 microversion: 2.1 time: 2.258079 Nov 02 12:08:08.433450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1832/3645] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:06 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1554 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:08.899877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:08.900574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:08.913536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:08.916608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:08.916608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:08.916608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:08.916608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:08.916608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:09.798689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:09.807768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4820d081-5d74-4cfb-8b41-3d0995b69959 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 1.925768 Nov 02 12:08:09.812093 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1814/3646] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:07 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:09.837803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:09.840700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:09.882045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:09.883600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:09.884671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:09.886190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:09.887257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:09.891677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:10.778009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:10.792731 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba8d1072-c4c1-4201-8f18-7623e9e5b875 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 200 len: 1522 microversion: 2.1 time: 1.897527 Nov 02 12:08:10.793690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1833/3647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:08 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 1522 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:10.811977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09ad267-c38d-44d2-883f-ba3e8e9b2467", "name": "network-vif-unplugged", "status": "completed", "tag": "8ac21ae8-34c4-4787-b985-c29d472c1122"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:10.829656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:10.829656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:10.829656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:10.934499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] Creating event network-vif-unplugged:8ac21ae8-34c4-4787-b985-c29d472c1122 for instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 on n-h1-855649-4 Nov 02 12:08:10.945527 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-04df4074-c2d5-430c-b6ad-36b5a03ca198 req-73489ad9-2e82-4f8c-a05c-3bab8f03cc33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149990 Nov 02 12:08:10.948869 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1834/3648] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:10.955643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:10.956397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:10.984678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:10.985211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:10.994577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:11.010429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:11.011324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:11.012125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:11.134658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:11.150254 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf3fd4e0-2ed4-4e1a-ac7f-f9d99f5abda6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1554 microversion: 2.1 time: 1.336664 Nov 02 12:08:11.154730 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1815/3649] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:09 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1554 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:11.163094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780904df-9fe0-4440-a82e-a568deab6e04", "name": "network-vif-deleted", "tag": "913ece96-648e-4b91-9eff-32443537e83f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:11.196813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:11.198574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:11.200355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:11.229588 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] Creating event network-vif-deleted:913ece96-648e-4b91-9eff-32443537e83f for instance 780904df-9fe0-4440-a82e-a568deab6e04 on n-h2-855649-4 Nov 02 12:08:11.240517 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-93be3923-955b-4c8c-b181-e774816c088f req-bf835e2f-45b3-40e6-95b3-e60610acd904 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083927 Nov 02 12:08:11.245987 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1816/3650] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:11.504022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:11.522374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5511ef81-4169-48be-af04-6414afe45bdf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.571497 Nov 02 12:08:11.523252 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1835/3651] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:10 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:11.846356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:11.847203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:11.886603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:11.886603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:11.886603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:11.886603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:11.890088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:11.892731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.030421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:12.032153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:12.032810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.035991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lazy-loading 'fault' on Instance uuid 780904df-9fe0-4440-a82e-a568deab6e04 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:08:12.180905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:12.181776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:12.225636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:12.226786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:12.233081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:12.236887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.238583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:12.244660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:12.249548 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20f847a3-1006-4c43-9c24-6257bc1f73e0 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 200 len: 1312 microversion: 2.1 time: 0.409502 Nov 02 12:08:12.251695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.254311 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1817/3652] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:11 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:12.546009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:12.547023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:12.562614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:12.568295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:12.569776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.572173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:12.572797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:12.574719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:12.805044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:12.859237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61146732-b91d-4608-8d8a-0f7742ca83b0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.682705 Nov 02 12:08:12.866723 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1836/3653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:12 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:13.163773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af9d270d-3081-48fc-aaea-016acae0d6cf tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '.version_select at 0x7ff1b36c7f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:13.197472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9d270d-3081-48fc-aaea-016acae0d6cf tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.198838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9d270d-3081-48fc-aaea-016acae0d6cf tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.210226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af9d270d-3081-48fc-aaea-016acae0d6cf tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.228851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:13.326044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af9d270d-3081-48fc-aaea-016acae0d6cf tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.179271 Nov 02 12:08:13.327373 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1837/3654] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 12:08:13 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:13.418275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:13.419158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:13.432569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:13.476143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-743bac08-8f2e-4640-b6d2-92f924b99c15 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.927947 Nov 02 12:08:13.483019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.483019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.483364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1818/3655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:12 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:13.483458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.483458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.483458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.503639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.505654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09ad267-c38d-44d2-883f-ba3e8e9b2467", "name": "network-vif-deleted", "tag": "8ac21ae8-34c4-4787-b985-c29d472c1122"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:13.525925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.526703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.527348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.534277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] HTTP exception thrown: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 HTTP/1.1 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '780904df-9fe0-4440-a82e-a568deab6e04'} Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:13.536832 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:13.542129 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:13.551903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 404 to user: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:13.554150 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-579449ff-8394-400b-93f4-506a0b3e87c9 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 404 len: 111 microversion: 2.1 time: 0.190029 Nov 02 12:08:13.558838 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1838/3656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:13 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:13.560774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] Creating event network-vif-deleted:8ac21ae8-34c4-4787-b985-c29d472c1122 for instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 on n-h1-855649-4 Nov 02 12:08:13.569472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af18fe67-7076-4fc5-a247-57e2c7e2bda5 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:13.571463 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1c379bfb-a5fd-475f-a8e0-e2a35b6df87e req-c6666f92-e9c3-4fe9-95b7-a722c9e69004 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086489 Nov 02 12:08:13.572240 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1819/3657] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:13.620716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "780904df-9fe0-4440-a82e-a568deab6e04", "name": "network-vif-unplugged", "status": "completed", "tag": "913ece96-648e-4b91-9eff-32443537e83f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:13.630857 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af18fe67-7076-4fc5-a247-57e2c7e2bda5 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.063697 Nov 02 12:08:13.634732 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1839/3658] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:08:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:13.673370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:13.677833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.680898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.681684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.719420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:13.731755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:13.737441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] Creating event network-vif-unplugged:913ece96-648e-4b91-9eff-32443537e83f for instance 780904df-9fe0-4440-a82e-a568deab6e04 on n-h2-855649-4 Nov 02 12:08:13.764719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-77c7c600-f30c-4b06-97db-9b17e7029c74 req-5c3f510f-88eb-41d9-8ff8-b96795224136 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179170 Nov 02 12:08:13.767433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1820/3659] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:13.778684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.780745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.784422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.789614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.791886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.792934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.821039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8087c7f-7501-4b28-9f46-c80d3dfee62c tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-195157514", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:13.969714 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41da7697-b79b-4e52-8768-c7eb47e3aa18 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.333420 Nov 02 12:08:13.970310 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1840/3660] 10.222.0.48 () {58 vars in 1230 bytes} [Wed Nov 2 12:08:13 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:13.985606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:13.986219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:13.993498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.994006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.994447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:13.995208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:13.995697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:13.996326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:14.010740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8087c7f-7501-4b28-9f46-c80d3dfee62c tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.241144 Nov 02 12:08:14.012096 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1821/3661] 10.222.0.48 () {60 vars in 1146 bytes} [Wed Nov 2 12:08:13 2022] POST /compute/v2.1/flavors => generated 498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:14.138602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:14.164074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9766aad4-3413-43c5-b1a8-059a6cc2c7ed tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.184225 Nov 02 12:08:14.183477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1841/3662] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:13 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:14.198528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15272033-6de7-40e2-b948-e057fd11c55d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15272033-6de7-40e2-b948-e057fd11c55d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:08:14.207548 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 12:08:14.213748 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:14.216212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15272033-6de7-40e2-b948-e057fd11c55d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:14.217271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15272033-6de7-40e2-b948-e057fd11c55d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032487 Nov 02 12:08:14.218414 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1842/3663] 10.222.0.48 () {58 vars in 1182 bytes} [Wed Nov 2 12:08:14 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:08:14.224290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c937f11-6329-476c-848c-2134ab5f9496 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:14.241069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:14.247347 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c937f11-6329-476c-848c-2134ab5f9496 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027344 Nov 02 12:08:14.248695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1843/3664] 10.222.0.48 () {58 vars in 1182 bytes} [Wed Nov 2 12:08:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:14.254572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:14.260241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:14.261227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:14.310229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:14.310999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:14.312301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:14.315272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:14.316094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:14.316745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:14.419947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:08:14.440788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:14.575348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faa0eec4-d5ac-4ab6-bd63-938f50bd87db tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.325220 Nov 02 12:08:14.580370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1844/3665] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:08:14 2022] GET /compute/v2.1/servers => generated 681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:14.597467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:14.605879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:14.634115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11b2b7dc-4ed4-4106-bd37-023500d8bc56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: .version_select at 0x7ff1bba9cf70>, body: {"keypair": {"name": "tempest-keypair-808636974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJaQPw69R4AlXuiFn4MMbBjXCfnhIvduPdQ7zy1Hd2i1GF2Ojc450icCnAPoLB7hF89eGWb5B4sootV32KTT2nA8p1M2ab14pKPK3FQxtj/H4Woss77aUp9elGbwQWwZQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:14.644195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:14.646029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:14.648393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:14.649333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:14.656605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:14.659573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:14.695182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-11b2b7dc-4ed4-4106-bd37-023500d8bc56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:14.713716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-11b2b7dc-4ed4-4106-bd37-023500d8bc56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:14.847802 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11b2b7dc-4ed4-4106-bd37-023500d8bc56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.825939 Nov 02 12:08:14.856083 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1822/3666] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:08:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:14.862090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1028736881", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "1ac79b59-4b07-4927-b6e3-749b4905d32d"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:14.964156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:14.994000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:15.006624 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccc99794-6251-4440-9984-97b493a9f58e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.414585 Nov 02 12:08:15.011321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1845/3667] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:14 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:15.023871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:15.033346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:15.033346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:08:15.039656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:15.050542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.051859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.055438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.056612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.057282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.058107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.158381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:08:15.283253 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3193d0a-8e29-4063-b052-db5844b1dbf4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.268727 Nov 02 12:08:15.298825 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1846/3668] 10.222.0.48 () {58 vars in 1144 bytes} [Wed Nov 2 12:08:15 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:15.314289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:15.315760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:15.346127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.347378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.349288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.353474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.355483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.356859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.570831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:15.586938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:15.587396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:15.587880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:15.588290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:15.588633 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe62fd21-1174-4a6d-a496-1a34e3a8745a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.287644 Nov 02 12:08:15.588761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:15.590164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1847/3669] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:15 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:15.605472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54628b67-90cf-4de7-9786-2a99219f08ab tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54628b67-90cf-4de7-9786-2a99219f08ab tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '-1' Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:08:15.614663 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54628b67-90cf-4de7-9786-2a99219f08ab tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:15.621637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54628b67-90cf-4de7-9786-2a99219f08ab tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020973 Nov 02 12:08:15.624212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.625759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.626016 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1848/3670] 10.222.0.48 () {58 vars in 1142 bytes} [Wed Nov 2 12:08:15 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:08:15.626629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.627522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.627999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.628436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.635190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d44516-5d02-45d1-8855-0ccd5f2cb1b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d44516-5d02-45d1-8855-0ccd5f2cb1b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: action_args: {} Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 12:08:15.643165 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d44516-5d02-45d1-8855-0ccd5f2cb1b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89d44516-5d02-45d1-8855-0ccd5f2cb1b8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019514 Nov 02 12:08:15.664494 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1849/3671] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:08:15 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:08:15.674386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:15.678213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d57d320-dead-45cd-bfda-2b21b266c9de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:15.684396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:15.717737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d57d320-dead-45cd-bfda-2b21b266c9de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:15.718759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d57d320-dead-45cd-bfda-2b21b266c9de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:15.740046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:15.745659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:15.801904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-2d57d320-dead-45cd-bfda-2b21b266c9de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Flavor 'non_existing_flavor' could not be found {{(pid=127567) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 12:08:15.804079 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d57d320-dead-45cd-bfda-2b21b266c9de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.134902 Nov 02 12:08:15.813829 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1850/3672] 10.222.0.48 () {58 vars in 1178 bytes} [Wed Nov 2 12:08:15 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:15.856211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b50c0c-1c29-480c-b19d-abaa92626a6e", "name": "network-vif-plugged", "status": "completed", "tag": "8ee65e76-8b87-4f46-8751-43c128d09a30"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:15.922131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:15.924504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:15.926747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:15.990746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] Creating event network-vif-plugged:8ee65e76-8b87-4f46-8751-43c128d09a30 for instance 94b50c0c-1c29-480c-b19d-abaa92626a6e on n-h1-855649-4 Nov 02 12:08:16.073927 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ac91afa8-ecdb-44c3-8e5f-a29e32af21d2 req-96e2be2e-d2f6-4d89-8081-2156e45f206b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231926 Nov 02 12:08:16.078729 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1851/3673] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:16.084252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ef35b79-c2f3-4a63-9299-e95a9f915975 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209557 Nov 02 12:08:16.090276 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1823/3674] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:16.161832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:16.166696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:16.166696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:16.201312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:16.202585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:16.215069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.215908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.216582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.219509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.226706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.227426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.264672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.265520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.269010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.274603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.285078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.292262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.512392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cea1c32b-49f7-49a7-bdd1-e81a7c92756d tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.423272 Nov 02 12:08:16.525212 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1852/3675] 10.222.0.48 () {58 vars in 1174 bytes} [Wed Nov 2 12:08:16 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:16.546963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2842b0ed-c6a7-4524-bc61-b4e0ba9515ab tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:16.548188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2842b0ed-c6a7-4524-bc61-b4e0ba9515ab tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:16.787746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2842b0ed-c6a7-4524-bc61-b4e0ba9515ab tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:16.802604 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2842b0ed-c6a7-4524-bc61-b4e0ba9515ab tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1279 microversion: 2.1 time: 0.274668 Nov 02 12:08:16.821552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1853/3676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:16 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:16.833126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:16.839718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:16.841413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:16.854631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.859357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.860093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.861145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:16.861830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:16.862442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:16.996808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4884be5-ac2a-4b67-9da7-10021dc23b9e tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.172855 Nov 02 12:08:16.999253 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1854/3677] 10.222.0.48 () {58 vars in 1184 bytes} [Wed Nov 2 12:08:16 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:17.010599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.011838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:17.018790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.019408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.020066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.020779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.021289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.021980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.043258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.053941 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c0005bc-7736-4fbf-bdd2-3da874e8b3cf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.955883 Nov 02 12:08:17.054690 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1824/3678] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:16 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:17.059766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.065009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.066078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:17.071854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.072339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.072774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.073809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.074267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.074688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.124597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:08:17.125336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.125336 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-303d8506-50ee-4ba1-95b6-796f01c79f64 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.120865 Nov 02 12:08:17.125336 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1855/3679] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:17 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:17.146102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.153402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.153878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.154333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.381887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5721516-d2d2-4f97-a29c-403419a1cab5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.325741 Nov 02 12:08:17.383358 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1825/3680] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:08:17 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:17.414254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c26c147-85f6-4f8f-9bfe-8a71276709f8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.428604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c26c147-85f6-4f8f-9bfe-8a71276709f8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.429716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c26c147-85f6-4f8f-9bfe-8a71276709f8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021252 Nov 02 12:08:17.436020 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1856/3681] 10.222.0.48 () {58 vars in 1178 bytes} [Wed Nov 2 12:08:17 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:08:17.447212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.451369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:17.452064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Searching by: {'deleted': False, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:08:17.462314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.463171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.465511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.466767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.471292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.471292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.542020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:08:17.591520 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e97a4050-94ab-439a-88fa-bcdec441cac5 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.143694 Nov 02 12:08:17.591520 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1826/3682] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:08:17 2022] GET /compute/v2.1/servers => generated 681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:17.602605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.603306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:17.611805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.612384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.612838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.613616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.614076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.614518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.629657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] HTTP exception thrown: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 HTTP/1.1 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '780904df-9fe0-4440-a82e-a568deab6e04'} Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:17.631494 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 404 to user: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34598ccc-b94e-4f05-b20d-847b968ded44 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 404 len: 111 microversion: 2.1 time: 0.036921 Nov 02 12:08:17.637350 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1857/3683] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:17 2022] DELETE /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:08:17.643338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.643914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:17.651288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.652120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.652410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.653199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:17.653673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:17.654306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:17.709389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:17.829117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8270b926-27c0-4678-be19-55a57b905e49 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:17.830254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8270b926-27c0-4678-be19-55a57b905e49 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:17.977701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8270b926-27c0-4678-be19-55a57b905e49 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:18.001181 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8270b926-27c0-4678-be19-55a57b905e49 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1279 microversion: 2.1 time: 0.171327 Nov 02 12:08:18.031247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1858/3684] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:17 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:18.054211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:18.077057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:18.090887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.091837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.094941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.096002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.097688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.098744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.164504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:18.240996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ad7be2d-e2ba-4fde-a507-5d72b0f68ad8 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 204 len: 0 microversion: 2.1 time: 0.601568 Nov 02 12:08:18.243848 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1827/3685] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:17 2022] DELETE /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:18.250527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:18.257600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.291419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.666896 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d4381ed-e999-45cd-89b1-aeee9e63eeb2 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 204 len: 0 microversion: 2.1 time: 0.615640 Nov 02 12:08:18.671752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1859/3686] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:18 2022] DELETE /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:18.680029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:18.682338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:18.697037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.697543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.698704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.699717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.700360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.702724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.732550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:18.744152 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bef20dd5-bdcf-4473-ab02-2146d9beaf66 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1328 microversion: 2.1 time: 0.498437 Nov 02 12:08:18.759009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1828/3687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:18 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:18.759009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:18.759009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:18.759009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.759009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.759699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.760644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.761277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.762421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.857596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:18.858672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:18.874021 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0b0922e-7830-42e8-82a3-967381ae326d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.200522 Nov 02 12:08:18.876103 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1860/3688] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:18 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:18.886895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:18.890313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:18.914419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.917822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.918219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:18.919136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:18.919620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:18.920058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.262734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:19.286544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4439d3cc-1a8b-4ab7-b23e-4f0030f4cae4 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1507 microversion: 2.1 time: 0.406329 Nov 02 12:08:19.313967 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1861/3689] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:18 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:19.342559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:19.343951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:19.362690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.363228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff3114da-2254-421e-9e0c-7f587e0ded36 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 204 len: 0 microversion: 2.1 time: 0.616814 Nov 02 12:08:19.364144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1829/3690] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:18 2022] DELETE /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:19.365427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.366760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.369828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.371658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.373851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.374724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:19.375609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 780904df-9fe0-4440-a82e-a568deab6e04] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:19.401004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.403330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.404074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.407759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.412661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.413136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.445163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:19.480941 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] HTTP exception thrown: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 HTTP/1.1 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '780904df-9fe0-4440-a82e-a568deab6e04'} Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:19.491183 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 404 to user: Instance 780904df-9fe0-4440-a82e-a568deab6e04 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:19.496053 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2b26a57-16b7-4c8e-9877-0411a9077e6b tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04" status: 404 len: 111 microversion: 2.1 time: 0.124071 Nov 02 12:08:19.497033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1830/3691] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:19 2022] GET /compute/v2.1/servers/780904df-9fe0-4440-a82e-a568deab6e04 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:08:19.518524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:19.519199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:19.528860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:19.539188 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20aa5c3c-d017-461a-84c3-d46db1499a0e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1331 microversion: 2.1 time: 0.226812 Nov 02 12:08:19.541444 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1862/3692] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:19 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1331 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:19.541871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.542381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.542888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.543674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.544162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.545601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.773971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:19.775776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:19.790911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.795309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.795309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.795309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.795309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.795309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.844305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:19.852611 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dba6a0d4-0d13-40e8-9949-b74418e0aaef tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1522 microversion: 2.1 time: 0.354500 Nov 02 12:08:19.867440 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1831/3693] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:19 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:19.906852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:19.908140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:19.922275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.923120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.924306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:19.930832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:19.938202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:19.938909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:20.073782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:20.083019 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16ee9011-0be1-4ae2-8591-ec386996ab8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.181207 Nov 02 12:08:20.088438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1832/3694] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:19 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:20.117244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:20.129968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce7c327c-40c0-45dc-a16b-0919ec10672a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1509 microversion: 2.1 time: 0.359786 Nov 02 12:08:20.129968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1863/3695] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:19 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:20.151527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:20.152452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:20.159239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:20.163857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:20.163857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:20.163857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:20.163857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:20.163857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:20.266038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1255361948", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3132260-2b5f-490b-9b53-8a040d77422f"}], "security_groups": [{"name": "tempest-securitygroup--1280487875"}], "key_name": "tempest-keypair-808636974", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:20.670617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] validate_networks() for [('f3132260-2b5f-490b-9b53-8a040d77422f', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:20.729389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:20.741782 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07ccd0df-0122-4d6e-8273-8fa5d3077123 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1509 microversion: 2.1 time: 0.592090 Nov 02 12:08:20.743447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1833/3696] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:20 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:20.754472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:20.755320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:20.778468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:20.778988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:20.780468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:20.782498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:20.782999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:20.786593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.157352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:21.172559 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33c398dc-88ab-47e8-8efc-23f0728fcfd6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1507 microversion: 2.1 time: 0.427685 Nov 02 12:08:21.173530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1834/3697] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:20 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:21.178935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:21.179636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:21.192420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.192909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.199892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.200931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.201574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.202814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.371485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:21.402940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92278bee-edbe-4362-962a-43c991a45612 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1337 microversion: 2.1 time: 0.227741 Nov 02 12:08:21.403985 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1835/3698] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:21 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1337 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:21.413211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:21.413720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:21.431204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.435859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.436562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.437476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.438023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.438727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.475402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:21.651518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:21.651992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:21.652475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:21.653086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:21.653777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:21.663896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.664389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.664834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.665610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.666081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.670706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.712026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:21.723848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:21.726817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:21.739439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:21.742127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:21.881257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f352373-70e3-4c43-8859-d3b388449000 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 204 len: 0 microversion: 2.1 time: 0.475924 Nov 02 12:08:21.882251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1836/3699] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:21 2022] DELETE /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:21.887571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:21.888549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:21.896377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.897286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.897936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.898907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.899612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.900587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.903967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0202646c-9f27-41d7-be7a-bbb6e790de1f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.650753 Nov 02 12:08:21.905313 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1864/3700] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:21.912240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:21.913131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:21.922381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.927368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.927368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:21.927368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:21.927368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:21.927368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.117101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:22.170462 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e626b9d2-4e72-4e54-80cb-630bdbe65001 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1346 microversion: 2.1 time: 0.263669 Nov 02 12:08:22.191030 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1865/3701] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:21 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1346 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:22.197921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:22.197921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:22.224812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.224812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.224812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.225628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.226225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.226668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.279124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:22.292396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76d469bc-81ff-4acd-b19a-86726df7d228 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1522 microversion: 2.1 time: 0.408854 Nov 02 12:08:22.293375 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1837/3702] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:21 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:22.300428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-853a09da-aea2-458e-8f87-3ae4fbd47f4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:22.306691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-853a09da-aea2-458e-8f87-3ae4fbd47f4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:22.388919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-853a09da-aea2-458e-8f87-3ae4fbd47f4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:22.398481 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-853a09da-aea2-458e-8f87-3ae4fbd47f4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1238 microversion: 2.1 time: 0.103760 Nov 02 12:08:22.401914 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1838/3703] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:22 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:22.412717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:22.415432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:22.442800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.445207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.447305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.449405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.451633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.452430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.650136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:22.664081 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ceeb0b7f-957b-44a5-a170-b4da2774be74 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1515 microversion: 2.1 time: 0.475337 Nov 02 12:08:22.666164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1866/3704] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:22 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:22.687470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:22.688306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:22.711372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.712360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.715238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:22.715238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:22.715238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:22.715962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.073481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:23.081457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e844494-ada3-4be6-9829-6ce395d82067 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1507 microversion: 2.1 time: 0.678160 Nov 02 12:08:23.082088 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1839/3705] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:22 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1507 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:23.087246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5d9b1-1d33-4a6d-984a-63c82ac2b517", "name": "network-vif-unplugged", "status": "completed", "tag": "2187eb95-6507-4002-86b4-fe4d0b4301c4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:23.123359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.123760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.124203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.140753 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] Creating event network-vif-unplugged:2187eb95-6507-4002-86b4-fe4d0b4301c4 for instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 on n-h2-855649-4 Nov 02 12:08:23.148206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-426d3119-a958-48af-8167-8ab31953451f req-b83ab8e1-82b9-461e-9455-4014f94f145a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064385 Nov 02 12:08:23.149723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1840/3706] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:23.206364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:23.207958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:23.216923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.217886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.218394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.219311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.219999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.220570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.266751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.267607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.268157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.268973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'fault' on Instance uuid b09ad267-c38d-44d2-883f-ba3e8e9b2467 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:08:23.680665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:23.696988 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-151eb902-2820-470b-a7e7-680901bed478 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 1.029691 Nov 02 12:08:23.707667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1867/3707] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:22 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:23.709338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:23.711557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:23.725423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.728761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.730353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.731347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.732000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.732742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.787272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:23.794632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:23.810527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df92165f-f994-4e6b-b35b-5bedefeaea1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 200 len: 1351 microversion: 2.1 time: 0.606637 Nov 02 12:08:23.810527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1841/3708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:23 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 1351 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:23.814794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:23.815430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:23.822090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.822585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.823284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:23.823998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:23.824455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:23.824884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.028462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:24.040831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1660242a-26d4-4fce-bda9-e0ed131564a9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1242 microversion: 2.1 time: 0.229594 Nov 02 12:08:24.041451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1842/3709] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:23 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1242 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:24.049018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:24.056186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:24.068262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.069091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.070740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.072426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.073929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.074600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.808299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:24.819899 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45640685-6636-4be9-9af1-698807f1b015 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1515 microversion: 2.1 time: 0.777206 Nov 02 12:08:24.821368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1843/3710] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:24 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1515 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:24.828470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:24.829492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:24.838705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.839802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.840383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.841256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.841845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.842405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.925474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:24.933425 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b6d50d5-9e04-42f4-a7be-cc16c38d3343 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1522 microversion: 2.1 time: 1.233100 Nov 02 12:08:24.934087 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1868/3711] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:23 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1522 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:24.940404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:24.941251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:24.949103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.949880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.950766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:24.951693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:24.952154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:24.952586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.624711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:25.637718 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b0ba4c8-ad7e-4235-a510-6f52f3dbefa9 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1507 microversion: 2.1 time: 0.814832 Nov 02 12:08:25.639037 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1844/3712] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:24 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1507 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:25.645821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:25.646693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:25.655083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.655968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.656602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.657576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.658233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.658850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.705489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:25.717681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 HTTP/1.1 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'b09ad267-c38d-44d2-883f-ba3e8e9b2467'} Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:25.720168 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:25.725537 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:25.727843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:25.728955 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df50248a-7439-453f-9ca6-44119406f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 404 len: 111 microversion: 2.1 time: 0.088300 Nov 02 12:08:25.729725 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1845/3713] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:25 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:25.737751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:25.737751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:25.756066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.756616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.757645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.758423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.758932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcbb464c-ffd4-47d7-9eea-45232d0e838e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.823441 Nov 02 12:08:25.759179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.759625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.770696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1869/3714] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:24 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:25.850686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:25.852635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:25.870515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.871219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.871859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:25.872749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:25.873363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:25.874036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.076952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:26.103818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-869a03b8-a86b-4515-99a2-1ac41535cd2f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1296 microversion: 2.1 time: 0.371469 Nov 02 12:08:26.107418 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1846/3715] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:25 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1296 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:26.115277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a54097f-3ef1-4f38-b95f-84fece5a9075", "name": "network-vif-deleted", "tag": "e1bcb505-2efa-43ca-b7d8-14f24d6c9073"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:26.129913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.130611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.136197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.157625 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] Creating event network-vif-deleted:e1bcb505-2efa-43ca-b7d8-14f24d6c9073 for instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 on n-h2-855649-4 Nov 02 12:08:26.166424 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6012c2ef-afaf-484e-8162-7e63bb64d43c req-adfcf93c-8500-4deb-9051-4dd8d6b4a34a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056899 Nov 02 12:08:26.167357 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1847/3716] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:26.178231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:26.180818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:26.187643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.188478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.189261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.190185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.190913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.191603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.218184 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467/os-volume_attachments HTTP/1.1 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': 'b09ad267-c38d-44d2-883f-ba3e8e9b2467'} Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:26.233251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8045a1f9-686e-4b9e-8e34-8ab590b06ba2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066766 Nov 02 12:08:26.243510 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1848/3717] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:08:26 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467/os-volume_attachments => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:26.263088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:26.266078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:26.297439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.301259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.304409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.307258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.308036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.311279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.323723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:26.658223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:26.661704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:26.668092 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b365a933-272d-4f77-acb1-8502c2e28413 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1515 microversion: 2.1 time: 0.825925 Nov 02 12:08:26.668906 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1870/3718] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:25 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1515 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:26.670335 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1003b28f-2c28-4d79-b3e1-2db19a7c4a50 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1480 microversion: 2.1 time: 0.428298 Nov 02 12:08:26.671252 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1849/3719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:26 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1480 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:26.674330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-113330841", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:26.675721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:26.676383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:26.685025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.685526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.685969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.686872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.687540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.691036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.738413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:26.899912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:26.915631 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc79a6cc-ab15-47b5-9523-242ce9d56e67 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 200 len: 1465 microversion: 2.1 time: 0.242238 Nov 02 12:08:26.917625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1850/3720] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:26 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 1465 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:26.943971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:26.949479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:26.971809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.972913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.983133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:26.986632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:26.991153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:26.991995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:27.482813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:27.979082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:27.994440 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-207f7844-2ef9-41fb-a5d1-a2f98f97e43d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 1.075471 Nov 02 12:08:27.995905 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1851/3721] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:26 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:28.001992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.002920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.011539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.012087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.012780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.015492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.016634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.017381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.161791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:28.171124 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b8a15dd-64a2-45e2-9b05-eeab9efbcf32 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1296 microversion: 2.1 time: 0.173517 Nov 02 12:08:28.187348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1852/3722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:27 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:28.208031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.210280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.222729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.223262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.224248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.224402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.227403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.228047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.278214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.278713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.279192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.279656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lazy-loading 'fault' on Instance uuid 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:08:28.489104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bcdaf8c1af4d32bede55e61ec61fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8bda9de9c7f4da9b5e067e9dd5fea75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:28.494459 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3cf9474-5404-4994-8333-0e7dc9c883f4 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 200 len: 1312 microversion: 2.1 time: 0.305654 Nov 02 12:08:28.508957 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1853/3723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:28 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:28.520598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.521441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.528048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.529377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.529990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.530877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.531527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.532118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.556370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:28.556927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:28.557400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:28.559662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:28.560386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:28.578814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.579547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.580162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.580638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lazy-loading 'fault' on Instance uuid 94b50c0c-1c29-480c-b19d-abaa92626a6e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:08:28.588415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.589496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.590044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.597105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.601440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.601440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.636775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:28.642639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:28.657901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:28.660196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:28.693523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:28.702970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-804bfe8f-48c8-4583-81bc-da6498a63e3c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 200 len: 1318 microversion: 2.1 time: 0.192681 Nov 02 12:08:28.703754 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1854/3724] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:28 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:28.708556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.709375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: d9a3838c-a50d-4cc9-ba70-6ed331052732] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.731720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.732229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.735153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.736057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.736704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.737255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.779034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 HTTP/1.1 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd9a3838c-a50d-4cc9-ba70-6ed331052732'} Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:28.790140 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:28.797666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 404 to user: Instance d9a3838c-a50d-4cc9-ba70-6ed331052732 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:28.798326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d932af98-fb09-49f7-b092-08d9765b848b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126770 Nov 02 12:08:28.798326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1871/3725] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:28.801112 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40ad82d0-1a64-4a07-86c8-5307b39b4cb3 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732" status: 404 len: 111 microversion: 2.1 time: 0.095026 Nov 02 12:08:28.803524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c5d9b1-1d33-4a6d-984a-63c82ac2b517", "name": "network-vif-deleted", "tag": "2187eb95-6507-4002-86b4-fe4d0b4301c4"}, {"server_uuid": "d9a3838c-a50d-4cc9-ba70-6ed331052732", "name": "network-vif-deleted", "tag": "31f8d285-61e4-4afd-a77b-1ac5c8611a7f"}, {"server_uuid": "94b50c0c-1c29-480c-b19d-abaa92626a6e", "name": "network-vif-deleted", "tag": "8ee65e76-8b87-4f46-8751-43c128d09a30"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:28.806024 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1855/3726] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:28 2022] GET /compute/v2.1/servers/d9a3838c-a50d-4cc9-ba70-6ed331052732 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:28.813526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3c762ac-34aa-4ddd-b8eb-5f1cb94d2a60 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.815799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3c762ac-34aa-4ddd-b8eb-5f1cb94d2a60 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.818736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.819444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.820058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.836807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Creating event network-vif-deleted:2187eb95-6507-4002-86b4-fe4d0b4301c4 for instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 on n-h2-855649-4 Nov 02 12:08:28.837588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Creating event network-vif-deleted:31f8d285-61e4-4afd-a77b-1ac5c8611a7f for instance d9a3838c-a50d-4cc9-ba70-6ed331052732 on n-h2-855649-4 Nov 02 12:08:28.838707 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] Creating event network-vif-deleted:8ee65e76-8b87-4f46-8751-43c128d09a30 for instance 94b50c0c-1c29-480c-b19d-abaa92626a6e on n-h1-855649-4 Nov 02 12:08:28.851231 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a485aa65-e117-433f-b4e7-5d2a11842881 req-6be60f06-850d-44c0-86e3-905fce61cc36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051839 Nov 02 12:08:28.852111 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1872/3727] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:28.862235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.862235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.867776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.868270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.868719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.869418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:28.869865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:28.870742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:28.900874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:28.901388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3c762ac-34aa-4ddd-b8eb-5f1cb94d2a60 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:28.913557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3c762ac-34aa-4ddd-b8eb-5f1cb94d2a60 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5" status: 200 len: 1214 microversion: 2.1 time: 0.103926 Nov 02 12:08:28.913557 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1856/3728] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:28 2022] GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:28.935792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-932b6f70-649a-4b36-a085-96fe9e693767 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:28.940553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-932b6f70-649a-4b36-a085-96fe9e693767 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:28.954821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-932b6f70-649a-4b36-a085-96fe9e693767 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:29.265292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:29.385709 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b865bb66-eda4-4bb7-a515-8e83e5c6d3bc tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "DELETE /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 204 len: 0 microversion: 2.1 time: 0.531647 Nov 02 12:08:29.393889 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-932b6f70-649a-4b36-a085-96fe9e693767 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5" status: 204 len: 0 microversion: 2.1 time: 0.456415 Nov 02 12:08:29.395445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1873/3729] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:28 2022] DELETE /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:08:29.395555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1857/3730] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:28 2022] DELETE /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:08:29.398010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.398939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.408163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.408804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.415608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.417135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.417313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.417828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.418338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.418969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.419156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.419662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.420197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.423517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.424226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.424953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.818414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:29.837166 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-742eb9ef-33da-4a4f-a1d2-072f536950c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.429103 Nov 02 12:08:29.837361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:29.837827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1858/3731] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:29.837827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.837827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.838132 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d313e630-8cae-4177-80f7-26fed540d564 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.443981 Nov 02 12:08:29.838132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1874/3732] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:29.840742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.841406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.841582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.842341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.842550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.843438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.844083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.844691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 HTTP/1.1 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'a05494d6-50f5-459d-83fd-fe99884695d5'} Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:08:29.858464 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ffef8e46-e02a-49a1-9630-ce454ef63c43 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5" status: 404 len: 111 microversion: 2.1 time: 0.025307 Nov 02 12:08:29.866609 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1875/3733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:29.870453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.871167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 31c5d9b1-1d33-4a6d-984a-63c82ac2b517] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.881248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.881845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.882515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.883670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.884355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.884953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.909185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] HTTP exception thrown: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 HTTP/1.1 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '31c5d9b1-1d33-4a6d-984a-63c82ac2b517'} Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.911896 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 404 to user: Instance 31c5d9b1-1d33-4a6d-984a-63c82ac2b517 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:29.917671 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e7ef922-e841-4543-a4b5-80542abf7400 tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517" status: 404 len: 111 microversion: 2.1 time: 0.048815 Nov 02 12:08:29.918683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1876/3734] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/31c5d9b1-1d33-4a6d-984a-63c82ac2b517 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:29.922444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.923103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.930320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.930791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.931255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.931951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.932400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.932825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.949060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e HTTP/1.1 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '94b50c0c-1c29-480c-b19d-abaa92626a6e'} Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:29.950714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:08:29.956852 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:29.958714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:29.959803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30acc2ea-99ca-47ee-8bdd-55563c18367d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 404 len: 111 microversion: 2.1 time: 0.041104 Nov 02 12:08:29.960553 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1877/3735] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:29.966148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:29.968511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] [instance: 8a54097f-3ef1-4f38-b95f-84fece5a9075] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:29.976752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.977554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.978168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:29.979511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:29.980466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:29.981064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:30.017647 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] HTTP exception thrown: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Request method failure captured: Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 HTTP/1.1 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl19Jgr1bH2kc7nK60amWDt04oA5jA4zfHgEtzS_zyi_XNYwjWdnnDH12Mw17ZzydJ_8Q_zlk5Svu2hwYnPo7mp8iv8V1ozaXZ5T_OjQjtsqUjOii0yqDLLd0nxJjrP--dV6CMHw0BDtZLeYGQJOCzTWEAPgyYEXOXzRT6czLZvy4Yk Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8bda9de9c7f4da9b5e067e9dd5fea75", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8bda9de9c7f4da9b5e067e9dd5fea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e8bda9de9c7f4da9b5e067e9dd5fea75 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-902063812 Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 43bcdaf8c1af4d32bede55e61ec61fbc Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServersNegativeTestJSON-902063812-project Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '8a54097f-3ef1-4f38-b95f-84fece5a9075'} Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:30.019378 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] Returning 404 to user: Instance 8a54097f-3ef1-4f38-b95f-84fece5a9075 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91b64d17-c6d6-40b8-ae9e-c2aebb7cb6de tempest-ListServersNegativeTestJSON-902063812 tempest-ListServersNegativeTestJSON-902063812-project] 10.222.0.48 "GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075" status: 404 len: 111 microversion: 2.1 time: 0.059014 Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1878/3736] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/8a54097f-3ef1-4f38-b95f-84fece5a9075 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:30.034703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f9585aa-1849-4975-85e5-2c41bf92f531 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '.version_select at 0x7ff1bba621f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:30.107302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f9585aa-1849-4975-85e5-2c41bf92f531 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-key-296692529" status: 202 len: 0 microversion: 2.1 time: 0.081477 Nov 02 12:08:30.108962 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1879/3737] 10.222.0.48 () {58 vars in 1206 bytes} [Wed Nov 2 12:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-296692529 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:08:30.123121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-701894895", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:30.189638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:30.270729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:30.279457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba7e56e6-e147-4f80-9310-61f362d12db6 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 0.451447 Nov 02 12:08:30.296091 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1859/3738] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:29 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:30.320831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1144488645", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:30.384201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:31.223427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:31.223925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:31.224376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:31.225515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:31.226417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:31.236502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.236991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.237457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.239850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.241000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.241436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.262257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:31.268575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:31.285321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:31.288125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:31.342878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:31.343575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:31.344304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:31.345657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:31.346703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:31.361490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.362315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.365509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.365509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.365509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.365509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.384450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:31.395266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:31.409521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:31.412518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:31.459425 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0289f0fc-5c3e-4a7b-80aa-8036b601a15b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348421 Nov 02 12:08:31.463275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1880/3739] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:31.465021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:31.465813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:31.473586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.474005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.474446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.475196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.475655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.476081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.566733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e36e51ad-5f3c-4154-80d4-b0fd9320462a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249728 Nov 02 12:08:31.568865 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1860/3740] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:31.575857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:31.576898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:31.590805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.591626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.592283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:31.594145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:31.595288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:31.600720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:32.064279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:32.078537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7fbdd54-588b-404f-992d-89ffc0ec7e81 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.614479 Nov 02 12:08:32.081731 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1881/3741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:31 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:32.109306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:32.111718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:32.123976 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e098cc3e-6881-412c-ba79-ef58d5d8a960 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.551696 Nov 02 12:08:32.139994 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1861/3742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:31 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:32.150559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:32.151533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:32.152320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:32.152849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:32.153321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:32.170305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:32.174536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:32.174536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:32.175079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:32.178456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:32.179183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:32.185450 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] Creating event network-changed:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:08:32.196383 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-16f7cda8-d596-420b-85c9-d626426f345b req-635cfc16-cee9-45d0-afaa-12ad0c99254d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111606 Nov 02 12:08:32.205845 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1882/3743] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:32.228550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd2116d2-d90f-41c2-a984-326f2534627b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:32.229570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd2116d2-d90f-41c2-a984-326f2534627b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:32.903219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd2116d2-d90f-41c2-a984-326f2534627b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:32.923923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd2116d2-d90f-41c2-a984-326f2534627b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1214 microversion: 2.1 time: 0.710212 Nov 02 12:08:32.926016 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1883/3744] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:32 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1214 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:32.956382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:32.960335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:33.005371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.005870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.006311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.007052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.020324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.021100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.209923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:33.220243 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ac810c4-c05c-46ab-9057-94c90d13cd98 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1213 microversion: 2.1 time: 0.290952 Nov 02 12:08:33.221557 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1884/3745] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:32 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:33.347895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:33.360854 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-040405c8-2723-4974-b7c9-b3413e5bdc73 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1521 microversion: 2.1 time: 1.219812 Nov 02 12:08:33.365899 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1862/3746] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:32 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1521 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:33.376434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:33.378353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:33.387794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.388735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.389552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.390734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.391473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.392131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.669477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913d268b-12de-473f-b12a-32516fe6c52d", "name": "network-vif-deleted", "tag": "a8399d01-2b5b-4627-9639-e2bcf8897fb0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:33.717011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.717495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.718576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.743310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] Creating event network-vif-deleted:a8399d01-2b5b-4627-9639-e2bcf8897fb0 for instance 913d268b-12de-473f-b12a-32516fe6c52d on n-h2-855649-4 Nov 02 12:08:33.756520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c97b3bc5-b466-4c21-9c6a-0e3079bec1fa req-b3c1c8eb-3d4f-4fee-9e7b-8a56c3736c67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.528187 Nov 02 12:08:33.764910 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1885/3747] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:33.805415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:33.806381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:33.820024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.822385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.823745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.825032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.827004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.827614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.901350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:33.912103 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be5db869-8e73-413c-9748-d213a0a9ec90 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.544908 Nov 02 12:08:33.918520 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1863/3748] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:33 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:33.948721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:33.949595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:33.955953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.956452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.957445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:33.958362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:33.959029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:33.959459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.106394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:34.118661 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08164a72-dbee-4565-971b-a4c6cac11e8d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1210 microversion: 2.1 time: 0.174035 Nov 02 12:08:34.120874 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1864/3749] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:33 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1210 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:34.200226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:34.219981 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f428560b-cc59-4f98-bb7f-2327ac6bfa2b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.448853 Nov 02 12:08:34.221155 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1886/3750] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:33 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:34.248932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:34.250315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:34.264513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:34.282779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.287561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.289551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.293096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.295926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.296771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.297558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.300172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.300172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.340570 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] Creating event network-changed:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:08:34.357795 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3e367fa7-5d79-4582-b24c-9d566aac30e5 req-d9ffbb0c-e644-4e18-bfa9-0077e9725595 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096791 Nov 02 12:08:34.360570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1887/3751] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:08:34.388489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:34.389207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:34.414147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.414651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.415136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.415857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.416313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.416741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.427967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:34.439997 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6217d39c-d9b1-4246-8577-54a69a2a264d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1205 microversion: 2.1 time: 0.198059 Nov 02 12:08:34.457393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1865/3752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:34 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1205 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:34.481126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.481730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.482187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.482654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lazy-loading 'fault' on Instance uuid 913d268b-12de-473f-b12a-32516fe6c52d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:08:34.541342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61ff49dd4424227ab6c623289ef4a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd90f20f33c485cad027be5f3c9f296', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:34.559862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6be9368-00c7-47fc-8f1a-1392a3217141 tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 200 len: 1312 microversion: 2.1 time: 0.174590 Nov 02 12:08:34.560471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1888/3753] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:34 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:34.945607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:34.951519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:34.959499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.960718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.961531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:34.962613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:34.963512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:34.964289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.148294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:35.148908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:35.162006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.163192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.170396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.170396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.170396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.170396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.286305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:35.319586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:35.323799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04c26d7d-c91d-424f-a251-377578e62a31 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1266 microversion: 2.1 time: 0.179976 Nov 02 12:08:35.327853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1889/3754] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:35 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:35.344295 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ba5de76-e948-40cb-8cdf-17a4f0da4e64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.406310 Nov 02 12:08:35.350104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:35.352272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:35.361578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1866/3755] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:34 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:35.369559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.370567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.371517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.377543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.377543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.377543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.467177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:35.467867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:35.469825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:35.477202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.480043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.481950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.499502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.500033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.500488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.745581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:35.757113 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57920bf4-620d-4c97-b00c-95489b57f549 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1261 microversion: 2.1 time: 0.295601 Nov 02 12:08:35.759345 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1867/3756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:35 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1261 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:35.781639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:35.781639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] [instance: 913d268b-12de-473f-b12a-32516fe6c52d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:35.798898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.800289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.801320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.802879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:35.804885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:35.805654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:35.834437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] HTTP exception thrown: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Request method failure captured: Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d HTTP/1.1 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYlxlAw26elTDUu81deRlUvaqxiRE-7fzDSBuyJRmQMVOPTQhf79ryuWQTcj7D6igxcaA5BxJzn603OYzOXiQGPJq_nvy_p-07fyKRqHYCaazyrX2hf5Vh3hRt2Yzzinq-rSsgaeSNviZ7KaIzd4iSBMOcwH65UoiYQoMFLeC0GMloCY Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abd90f20f33c485cad027be5f3c9f296", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abd90f20f33c485cad027be5f3c9f296"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: abd90f20f33c485cad027be5f3c9f296 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147402395 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: e61ff49dd4424227ab6c623289ef4a14 Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147402395-project Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '913d268b-12de-473f-b12a-32516fe6c52d'} Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:35.839643 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. Nov 02 12:08:35.844270 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:08:35.846469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] Returning 404 to user: Instance 913d268b-12de-473f-b12a-32516fe6c52d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:08:35.848174 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cea239d6-4cb5-4f6d-b329-2c9aa931200e tempest-ServerRescueNegativeTestJSON-147402395 tempest-ServerRescueNegativeTestJSON-147402395-project] 10.222.0.48 "GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d" status: 404 len: 111 microversion: 2.1 time: 0.086459 Nov 02 12:08:35.854144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1868/3757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:35 2022] GET /compute/v2.1/servers/913d268b-12de-473f-b12a-32516fe6c52d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:08:35.925362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:35.935556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d7b718c-3cc1-48ad-a22b-6dd035da8d52 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.602223 Nov 02 12:08:35.936151 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1890/3758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:35 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:36.351822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:36.352530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:36.367038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.367803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.368427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.369784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.370257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.372285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.376123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:36.377375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:36.378085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:36.390618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.401813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.401813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.401813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.401813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.401813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.549621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:36.560086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a064b917-27fb-4cf2-ae53-ed5263ab4db7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1272 microversion: 2.1 time: 0.214026 Nov 02 12:08:36.561570 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1869/3759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:36 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:36.568625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-plugged", "status": "completed", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:36.582918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.584123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.585076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.603357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] Creating event network-vif-plugged:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:08:36.610936 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1d79eefc-8932-4918-8a89-8bffc349300f req-400b0105-b647-4bde-8715-e5bc366d9c4b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047579 Nov 02 12:08:36.619150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1870/3760] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:36.745864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:36.757389 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-633e00b7-b2fa-4c8c-9974-f0e35d66b38f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.390694 Nov 02 12:08:36.758080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1891/3761] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:36 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:36.792417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:36.795279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:36.810072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.812632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.814069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.815262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.816468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.818533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.933536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:36.944492 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-732d081a-9ecc-412b-ac02-6088e8fb4e27 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1267 microversion: 2.1 time: 0.166234 Nov 02 12:08:36.946550 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1871/3762] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:36 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:36.964038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:36.965165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:36.974761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.974907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.975856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:36.976663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:36.977293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:36.977877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.008427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:37.211665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:37.224070 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0438bd51-5632-4551-87ec-98bb545b2284 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1379 microversion: 2.1 time: 0.263946 Nov 02 12:08:37.224785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1892/3763] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:36 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1379 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:37.602109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:37.603776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:37.626257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.627583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.636235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.642281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.646787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.647728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.766518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:37.786324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4396d467-4162-4823-ba01-8df059b7a707 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1272 microversion: 2.1 time: 0.200109 Nov 02 12:08:37.799147 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1872/3764] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:37 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.799561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.800992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.801139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.973440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:37.974384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:37.986087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.990674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.991509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:37.992455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:37.993099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:37.993875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.332962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:38.369130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-612a3170-3e77-4506-a3af-30a9ed10e4cb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.583949 Nov 02 12:08:38.371529 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1893/3765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:37 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:38.381254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:38.384010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:38.405536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.407094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.409372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.412064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.414080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.415478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.452016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:38.467882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-371a94a6-6744-43e1-83cf-b029d4589234 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.498242 Nov 02 12:08:38.471139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1873/3766] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:37 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:38.766318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:38.778240 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ddda729-cab0-430d-8dc9-50a4fd3527cb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1529 microversion: 2.1 time: 0.404754 Nov 02 12:08:38.778831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1894/3767] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:38 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1529 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:38.807553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:38.808887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:38.819652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:38.821912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:38.830585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.835690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.836791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.837102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.837273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.838345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.839070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.840812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.846808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:38.857785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:38.858372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:38.860345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.325625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:39.340812 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e565ad34-47f2-4c03-b4b9-6ffd7800394a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1529 microversion: 2.1 time: 0.538187 Nov 02 12:08:39.342030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1874/3768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:38 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1529 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:39.373562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f84dc6f-f2a7-4288-9c7f-90f97e1865fb tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:39.428298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:39.442643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-465aad63-aeaa-48ab-9ce4-26e9fdbcf780 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.629177 Nov 02 12:08:39.443614 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1895/3769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:38 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:39.459155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:39.459774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:39.482776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.483040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.483436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.484159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.484612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.485605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.520019 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f84dc6f-f2a7-4288-9c7f-90f97e1865fb tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1ac79b59-4b07-4927-b6e3-749b4905d32d" status: 202 len: 0 microversion: 2.1 time: 0.155810 Nov 02 12:08:39.523831 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1875/3770] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:08:39 2022] DELETE /compute/v2.1/flavors/1ac79b59-4b07-4927-b6e3-749b4905d32d => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:08:39.526070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:39.527062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:39.540938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.546667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.548795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.551305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.552039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.552657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.909603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:39.913245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:39.920463 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23c3fa12-989c-419c-ad98-d316e2d7229b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.398277 Nov 02 12:08:39.921065 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1876/3771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:39 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:39.930733 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b31ca96-83f6-43bf-bfac-f35c68b7ed8b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.477412 Nov 02 12:08:39.931473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba0bc952-7528-400c-ba33-6c3ef4c84bad tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:39.932831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1896/3772] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:39 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:39.963240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba0bc952-7528-400c-ba33-6c3ef4c84bad tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041040 Nov 02 12:08:39.964006 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1877/3773] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:08:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:39.982446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:39.986030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:39.995742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.996601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.998812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:39.998812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:39.998812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:39.999390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.134537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899aa726-7adf-4032-b6b0-184ce8a40b7f", "tag": "ad1572db-255a-4a9f-a371-85f18244d227"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:40.158333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.162690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.163422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.226223 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] Creating event network-changed:ad1572db-255a-4a9f-a371-85f18244d227 for instance 899aa726-7adf-4032-b6b0-184ce8a40b7f on n-h2-855649-4 Nov 02 12:08:40.243094 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-090d22ea-3585-4274-b164-7a45ad628c4f req-c0055b3e-a965-4632-8ea9-302048570d9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111871 Nov 02 12:08:40.247266 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1878/3774] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:08:40.263396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc127e98-cc29-4bfc-8ce2-32d029e1c842", "tag": "0117c04c-cccd-4f56-9068-19e7033785fd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:40.309400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:40.312880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.313638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.316832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.319682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Old instance type tempest-test_resize_flavor_-195157514, new instance type m1.heat {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:08:40.339205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:40.341308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:40.342423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:40.343956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:40.345344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:40.345949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] Creating event network-changed:0117c04c-cccd-4f56-9068-19e7033785fd for instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 on n-h2-855649-4 Nov 02 12:08:40.356891 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8e1c066f-f1a5-4497-9e84-81d5b837dfff req-0f78d25a-e77b-450a-90c2-45b7bf957f54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106373 Nov 02 12:08:40.361904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1879/3775] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:40.470927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:40.471736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:40.488212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.488732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.489194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.491011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.491493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.491941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.873800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-853d9912-146b-4362-8eaf-9c6808b03dc9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3/action" status: 202 len: 0 microversion: 2.1 time: 0.895364 Nov 02 12:08:40.874761 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1897/3776] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:08:39 2022] POST /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:08:40.884233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-plugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:40.913293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.914160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.914160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.937422 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] Creating event network-vif-plugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:08:40.950289 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6f2f771e-a6cf-4522-8a97-12b75413709b req-b12660f1-600a-4401-91c8-6d907df2a8e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070165 Nov 02 12:08:40.956873 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1898/3777] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:40.965107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:40.965808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:40.981183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.981676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.982116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:40.983108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:40.983789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:40.984385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:41.250743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:41.372506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:41.403635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=24 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:41.624382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:41.647194 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab77d2ac-0609-47f8-a43c-a8e81d3b314d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 1.183563 Nov 02 12:08:41.648991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1880/3778] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:40 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:41.679603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:41.680395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:41.687784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:41.687784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:41.687784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:41.688441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:41.688843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:41.689266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:41.901885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:41.915161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0e18929c-5d11-470a-a887-731b1ccb5a6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1538 microversion: 2.1 time: 0.959091 Nov 02 12:08:41.916105 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1899/3779] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:40 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1538 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:41.930918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:41.931589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:41.943604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:41.944352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:41.945092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:41.945814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:41.946437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:41.947069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:42.127390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:42.142613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73b02acb-22cb-4ec6-9bb6-90dbfbab8276 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.492104 Nov 02 12:08:42.143475 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1881/3780] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:41 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:42.190558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:42.201711 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-615b61fb-39c4-489b-9922-82e619ebf840 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1364 microversion: 2.1 time: 0.284450 Nov 02 12:08:42.211322 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1900/3781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:41 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:42.671539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:42.672943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:42.680110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:42.680439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:42.680879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:42.681730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:42.682457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:42.683087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:42.939369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:42.940520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:42.942994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:42.949228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:42.952098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:42.953023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:42.953900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:42.955370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:42.956200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:42.956987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:42.962214 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf4d742f-737f-49bf-b135-82b273272498 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.294693 Nov 02 12:08:42.975160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1882/3782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:42 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:43.167470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:43.168096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:43.174111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.174598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.175087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.175792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.176245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.176670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.300385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:43.309392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23a92960-1260-45db-9bcc-d2e52eb74c53 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1538 microversion: 2.1 time: 0.373945 Nov 02 12:08:43.309923 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1901/3783] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:42 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1538 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:43.315390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:43.316953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:43.325289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.326033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.326955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.327922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.329101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.329542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.528569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:43.537073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d342a677-25d5-4fdf-9a14-2b179a0a4760 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.373744 Nov 02 12:08:43.537670 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1883/3784] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:43 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:43.601719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:43.621861 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ed0c505-0293-4cfd-90b7-f5bff5f1529e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1550 microversion: 2.1 time: 0.309995 Nov 02 12:08:43.643528 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1902/3785] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:43 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1550 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:43.650607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:43.651490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:43.659523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.660511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.661243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.663913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:43.665585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:43.666291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:43.822412 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05c06df4-5e63-44a4-991a-5d095d67b2fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176185 Nov 02 12:08:43.830972 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1884/3786] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:08:43 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:43.987475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:43.988879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:44.020661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.023754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.025489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:44.026374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.027618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.028081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:44.240995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:44.250156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b049c1c-c869-4c01-8ee0-28d927c0df3d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.267357 Nov 02 12:08:44.263981 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1903/3787] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:43 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:44.335633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:44.336375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:44.356945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.358508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.359209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:44.360107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.360746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.361745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:44.563495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:44.564267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:44.580121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.580622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.585174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:44.587909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:44.588767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:44.590839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:45.030931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:45.041223 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb554e16-e034-4464-9556-2615657a7b1f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1538 microversion: 2.1 time: 0.711316 Nov 02 12:08:45.042430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1885/3788] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:44 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1538 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:45.237029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:45.250300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c486540-a0bb-457b-b81c-62d85a20c52f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.691689 Nov 02 12:08:45.255321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1904/3789] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:44 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:45.278404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:45.279216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:45.310454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:45.592927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:45.606324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:45.607950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:45.608636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:45.630904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] Creating event network-changed:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:08:45.637908 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7d04dc10-82f9-463e-90d0-c003e511b73f req-04e92e0e-8225-4ac5-9165-76c6e7bac409 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048625 Nov 02 12:08:45.644453 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1905/3790] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:08:45.717382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:45.736303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b627033-71aa-448c-a161-2dc7c0db594d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.462867 Nov 02 12:08:45.753861 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1886/3791] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:45 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:46.074242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:46.075081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:46.105882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:46.106770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:46.110004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:46.112892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:46.114938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:46.118939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:46.280384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:46.280384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:46.292226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:46.293272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:46.295559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:46.300664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:46.301580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:46.302240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:47.140251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:47.153956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b06291a9-45d7-43fc-a881-9d5ac0d0d446 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1538 microversion: 2.1 time: 1.086323 Nov 02 12:08:47.155741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1906/3792] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:46 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1538 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:47.166407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:47.172033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:47.182438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:47.182930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:47.183391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:47.184089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:47.184544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:47.185349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:47.317107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:47.335828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22743767-2713-4e60-a8b9-a46b11b01f44 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 1.060678 Nov 02 12:08:47.351903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1887/3793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:46 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:47.800691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:47.807471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9f60fcc-b9f0-4602-9ea8-a5312e608622 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.647046 Nov 02 12:08:47.809071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1907/3794] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:47 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:48.185108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:48.185778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:48.192753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.197541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.197541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.197541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.197541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.197541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.361512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:48.362087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:48.375058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.375639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.376320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.377090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.377614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.378109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.424028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:48.435148 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64219f91-1bdb-4103-b85b-ed81f316a892 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1538 microversion: 2.1 time: 0.253911 Nov 02 12:08:48.435735 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1888/3795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:48 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1538 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:48.638872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:48.649210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:48.658591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54efd9d4-ee6f-474e-a868-873af6f7b9c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.301198 Nov 02 12:08:48.663453 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1908/3796] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:48 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:48.836669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:48.837511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:48.844603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.845359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.845992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.847647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.848306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.848910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.945334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aa726-7adf-4032-b6b0-184ce8a40b7f", "name": "network-vif-plugged", "status": "completed", "tag": "ad1572db-255a-4a9f-a371-85f18244d227"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:48.957708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:48.958187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:48.958644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:48.971576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] Creating event network-vif-plugged:ad1572db-255a-4a9f-a371-85f18244d227 for instance 899aa726-7adf-4032-b6b0-184ce8a40b7f on n-h2-855649-4 Nov 02 12:08:48.977305 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3c0fc514-49b9-4574-9aef-6657f078f74b req-54bd5fef-1aea-4fd0-810f-eea75682eff0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036541 Nov 02 12:08:48.977918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1909/3797] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:08:49.010937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:49.033501 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2a8fdd7-9f68-413e-a62a-a55333c3c698 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.200791 Nov 02 12:08:49.039171 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1889/3798] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:48 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:49.461663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:49.462455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:49.471911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:49.472701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:49.473366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:49.474186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:49.474701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:49.475597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:49.679984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:49.685189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:49.686825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:49.692114 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ad5e9b-89aa-4a7d-af71-36c46da5ac9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.237395 Nov 02 12:08:49.692491 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1910/3799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:49 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:49.713552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:49.714365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:49.715095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:49.722723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:49.722723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:49.722723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:49.722723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:49.904247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:49.918078 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24259107-91ba-4660-982d-4f2555c0bf9f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1309 microversion: 2.1 time: 0.238901 Nov 02 12:08:49.930618 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1890/3800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:49 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:50.060297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:50.061766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:50.063974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:08:50.069110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.069680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.070147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:50.070907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.071855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.072299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:50.297554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:50.311128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cbebe44-7c52-485f-ac94-e26dd07c85e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.254773 Nov 02 12:08:50.311971 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1911/3801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:50 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:50.716048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:50.716685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:50.733839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.734457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.734912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:50.736213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.737992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.739601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:50.942722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:50.945623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:50.950969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.951834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.952744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:50.953721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:50.954996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:50.955708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:51.153706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:51.170640 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd585e65-e948-47f1-b674-5b8dcee86f1b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.458833 Nov 02 12:08:51.172128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1891/3802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:50 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:51.198660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:51.207776 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dcd7de1f-0e08-40e3-886f-03500dfdf3b4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1490 microversion: 2.1 time: 0.269800 Nov 02 12:08:51.209426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1912/3803] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:50 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1490 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:51.344725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:51.345356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:51.351952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:51.352438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:51.353083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:51.354163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:51.354802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:51.355454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:51.390391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1144488645", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:51.464874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:51.668875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:51.695256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49ad9f5f-d463-4270-9adc-823adc02a534 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.364042 Nov 02 12:08:51.696415 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1892/3804] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:51 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:52.194711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:52.196400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:52.212634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:52.216343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:52.216858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:52.219858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:52.220398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:52.220826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:52.966607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:52.986019 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5508400b-3221-45fc-8a0e-24763ed8e7ed tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.795933 Nov 02 12:08:52.989706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:52.990875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:52.991558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:52.992152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:52.992576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:52.996766 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1893/3805] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:52 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:53.004501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:53.005218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:53.010174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.010934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.016356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.016356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.016356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.016356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.016975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.017327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.018111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.019117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.019779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.020392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.040235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:53.048622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:53.066418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:53.069461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:53.312193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59877049-43b1-484f-9b59-8596bd4d3082 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.926157 Nov 02 12:08:53.313108 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1913/3806] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:08:53.326233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:53.327293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:53.333377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:53.347576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:53.360413 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2841c995-3fa6-4fe1-a268-0bd383ebc740 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.360699 Nov 02 12:08:53.364572 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1894/3807] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:52 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:53.426367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:08:53.776413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1147070952", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:53.839099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] validate_networks() for [('1bdaa6a3-a90c-44a4-bb1c-08bcc26b3434', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:08:53.867652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbfa2987-e239-4331-8ca3-b78c507d4ad4 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 204 len: 0 microversion: 2.32 time: 0.546363 Nov 02 12:08:53.868703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1914/3808] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:08:53 2022] DELETE /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:08:53.875253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00f0b167-322f-49e3-b327-41ceded3ed33 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:53.875613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00f0b167-322f-49e3-b327-41ceded3ed33 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:54.093316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00f0b167-322f-49e3-b327-41ceded3ed33 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:54.109856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00f0b167-322f-49e3-b327-41ceded3ed33 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1209 microversion: 2.1 time: 0.239640 Nov 02 12:08:54.113658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1915/3809] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:53 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1209 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:54.122089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:54.123303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:54.134395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:54.144346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:54.145297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:54.151639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:54.152438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:54.153187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:54.711749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:54.724483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:54.725936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:54.731805 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0dc13a6-9c97-4170-af6b-6c26e0883b13 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2956 microversion: 2.32 time: 0.614451 Nov 02 12:08:54.738172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1916/3810] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:08:54 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2956 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:08:54.749560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:54.754372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:54.774503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:54.781708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:54.782178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:54.782936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:54.783430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:54.784757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:54.994371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:55.005689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ae42d1a-71e5-49db-9422-da9eb82b83f9 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.266102 Nov 02 12:08:55.008357 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1917/3811] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:54 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:55.013018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:08:55.014157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:08:55.014834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:08:55.015639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:08:55.016225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:08:55.033989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc127e98-cc29-4bfc-8ce2-32d029e1c842", "name": "network-vif-plugged", "status": "completed", "tag": "0117c04c-cccd-4f56-9068-19e7033785fd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:55.035880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.037364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.039543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.042260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.042961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.043616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.059144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.060030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.061604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.089573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Getting quotas for project b94fe0c880364fc08c529278a30b2079. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:08:55.090431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] Creating event network-vif-plugged:0117c04c-cccd-4f56-9068-19e7033785fd for instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 on n-h2-855649-4 Nov 02 12:08:55.102244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-015bac08-fa0e-4f5c-9e13-ab6bba2ee9d8 req-da1bd64c-9ec3-459c-b75f-0a80e1698a97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092418 Nov 02 12:08:55.105233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1918/3812] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:08:55.107156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Getting quotas for user 51600b50f5594d4b8ae305d518a6ae1d and project b94fe0c880364fc08c529278a30b2079. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:08:55.119865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:55.122405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:55.138771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.139685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:08:55.139991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.141954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.143094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.144493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.145385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.148015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:08:55.304028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db9fc125-657d-4d66-bc21-1e6060eeb371 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.938215 Nov 02 12:08:55.304682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1895/3813] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:08:55.324285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:55.333934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:55.368629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.369449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.370088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.371018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.371651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.372275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.386344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:55.399400 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-207a5885-530f-4a05-b477-e771a4012578 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.292685 Nov 02 12:08:55.401083 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1919/3814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:55 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:55.410959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d22bd1a-6938-44fb-9d50-5d2183c196a1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:55.414077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d22bd1a-6938-44fb-9d50-5d2183c196a1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:55.512148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:55.536455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11ef6960-6e60-4ab8-b827-24acc04e4e3d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1213 microversion: 2.1 time: 0.218386 Nov 02 12:08:55.551216 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1896/3815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:55 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:55.589566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d22bd1a-6938-44fb-9d50-5d2183c196a1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:55.599746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d22bd1a-6938-44fb-9d50-5d2183c196a1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1214 microversion: 2.1 time: 0.193998 Nov 02 12:08:55.600790 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1920/3816] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:55 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:55.772952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:55.775348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:55.790540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.791036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.791490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:55.792218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:55.792686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:55.793120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.037985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:56.040962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:56.057504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.059709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.061634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.064549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.065268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.067117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.551016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:56.572796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:56.589551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:56.591220 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca01e62c-53f7-4185-8756-96da0ea2e3b0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2956 microversion: 2.32 time: 0.827438 Nov 02 12:08:56.591831 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1897/3817] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:08:55 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2956 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:08:56.636317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:56.636799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:56.676762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.677271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.678272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.678428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.678872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.700921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.903948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:56.913153 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89576aa9-1dbd-4ae8-8234-ae5b640e57c0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.881358 Nov 02 12:08:56.918676 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1921/3818] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:56 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:56.926702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:56.931874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:56.956731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.966227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.966962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:56.968020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:56.968656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:56.969256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.098315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:57.114643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:57.134102 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31d6ae84-2f25-4c37-b961-3a76f97ce172 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1261 microversion: 2.1 time: 0.200025 Nov 02 12:08:57.140703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1922/3819] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:56 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:57.145522 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c041c860-18a8-41fc-84be-5d6714d6aab1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.522665 Nov 02 12:08:57.154891 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1898/3820] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:56 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:57.159432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:57.160273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:57.180727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.184037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:57.186216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.187384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.190116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:57.192753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.484053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:57.499694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bcc20d76-9c6b-424f-bff4-4f8b67003221 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1218 microversion: 2.1 time: 0.354576 Nov 02 12:08:57.499694 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1923/3821] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:57 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:57.625379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:57.626093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:57.634156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.634726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:57.642922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.644362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.644940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:57.648679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.960825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:57.962125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:57.974326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.974827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:57.976445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:57.989859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:57.990792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.001518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.185615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:58.213489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:58.217373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:58.222955 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92dc62fd-c1c0-46e9-aba4-bc76d0718868 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2956 microversion: 2.32 time: 0.600597 Nov 02 12:08:58.240013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1899/3822] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:08:57 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2956 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:08:58.270999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:58.271720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:58.284824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.285519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.304830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.305888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.306545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.307209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.771680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:58.789682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c038f1a-05fa-45f2-a1da-d51a675f9e86 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.829480 Nov 02 12:08:58.793713 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1924/3823] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:57 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:08:58.808766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:58.817350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:58.835541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:58.836670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.839067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.839699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.843189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.843189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.843189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.847883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edf4f70c-ef22-4173-b82b-ba8422e78177 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1314 microversion: 2.1 time: 0.605353 Nov 02 12:08:58.849002 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1900/3824] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:58 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:58.858368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:58.861504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:58.875684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.876465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.877702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:58.879847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:58.882858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:58.883538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:59.352431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:59.368093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:08:59.376766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-842be859-bd1f-44ee-840a-b6db9b130f81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1266 microversion: 2.1 time: 0.524988 Nov 02 12:08:59.397123 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1901/3825] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:58 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:59.398092 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7cdb717f-7560-4b72-a402-6d69c08f1ad7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1269 microversion: 2.1 time: 0.597761 Nov 02 12:08:59.406914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1925/3826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:08:58 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1269 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:08:59.421065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:08:59.426565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:08:59.430390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:59.437991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:59.438893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:59.439990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:08:59.442270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:08:59.442712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:08:59.752514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-310500134", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:08:59.860826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] validate_networks() for [('30d4505b-c465-4ce4-958f-871528754b05', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:09:00.173881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:00.199959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:00.201673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:00.203004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53df0fb5-0fcb-4153-be59-252e4fbb75d3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2956 microversion: 2.32 time: 0.794742 Nov 02 12:09:00.203587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1926/3827] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:08:59 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2956 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:00.234414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-unplugged", "status": "completed", "tag": "2d8bdb28-49c7-46e6-bf07-b47c1518f9d2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:00.271265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:00.271880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:00.272895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:00.289198 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] Creating event network-vif-unplugged:2d8bdb28-49c7-46e6-bf07-b47c1518f9d2 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:00.295958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1186b1dd-aec7-40df-aff4-48ca7181235a req-520dbce8-f281-4c21-9093-0f4bae04e00c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076620 Nov 02 12:09:00.297147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1927/3828] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:00.304839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:00.306930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:00.318423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:00.319245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:00.320039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:00.331964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:00.335369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:00.336042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:00.373502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:01.514920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:01.537337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd60132f-d3b3-49d3-b483-369b855ba834 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 1.236193 Nov 02 12:09:01.538210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1928/3829] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:00 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:01.548699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:01.552218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:01.568968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:01.569510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:01.569962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:01.570703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:01.571217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:01.571652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.062312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:09:02.063110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:09:02.063625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:09:02.064047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:09:02.064471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:09:02.080785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.081744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.082378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.084665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.084665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.084665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.122593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Getting quotas for project 8b20d26c9b454b88b0202395055cb18f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:02.130057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Getting quotas for user f8f290b12f9f48b7a9d59cd81df44cbf and project 8b20d26c9b454b88b0202395055cb18f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:02.149432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:02.165816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:02.169450 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ba10685-948e-498e-80cb-fccbb3c27334 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1501 microversion: 2.1 time: 0.627657 Nov 02 12:09:02.193414 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1929/3830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:01 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1501 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:02.200612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:09:02.202901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:09:02.206294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:02.207239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:02.233653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.234918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.235762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.238537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.239957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.241485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.383386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:02.391374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f15a9840-24d1-429a-8b92-acd33c461985 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1272 microversion: 2.1 time: 0.196509 Nov 02 12:09:02.405657 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1930/3831] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:02 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:02.414274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:02.414883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:02.423069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.423574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.424011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.425143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.425777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.429574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.458284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28eebbbf-ff4f-4e99-8f19-2803f2c95765 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.066769 Nov 02 12:09:02.458284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1902/3832] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:09:02.470786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:02.472664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:02.499008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.030310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:03.175318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.180170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.189324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d3b1758-d122-4bc2-847a-edd326525fc6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.782186 Nov 02 12:09:03.201114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1931/3833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:02 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:03.201317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.201317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.201992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:03.202369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd3fdeb0-dcf4-4609-87d9-3c8ade82e19a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2914 microversion: 2.32 time: 0.740918 Nov 02 12:09:03.203228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:03.220920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.223700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.224530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.228306 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1903/3834] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:02 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2914 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:03.232714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.241052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.241052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.243002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-unplugged", "status": "completed", "tag": "b879a752-ec06-440b-84a3-563bb110cd1d"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-unplugged", "status": "completed", "tag": "f6e7433d-cdbb-4831-805c-6ec5d60d2aee"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-unplugged", "status": "completed", "tag": "0ff918d3-9b80-4216-9267-64ae5089850a"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-unplugged", "status": "completed", "tag": "f41ae705-0356-48af-848d-ad7512330081"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:03.267570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.275613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.275613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.293606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Creating event network-vif-unplugged:b879a752-ec06-440b-84a3-563bb110cd1d for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:03.296486 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Creating event network-vif-unplugged:f6e7433d-cdbb-4831-805c-6ec5d60d2aee for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:03.298162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Creating event network-vif-unplugged:0ff918d3-9b80-4216-9267-64ae5089850a for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:03.300894 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] Creating event network-vif-unplugged:f41ae705-0356-48af-848d-ad7512330081 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:03.317957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-44cefa09-0fda-4246-ba5a-116180408b58 req-1324bff0-25fe-48a4-b857-cb642683fe0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.088243 Nov 02 12:09:03.319433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1904/3835] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:03.330614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d61a1943-f886-4002-8387-fbcbeedf96f1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:03.333434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d61a1943-f886-4002-8387-fbcbeedf96f1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:03.525527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d61a1943-f886-4002-8387-fbcbeedf96f1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.537633 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d61a1943-f886-4002-8387-fbcbeedf96f1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1216 microversion: 2.1 time: 0.216775 Nov 02 12:09:03.552242 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1905/3836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:03 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1216 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:03.570850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:03.571712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:03.579362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.579865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.580296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.581146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.581641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.582228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.602942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3528ade-2eea-4c1b-8272-883327844c93 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842/action" status: 202 len: 0 microversion: 2.1 time: 0.409923 Nov 02 12:09:03.603621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1932/3837] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:03 2022] POST /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:09:03.609358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:03.613759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:03.630927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.630927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.630927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.641865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.642699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.643380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.956302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:03.966075 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca3ad6cd-d665-4a66-a9ff-166403ed90dd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.412462 Nov 02 12:09:03.970892 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1906/3838] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:03 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:03.976147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:03.979143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:03.989763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.990274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.990730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:03.991473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:03.991938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:03.992444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.003275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:04.015722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d38dfac6-066a-424b-8085-79842bf84bf2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.410637 Nov 02 12:09:04.016983 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1933/3839] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:03 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:04.036286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b643d7-78e9-46d9-91c6-9b032c041e8d", "tag": "dc369ddb-11ff-4487-8777-b6def90fdc3c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:04.054373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.055023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.055679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.069489 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] Creating event network-changed:dc369ddb-11ff-4487-8777-b6def90fdc3c for instance 81b643d7-78e9-46d9-91c6-9b032c041e8d on n-h2-855649-4 Nov 02 12:09:04.074750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e27bd603-4c89-4ab5-9add-c6ec9af64705 req-db8458d5-7b77-4e98-8ca8-10320bec91e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056350 Nov 02 12:09:04.075464 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1934/3840] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:04.221041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:04.222953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:04.231973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.233138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.233892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.234997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.236045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.236898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.393076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:04.402912 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b14438c8-1574-4c3a-a1a3-248d49303ac6 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1506 microversion: 2.1 time: 0.430560 Nov 02 12:09:04.418070 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1907/3841] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:03 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:04.424246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:04.425238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:04.432781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.435862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.435862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.435862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.435862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.436670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.786271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:04.804015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ede63f7-b68b-4f0f-8e49-8a3b852f708a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.590317 Nov 02 12:09:04.805867 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1935/3842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:04 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:04.812305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-deleted", "tag": "2d8bdb28-49c7-46e6-bf07-b47c1518f9d2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:04.826309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.828035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.828992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.849166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] Creating event network-vif-deleted:2d8bdb28-49c7-46e6-bf07-b47c1518f9d2 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:04.857337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d252ff32-a122-4ba2-b738-edf7c82a6dd8 req-f97f5b77-0a97-4b4f-9440-0fe621f467ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049850 Nov 02 12:09:04.858784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1936/3843] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:04.868946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:04.870423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:04.877839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.878620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.879341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.880377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:04.881041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:04.881676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:04.984744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:04.992203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a0264ea-eaa9-4035-9bba-e779be2786a2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1220 microversion: 2.1 time: 0.131928 Nov 02 12:09:04.992879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1937/3844] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:04 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:04.997754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:04.998048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:05.004199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.004403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.004692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.005132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.005833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.006475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.007495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.022102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.023727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.028261 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bf3f540-d5d2-4c02-842c-07e2a2319028 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2867 microversion: 2.32 time: 0.607930 Nov 02 12:09:05.031460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1908/3845] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:04 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2867 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:05.046638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:05.048441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:05.056160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.060993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.060993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.060993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.060993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.060993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.396819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.408329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.414184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:05.417149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-407d0ff7-e2ce-45e3-a53d-e8749a0ecd76 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1543 microversion: 2.1 time: 0.423296 Nov 02 12:09:05.422894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1938/3846] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:04 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1543 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:05.425346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d42b9aef-431f-4b6a-af5f-ea3c236ec8e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.384012 Nov 02 12:09:05.427466 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1909/3847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:05 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:05.441660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:05.451983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:05.458343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.459758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.460397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.461274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.461942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.462442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.601038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:05.819407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:05.830946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:05.831604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:05.839482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23ca0a67-c8d8-4919-9a8b-150e82b4f330 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1486 microversion: 2.1 time: 0.413026 Nov 02 12:09:05.840336 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1939/3848] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:05 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:05.843046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.843515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.843960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.844680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.845142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.845574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.864451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:05.864952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:05.871914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.872597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.879238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.880230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:05.881010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:05.881645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:05.910077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:09:06.098705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.119292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11186be5-3801-461c-a8e4-5426367b54f9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.285037 Nov 02 12:09:06.119292 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1910/3849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:05 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:06.131374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:06.132138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:06.141949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.142608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.143935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.144886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.146329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.147242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.236982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.241793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5044458-2235-487f-a0d1-bf3550364a1a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 204 len: 0 microversion: 2.1 time: 0.381470 Nov 02 12:09:06.242918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1940/3850] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:05 2022] DELETE /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:09:06.248373 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8354810-0ed7-4512-8b17-fb789625f9a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1212 microversion: 2.1 time: 0.134855 Nov 02 12:09:06.252011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1911/3851] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:06 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:06.261396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:06.265217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:06.266343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:06.271554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:06.284396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.285466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.285633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.286112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.293375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.294595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.295794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.304497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.304999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.305706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.309194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.310075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.546425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.553817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.556028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30655154-c4e0-4936-965f-a7cc4080c223 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1492 microversion: 2.1 time: 0.302668 Nov 02 12:09:06.556623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1912/3852] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:06 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1492 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:06.562048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:06.562873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:06.563300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.564754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:06.566016 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a393c93-2212-434f-8616-0578af4aa83f tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2820 microversion: 2.32 time: 0.318500 Nov 02 12:09:06.566567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1941/3853] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:06 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2820 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:06.571141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.583349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.583950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:06.583950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.583950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.583950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:06.584323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:06.584915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:06.585345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.305438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:07.311167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:07.323105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53dc8d3b-aae5-43eb-819e-8108ae5e767f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.755260 Nov 02 12:09:07.327481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1942/3854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:06 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:07.327915 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a500311-c969-4dce-a18e-9299a4b0b5fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1542 microversion: 2.1 time: 0.768981 Nov 02 12:09:07.343003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1913/3855] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:06 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1542 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:07.343003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:07.343003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:07.345465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-deleted", "tag": "f6e7433d-cdbb-4831-805c-6ec5d60d2aee"}, {"name": "network-changed", "server_uuid": "c4deaca1-0044-4227-ad3e-04f13e6e3e27", "tag": "44528961-4e14-409f-8e98-2d3367350901"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:07.354359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.355797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.356939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.359242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.359452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.359919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.361034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.362217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.362504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.386820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Creating event network-vif-deleted:f6e7433d-cdbb-4831-805c-6ec5d60d2aee for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:07.387411 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] Creating event network-changed:44528961-4e14-409f-8e98-2d3367350901 for instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 on n-h2-855649-4 Nov 02 12:09:07.395752 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9e623d9b-73e5-4e06-bc47-c6b3ac3d07e9 req-89886b3c-db9b-43e2-9eee-d8ee546a4950 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070204 Nov 02 12:09:07.396625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1943/3856] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:07.401728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:07.403335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:07.409023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.409514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.409949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.410658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.411165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.411577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.449316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:07.594989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:07.607690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9307b19-9eea-4123-b03e-a4c2f3138f08 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1276 microversion: 2.1 time: 0.209287 Nov 02 12:09:07.609059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1944/3857] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:07 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:07.619480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:07.620623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:07.632267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.632979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.633720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.640866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.641452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.642653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.805351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:07.823212 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00ed045b-e2b9-4b23-b30f-4fa42ab4f9e8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.489081 Nov 02 12:09:07.823859 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1914/3858] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:07 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:07.839683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:07.839683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:07.850630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.851541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.852660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:07.853002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:07.853586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:07.854127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:08.066715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:08.075191 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d171e73c-36c7-4b01-8cc6-3e5154b46b91 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1492 microversion: 2.1 time: 0.464186 Nov 02 12:09:08.075517 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1945/3859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:07 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1492 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:08.181651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:08.191191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:08.192652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:08.193927 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c60cc605-6a40-4f79-bfda-56d073e98452 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2707 microversion: 2.32 time: 0.366534 Nov 02 12:09:08.194501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1915/3860] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:07 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2707 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:08.363245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:08.363986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:08.366480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:08.378216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:08.378669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:08.379309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:08.379752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:08.380512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:08.382306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:08.383133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:08.383692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:08.391576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:08.401993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:08.402558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:08.403557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:08.404233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:08.404748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.042820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:09.059673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-097738dd-66ce-435a-9dba-b2b96c41d149 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1542 microversion: 2.1 time: 0.700790 Nov 02 12:09:09.060750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1946/3861] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:08 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1542 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:09.070319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:09.086838 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea722874-210d-459d-8e62-46c5f1d0bb81 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.707296 Nov 02 12:09:09.088283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1916/3862] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:08 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:09.091420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:09.092700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:09.102241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:09.103070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:09.109092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.111944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.113387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.118582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.119261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.119811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.123628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.125781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.126363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.130431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.134948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.136148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.389025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:09.405997 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-884d0a35-a574-485c-95c3-d729aa995ad4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1274 microversion: 2.1 time: 0.340733 Nov 02 12:09:09.435531 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1947/3863] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:09 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1274 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:09.442067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:09.442787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:09.451571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.452164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.453078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.453942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.454508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.455106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a66c1e9e-2023-4c98-bd72-4094bfd93c79 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1450 microversion: 2.1 time: 0.260591 Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1948/3864] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:09 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1450 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:09.840727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a7f2a6c-46f0-4732-91f7-3ce4abfe260b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.907825 Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1917/3865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:09 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-deleted", "tag": "f41ae705-0356-48af-848d-ad7512330081"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] Creating event network-vif-deleted:f41ae705-0356-48af-848d-ad7512330081 for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3e5321aa-eacf-49bf-9704-92bef5cce921 req-7dc0e979-c8bd-40f9-b273-3d612220aa68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039071 Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1918/3866] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc127e98-cc29-4bfc-8ce2-32d029e1c842", "name": "network-vif-deleted", "tag": "0117c04c-cccd-4f56-9068-19e7033785fd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.076687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.077720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.077720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] Creating event network-vif-deleted:0117c04c-cccd-4f56-9068-19e7033785fd for instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 on n-h2-855649-4 Nov 02 12:09:10.077720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5c6b542b-7e25-4a03-ad25-1270208ca9cc req-2da4ab9c-efbe-4390-aaa1-e1de7245eae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Nov 02 12:09:10.078729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1919/3867] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:10.085859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b643d7-78e9-46d9-91c6-9b032c041e8d", "name": "network-vif-plugged", "status": "completed", "tag": "dc369ddb-11ff-4487-8777-b6def90fdc3c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:10.096382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.096768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.097231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.109823 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] Creating event network-vif-plugged:dc369ddb-11ff-4487-8777-b6def90fdc3c for instance 81b643d7-78e9-46d9-91c6-9b032c041e8d on n-h2-855649-4 Nov 02 12:09:10.115719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-53bc8837-79b0-45dd-9903-0c8f10acdcff req-1cae1c5a-5ef5-43d9-85c4-a19260c8b782 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035219 Nov 02 12:09:10.116350 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1920/3868] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:10.121863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:10.122627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:10.129926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.130432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.130877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.132661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.132661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.132661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.172580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:10.187398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:10.189680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:10.191237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61dac452-e5b5-4a52-bb73-b646f9fdfd47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2546 microversion: 2.32 time: 0.489358 Nov 02 12:09:10.191824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1949/3869] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:09 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2546 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:10.200939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:10.201832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:10.220341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.221504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.221504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.222020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.222810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.222879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.580787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:10.589300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57e17263-eaa1-455b-af2e-8247cfe40bba tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1542 microversion: 2.1 time: 0.471624 Nov 02 12:09:10.589907 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1921/3870] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:10 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1542 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:10.608205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:10.609060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:10.616352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.617068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.617684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:10.618541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:10.619170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:10.619732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.113924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.122434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a7b610c-b694-48f3-8081-4ef19e96deed tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.929522 Nov 02 12:09:11.134156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1950/3871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:10 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:11.139395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:11.140120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:11.148370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.148993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.149534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.150583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.151145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.151651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.272893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.282469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce7ee486-feee-4c83-ab68-4b205315bc92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1450 microversion: 2.1 time: 0.146978 Nov 02 12:09:11.283327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1951/3872] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:11 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:11.289054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:11.289896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:11.297662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.298469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.299139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.300082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.300739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.301388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.371245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.380329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe0cfc5e-5952-4cdf-811a-110fa7bce7b6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.775932 Nov 02 12:09:11.380859 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1922/3873] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:10 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:11.386231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:11.387190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:11.395490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.396526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.396949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.397679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.398144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.398581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.749522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.759815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dbb3f5b-9870-4ad3-b01b-f5745d4c374e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 0.475200 Nov 02 12:09:11.760426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1952/3874] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:11 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:11.766646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:11.767543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:11.784816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.785512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.786122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.786859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:11.794180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:11.794180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:11.801381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.813831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.817305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:11.818854 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36559d83-77a6-4c0f-9cc5-65e7ddd6dde0 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2499 microversion: 2.32 time: 0.436605 Nov 02 12:09:11.839082 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1923/3875] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:11 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2499 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:12.150490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:12.154162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:12.155160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:12.166440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.167158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.167616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.168421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.168939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.169390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.645462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:12.655006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e77fae8-4503-4693-9c11-51bca1ea1bf2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1542 microversion: 2.1 time: 0.893344 Nov 02 12:09:12.655835 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1953/3876] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:11 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1542 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:12.661295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-unplugged", "status": "completed", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}, {"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-deleted", "tag": "0ff918d3-9b80-4216-9267-64ae5089850a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:12.673464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.674167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.674782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.693602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Creating event network-vif-unplugged:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h2-855649-4 Nov 02 12:09:12.694341 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Creating event network-vif-deleted:0ff918d3-9b80-4216-9267-64ae5089850a for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:12.702177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:09:12.716277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8d38b5ba-a1bf-4741-837a-e56ddb0eeb4b req-d5307f58-781e-4847-98bf-d1c92bf3cf8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059088 Nov 02 12:09:12.717450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1954/3877] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:12.723372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:12.724131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:12.731334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.731828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.732324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.733794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.734263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.734687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.774143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.774635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.775101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.775554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'fault' on Instance uuid cc127e98-cc29-4bfc-8ce2-32d029e1c842 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:12.963007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:12.971879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11b10b0b-aeac-4012-8b11-445f77c28f5f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 200 len: 1304 microversion: 2.1 time: 0.252729 Nov 02 12:09:12.972730 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1955/3878] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:12 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:12.977791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:12.978605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:12.985930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.987516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.989814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.992055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:12.992548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:12.992992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:12.996501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:13.009174 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da9351a1-cf33-485b-8722-9b6f4ae9c036 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.863247 Nov 02 12:09:13.010036 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1924/3879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:12 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:13.016859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:13.017832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:13.026216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:13.027297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:13.028649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:13.030323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:13.031041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:13.032443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:13.535046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:14.111818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.123160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.139817 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a6fc562-3292-4c1a-b2bb-c5fc488ed056 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1309 microversion: 2.1 time: 1.123633 Nov 02 12:09:14.140165 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1925/3880] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:13 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1309 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:14.140974 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6170d79a-5d56-4856-bdec-4c147722249c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 1.164214 Nov 02 12:09:14.142449 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1956/3881] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:12 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:14.150204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:14.154686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:14.155808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:14.160935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:14.171777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.175176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.177616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.178877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.179837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.180594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.181341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.181977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.182723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.185171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.186448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.189523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.806147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.816433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.817729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.819252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:14.820827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35841736-67c2-49f2-9b58-af0dbdaa9a47 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2227 microversion: 2.32 time: 0.677363 Nov 02 12:09:14.821161 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1926/3882] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:14 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2227 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:14.824870 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24f5ed51-66e6-40e7-b411-c38f8936c882 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1542 microversion: 2.1 time: 0.679937 Nov 02 12:09:14.825442 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1957/3883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:14 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1542 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:14.826405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:14.827318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:14.833861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.834616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.836551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.838158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.838864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.839526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.843909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:14.844626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:14.853853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.854424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.854882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.855773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.857971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 HTTP/1.1 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc127e98-cc29-4bfc-8ce2-32d029e1c842'} Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:14.860718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:14.864333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:14.865813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.866280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.866921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7f6a9e5-28e6-4387-86a2-cd4482dd54cc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 404 len: 111 microversion: 2.1 time: 0.044295 Nov 02 12:09:14.868102 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1927/3884] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:14 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:14.881254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:14.893284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:14.894063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:14.894744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:14.909737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Creating event network-changed:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h2-855649-4 Nov 02 12:09:14.916406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:09:14.931733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e0a88d96-b347-4b5f-8c9b-e411b283abf9 req-12c9bfb3-dce8-42e5-88f2-1430b314f09c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060806 Nov 02 12:09:14.933120 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1928/3885] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:15.064771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1192839549", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:15.137171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:09:15.548970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:15.566562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee90a1de-7e8e-4cd3-b4c6-eab4c518e764 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.726284 Nov 02 12:09:15.591991 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1958/3886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:14 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:15.599559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:15.600675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:15.611517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:15.612392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:15.613685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:15.614913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:15.616381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:15.617103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:16.720060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:16.735480 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f8574c4-ec28-4be8-b106-a0f8ee4a2c0e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1490 microversion: 2.1 time: 1.135027 Nov 02 12:09:16.746072 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1959/3887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:15 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1490 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:16.753226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:16.754022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:16.760452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:16.761074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:16.764267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:16.764267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:16.764267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:16.764267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.300717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.312690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c352fc77-35f4-418b-9ddb-5b7733c0745f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.563896 Nov 02 12:09:17.324811 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1960/3888] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:16 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:17.336210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4deaca1-0044-4227-ad3e-04f13e6e3e27", "name": "network-vif-plugged", "status": "completed", "tag": "44528961-4e14-409f-8e98-2d3367350901"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:17.347476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.347962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.348394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.352906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:17.361152 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] Creating event network-vif-plugged:44528961-4e14-409f-8e98-2d3367350901 for instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 on n-h2-855649-4 Nov 02 12:09:17.367809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7270fdb7-f2a9-49a6-8a3a-202cb9de3ba9 req-ebad19c7-70eb-4a37-b54e-cd9941a6afc1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042162 Nov 02 12:09:17.368630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1961/3889] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:17.374459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:17.376450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:17.385285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.385891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.386534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.386715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:09:17.387254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:09:17.387766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:09:17.388199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:09:17.388571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.388709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:09:17.390180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.390847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.405081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.405939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.406629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.408246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.413939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.413939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.436363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:17.443811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:17.464994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:09:17.467650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:09:17.580907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.589637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0aa7d63-b94d-4d72-a0ba-b8d0a3096195 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1474 microversion: 2.1 time: 0.219544 Nov 02 12:09:17.590228 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1962/3890] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:17 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:17.595055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:17.596003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:17.603116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.603857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.604500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.605484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.606180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.606676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.618857 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf65bf7a-be9b-4ff2-a1b7-7629b6f53749 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.558182 Nov 02 12:09:17.620468 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1929/3891] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:09:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:09:17.629644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:17.631249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:17.643818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.645003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.645756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.647006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.647862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.648636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.657488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:17.714415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.727110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.728585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.731618 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cd0d55f-cb2e-486d-a3f2-c6248dcc3951 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2159 microversion: 2.32 time: 0.138952 Nov 02 12:09:17.733292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1963/3892] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:17 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2159 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:17.742549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:17.743214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:17.755854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.756367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.756978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.760739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.760739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.760739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.911283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.925428 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f96aa828-40c0-4ce1-9244-68fbd6ee6021 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.299002 Nov 02 12:09:17.930165 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1930/3893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:17 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:17.935214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:17.953928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:17.954646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:17.955291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:17.978303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:17.980226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] Creating event network-changed:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h1-855649-4 Nov 02 12:09:17.986026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-897f9504-1bef-471b-bfb2-426d121a1785 req-d00e7434-f95d-45a6-9b5d-70fbdf56b30f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055193 Nov 02 12:09:17.987651 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1931/3894] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:17.988768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c41be140-c958-4a79-806f-0746bffeb9a2 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1490 microversion: 2.1 time: 0.254081 Nov 02 12:09:17.989636 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1964/3895] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:17 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1490 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:18.001368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b2e53aa-caa9-483f-bcb0-5af4fb5785ad tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.002750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b2e53aa-caa9-483f-bcb0-5af4fb5785ad tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.012736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.013915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.024474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.025291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.025754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.026688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.027328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.027772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.090109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b2e53aa-caa9-483f-bcb0-5af4fb5785ad tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:18.101482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b2e53aa-caa9-483f-bcb0-5af4fb5785ad tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1215 microversion: 2.1 time: 0.110545 Nov 02 12:09:18.102096 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1965/3896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:17 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:18.233123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:18.243331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a11c1418-f5de-4eca-baa2-cef56055fd91 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1490 microversion: 2.1 time: 0.235049 Nov 02 12:09:18.244301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1932/3897] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:18 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1490 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:18.266857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.269138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.275583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.276022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.276448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.277164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.277625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.278051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.311089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:09:18.339155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.339947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.346735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.347347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.347886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.348716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.349384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.349827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.501219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:18.510084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba13b5be-1737-4a2d-a012-91bd90c67060 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.174950 Nov 02 12:09:18.510680 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1933/3898] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:18 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:18.614495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.615160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.622227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.622728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.623286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.624145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.624617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.625052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.642608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9d28350-f3c5-44ae-808f-17fa1854ffa8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 204 len: 0 microversion: 2.1 time: 0.379639 Nov 02 12:09:18.647903 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1966/3899] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:18 2022] DELETE /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:09:18.654445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.655401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.662432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.662931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.663609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.664484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.665105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.665686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.951883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:18.960816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37136fbb-575c-47ec-b92b-33d8d877845b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1474 microversion: 2.1 time: 0.350836 Nov 02 12:09:18.961523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1934/3900] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:18 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:18.966915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:18.967791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:18.976242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.977086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.977717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.978844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:18.979525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:18.980127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:18.993228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.002408 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5980e6b6-50b4-428e-b5b2-46759522e1c3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1496 microversion: 2.1 time: 0.352871 Nov 02 12:09:19.015008 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1967/3901] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:18 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1496 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:19.015008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:19.015008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:19.023855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.297072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.297072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.297072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.297072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.297072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-819bd6c6-e062-403a-96a6-03187adb961a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 2159 microversion: 2.32 time: 0.171502 Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1935/3902] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:18 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 2159 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.298051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.298924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.298924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.298924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.298924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad5e6254-5285-4dd3-9c66-654115fd1b4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1219 microversion: 2.1 time: 0.141845 Nov 02 12:09:19.298924 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1936/3903] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:19 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:19.327366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.338119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d080c76f-4880-4f90-9d04-d10dafff559b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.333216 Nov 02 12:09:19.351621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1968/3904] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:19 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:19.610359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:19.611284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:19.617862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.623241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.623241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.623241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:19.623241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:19.623241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:19.798724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:19.806015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2877c07-e3b5-4360-b36d-ec8cc63010d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.199529 Nov 02 12:09:19.806625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1937/3905] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:19 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:19.989778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:19.990910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.001952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.006348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fd3a62-65bc-4836-b56d-d7900ad7b34f", "name": "network-vif-deleted", "tag": "b879a752-ec06-440b-84a3-563bb110cd1d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:20.017261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.022649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.023595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.036235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] Creating event network-vif-deleted:b879a752-ec06-440b-84a3-563bb110cd1d for instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f on n-h2-855649-4 Nov 02 12:09:20.041236 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a9132a0e-874a-498c-9cf2-471ebc432b8f req-26c71fa9-108b-4b02-ab74-e8b137c18bbb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039497 Nov 02 12:09:20.042331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1938/3906] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:20.047824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.048742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.056000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.056681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.057120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.058042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.058648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.059101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.242611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.261417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7c3e050-1284-4a2c-aa95-69092319ee02 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1474 microversion: 2.1 time: 0.275994 Nov 02 12:09:20.275005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1969/3907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:19 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:20.275356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.278844 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b6f4c15-dcf2-46ea-a380-9850620dc393 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1496 microversion: 2.1 time: 0.235097 Nov 02 12:09:20.280681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1939/3908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1496 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:20.284969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.285604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.305918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.309153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.310174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.311265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.311945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.312235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.312824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.313558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.324815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.325306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.325931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.326655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.327187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.327618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.414287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.434634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.436162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.437593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ba2db6e-c120-46c7-afb0-69aa92bd41a6 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.171788 Nov 02 12:09:20.438158 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1970/3909] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:20.445255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.446440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.458213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.458709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.459222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.460118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.460754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.461358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.477253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.493267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-282fbf74-98c8-4b4d-85b1-3e7358a42f16 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1267 microversion: 2.1 time: 0.192662 Nov 02 12:09:20.494238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1940/3910] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:20.500230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.501014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.507496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.508189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.508808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.510998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.511810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.512666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.863262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.879710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2bc42198-7fab-4f13-96a6-659d7bc56adf tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 0.440289 Nov 02 12:09:20.880468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1971/3911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:20.896873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.897831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.918749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:20.928604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13d33510-76f0-404f-8fbb-fe17fa8082d9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.433202 Nov 02 12:09:20.932093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.932691 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1941/3912] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:20.934091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.934829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.936195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.936737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.937237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.966227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:20.968298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:20.979163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:20.979778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.407650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:21.435350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f26a4c90-6676-427f-8693-dd64e9395cdf tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.552560 Nov 02 12:09:21.437226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1972/3913] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:21.442812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:21.443701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:21.459554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.462623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.464568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.465723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.470086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.471686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.482659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:21.493204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb4c4ee8-ad4b-48e3-8a01-094e35a81eaf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.532216 Nov 02 12:09:21.493811 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1942/3914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:20 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:21.510918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:21.511570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:21.519677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.524525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.525222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.526130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.526750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.528757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.891488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:21.906862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8966ec80-ccdf-4cd0-80ec-43c446734fe3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1471 microversion: 2.1 time: 0.467838 Nov 02 12:09:21.908283 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1973/3915] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:21 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:21.938077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:21.939151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:21.954254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:21.956518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.957380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.958052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.959354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:21.960046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:21.967229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:21.974067 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59f7e7e6-c80e-49aa-8d97-696c8953acd8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1496 microversion: 2.1 time: 0.479133 Nov 02 12:09:21.974694 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1943/3916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:21 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1496 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:21.980202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:21.980939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:22.001851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.002932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.003635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:22.004546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.005168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.005741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:22.136605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:22.155071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:22.157189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:22.157672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:22.162638 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1b10e3c-f9da-4a2c-a428-a0446b1aad2d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.249138 Nov 02 12:09:22.165908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1974/3917] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:21 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:22.176176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:22.176852 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd2201a1-7f8c-4260-ac94-185b20e27098 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1273 microversion: 2.1 time: 0.200822 Nov 02 12:09:22.177481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:22.177595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1944/3918] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:21 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:22.187189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:22.193854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.195075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.195203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:22.207586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:22.207586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.207586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.207586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:22.222180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.222700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.249391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:22.249391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:22.251351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:22.253705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.596784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:23.623857 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46a21c0e-ee7d-4c6a-9ef1-8b0e9fd57635 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.458718 Nov 02 12:09:23.635369 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1975/3919] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:22 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:23.643499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:23.651881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:23.662566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.663113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.663561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.664344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.664816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.665248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.690078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:23.716155 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a9e2216-781e-4aed-bcbe-7b7020aae0a6 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1314 microversion: 2.1 time: 1.536400 Nov 02 12:09:23.718417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1945/3920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:22 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1314 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:23.745138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-plugged", "status": "completed", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:23.784656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.785613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.787515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.808930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.816649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.818334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Creating event network-vif-plugged:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h2-855649-4 Nov 02 12:09:23.824186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.824186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.824186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.824186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.825991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:09:23.840623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5f1c637e-6c17-49cd-8f0c-f66e0f03dd3a req-35f0bdf7-8d64-4078-8b61-2f9b8a6fba03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116683 Nov 02 12:09:23.842661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1946/3921] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:23.849714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:23.850882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:23.858418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.859341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.860020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.861012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:23.861734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:23.862397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:23.890635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:23.903809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:23.918213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:24.241667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:24.255907 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79d5844c-498c-4640-922d-081eb712ba1f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.411238 Nov 02 12:09:24.257389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1947/3922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:24.266875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:24.268069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:24.281197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.282399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.289858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:24.289858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.289858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.289858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:24.365070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:24.504583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:24.539893 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd730b15-a61f-4f0a-883c-3bf3bc2013a9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 200 len: 1454 microversion: 2.1 time: 0.280543 Nov 02 12:09:24.540953 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1948/3923] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:24 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 1454 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:24.570223 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-139312fb-7ba3-4fbb-9c0e-4b83e7174a3a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3/action" status: 202 len: 0 microversion: 2.1 time: 0.943480 Nov 02 12:09:24.571514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1976/3924] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:23 2022] POST /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:09:24.586852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:24.587676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:24.588153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:24.588984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:24.598949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.600447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.601480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:24.609543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.609543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.609543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:24.609908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.000019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:25.055912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:25.062994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:25.065939 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ead43486-0455-4685-9f2f-03f519f2d6ee tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.498093 Nov 02 12:09:25.071126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1949/3925] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:24 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:25.089383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-165478509"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:25.108854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:25.134164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.139100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.139903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.141319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.146015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.147313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.382453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:25.422612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-954ac868-e847-4202-81bb-278db15761f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.843242 Nov 02 12:09:25.423633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1977/3926] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:24 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:25.472583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:25.475816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:25.495957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.507536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.508722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.510455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.511323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.512155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.871991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b8480c3-c237-47c3-9feb-f817f3b7bb5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.795668 Nov 02 12:09:25.897143 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1950/3927] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:25 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 12:09:25.909724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b643d7-78e9-46d9-91c6-9b032c041e8d", "name": "network-vif-deleted", "tag": "dc369ddb-11ff-4487-8777-b6def90fdc3c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:25.915300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:25.947730 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62db9d73-4ebf-4f07-b773-23a2c338714d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1470 microversion: 2.1 time: 0.484503 Nov 02 12:09:25.949224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1978/3928] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:25 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:25.961959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.963367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.964463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.966260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:25.967454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:25.995761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.996495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.997064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:25.997971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:25.998589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:25.999369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.008797 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] Creating event network-vif-deleted:dc369ddb-11ff-4487-8777-b6def90fdc3c for instance 81b643d7-78e9-46d9-91c6-9b032c041e8d on n-h2-855649-4 Nov 02 12:09:26.025401 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-66035d9f-8703-4f72-b7a6-1d6c24a089b1 req-90c5b136-655e-4c56-be1f-f6d75600e86e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121707 Nov 02 12:09:26.029274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1951/3929] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:26.045980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:26.048046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:26.064699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.066704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.068322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.070191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.072254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.073474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.617653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:26.638017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73deb8ae-7d23-4532-a831-826c13e9def0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1498 microversion: 2.1 time: 0.686927 Nov 02 12:09:26.640268 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1979/3930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:25 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1498 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:26.689385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:26.690544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:26.715019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:26.720619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.722102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.722868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.724115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.724874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.725604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.733723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c3587a0-ef29-4441-b799-c40d795f763a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.700632 Nov 02 12:09:26.743071 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1952/3931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:26.766096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "name": "network-vif-plugged", "status": "completed", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:26.785357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d HTTP/1.1 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '81b643d7-78e9-46d9-91c6-9b032c041e8d'} Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:26.788699 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:09:26.795426 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:26.798538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:26.800712 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cb2518e-14cc-4323-a3c5-9043b0c5e142 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 404 len: 111 microversion: 2.1 time: 0.158080 Nov 02 12:09:26.801440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.808545 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1980/3932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:26 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:26.817425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:26.819388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:26.819649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.820234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.834448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.839843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.844227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.849305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.850335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.853603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.857171 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] Creating event network-vif-plugged:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h1-855649-4 Nov 02 12:09:26.872016 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6e30de72-9581-492c-878e-ddcf3118e443 req-5779c95f-0522-47f4-aaad-eb49f25e1744 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124527 Nov 02 12:09:26.878874 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1953/3933] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:26.913653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:26.915729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:26.969649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.973347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.977364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:26.986313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:26.990544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:26.991424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.184428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:27.200169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:27.203312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:27.206069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d903e87-1f7a-4160-a04b-728a16033073 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.394943 Nov 02 12:09:27.221527 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1981/3934] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:26 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:27.236940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:27.241983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:27.254209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.255348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.256191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.257490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.258581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.259443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.295014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lazy-loading 'flavor' on Instance uuid c4deaca1-0044-4227-ad3e-04f13e6e3e27 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:27.425517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:27.458181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:27.604240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:27.639384 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5b557ae-1723-46c0-a130-ab67515a1271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.743860 Nov 02 12:09:27.651055 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1954/3935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:26 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:27.655232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:27.656389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:27.669092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.669982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.670916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.672094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.672693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.673339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.697641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c04314f-c8b7-4147-8110-1f1e872f8c8e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "POST /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27/action" status: 200 len: 32 microversion: 2.1 time: 0.487635 Nov 02 12:09:27.699840 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1982/3936] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:27 2022] POST /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:09:27.751880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:09:27.762909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:27.767032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:27.779193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:27.800445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.801587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.802570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:27.804249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:27.808012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:27.813176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.099960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:28.293078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:28.305292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16a0173b-8e03-457a-8fa9-38f701e5bed7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 204 len: 0 microversion: 2.1 time: 0.654651 Nov 02 12:09:28.309834 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1955/3937] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:27 2022] DELETE /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:09:28.331831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a61b28c-c9a0-4807-8b33-5b6b1306d857 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1470 microversion: 2.1 time: 0.625318 Nov 02 12:09:28.338270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:28.339838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:28.351471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.351738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1983/3938] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:27 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:28.352966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.353269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.354959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.355602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.356339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.372944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:28.374051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:28.388232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.389415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.393375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.393375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.393375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.394945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.799905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:28.813444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a3802bb-932c-48a9-b2d2-c8c797b94959 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.497114 Nov 02 12:09:28.815326 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1956/3939] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:28 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:28.821144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:28.824864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85127f38-e58f-43ae-afc0-e7a74f7b1d61", "tag": "99c40e87-d0ff-40d5-b939-20bfc69921a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:28.843987 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bca1bf1a-3012-4e41-ab99-253a87804f9f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1316 microversion: 2.1 time: 0.490489 Nov 02 12:09:28.850527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.851868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.852643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.861954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1984/3940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:28.871540 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] Creating event network-changed:99c40e87-d0ff-40d5-b939-20bfc69921a7 for instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 on n-h1-855649-4 Nov 02 12:09:28.873949 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9c19064a-b88e-462b-829e-9e3052d6086c req-51344077-1c76-4682-baac-226bd8448e80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056601 Nov 02 12:09:28.875074 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1957/3941] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:28.886473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:28.886473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:28.889822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.890487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.891624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.892336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:28.892500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.892897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.893345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.895807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:28.911445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.912484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.913399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:28.914935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:28.916177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:28.917064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.217601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.246763 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4b98f2c-4375-4f9f-a0bf-35dc8a8dff8f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1496 microversion: 2.1 time: 0.369921 Nov 02 12:09:29.249286 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1958/3942] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:28 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1496 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:29.259767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:29.260402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:29.267671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.268085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.268440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.269235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.269646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.270187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.422720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.433041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.434487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.436083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c6cbfc8-fbaf-4c6c-a6ac-75b38443ec26 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.562755 Nov 02 12:09:29.436823 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1985/3943] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:28 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:29.442061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:29.443048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:29.461169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.462023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.462698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.463720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.464406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.465040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.565884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.578996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67c0d880-1f56-48bc-81c7-c70fb88096cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.325500 Nov 02 12:09:29.579910 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1959/3944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:29.705274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:29.719403 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37f0df57-f770-484b-945c-e93f6c54acf4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1470 microversion: 2.1 time: 0.281246 Nov 02 12:09:29.720093 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1986/3945] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:29.864308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:29.865407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:29.875459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.876138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.876703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.877554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.878136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.879292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.897149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:29.899138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:29.905963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.906677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.907287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:29.908663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:29.909329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:29.909899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.156845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.176738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.185772 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b505ddef-3f93-4a52-866e-6d283819b516 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.327702 Nov 02 12:09:30.188293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f820805f-9fc2-4a60-95c7-986312589144 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.297210 Nov 02 12:09:30.193071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1987/3946] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:30.199930 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1960/3947] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:29 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:30.299520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:30.300999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:30.329304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.334923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.339170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.340726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.344248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.345306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.484344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:30.491800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:30.523015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.523880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.532036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.534068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.534937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.535772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.730818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.753254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.753254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.753254 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13138077-4e59-4374-9cc1-b92181d6408a tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.276038 Nov 02 12:09:30.753580 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1961/3948] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:30 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:30.758484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-725752643", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:30.804229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:30.818007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13232bc4-8ecf-40cc-9f93-8608b0548f10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1496 microversion: 2.1 time: 0.525265 Nov 02 12:09:30.833667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1988/3949] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:30 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1496 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:30.846546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:30.847644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:30.855802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.856734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.857495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.858737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:30.859508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:30.860291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:30.886893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] validate_networks() for [('30d4505b-c465-4ce4-958f-871528754b05', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:09:31.963722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:31.988897 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6802aef2-638b-45c2-ae07-38793dde65a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 1.136382 Nov 02 12:09:31.988897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1989/3950] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:30 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:31.995406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:31.998269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:32.019724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:32.029034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:32.031984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:32.037412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:32.038649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:32.047897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:32.063512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:32.755435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:32.767542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47f198e9-55e7-4779-9d33-60dda7bfd489 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1536 microversion: 2.1 time: 0.787043 Nov 02 12:09:32.773743 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1990/3951] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:31 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1536 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:32.791089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:32.791951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:32.808993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:32.809426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:32.809878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:32.810608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:32.811098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:32.811538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:33.649723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a557e3a-f624-434c-bb06-9d8d28c3d7d7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.890536 Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1991/3952] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:32 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:33.778026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:33.779528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:09:33.779528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:09:33.779528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:09:33.779528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:09:33.779528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:09:33.786703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:33.793237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:33.797100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:33.805738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:33.837456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:33.837456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:33.866967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:33.884553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Getting quotas for project 8b20d26c9b454b88b0202395055cb18f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:33.898286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Getting quotas for user f8f290b12f9f48b7a9d59cd81df44cbf and project 8b20d26c9b454b88b0202395055cb18f. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:33.933012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:09:33.938880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:09:34.041308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:34.053161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:34.055000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:34.056472 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b6327f1-455f-4e76-9ae5-f1644d351631 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.390261 Nov 02 12:09:34.057666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1992/3953] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:33 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:34.063503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:34.064432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:34.072101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.072903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.073570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.074497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.075362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.076013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.224145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06b417ce-d85d-4c9f-b044-21d85f2f0520 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.469358 Nov 02 12:09:34.231749 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1962/3954] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:09:34.245517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-plugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:34.251574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.252325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.252766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.276538 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] Creating event network-vif-plugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:09:34.296729 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6e594d63-ef32-4818-99e4-4fcc83fd2e83 req-c1e369bc-8f15-4e98-a80f-5ef612ad58e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052208 Nov 02 12:09:34.296729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1963/3955] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:34.296729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:34.296729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:34.311920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.312551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.313216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.319637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.320369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.320944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.609153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:34.626724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a911e1c-7963-4fa7-802e-69557ea1c512 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1454 microversion: 2.1 time: 0.566850 Nov 02 12:09:34.637756 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1993/3956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:34 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1454 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:34.651309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:34.653116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:34.681326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.682324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.683960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.685682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:34.695534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:34.695534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:34.966113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:34.983148 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d211e64-6d99-489c-b564-bf9b6ac44e56 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.693538 Nov 02 12:09:34.986864 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1964/3957] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:34 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:35.005482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd5c2056-0c45-48c7-9ea8-db38a0c30df1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:35.008654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd5c2056-0c45-48c7-9ea8-db38a0c30df1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:35.108018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.117925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9a57b49-0847-4709-b3d5-143c909a018f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1536 microversion: 2.1 time: 0.483344 Nov 02 12:09:35.119026 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1994/3958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:34 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1536 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:35.125659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899aa726-7adf-4032-b6b0-184ce8a40b7f", "name": "network-vif-deleted", "tag": "ad1572db-255a-4a9f-a371-85f18244d227"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:35.152916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.154314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.166749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd5c2056-0c45-48c7-9ea8-db38a0c30df1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.172974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.182026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd5c2056-0c45-48c7-9ea8-db38a0c30df1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1216 microversion: 2.1 time: 0.194069 Nov 02 12:09:35.182711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1965/3959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:34 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:35.203423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:35.203423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:35.204339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.204840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.205546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.227409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.228030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.229726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.242563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] Creating event network-vif-deleted:ad1572db-255a-4a9f-a371-85f18244d227 for instance 899aa726-7adf-4032-b6b0-184ce8a40b7f on n-h2-855649-4 Nov 02 12:09:35.254186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:35.266476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f1751398-92c9-4afb-8b84-f5796cb1d00d req-77629063-30c5-42d1-aa12-abbcd5df6c3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144326 Nov 02 12:09:35.270386 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1995/3960] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:35.284066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:35.300402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:35.323665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.329073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.329909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.331333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.335468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.338637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.632246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.645222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.651214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.652481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7fead5a-5498-4295-ad49-ede332b12308 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.380583 Nov 02 12:09:35.657708 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1996/3961] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:35 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:35.677673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:35.678304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:35.693900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.693900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.693900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.694340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.694855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.695429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.754331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:35.755338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:35.756150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:35.756886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lazy-loading 'fault' on Instance uuid 899aa726-7adf-4032-b6b0-184ce8a40b7f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:35.856246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.864601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:35.880553 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c9eea05-bd43-4a39-88d4-333deb80b5e6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 200 len: 1299 microversion: 2.1 time: 0.220663 Nov 02 12:09:35.882633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1997/3962] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:35 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:35.898753 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4517db77-d055-4599-a55e-71f630d4cc31 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.713732 Nov 02 12:09:35.913639 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1966/3963] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:35 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:36.009603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.010341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:36.025381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.025886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.033685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.040089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.040644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.041097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.146291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.147847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:36.166933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.168368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.169407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.170446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.173366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.174205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.478321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:36.487792 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a77be27-3651-4fa5-986b-b03d3195ac5e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.482574 Nov 02 12:09:36.488753 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1998/3964] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:36.495805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.500043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:36.537975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.540800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.542229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.544229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.548120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.549447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.756682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:36.773650 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da4456e8-ecd2-4b3d-8f7c-6a75c38ad9c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1212 microversion: 2.1 time: 0.282153 Nov 02 12:09:36.775700 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 1999/3965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1212 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:36.789037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:36.794335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85127f38-e58f-43ae-afc0-e7a74f7b1d61", "name": "network-vif-plugged", "status": "completed", "tag": "99c40e87-d0ff-40d5-b939-20bfc69921a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:36.807827 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-695daff6-c8e8-4973-9688-f82ec7c59c6d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1536 microversion: 2.1 time: 0.670045 Nov 02 12:09:36.810393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1967/3966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1536 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:36.824248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.826273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:36.833342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.836016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.836773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.847255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.847768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.848220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.848957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.849420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.849854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.876863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] Creating event network-vif-plugged:99c40e87-d0ff-40d5-b939-20bfc69921a7 for instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 on n-h1-855649-4 Nov 02 12:09:36.886612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b2493cba-856b-4455-a380-c0d472581a62 req-90020cfe-6069-4dfd-b6e3-603e53a88b20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109162 Nov 02 12:09:36.887337 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2000/3967] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:36.923285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:36.924422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:36.962019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.966898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.975249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:36.976762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:36.979448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:36.980262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:37.021297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f HTTP/1.1 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '899aa726-7adf-4032-b6b0-184ce8a40b7f'} Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:37.024383 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:09:37.029350 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:37.035679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:37.037174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc8d93a1-5932-4982-a542-7ef7b4b99f9d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 404 len: 111 microversion: 2.1 time: 0.127634 Nov 02 12:09:37.039779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2001/3968] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:37.046967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:37.048509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:37.056237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:37.057002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:37.057755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:37.058631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:37.059580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:37.060168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:37.144688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:37.207504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:37.225337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:37.229557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f22157e1-07bd-4295-9efa-3a11ba2c4839 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.413952 Nov 02 12:09:37.238958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1968/3969] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:36 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:37.322422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-962218165", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:37.448452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:09:38.468790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:38.491684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8607280f-9bea-4ee2-bc22-140882456742 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 1.451737 Nov 02 12:09:38.540064 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2002/3970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:37 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:38.565898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-unplugged", "status": "completed", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}, {"name": "network-changed", "server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:38.602424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:38.603001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:38.603505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:38.637417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Creating event network-vif-unplugged:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:09:38.638114 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Creating event network-changed:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:09:38.653456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:09:38.678068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ac4486f9-b722-46f4-81df-7666f07828b1 req-b72c4009-dbda-419f-b110-e874e23c46dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.136236 Nov 02 12:09:38.679184 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2003/3971] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:38.685813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:38.694259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:38.710081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:38.712638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:38.713307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:38.714593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:38.717958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:38.718717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.555736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:39.572082 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3d3c641-22eb-4ed0-9be3-8aa602d9073d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1315 microversion: 2.1 time: 0.889614 Nov 02 12:09:39.572822 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2004/3972] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:38 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:39.582002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:39.582605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:39.601092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.601723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.601955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.605769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.608700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.609437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.792467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:39.808052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-227afc74-e258-45e6-8443-a2c1be342622 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1274 microversion: 2.1 time: 0.233932 Nov 02 12:09:39.823495 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2005/3973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:39 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:39.831170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:39.831805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:39.838678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.839021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.839410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.840133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.840592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.841577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.953359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:09:39.954110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:09:39.956391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:09:39.956391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:09:39.956391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:09:39.971720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.972596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.973265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:39.975104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:39.976075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:39.977276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:40.055678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:40.067748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:40.084638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:09:40.087509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:09:40.342030 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-199724bd-c923-4b12-aefe-1aad8a064850 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025997 Nov 02 12:09:40.346230 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1969/3974] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:09:40.353497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:40.357382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:40.384924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:40.385873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:40.385873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:40.386584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:40.387245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:40.393186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:40.819533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:40.833638 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbd515c6-d254-4f3e-80e8-e087c46142a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1536 microversion: 2.1 time: 1.008893 Nov 02 12:09:40.834247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2006/3975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:39 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1536 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:40.874849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:40.875577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:40.896997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:40.897768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:40.898351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:40.899280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:40.899906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:40.900518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:41.014868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:41.029031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:41.035567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:41.039346 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ca0109c-3590-43b0-8782-f8d99bc5f0bc tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.689487 Nov 02 12:09:41.056521 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1970/3976] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:40 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:41.077189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4e8ada1-67e4-4479-9acb-57d4b585c897 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:41.077189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4e8ada1-67e4-4479-9acb-57d4b585c897 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:41.193694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4e8ada1-67e4-4479-9acb-57d4b585c897 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:41.201460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4e8ada1-67e4-4479-9acb-57d4b585c897 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1208 microversion: 2.1 time: 0.139184 Nov 02 12:09:41.205628 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1971/3977] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:41 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1208 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:41.223419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:41.223419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:41.240008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:41.240634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:41.253663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:41.254486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:41.255003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:41.255459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:41.860928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:41.879353 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4b00f61-098f-47e5-a887-6bdf6f2d10dc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.999079 Nov 02 12:09:41.880374 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2007/3978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:40 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:41.897871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:41.898671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:41.918622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:41.921393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:41.923276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:41.927831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:41.928659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:41.931342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.065239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:42.078284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9721e899-88df-4666-87bd-bc3cbdeba933 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1502 microversion: 2.1 time: 0.871233 Nov 02 12:09:42.086965 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1972/3979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:41 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1502 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:42.094883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:42.102662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:42.111854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:42.116962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.118536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.118536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.133014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.139612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.140430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.638606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:42.641243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:42.649646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:42.664419 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d956dc4-f819-48c2-ba0a-f763ee69d443 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1529 microversion: 2.1 time: 0.575918 Nov 02 12:09:42.668795 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1973/3980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:42 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1529 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:42.674119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dcf2b26-3ad4-47bf-bb67-c97f622dcf76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.786519 Nov 02 12:09:42.693164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2008/3981] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:41 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:42.696866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:42.702321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:42.702523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:42.702523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:42.717373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.718509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.719745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.723274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.724226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.726536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.743938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.744472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.744942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.751324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:42.755833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:42.756328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:42.793854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'flavor' on Instance uuid 85127f38-e58f-43ae-afc0-e7a74f7b1d61 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:09:43.050015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:43.079634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:43.088051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:43.090709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35c8d138-d332-4e07-847b-c816e96fdce3 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.416924 Nov 02 12:09:43.095382 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1974/3982] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:42 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:43.113845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:43.114542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:43.131704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.132211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.133865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.136719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.137436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.137906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.290860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:43.304749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df11dc44-435c-422d-9340-afec03c91478 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1260 microversion: 2.1 time: 0.208170 Nov 02 12:09:43.316235 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1975/3983] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:43 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:43.341710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:43.352280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:43.370062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.373225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.373687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.377255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.377990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.378620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.624482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89d5cfd3-87ad-402d-8c8c-2bfed495510c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61/action" status: 202 len: 0 microversion: 2.1 time: 0.928923 Nov 02 12:09:43.628189 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2009/3984] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:42 2022] POST /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:09:43.636398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:43.637895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:43.649338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.650044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.651270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.655968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.655968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.655968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.672735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:43.691285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac3c8eea-b5c8-4c6c-96a8-8a7cda929750 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1529 microversion: 2.1 time: 0.373262 Nov 02 12:09:43.692324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1976/3985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:43 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1529 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:43.698622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:43.705182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:43.728862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.729911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.730564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:43.731706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:43.732369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:43.733241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:44.713502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:44.732360 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24cb47a0-9506-48e8-9cf5-ff492f79a25a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 1.102446 Nov 02 12:09:44.748797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2010/3986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:43 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:44.754730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:44.755621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:44.766169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:44.767012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:44.767657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:44.768552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:44.769176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:44.769772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:44.842565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:44.870919 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c84f401-320c-4dbf-9757-a544b8cfe151 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 1.172772 Nov 02 12:09:44.875432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1977/3987] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:43 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:44.904274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-697a9be8-159d-4658-99a6-8d6ea26b726d tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:44.931452 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-697a9be8-159d-4658-99a6-8d6ea26b726d tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] HTTP exception thrown: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-697a9be8-159d-4658-99a6-8d6ea26b726d tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Request method failure captured: Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/flavors/1ac79b59-4b07-4927-b6e3-749b4905d32d HTTP/1.1 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0FcL1rmnrjgU1IzcQMI1qhbvxpwCVr7T9_WDqJChJpI9nHKNrRVDmI7toqQH8JFzzj69qgMlRhBcPpSYyrg-HE4jTu9CpZ-QV-nVjgIu4Urs4uGwvTqwmHJUaIhQlrnNVLQrkJG32zyfGOEZJWycGFRA9rxE-PfmcGC5mJx7gwDnc Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 099b2a539d384ababf54e39b0c469406 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MigrationsAdminTest-18589353 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/099b2a539d384ababf54e39b0c469406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_099b2a539d384ababf54e39b0c469406", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/099b2a539d384ababf54e39b0c469406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/099b2a539d384ababf54e39b0c469406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MigrationsAdminTest-18589353 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 099b2a539d384ababf54e39b0c469406 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MigrationsAdminTest-18589353 Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MigrationsAdminTest-18589353-project-admin Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 541ab607babc497eb4c129b0a9ce309b Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MigrationsAdminTest-18589353-project-admin Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1ac79b59-4b07-4927-b6e3-749b4905d32d'} Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:44.949659 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. Nov 02 12:09:44.953905 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:09:44.955556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-697a9be8-159d-4658-99a6-8d6ea26b726d tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Returning 404 to user: Flavor 1ac79b59-4b07-4927-b6e3-749b4905d32d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:44.986621 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-697a9be8-159d-4658-99a6-8d6ea26b726d tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1ac79b59-4b07-4927-b6e3-749b4905d32d" status: 404 len: 109 microversion: 2.1 time: 0.076419 Nov 02 12:09:44.995866 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1978/3988] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:44 2022] DELETE /compute/v2.1/flavors/1ac79b59-4b07-4927-b6e3-749b4905d32d => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:09:45.004573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:45.005227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:45.023908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.024431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.024881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.026081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.026081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.026509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.330815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:45.348065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:45.351549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '697b00bb715f446f98a3e11f7617e001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbd89dc180e42ca9337a58e9348efc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:45.353330 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6983f5bd-fa3a-4b95-80bb-800fde7f71c1 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 200 len: 1604 microversion: 2.32 time: 0.356220 Nov 02 12:09:45.354540 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1979/3989] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:44 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 1604 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:09:45.366970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:45.367976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:45.385810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.386582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.387387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.391343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.391343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.391343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.472172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:45.481999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a45e31fe-3d92-4ff3-a650-8c3369b0dcc9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.731701 Nov 02 12:09:45.482766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2011/3990] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:44 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:45.489883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-plugged", "status": "completed", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:45.500662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.501468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.502065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.516871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] Creating event network-vif-plugged:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:09:45.525506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:45.527883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f3365bfc-dfce-49eb-b06a-7d49edb043bc req-e5cd7317-cf45-497f-92e3-634d7003ba80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Nov 02 12:09:45.528852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2012/3991] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:45.535435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e3a9c5d-ce8b-425b-b93b-d366c0413eb3 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1266 microversion: 2.1 time: 0.179332 Nov 02 12:09:45.536285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1980/3992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:45 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:45.551181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-995128877", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:45.619082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:09:45.668056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d0b55c-9f35-4afd-ba10-58445d7403c2", "tag": "a43d9868-505f-48cd-81ea-ef66c30430a2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:45.702554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.703342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.706114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.733399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] Creating event network-changed:a43d9868-505f-48cd-81ea-ef66c30430a2 for instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 on n-h2-855649-4 Nov 02 12:09:45.763546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a847749e-7845-482c-9b46-34c866d7ea9c req-16416398-5e16-48d7-bc4b-15c05c26d89c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106579 Nov 02 12:09:45.767604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1981/3993] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:45.777524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:45.777524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:45.795718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.796246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.796692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:45.797429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:45.800453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:45.800453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.185113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:09:46.186673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:09:46.187518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:09:46.189515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:09:46.190273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:09:46.205733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.206533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.207320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.208702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.209477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.209918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.278026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:09:46.305478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Getting quotas for user dcc5d089a97c4aac8ea9a1920e2f64e6 and project b682b29c6b1e4ec5ba8150751c940ff7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:09:46.305709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:46.318175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8347fe0a-4624-4d60-bbf3-92cddcb45687 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.549108 Nov 02 12:09:46.319522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1982/3994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:45 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:46.327484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:46.328376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:46.338641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.339934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.340878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.341985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.342926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.343597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.371391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:09:46.383238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:09:46.613441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21afb82f-3cbc-4148-9d4f-348a25e5b938 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083174 Nov 02 12:09:46.626997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2013/3995] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:09:46.644740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:46.648298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:46.673013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.675163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.675791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.676840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.677464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.678081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.753710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] HTTP exception thrown: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Request method failure captured: Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f HTTP/1.1 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwBTSp-pkI7NY5FQlJH3gIFsEu-vxV21wzvsx2HzwKNrH7T2koOq7w6lDgeDkV85_YvEnXH3CGaCtgBmFgw35z_MFFD6kCDP8CJPBAltdFsOXYzn0hMULKzSvF160AnF23u497su6Uxiy-zx0V0gj2EDKclE5U5_w2xFjB_qDLhPUE Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1cbd89dc180e42ca9337a58e9348efc5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 697b00bb715f446f98a3e11f7617e001 Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '49fd3a62-65bc-4836-b56d-d7900ad7b34f'} Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:46.760627 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:46.764834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Returning 404 to user: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:46.766418 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c657e59-c413-4b00-8f86-bad81ae35d5d tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 404 len: 111 microversion: 2.32 time: 0.134055 Nov 02 12:09:46.768160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2014/3996] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:46 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:09:46.776016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:46.784298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:46.785420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:46.786124 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26a57b33-b6e7-4d41-9536-e04dc35d88ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.463543 Nov 02 12:09:46.795758 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1983/3997] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:46 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:46.811739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:46.812843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:46.820879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.822581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.823353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.823594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.824166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.824577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.825113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.825363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.825992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:46.831226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:46.831910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:46.833752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.006323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:47.057781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-647ea972-4d56-40a6-b951-4c00a6683380 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1266 microversion: 2.1 time: 0.260430 Nov 02 12:09:47.073403 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1984/3998] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:46 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:47.116917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94f4202e-018c-44db-b294-064ba6659ff4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:47.118928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94f4202e-018c-44db-b294-064ba6659ff4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:47.203518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94f4202e-018c-44db-b294-064ba6659ff4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:47.210589 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94f4202e-018c-44db-b294-064ba6659ff4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1212 microversion: 2.1 time: 0.150419 Nov 02 12:09:47.211209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1985/3999] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:47 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:47.222645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-062f43fa-4b62-44f3-8343-6ed3df2528b9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '.version_select at 0x7ff1b3335c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:47.232311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:47.241300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-040fd823-d619-41a4-9bf7-bd691dc596ce tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.472050 Nov 02 12:09:47.241895 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2015/4000] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:46 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:47.355018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:47.355806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:47.363957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.364744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.365328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.366378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.367068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.367912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.508588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:47.516591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06535e77-faf9-48ac-965e-f615857418bc tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.166221 Nov 02 12:09:47.517660 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2016/4001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:47 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:47.580051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-062f43fa-4b62-44f3-8343-6ed3df2528b9 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-199933078" status: 204 len: 0 microversion: 2.32 time: 0.367092 Nov 02 12:09:47.585993 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1986/4002] 10.222.0.48 () {60 vars in 1259 bytes} [Wed Nov 2 12:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-199933078 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:09:47.822694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:47.823612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:47.834664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.835448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.836025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:47.836901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:47.838284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:47.843755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.084208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:48.085171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:48.099457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.100285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.103992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.103992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.103992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.103992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.155431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:48.189752 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1796ac30-335b-4996-ada5-97c25077ba9b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.367857 Nov 02 12:09:48.199990 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2017/4003] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:47 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:48.249610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c34f9e1c-15ec-409e-8e1f-af4c740a3ef5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:48.253415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c34f9e1c-15ec-409e-8e1f-af4c740a3ef5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:48.387923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c34f9e1c-15ec-409e-8e1f-af4c740a3ef5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:48.397044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c34f9e1c-15ec-409e-8e1f-af4c740a3ef5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1212 microversion: 2.1 time: 0.159043 Nov 02 12:09:48.416140 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2018/4004] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:48 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1212 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:48.422176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:48.424192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:48.435193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.436151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.437257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.438710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.440090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.440734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.457512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:48.473632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-684a1329-c1ad-4719-ba12-9671d7af8dc8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.395607 Nov 02 12:09:48.477316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1987/4005] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:48 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:48.542672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:48.543699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:48.557853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.560160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.560822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.561766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:48.562237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:48.562679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:48.587046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:48.760323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:48.786273 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02d6367c-a73d-45cb-bb1c-70f7d3a02c23 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.365718 Nov 02 12:09:48.787799 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2019/4006] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:48 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:48.811528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:48.821993 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-924e96a6-1d17-4148-9616-749f51c8c313 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.282993 Nov 02 12:09:48.827490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1988/4007] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:48 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:49.240010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.241347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.251415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.253051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.254911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.256028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.257872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.258951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.434543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.435501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.445076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.451731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.452402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.453308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.453911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.454572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.479435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:49.490524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f476deb8-4c83-48bf-9632-fbab148cbfee tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.260216 Nov 02 12:09:49.503824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2020/4008] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:49.519852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.523750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.541650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.543290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.544390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.546218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.547656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.548391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.616707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:49.632179 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b0c3f86-c6b7-43dd-8f25-c5fd1055b988 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1216 microversion: 2.1 time: 0.201484 Nov 02 12:09:49.632803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1989/4009] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:49.781907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:49.800036 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf76cebe-c3d1-4a95-8120-199230718530 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.294172 Nov 02 12:09:49.802061 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2021/4010] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:49.810669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.811435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.827449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.827977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.828374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.829096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.829878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.830504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.848324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:49.849455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:49.871944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.871944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.871944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:49.874365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:49.876112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:49.879771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:50.028579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:50.953340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:50.979954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e79727a1-c451-44d7-9a29-985e491cf61a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 1.136888 Nov 02 12:09:50.991414 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2022/4011] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:50.996950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:50.997832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:51.009098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.010152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.015578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.016668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.018178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.019324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.116762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:51.140637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b578232-ca01-40a2-add8-4ccd44e6e9bd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 1.328444 Nov 02 12:09:51.158536 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1990/4012] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:49 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:51.172806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:51.174616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:51.210034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.211161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.212860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.214963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.215836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.217253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.442699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:51.457828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-760a7bf4-7975-437e-905f-60e895a8f725 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1264 microversion: 2.1 time: 0.288706 Nov 02 12:09:51.472213 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1991/4013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:51 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:51.475915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:51.476861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:51.488148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.493755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.494782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.502394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:51.502394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:51.503623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:51.720926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:51.736593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84ebb33a-c214-4be6-9c15-72d48b026585 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.743010 Nov 02 12:09:51.739247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2023/4014] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:50 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:52.008479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:52.010834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:52.014598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:52.040763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:52.043979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:52.044760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:52.048635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:52.048635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:52.048635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:52.248480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:52.275262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbc25803-9d85-4498-9a39-b218b1995ea6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.810308 Nov 02 12:09:52.291241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1992/4015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:51 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:52.306468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:52.306468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:52.315617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:52.318511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:52.320763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:52.325660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:52.328878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:52.331702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:52.804130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:52.820796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1256e5b2-35ba-4299-87d6-aa5eb0a74d6d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.534503 Nov 02 12:09:52.825495 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1993/4016] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:52 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:52.841592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0b55c-9f35-4afd-ba10-58445d7403c2", "name": "network-vif-plugged", "status": "completed", "tag": "a43d9868-505f-48cd-81ea-ef66c30430a2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:52.915092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:52.924242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:52.924707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:52.949902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:52.961488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da80e767-48c8-4529-ba7e-5618a1474981 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.957093 Nov 02 12:09:52.971839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2024/4017] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:52 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:52.983629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:52.995279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:53.011308 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] Creating event network-vif-plugged:a43d9868-505f-48cd-81ea-ef66c30430a2 for instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 on n-h2-855649-4 Nov 02 12:09:53.023497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.025860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.031212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.036225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.040931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.041653 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-28b2c5c6-cbe9-42c6-a35b-47d899831ae6 req-9212a6b0-7a7f-43d9-b57a-5b393a153eb9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211679 Nov 02 12:09:53.044505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.047015 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1994/4018] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:53.088097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:53.090304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:53.117323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.117857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.118484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.119447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.120224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.120837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.397651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:53.447777 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78d7d747-9f12-4a60-90c3-07667ec9ff22 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1270 microversion: 2.1 time: 0.474550 Nov 02 12:09:53.449879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2025/4019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:52 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1270 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:53.462664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:53.465407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:53.500293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.505749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.507715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.509718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.514957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.517777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.551906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:53.804161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:53.816385 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8417ed11-b57e-469a-b56e-5498fb8092a1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.764495 Nov 02 12:09:53.836000 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1995/4020] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:53 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:53.856324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:53.857271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:53.865611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.866315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.867063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.868086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:53.868740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:53.869437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:53.915940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:53.924048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bca47df-000a-4dbd-8416-e298896fad5b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.472119 Nov 02 12:09:53.924671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2026/4021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:53 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:53.999514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:54.001024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:54.018027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.019650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.024167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:54.030010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:54.030010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:54.030010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.704180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:55.715911 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22f4d959-01d0-4dc8-a9c2-98485933a790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 1.863579 Nov 02 12:09:55.742831 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1996/4022] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:53 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:55.753317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bc5d5c-374f-41c3-b062-22c514b5b861", "tag": "8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:55.780271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:55.784118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:55.784773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.814658 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] Creating event network-changed:8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd for instance e9bc5d5c-374f-41c3-b062-22c514b5b861 on n-h2-855649-4 Nov 02 12:09:55.828717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c7648fed-6538-43ec-a5af-ba012c61eacf req-3276e207-e7b0-4e38-b164-a5ed1478eaa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079694 Nov 02 12:09:55.830475 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1997/4023] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:09:55.852938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:55.858479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:55.875888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:55.876931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:55.879815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.880755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:55.881375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:55.882640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.936935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:55.951050 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c469105a-4bcd-406b-a2fd-8c544bdf39c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 1.960787 Nov 02 12:09:55.956229 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2027/4024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:53 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:55.968100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:55.969202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:55.986369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:55.987169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:55.987768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:55.989040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:55.992014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:55.992661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.242688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:56.274207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:56.290083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:56.301925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-350a087c-a74c-4734-b27c-7976d00ea99b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.469909 Nov 02 12:09:56.317989 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72672295-f611-4ae6-84cc-0928bfb7ebb9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.349758 Nov 02 12:09:56.320634 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1998/4025] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:55 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:56.324703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2028/4026] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:55 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:56.326574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.327399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.336391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.336907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.337354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.338151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.338558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.339057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.477589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.477589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.494091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.499680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.502067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.503121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.506222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.506971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.536724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] HTTP exception thrown: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Request method failure captured: Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f HTTP/1.1 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwBTSp-pkI7NY5FQlJH3gIFsEu-vxV21wzvsx2HzwKNrH7T2koOq7w6lDgeDkV85_YvEnXH3CGaCtgBmFgw35z_MFFD6kCDP8CJPBAltdFsOXYzn0hMULKzSvF160AnF23u497su6Uxiy-zx0V0gj2EDKclE5U5_w2xFjB_qDLhPUE Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1cbd89dc180e42ca9337a58e9348efc5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 697b00bb715f446f98a3e11f7617e001 Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '49fd3a62-65bc-4836-b56d-d7900ad7b34f'} Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:56.552086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Returning 404 to user: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77853c37-7653-4a1d-ac95-95015a2bf502 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 404 len: 111 microversion: 2.32 time: 0.081666 Nov 02 12:09:56.558945 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2029/4027] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:09:56 2022] DELETE /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:09:56.567156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.567983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] [instance: 49fd3a62-65bc-4836-b56d-d7900ad7b34f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.576495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.588913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.588913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.588913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.588913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.588913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.597848 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] HTTP exception thrown: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Request method failure captured: Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f HTTP/1.1 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYlwBTSp-pkI7NY5FQlJH3gIFsEu-vxV21wzvsx2HzwKNrH7T2koOq7w6lDgeDkV85_YvEnXH3CGaCtgBmFgw35z_MFFD6kCDP8CJPBAltdFsOXYzn0hMULKzSvF160AnF23u497su6Uxiy-zx0V0gj2EDKclE5U5_w2xFjB_qDLhPUE Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1cbd89dc180e42ca9337a58e9348efc5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1cbd89dc180e42ca9337a58e9348efc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 1cbd89dc180e42ca9337a58e9348efc5 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1545753599 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 697b00bb715f446f98a3e11f7617e001 Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest-1545753599-project Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '49fd3a62-65bc-4836-b56d-d7900ad7b34f'} Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.599453 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. Nov 02 12:09:56.602963 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:09:56.604271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] Returning 404 to user: Instance 49fd3a62-65bc-4836-b56d-d7900ad7b34f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:09:56.605090 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9544ef59-3670-48af-b5a3-ec6eda791f91 tempest-TaggedBootDevicesTest-1545753599 tempest-TaggedBootDevicesTest-1545753599-project] 10.222.0.48 "GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f" status: 404 len: 111 microversion: 2.32 time: 0.043465 Nov 02 12:09:56.605749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2030/4028] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:09:56 2022] GET /compute/v2.1/servers/49fd3a62-65bc-4836-b56d-d7900ad7b34f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:09:56.607263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:56.625991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2275a183-3840-42fa-aa81-210e478bcb14 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.303187 Nov 02 12:09:56.627223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 1999/4029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:56 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:56.745788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.746472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.754164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.754919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.755785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.756790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.757644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.758375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.814672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:56.835068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.835556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.836001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.853462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] Creating event network-changed:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:09:56.858542 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0e3d6836-82c5-44a4-abf5-f4224bc7e0c1 req-a31fec2a-4cca-4215-af3f-d9d8367201cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047920 Nov 02 12:09:56.862575 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2000/4030] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:09:56.984495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:56.985441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:56.994472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.995158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.996721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:56.996721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:56.997284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:56.997789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.033563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.041960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d23d299-c49f-4de4-866a-20a9df1e6e85 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1316 microversion: 2.1 time: 0.299952 Nov 02 12:09:57.052230 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2031/4031] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:56 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:57.207700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:57.214267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.223084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec69bc91-554d-4eac-b8bb-cfa43b73a1e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.243771 Nov 02 12:09:57.223680 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2001/4032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:56 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:57.327070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:57.327988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:57.335733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:57.336438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:57.339435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.339931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.340372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.341136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.342681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.343359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.348611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.349191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.349648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.350467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.350935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.351427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.615196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.621541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.624962 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72f5a673-37d9-4750-9c04-172f173389cd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.295806 Nov 02 12:09:57.627474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2002/4033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:57 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:57.649911 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f334202d-f6b2-4b44-b81c-57050d0df897 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.326988 Nov 02 12:09:57.651134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2032/4034] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:57 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:57.655870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:57.656503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:57.665015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.666225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.667005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.667981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.669970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.672288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.730207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:57.730905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:57.738566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.739403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.740139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.741021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:57.742101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:57.758949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:57.902001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.920845 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30cc3690-5e00-446d-bbc0-f583c8b4f6d8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.265850 Nov 02 12:09:57.931205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2003/4035] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:57 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:57.968638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:57.978298 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bdc0dd0-a571-41da-b029-c7cb8eb71111 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.253697 Nov 02 12:09:57.979247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2033/4036] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:57 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:58.004884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-508184335"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:09:58.007579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.014622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.015248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.015700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.016813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.023329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.023329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.067788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.069773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.078958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.080760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.081409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.082471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.083299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.083946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.281229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:58.290800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbb6c6fd-7b9a-4a23-a5f8-d7b0ea4d9d27 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1505 microversion: 2.1 time: 0.229002 Nov 02 12:09:58.300695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2034/4037] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:58.300695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.300695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.312768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.396830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:58.473048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:58.483332 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a787acc-ca6b-47c9-8fa6-63aff75aaab8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.190478 Nov 02 12:09:58.484042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2035/4038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:58.504125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.504655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.511268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.511803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.512308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.512970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.513435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.513869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.541994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:09:58.576925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75a1d08c-2cca-4e5b-aa4c-a7a43fd20480 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.576503 Nov 02 12:09:58.578955 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2004/4039] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:09:57 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Nov 02 12:09:58.655159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.656140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.663397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.663993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.664503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.665287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.665878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.666463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.843954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:58.847230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:09:58.855987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96e0d7c0-2062-423f-bb08-234f15957de5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.205812 Nov 02 12:09:58.857300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2005/4040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:09:58.863466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.865260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.872926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.873670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.874339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.875799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.877036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.877633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.917291 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01d59dee-da52-419d-8013-f5be579c19d8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 204 len: 0 microversion: 2.1 time: 0.431143 Nov 02 12:09:58.918093 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2036/4041] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:09:58 2022] DELETE /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:09:58.927777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:58.928877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:58.943371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.944293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.945650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:58.946741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:58.947587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:58.948279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.124519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:59.137588 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d9a79da-ccee-4a66-aa0c-b760476f466a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.278731 Nov 02 12:09:59.138530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2006/4042] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:59.145320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:59.146105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:59.155167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.155761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.156381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.158385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.159027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.159974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.172658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:59.181315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2bd514d0-98ea-47c3-9126-b85814971589 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1511 microversion: 2.1 time: 0.258966 Nov 02 12:09:59.191709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2037/4043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:58 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:59.323977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:59.336111 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67d994c4-06e5-4f4d-bd20-2a9c6c1f4c1b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.196457 Nov 02 12:09:59.336923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2007/4044] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:59 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:59.509524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:59.510031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:59.517292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.517738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.518228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.518937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.519414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.519846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.846886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:09:59.859905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff46331d-92b8-4f30-a701-59674f1f6e5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1504 microversion: 2.1 time: 0.355129 Nov 02 12:09:59.861992 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2038/4045] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:59 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:09:59.886477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:09:59.887521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:09:59.895539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.899232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.899994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:09:59.901160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:09:59.901845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:09:59.902479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.083341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:00.092372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-596d1608-c1aa-4c1b-9972-d9cdb8b7f26c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.210701 Nov 02 12:10:00.093193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2008/4046] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:09:59 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:00.174450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:00.175292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:00.196088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.200455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.202276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.203765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.205253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.209276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.210313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:00.211086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:00.218185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.218938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.219512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.220950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.226328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.226328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.505854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:00.508271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:00.519444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-337e2acd-7551-481d-9f0a-69dd31d3b15f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1511 microversion: 2.1 time: 0.315942 Nov 02 12:10:00.522312 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ac72da2-ee7c-4a88-89b1-a41b81ebb601 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.358047 Nov 02 12:10:00.524097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2039/4047] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:00 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:00.529748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:00.530656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:00.540032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.540989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.541905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.543181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.543823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.544576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.547718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2009/4048] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:00 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:00.807581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:00.817544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6632f167-f088-45d4-b907-16faffb9ddbf tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.292146 Nov 02 12:10:00.823145 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2040/4049] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:00 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:00.903155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:00.906016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:00.933400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.936027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.936668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:00.938635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:00.939847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:00.940803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.120312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:01.120946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:01.137714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.138506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.140227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.141006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.141477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.141950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.474428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:01.490877 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0571f786-b5fd-4324-a1cf-706d02f2728a tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1484 microversion: 2.1 time: 0.603529 Nov 02 12:10:01.513193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2010/4050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:00 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1484 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:01.540140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-unplugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:01.568850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.569339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.569777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.606090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] Creating event network-vif-unplugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:10:01.628310 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e725d250-5a09-4e73-af19-16c8fc7c869e req-f4423b18-4ead-4a03-ab6b-ad45f6a28b14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095703 Nov 02 12:10:01.630406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2011/4051] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:01.657009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:01.658515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:01.682473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:01.691880 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b0f959c-ed1d-4cc4-9397-b9454251de49 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.577933 Nov 02 12:10:01.695411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2041/4052] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:01 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:01.697983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.698558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.704758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.705668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.706163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.706750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.711172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:01.711793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:01.770721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.771260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.771703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:01.776793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:01.777539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:01.780132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:02.561227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:02.564501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:02.577372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7bd9d571-3ee0-4364-893d-89b283283268 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.876729 Nov 02 12:10:02.578871 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2042/4053] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:01 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:02.590721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-93163122", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:02.631488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:02.640517 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f93a810-003c-4f9d-ac69-7b860ba1c0e6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1511 microversion: 2.1 time: 1.006463 Nov 02 12:10:02.659746 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2012/4054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:01 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1511 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:02.677978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:02.680524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:02.698454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:02.701787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:02.702474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:02.703425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:02.705614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:02.706271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:02.774362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] validate_networks() for [('1bdaa6a3-a90c-44a4-bb1c-08bcc26b3434', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:10:03.415387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:03.429000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e638e6e-e95b-4a81-b680-ee99294359eb tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.766657 Nov 02 12:10:03.430254 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2013/4055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:02 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:03.436881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:03.438577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:03.450931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:03.452375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:03.462412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:03.463434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:03.463944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:03.464508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:03.839073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:03.861500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ec7f819-ff53-45e2-b014-830b2e6fad6a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.428611 Nov 02 12:10:03.862866 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2014/4056] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:03 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:03.902800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:03.908228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:03.923953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:03.924677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:03.931214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:03.931214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:03.931214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:03.931214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.093741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:10:04.094316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:10:04.094627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:10:04.095456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:10:04.096057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:10:04.116068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.117423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.118563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.120326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.121522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.122505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.164812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Getting quotas for project b94fe0c880364fc08c529278a30b2079. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:10:04.167243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:04.173680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Getting quotas for user 51600b50f5594d4b8ae305d518a6ae1d and project b94fe0c880364fc08c529278a30b2079. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:10:04.178328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9e619e6-ff46-4650-b270-af71903225a3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.281348 Nov 02 12:10:04.179384 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2015/4057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:03 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:04.186667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:04.187627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:04.195791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.196617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.197070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.197815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.209230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.209230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.210260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:10:04.210260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:10:04.342635 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdd04a3c-4d59-4139-baf6-23af392a893d tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.763302 Nov 02 12:10:04.345581 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2043/4058] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:10:04.363867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bc5d5c-374f-41c3-b062-22c514b5b861", "name": "network-vif-plugged", "status": "completed", "tag": "8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd"}, {"server_uuid": "63d0b55c-9f35-4afd-ba10-58445d7403c2", "name": "network-vif-unplugged", "status": "completed", "tag": "a43d9868-505f-48cd-81ea-ef66c30430a2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:04.363983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:04.374301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.375087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.375497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b9e1776-94aa-4251-9d91-a9e61ab5ed53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1469 microversion: 2.1 time: 0.195226 Nov 02 12:10:04.375839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.393401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2016/4059] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:04 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:04.399373 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Creating event network-vif-plugged:8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd for instance e9bc5d5c-374f-41c3-b062-22c514b5b861 on n-h2-855649-4 Nov 02 12:10:04.404714 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] Creating event network-vif-unplugged:a43d9868-505f-48cd-81ea-ef66c30430a2 for instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 on n-h2-855649-4 Nov 02 12:10:04.419597 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-64d99833-c68e-43dc-813d-1ad3d2a0bee6 req-bf874ebe-3500-4e62-b7ab-8827f19c6c20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.072229 Nov 02 12:10:04.421185 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2044/4060] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:04.424159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0b55c-9f35-4afd-ba10-58445d7403c2", "name": "network-vif-deleted", "tag": "a43d9868-505f-48cd-81ea-ef66c30430a2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:04.431197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1cc4aa2-2b75-4c52-8ee9-21622ba22847 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:04.432637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1cc4aa2-2b75-4c52-8ee9-21622ba22847 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:04.440530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.441010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.441445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.459640 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] Creating event network-vif-deleted:a43d9868-505f-48cd-81ea-ef66c30430a2 for instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 on n-h2-855649-4 Nov 02 12:10:04.466874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e785bf00-3a03-4d9b-903a-c615aaf1e0a3 req-820efa19-bd51-478a-b4d8-a7df99cf0fab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071892 Nov 02 12:10:04.468242 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2017/4061] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:04.476542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:04.478961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:04.486548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.487294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.487880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.489096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.489568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.490104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.529695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1cc4aa2-2b75-4c52-8ee9-21622ba22847 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:04.538340 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1cc4aa2-2b75-4c52-8ee9-21622ba22847 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1212 microversion: 2.1 time: 0.115956 Nov 02 12:10:04.539461 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2045/4062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:04 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:04.850775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:04.865190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cee21ce-0fe4-4ed6-98f6-428a2fea8b23 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.392208 Nov 02 12:10:04.879795 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2018/4063] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:04 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:04.906336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:04.908071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:04.940721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.942041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.943874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:04.947883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:04.949299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:04.950322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.204908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:05.205687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:05.224528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.225144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.225698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.226533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.227234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.228338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.700616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:05.726609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4d78215-21f2-47a9-b30d-c557ee23dfa1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.527086 Nov 02 12:10:05.728273 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2019/4064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:05 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:05.733097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:05.737030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:05.760969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.760969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.760969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.760969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.761256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:05.761695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.761695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.767998 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cec99296-4efa-4ccf-b293-ab3f9eb2f833 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.881000 Nov 02 12:10:05.768765 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2046/4065] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:04 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:05.777935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cae92db3-8806-4262-ade2-8543e23e14f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:05.779154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cae92db3-8806-4262-ade2-8543e23e14f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:05.849429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:05.852230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.853553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.854230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.871913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'fault' on Instance uuid 63d0b55c-9f35-4afd-ba10-58445d7403c2 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:10:05.918393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cae92db3-8806-4262-ade2-8543e23e14f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:05.926637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cae92db3-8806-4262-ade2-8543e23e14f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1212 microversion: 2.1 time: 0.156552 Nov 02 12:10:05.930289 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2047/4066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:05 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1212 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:05.945648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:05.946888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:05.991455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.995825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.996538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:05.997482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:05.998136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:05.998787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:06.057631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:06.076432 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-073d23ce-cd37-48a9-afad-875419962bd7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 200 len: 1306 microversion: 2.1 time: 0.346910 Nov 02 12:10:06.077044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2020/4067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:05 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 1306 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:06.280011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:06.297192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-930ab018-dd61-4339-93a8-636da2232402 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1308 microversion: 2.1 time: 0.362354 Nov 02 12:10:06.299738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2048/4068] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:05 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:06.484238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-plugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:06.528237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:06.536108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:06.536108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:06.572232 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] Creating event network-vif-plugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:10:06.600883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d08c84af-0d04-4fe8-b7bf-dc9ddae1676d req-684bc8ba-8299-4042-8212-91da62190ae4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120296 Nov 02 12:10:06.601512 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2021/4069] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:10:06.760324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:06.761232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:06.778786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:06.779404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:06.783577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:06.784792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:06.787246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:06.787925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:06.797570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:06.800653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:06.816965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:06.822898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:06.827212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:06.833573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:06.834402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:06.839563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.182602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:07.191334 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acf316e1-a793-4315-96a9-03f14a085c5d tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.435455 Nov 02 12:10:07.209262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:07.218289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8daa9eb-4fe5-4dc0-bbec-4bfd4357f5ac tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.425274 Nov 02 12:10:07.220457 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2049/4071] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:06 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:07.222040 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2022/4071] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:06 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:07.247091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:07.247744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:07.250358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:07.251051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:07.264344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.264936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.265214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.265944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.266409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.268799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.274586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.274586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.274586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.274586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.274586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.275563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.303709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 HTTP/1.1 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '63d0b55c-9f35-4afd-ba10-58445d7403c2'} Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:07.309093 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:07.312884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1dcffbba-40c0-4368-8ec4-b60e4758a5d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 404 len: 111 microversion: 2.1 time: 0.088248 Nov 02 12:10:07.319341 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2023/4072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:07 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:10:07.324684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:07.325315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:07.365146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.365655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.366108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.366865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.367347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.367783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.400797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:07.410033 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ac7152d-90bb-4136-bf6c-b078cded060f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1264 microversion: 2.1 time: 0.188400 Nov 02 12:10:07.410662 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2050/4073] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:07 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:07.432417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:07.436709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:07.451675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.452445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.455545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.456505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.459129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.459839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.717602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:07.720196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:07.729709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c1e6ce9-b6a1-4454-a7ea-095195bfa4a1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.409186 Nov 02 12:10:07.742544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2024/4074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:07 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:07.894089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:07.905576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0cb3162-0103-41e8-bdc4-129fbb4d9ca0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1489 microversion: 2.1 time: 0.476949 Nov 02 12:10:07.906177 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2051/4075] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:07 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1489 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:07.933216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:07.935974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:07.952280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.952788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.953240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:07.953982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:07.954485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:07.954918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.054121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3fbd05c-176a-46e8-b614-2a9e79f055c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3fbd05c-176a-46e8-b614-2a9e79f055c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 163 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": 12345, "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 12345 Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:10:08.058547 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 12:10:08.061965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:08.064569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3fbd05c-176a-46e8-b614-2a9e79f055c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:08.065747 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3fbd05c-176a-46e8-b614-2a9e79f055c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015626 Nov 02 12:10:08.066727 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2052/4076] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:08 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:10:08.081216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:08.082553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:08.091368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.092604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.093362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.094381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.095943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.096655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.212830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1b29e70-b752-4390-bc6c-81b4bea1890d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "PUT /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1084 microversion: 2.1 time: 0.283905 Nov 02 12:10:08.214497 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2025/4077] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:10:07 2022] PUT /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1084 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:08.236128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:08.238461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:08.260877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.262836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.266410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.268369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.271390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.276708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.435923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:08.457517 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce3f30ce-c7d6-4fa6-b930-90cf01af902b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.378752 Nov 02 12:10:08.459938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2053/4078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:08 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:08.487544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:08.495066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:08.507947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.512260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.513235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:08.514232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:08.516460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:08.517374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a49df51b-2452-437c-95c3-bc34aed62515 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1510 microversion: 2.1 time: 1.135389 Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2026/4079] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:08 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1510 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.412632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.494849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:09.507263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cee82ace-c162-4303-ac4b-b4f5164ebd8f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 1.043542 Nov 02 12:10:09.524893 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2054/4080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:08 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:09.536280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.540953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:09.550261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.553162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.554089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.555121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.559765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.560660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.720746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:09.739652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43513edd-9596-42fb-96f2-bd74663530f2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1270 microversion: 2.1 time: 0.213467 Nov 02 12:10:09.745662 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2055/4081] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:09.751986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.761453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:09.770430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.772839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.772839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.772839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.773714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.774399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.788921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:09.806306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ceee7cf-f566-4881-8b9d-e585a951fe9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.432174 Nov 02 12:10:09.816711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2027/4082] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:09.838839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-plugged", "status": "completed", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:09.850665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.851477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.852137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.865709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] Creating event network-vif-plugged:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:10:09.873345 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-caad9a70-261e-46fb-bfd6-9f418ec31b53 req-c94c5c5a-4591-4bba-be68-3ed40531e671 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041706 Nov 02 12:10:09.875247 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2028/4083] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:09.884494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:09.885616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:09.895208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.896576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.897563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:09.898552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:09.899264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:09.900184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.361182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:10.391234 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4e9773b7-2929-44e1-93da-b7bdba084933 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.633265 Nov 02 12:10:10.391234 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2056/4084] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:10.391508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:10.404008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef4368ec-53fd-4168-a24a-488e573d4189 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1510 microversion: 2.1 time: 0.526850 Nov 02 12:10:10.405385 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2029/4085] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:09 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1510 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:10.431983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:10.432845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:10.444587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.446577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.447651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.450581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.451168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.451611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.536278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:10.537201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:10.544649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.549321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:10:10.553219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.553219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.553219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.553219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.553558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.941385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:10.953453 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6955576f-3567-4ff4-b724-4cb45a953fe7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.425071 Nov 02 12:10:10.971739 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2030/4086] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:10 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:10.978503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:10.981211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:10.986230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.986962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.987702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:10.988573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:10.989174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:10.989745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.054417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5aea6396-b59a-4658-bfac-b55999922126 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 204 len: 0 microversion: 2.1 time: 0.626402 Nov 02 12:10:11.057039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2057/4087] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:10:10 2022] DELETE /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:10:11.068190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.070737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:11.081260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.082093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.082767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.084020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.084772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.085700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.594963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:11.605119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29259ac9-d9fc-4d6a-94f7-2db39f3f8f07 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.630584 Nov 02 12:10:11.606844 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2031/4088] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:10 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:11.617397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.624317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:11.638680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.639547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.640820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.643657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.645745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.649985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.662178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:11.687106 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0896900e-b9ff-4a63-be8d-e4e731ac389f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.621118 Nov 02 12:10:11.687106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2058/4089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:11.937244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:11.952987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ef5b7b7-7933-41ba-995d-40cb9bf8c7ff tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1516 microversion: 2.1 time: 0.344872 Nov 02 12:10:11.954114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2032/4090] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:11.977994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:11.979074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:11.987321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.988012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.988457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:11.989377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:11.989997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:11.990645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.514688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:12.527727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2eb99e5a-9887-46a2-9018-49ffd51a1797 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.551714 Nov 02 12:10:12.529978 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2059/4091] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:11 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:12.633170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:12.633799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:12.645199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.645735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.646237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.646970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.647489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.647942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.706664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:12.708505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:12.723273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:12.725230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.737066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.738738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:12.741526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:12.746245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:12.747253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.345285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:13.358146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-522be8de-aea6-494c-b16d-0e4fe57e5488 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.728751 Nov 02 12:10:13.358911 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2033/4092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:12 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:13.375702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.376641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:13.384471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.385193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:13.386144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.386693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.387360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:13.388068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.399808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:13.415094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-415fc196-b329-45d0-9d7a-1b2ced6575fd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1312 microversion: 2.1 time: 0.714923 Nov 02 12:10:13.420282 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2060/4093] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:12 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1312 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:13.554311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:13.555394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:13.566769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.568392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:13.568835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.569550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:13.570009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:13.570437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:13.778343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:13.788341 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1cdb68e-9fc8-442e-a420-d7431250368a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1516 microversion: 2.1 time: 0.421266 Nov 02 12:10:13.793259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2034/4094] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1516 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:14.145931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:14.208061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:14.216742 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55536ad5-84a3-4b5d-b62b-8a4873667805 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1508 microversion: 2.1 time: 0.667218 Nov 02 12:10:14.223045 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2061/4095] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:13 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1508 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:14.384338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:14.386399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:14.399683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:14.400329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:14.400882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:14.401847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:14.402445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:14.406260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:14.449512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:14.451007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:14.470215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:14.477416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:14.478345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:14.481087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:14.481456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:14.481894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:14.486376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:15.065176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:15.087034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-096401bd-e0bc-4255-a896-5168ce79bc49 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.706635 Nov 02 12:10:15.088236 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2035/4096] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:14 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:15.098342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.102382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:15.117754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.121486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.122208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.127206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.129055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.135121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.151290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:15.167856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d422b8b5-26cc-4421-973d-1dcf11af1ac3 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1461 microversion: 2.1 time: 0.725036 Nov 02 12:10:15.192147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2062/4097] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:14 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1461 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:15.223144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.225088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:15.283113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.283113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.283665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.284684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.285333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.285933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.504157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:15.528676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f27b79e9-91b6-4e82-b933-0239b4e752a4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 200 len: 1474 microversion: 2.1 time: 0.433031 Nov 02 12:10:15.528676 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2036/4098] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:15.567740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:15.568788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:15.587454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.588866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.591643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.595575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:15.596244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:15.597659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:15.926195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:16.072968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43f57311-ee34-4280-b596-1cfd28fcecc9 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1612 microversion: 2.1 time: 0.861915 Nov 02 12:10:16.076005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2063/4099] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1612 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:16.086724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04dd51b8-72ba-4c20-993c-2f71c5972d2c", "tag": "4511f225-d05d-4b64-b003-a6e217af326d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:16.113890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.115520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.116846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.160067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] Creating event network-changed:4511f225-d05d-4b64-b003-a6e217af326d for instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c on n-h1-855649-4 Nov 02 12:10:16.174944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1d430100-815b-4f30-9dbf-819a1e58eac2 req-61a34190-e79a-4328-9bd9-1ba6cd1b7e0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097020 Nov 02 12:10:16.176092 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2064/4100] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:16.186731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e20d4574-06f9-48c1-9998-1082868d6900 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-24822778", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "170835a4-c4e9-4e1f-8933-4d0f61be4a7d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:16.260183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:16.276638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eeea63fa-e262-49a7-a23c-fdaf069c20d5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1529 microversion: 2.1 time: 0.746811 Nov 02 12:10:16.279881 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2037/4101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:15 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1529 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:16.295626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:16.299043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:16.319061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.322391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.322391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.322391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.323096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.323720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.368524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e20d4574-06f9-48c1-9998-1082868d6900 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e20d4574-06f9-48c1-9998-1082868d6900 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 356 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-24822778", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "170835a4-c4e9-4e1f-8933-4d0f61be4a7d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: exception: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-24822778', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '170835a4-c4e9-4e1f-8933-4d0f61be4a7d'}], 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:16.379146 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e20d4574-06f9-48c1-9998-1082868d6900 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Block Device 170835a4-c4e9-4e1f-8933-4d0f61be4a7d is not bootable. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e20d4574-06f9-48c1-9998-1082868d6900 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.203649 Nov 02 12:10:16.383554 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2065/4102] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:16 2022] POST /compute/v2.1/servers => generated 110 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:16.390907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:16.392258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:16.416646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.417151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.417603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.418342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.418803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '541ab607babc497eb4c129b0a9ce309b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '099b2a539d384ababf54e39b0c469406', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:16.419757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] flavor_id is None. Assuming migration. {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:10:16.420283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:10:16.425545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.426112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.922399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:16.934822 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-088ee8d4-acf6-4d7e-b321-8d447a583565 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.547022 Nov 02 12:10:16.959638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2066/4103] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:16 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:16.969204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:16.970837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:16.978512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.979149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.979822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:16.980739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:16.981422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:16.982047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.069431 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1110fe69-8714-4184-82cd-d89cd047ff14 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.787909 Nov 02 12:10:17.070442 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2038/4104] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:16 2022] POST /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:10:17.087116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:17.088140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:17.105625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.106701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.107408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.109586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.110411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.111038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.151045 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 HTTP/1.1 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e9bc5d5c-374f-41c3-b062-22c514b5b861'} Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:17.157041 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:10:17.161242 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:17.163073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:17.164650 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8ab4e3f-81b0-4fb2-97ff-17d2b8f0f93b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 404 len: 111 microversion: 2.1 time: 0.092259 Nov 02 12:10:17.165093 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2039/4105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:17 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:10:17.181306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:17.181306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:17.193496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.193970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.194421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.195183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.195652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.196362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.234237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:17.408982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:17.421414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16a98a26-89cf-4916-a28c-870a9dfc4d48 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.459485 Nov 02 12:10:17.422382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2067/4106] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:16 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:17.438083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:17.439502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:17.453641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.456170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.456415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.457493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.458066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.458649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.487381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:17.495471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03e95eb7-39b6-4cbb-83ab-4bf45c5fb47f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1470 microversion: 2.1 time: 0.329412 Nov 02 12:10:17.496060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2040/4107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:17 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:17.502891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1686917129", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6e374cd2-49aa-4283-b226-db833629fc09"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:17.639821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] validate_networks() for [('6e374cd2-49aa-4283-b226-db833629fc09', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:10:17.762115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:17.778228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7546fe9-c73c-480e-bb06-4980f8c2e45d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.350701 Nov 02 12:10:17.796142 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2068/4108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:17 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:17.803506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85127f38-e58f-43ae-afc0-e7a74f7b1d61", "name": "network-vif-plugged", "status": "completed", "tag": "99c40e87-d0ff-40d5-b939-20bfc69921a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:17.829709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.832257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.833136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.850103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] Creating event network-vif-plugged:99c40e87-d0ff-40d5-b939-20bfc69921a7 for instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 on n-h1-855649-4 Nov 02 12:10:17.856506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c8c378ad-ce6e-468d-b800-6c751bcf99c2 req-29b8589e-59a3-40e7-bbd9-8cabd19f9b0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058897 Nov 02 12:10:17.863960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2069/4109] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:17.872683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:17.874308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:17.886000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.887531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.888235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:17.889806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:17.890542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:17.893127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:18.228907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:18.241633 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed9ed196-99ae-42c6-9ce1-cb3c794ccbe7 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.375821 Nov 02 12:10:18.242704 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2070/4110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:17 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:18.253220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:18.257188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:18.274740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:18.275907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:18.278009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:18.279724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:18.281504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:18.284145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.626612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:10:19.627795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:10:19.628623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:10:19.629098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:10:19.634898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:10:19.666782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:19.669283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:19.669283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.669283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:19.670068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:19.670068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:19.732762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:10:19.769978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Getting quotas for user 061232b519354d529edb34dba5dc41d1 and project 9740bb86881748288bac1afe5929bdff. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:10:19.787343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:10:19.791635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:10:20.016771 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52d52e6a-0d41-4012-b9e4-dd69336a6121 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.512312 Nov 02 12:10:20.031152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2041/4111] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:10:20.070002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bc5d5c-374f-41c3-b062-22c514b5b861", "name": "network-vif-deleted", "tag": "8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:20.094115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.095227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.095967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.115999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:20.131950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44dafff0-9503-4d02-b99e-2deffb9c3cd8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 1.884557 Nov 02 12:10:20.139966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2071/4112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:18 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:20.147024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:20.161727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:20.171345 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] Creating event network-vif-deleted:8f2f9af5-b6e9-4557-8b1f-afffc3b95cfd for instance e9bc5d5c-374f-41c3-b062-22c514b5b861 on n-h2-855649-4 Nov 02 12:10:20.180307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8a242246-a47e-4951-a625-221589903170 req-eba9cc3d-0c12-4c47-96ae-b177ebe94ee0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143326 Nov 02 12:10:20.182329 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2042/4113] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:20.189598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:20.192013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:20.198272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.198784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.199264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.199998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.200465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.200895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.202800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.203552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.205238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:20.206204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:20.207075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:20.207830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:21.236868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:21.251769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7300165d-551a-4af7-84a7-d62975fbd34b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 1.065423 Nov 02 12:10:21.263447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2043/4114] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:20 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:21.272127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02a4c075-9e5b-45f3-98fd-ce5390de9e8a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:21.272364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02a4c075-9e5b-45f3-98fd-ce5390de9e8a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:21.436722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02a4c075-9e5b-45f3-98fd-ce5390de9e8a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:21.451009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02a4c075-9e5b-45f3-98fd-ce5390de9e8a tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1209 microversion: 2.1 time: 0.193695 Nov 02 12:10:21.456754 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2044/4115] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:21 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1209 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:21.467383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:21.474903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:21.492364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:21.496601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:21.497557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:21.499224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:21.501478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:21.503561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:21.548478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:21.568424 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f0ceca1-822f-4904-9b9f-2a4ee457bfb8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1470 microversion: 2.1 time: 1.420645 Nov 02 12:10:21.592957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2072/4116] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:20 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1470 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:22.280043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:22.283117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:22.290367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.291263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.292132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:22.309565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.314088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.315095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:22.369807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:22.378021 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-769e3b91-f444-45a6-9ef3-19660a1e354f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.919821 Nov 02 12:10:22.382188 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2045/4117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:21 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:22.483645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f20d4282-8a19-40e2-8638-2b7d545a0918 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:22.484541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f20d4282-8a19-40e2-8638-2b7d545a0918 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:22.587739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f20d4282-8a19-40e2-8638-2b7d545a0918 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:22.609435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f20d4282-8a19-40e2-8638-2b7d545a0918 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1209 microversion: 2.1 time: 0.129415 Nov 02 12:10:22.610583 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2046/4118] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:22 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:22.630667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:22.631338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:22.651001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.662026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.662026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:22.662026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:22.662026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:22.662026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.078321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:23.117152 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40d92df1-0c24-441d-aa27-879c4ff34d77 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.841202 Nov 02 12:10:23.131318 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2073/4119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:22 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:23.139940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80e8b64f-1c0f-4ab8-91db-97da2ba41066 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-522063226", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "destination_type": "local"}, {"source_type": "volume", "uuid": "6532fedc-0f3f-4cf1-85f9-ff76b9a88213", "destination_type": "invalid"}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80e8b64f-1c0f-4ab8-91db-97da2ba41066 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 494 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-522063226", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "destination_type": "local"}, {"source_type": "volume", "uuid": "6532fedc-0f3f-4cf1-85f9-ff76b9a88213", "destination_type": "invalid"}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-522063226', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6532fedc-0f3f-4cf1-85f9-ff76b9a88213', 'destination_type': 'invalid'}], 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:23.151990 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80e8b64f-1c0f-4ab8-91db-97da2ba41066 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:23.160588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80e8b64f-1c0f-4ab8-91db-97da2ba41066 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.033314 Nov 02 12:10:23.165175 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2074/4120] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:23 2022] POST /compute/v2.1/servers => generated 155 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:23.180598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:23.181506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:23.207996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.213159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.230868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.230868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.230868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.230868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.797042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:23.810370 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-496bdfc7-3527-4c43-af39-dbc900f88692 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.640745 Nov 02 12:10:23.818505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2075/4121] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:23.843156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:23.846156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:23.865968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.874241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.876380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:23.877508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:23.878880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:23.882114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.058766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:24.087590 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29cd00e3-6610-47f5-a10b-ecf5b9a51607 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1470 microversion: 2.1 time: 1.475198 Nov 02 12:10:24.116725 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2047/4122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:22 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1470 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:24.135748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:24.140804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:24.159343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:24.160424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:24.161346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.191794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:24.191794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:24.191794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.587675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:24.620415 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-453d444f-9257-4db0-a33d-ea83ac95804d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1261 microversion: 2.1 time: 0.476305 Nov 02 12:10:24.620415 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2048/4123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:24 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1261 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:24.625201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:24.626385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:24.637444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:24.637954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:24.638428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.642505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:24.658133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:24.660305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:24.980307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:24.999771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f2d592a-1152-4a1a-837d-60161406bff2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 1.174689 Nov 02 12:10:25.016694 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2076/4124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:23 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:25.016694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:25.016984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:25.049981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.053265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.053749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.054543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.062798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.063637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.086225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:25.098277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57838409-df29-44a9-a270-95388507ab07 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.490885 Nov 02 12:10:25.098890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2049/4125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:24 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:25.106563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dd51b8-72ba-4c20-993c-2f71c5972d2c", "name": "network-vif-plugged", "status": "completed", "tag": "4511f225-d05d-4b64-b003-a6e217af326d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:25.134548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.135066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.135509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.199748 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] Creating event network-vif-plugged:4511f225-d05d-4b64-b003-a6e217af326d for instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c on n-h1-855649-4 Nov 02 12:10:25.220272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-37e6ee85-6158-4148-a52a-926774263bbb req-78208fdc-359a-466f-9aca-efc5792616bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116432 Nov 02 12:10:25.224813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2050/4126] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:25.242819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:25.243611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:25.264537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.265310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.267109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.268017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.271728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.273899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.650435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:25.663014 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-64da9a46-69ae-4aca-8120-39085a5217a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.656572 Nov 02 12:10:25.672126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2077/4127] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:25 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:25.683909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1700e520-8eee-41f1-87f7-d6271291fe51 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-655622119", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1700e520-8eee-41f1-87f7-d6271291fe51 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 491 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-655622119", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-655622119', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.704965 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1700e520-8eee-41f1-87f7-d6271291fe51 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:25.716236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1700e520-8eee-41f1-87f7-d6271291fe51 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.040596 Nov 02 12:10:25.727475 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2078/4128] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:25 2022] POST /compute/v2.1/servers => generated 624 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:25.737936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:25.740313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:25.758159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.761590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.762387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:25.768276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:25.769479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:25.770341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.131282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.152612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a1fbe43-1409-491d-a060-a002914036fd tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1279 microversion: 2.1 time: 0.422174 Nov 02 12:10:26.156724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2079/4129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:25 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.184584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.187117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.220125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.220636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.229005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.232351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.232861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.235142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.528404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.546244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49e22fa5-4c7c-40e6-b207-5adff0edf9fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.389171 Nov 02 12:10:26.546904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2080/4130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.560314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.560971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.576486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.577006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.577457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.587282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.587282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.587282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.748024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:26.767322 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47350958-0f93-44ae-9624-01b760993ef6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1470 microversion: 2.1 time: 1.539998 Nov 02 12:10:26.783718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2051/4131] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:25 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1470 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:26.801817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:26.802457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:26.838442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.838952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.839636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:26.840377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:26.841040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:26.841750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.038273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:27.050094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a5c0be2-262b-491d-a3bb-a668613bbcb1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1312 microversion: 2.1 time: 0.501934 Nov 02 12:10:27.053409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2081/4132] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1312 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:27.064676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:27.069950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:27.098563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.099489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.100128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.101339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.102476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.107788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.509068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:27.521287 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd1a79a2-1f5c-4e5d-bdd3-22b84524a9fd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.466461 Nov 02 12:10:27.548063 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2082/4133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:27 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:27.562309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:27.563750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:27.581420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.584454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.585015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.590176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.591038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.591575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.598464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:27.623353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:27.646136 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3f65cc0-796f-49f5-b292-baec060e1377 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.860830 Nov 02 12:10:27.647614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2052/4134] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:27.720758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:27.746894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46836226-5200-42fd-8d18-4bc36f304b62 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46836226-5200-42fd-8d18-4bc36f304b62 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 416 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.759282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46836226-5200-42fd-8d18-4bc36f304b62 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:27.762889 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46836226-5200-42fd-8d18-4bc36f304b62 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022361 Nov 02 12:10:27.772012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcb46795-c17e-4e27-a62c-12eda5a46934 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1267 microversion: 2.1 time: 0.221755 Nov 02 12:10:27.787660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2053/4135] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:27 2022] POST /compute/v2.1/servers => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:10:27.789204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2083/4136] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:27 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:27.800645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:27.911827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.912435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:27.913189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.266484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:28.279776 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a6afe7e-e6e4-4237-b622-5fa9d04be9b8 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.485775 Nov 02 12:10:28.291402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2084/4137] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:27 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:28.306934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:28.320023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:28.327862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.328694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.329966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.331579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.333630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.334245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.401414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:28.416792 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-404861e5-008b-4f59-90a8-edb2f6a1241f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.626477 Nov 02 12:10:28.428102 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2054/4138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:27 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:28.462848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:28.463744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:28.477274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.479160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.479160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.483389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.493821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.494532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.910090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:28.930527 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d286550-582e-4e26-9b32-1c8fed2ebb5e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1496 microversion: 2.1 time: 0.630083 Nov 02 12:10:28.931819 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2085/4139] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:28 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1496 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:28.950969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:28.951875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:28.973781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.976438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.976875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:28.977631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:28.984521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:28.985646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.287673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:29.300442 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08c9612f-c7ba-4800-ad1c-2f7bbd60486c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.842192 Nov 02 12:10:29.324478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2055/4140] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:29.350795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:29.363956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:29.379426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.387828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.388528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.389515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.392252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.392910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.699466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:29.706237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:29.716240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d95f9bd7-be50-4ed2-9af7-693d918ea5a1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1267 microversion: 2.1 time: 0.390261 Nov 02 12:10:29.735636 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2056/4141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:29 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:29.743941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:29.758586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:29.777947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.782271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.794307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.794307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.794307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.794307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.816722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:29.837801 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88a8579d-854a-42fd-a0b8-0cc78e74cf78 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.904535 Nov 02 12:10:29.852927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2086/4142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:28 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:29.874420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:29.879877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:29.913899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lazy-loading 'flavor' on Instance uuid 04dd51b8-72ba-4c20-993c-2f71c5972d2c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:10:29.920435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.929525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.930462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:29.931472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:29.932163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:29.932804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:30.364740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5bd556f-91d4-41cb-9fa4-1e226d7eebac tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "POST /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c/action" status: 200 len: 32 microversion: 2.1 time: 0.625959 Nov 02 12:10:30.365631 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2057/4143] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:29 2022] POST /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c/action => generated 32 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:10:30.394165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a09636cd-e7ee-4298-9bf9-d134ea4ad4d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1847347758", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": -1, "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:30.457534 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a09636cd-e7ee-4298-9bf9-d134ea4ad4d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a09636cd-e7ee-4298-9bf9-d134ea4ad4d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 206 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1847347758", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": -1, "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor -1 could not be found. Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1847347758', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': -1, 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:30.477585 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 12:10:30.480891 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:30.488025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a09636cd-e7ee-4298-9bf9-d134ea4ad4d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:30.490131 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a09636cd-e7ee-4298-9bf9-d134ea4ad4d0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.117774 Nov 02 12:10:30.499855 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2058/4144] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:30 2022] POST /compute/v2.1/servers => generated 73 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:30.531805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:30.531805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:30.552204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:30.569868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:30.580097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:30.583492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:30.590371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:30.596004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:31.132625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:31.157144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-461bbbdf-9bc8-486e-b73f-fd3453b01a65 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 1.300666 Nov 02 12:10:31.158419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2087/4145] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:29 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:31.165433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:31.168248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:31.182548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:31.194481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:31.195651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:31.205809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:31.211959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:31.212835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:31.943820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:31.952917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b565509-1e86-45d2-beba-f34f5adb18c5 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 1.451368 Nov 02 12:10:31.959987 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2059/4146] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:30 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:31.981853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:31.987981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:32.017085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:32.020227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:32.021805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:32.023035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:32.025408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:32.028242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:32.612189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:32.892920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:32.910560 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c83a330c-3223-4228-bfbd-38dcb2f1ea0d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.750385 Nov 02 12:10:32.911681 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2088/4147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:31 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:32.932816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:32.934261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:32.944795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:32.945940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:32.946626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:32.947730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:32.948514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:32.949194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:33.246000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:33.259908 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71c90856-2306-4703-b20f-3e09284ae7ad tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 1.298489 Nov 02 12:10:33.264840 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2060/4148] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:31 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:33.284897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:33.286513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:33.306555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:33.310905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:33.313019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:33.313532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:33.314276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:33.316465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:33.318573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:33.330290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:33.537079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:33.546610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17ee4991-bf8f-4e50-846e-6379be9ac61c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.632891 Nov 02 12:10:33.555909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2089/4149] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:32 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:33.576275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:33.576903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:33.584162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:33.584984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:33.585677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:33.586544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:33.587280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:33.588121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:34.228791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:34.270047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b11b5c3d-7dae-4bb4-982e-7f08dd93a1aa tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.995575 Nov 02 12:10:34.290077 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2061/4150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:33 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:34.311364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:34.325479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:34.349262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:34.351597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:34.352208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:34.355859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:34.356467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:34.358421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:34.538065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:34.547663 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9a81e53-5ee9-49de-a34b-c4c1135fbbda tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.974869 Nov 02 12:10:34.548251 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2090/4151] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:33 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:34.569172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:34.581421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:34.595644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:34.596415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:34.596994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:34.602421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:34.603172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:34.603919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:34.960726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:34.970359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cdb4d907-17b9-4355-8497-802a14051392 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.678176 Nov 02 12:10:34.989334 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2062/4152] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:34 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:34.995893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:34.996768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:35.004920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.012155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.012155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.012155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.012155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.012155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.109282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:35.130673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d920371-bae3-4a38-9e43-2ddf757bd5e0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.566596 Nov 02 12:10:35.132032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2091/4153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:34 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:35.137770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:35.138651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:35.146663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.147508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.148175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.154733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.156900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.158355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.337374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:35.356637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c4b6f4b-f38e-4375-82f7-305a9c078f00 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.365422 Nov 02 12:10:35.367525 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2063/4154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:34 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:35.367525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6adf4394-0cea-467d-9ca3-ac1a32ea42e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1152952592", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6adf4394-0cea-467d-9ca3-ac1a32ea42e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 173 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1152952592", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1152952592', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi -1 Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:10:35.371171 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6adf4394-0cea-467d-9ca3-ac1a32ea42e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:35.376587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6adf4394-0cea-467d-9ca3-ac1a32ea42e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.014141 Nov 02 12:10:35.377489 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2064/4155] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:35 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:35.382020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2030001523"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:35.384512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:35.394129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.394936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.395425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.396148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.396607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.397041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.478260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:35.498701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23960eba-cba4-4550-a86d-9873874ee1e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.365128 Nov 02 12:10:35.517951 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2092/4156] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:35 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:35.517951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:35.517951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:35.531503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.532214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.532840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.533684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.534535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.535004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.693385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:35.702070 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8406771-edfd-4a68-8427-c65e84e3bbd4 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.200104 Nov 02 12:10:35.702752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2093/4157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:35 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:35.710059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:35.710059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:35.714589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.715115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.715619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.716335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.716801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.717227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.908431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:35.930358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eee72e2d-04f3-40f7-bb36-e0afc83fb5cc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.219888 Nov 02 12:10:35.931471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2094/4158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:35 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:35.936135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc67fb33-8548-49cd-8c26-197dde67e797", "tag": "f5943c53-39f0-4a53-b832-e906977d1138"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:35.968410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:35.969436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:35.969895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:35.982215 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] Creating event network-changed:f5943c53-39f0-4a53-b832-e906977d1138 for instance dc67fb33-8548-49cd-8c26-197dde67e797 on n-h2-855649-4 Nov 02 12:10:35.996581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6502fc1e-ebeb-4524-997e-5c6c1234d362 req-e04dc702-f70b-45e6-9be3-abbd940a130d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063962 Nov 02 12:10:35.997507 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2095/4159] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:36.004680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:36.005422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:36.025506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.027227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.027227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.027227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.027782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.028231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.188908 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b34e9607-9f68-401e-951b-de1d2721d2b0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.810277 Nov 02 12:10:36.192607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2065/4160] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:35 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 12:10:36.201464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:36.207106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:36.226567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.227145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.228695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.230291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.231293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.231929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.440014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:36.449754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c7acc51-d32b-4ef0-9b0c-a6dba4533f0a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.450984 Nov 02 12:10:36.456603 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2096/4161] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:35 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:36.461716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:36.462389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:36.480705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.481200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.481651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.482368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.482826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.483279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.837691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:36.840086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:36.849458 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2f4420f-e532-4677-bfa4-854ce51cc04c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.654651 Nov 02 12:10:36.863002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d68e43a4-c60e-4f65-a09d-35d486efc0b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.392771 Nov 02 12:10:36.863002 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2097/4162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:36 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:36.864546 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2066/4163] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:36 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:36.874866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:36.876377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:36.883294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.883972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:36.884677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:36.884973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.885624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.886576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.887279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.887922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.892170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.892665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.893181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:36.893892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:36.894355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:36.894788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.175216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:37.188229 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54c5400f-2d58-42fd-aa3c-6a2eeec1b7ee tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.307951 Nov 02 12:10:37.203797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2098/4164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:36 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:37.203797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1b0b7ee-cfe8-42ae-9a4f-8296bb10309b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-394069196", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:37.203797 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a1b0b7ee-cfe8-42ae-9a4f-8296bb10309b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:10:37.209561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1b0b7ee-cfe8-42ae-9a4f-8296bb10309b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 215 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-394069196", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-394069196', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:37.214086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1b0b7ee-cfe8-42ae-9a4f-8296bb10309b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1b0b7ee-cfe8-42ae-9a4f-8296bb10309b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025679 Nov 02 12:10:37.220160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2099/4165] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:37 2022] POST /compute/v2.1/servers => generated 123 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:37.225628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f214d241-977a-4f9e-8625-c80ddfcd0f1e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.359685 Nov 02 12:10:37.226596 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2067/4166] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:36 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:37.231209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:37.245416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:37.249367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:37.251935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:37.259842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.263423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.263925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.264371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.267284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.267284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.267284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.272488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.272942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.273716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.274190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.274636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.622726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:37.636174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df540ab8-0d35-46aa-9ecd-46bf31453cc1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.416867 Nov 02 12:10:37.637147 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2100/4167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:37 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:37.642569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-unplugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:37.653344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.654156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.654944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.677369 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] Creating event network-vif-unplugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:10:37.683309 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-676f0936-4da7-45b6-81b9-80aefab4689c req-0a037625-0001-4bfb-83d0-df062d7b741c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044416 Nov 02 12:10:37.684010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2101/4168] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:37.692916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:37.720422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7be36a95-766d-472b-9de7-d9571df837c2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.489376 Nov 02 12:10:37.747348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2068/4169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:37 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:37.753896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:37.753896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:37.770855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.772942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.778092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.780493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.781002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.781512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.784686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:37.879846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:37.880569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:37.890231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.891541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.891748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:37.892509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:37.892942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:37.893377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.080791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:38.091424 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4890594-4192-4f14-9e6f-5a45aa11f296 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.346675 Nov 02 12:10:38.092215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2102/4170] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:37 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:38.109480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:38.110229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:38.134644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.140890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.140890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.140890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.140890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.140890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.183044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:38.196716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b10db234-b218-4071-8e54-a5fdcfad4f7c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1687 microversion: 2.1 time: 0.325680 Nov 02 12:10:38.198408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2069/4171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:37 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1687 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:38.216690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:38.222474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:38.239688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.242358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.245826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.248557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.253765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.255926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.424259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:38.434366 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8c0dca9-0b14-4d00-94a1-251926a9bc06 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.341316 Nov 02 12:10:38.452444 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2103/4172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:38 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:38.477176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:38.478991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:38.493790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.494667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.497582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.498613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.499329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.499988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.626111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:38.644586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9727d7f3-099c-4a11-9516-35dc6c177d60 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.430441 Nov 02 12:10:38.645251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2070/4173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:38 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:38.660415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337518234", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-key-1087850718", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:38.754886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:38.766812 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09c112fb-0820-43a8-8f39-14214f7b794e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.302160 Nov 02 12:10:38.768666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2104/4174] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:38 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:38.773259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] validate_networks() for [('30d4505b-c465-4ce4-958f-871528754b05', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:10:38.773517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:38.774471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:38.781948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.782763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.784172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:38.785308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:38.785945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:38.787160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.123290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:39.132942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9267fdcc-2f79-41b6-8c32-fc55318c0f19 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.363355 Nov 02 12:10:39.146611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2105/4175] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:38 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:39.230264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:39.231590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:39.267549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.268061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.268514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.276909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.277628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.278075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.294217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Invalid key_name provided. Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 246 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-337518234", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-key-1087850718", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid key_name provided. Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-337518234', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'key_name': 'tempest-key-1087850718', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1087850718 not found for user f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:39.297855 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 12:10:39.301164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:39.309720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid key_name provided. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:39.317970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f730dc0-5499-4458-9c1b-22a77f20f6fb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.662556 Nov 02 12:10:39.317970 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2071/4176] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 666 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:10:39.331106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:39.343736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:39.355786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.361851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.364107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.368446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:39.369061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:39.374101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:39.934421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:39.954302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be907771-53e2-48be-8d07-608033d475e9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1687 microversion: 2.1 time: 0.728335 Nov 02 12:10:39.961261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2106/4177] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:39 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1687 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:39.982916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:39.988897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:40.010170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.011898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.012358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.013083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.013545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.022706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.099491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:40.110006 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06a8cedb-fbcf-4174-b6f5-b22a5cb17b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.787291 Nov 02 12:10:40.112747 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2072/4178] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:39 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:40.132872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:40.133826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:40.157050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.161273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.162022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.162808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.163317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.163836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.593679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:40.608720 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cf5c2ea-7298-46c0-8191-bc51c50ef68f tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.637250 Nov 02 12:10:40.609440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2107/4179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:39 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:40.624236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:40.624236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.630091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.716261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:40.727491 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e8aafee-023e-4283-823f-19e71e41392d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.611985 Nov 02 12:10:40.728683 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2073/4180] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:40 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:40.737334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:40.738181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:40.776221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.776927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.779087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:40.779087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:40.779087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:40.779866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.199960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:41.227362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f3c9283-afd1-49cd-9a46-368c645b18f7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.612224 Nov 02 12:10:41.230453 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2108/4181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:40 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:41.244276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:41.245303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:41.256869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:41.262012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.264687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.316570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c87aabc7-8ffe-4ef0-990c-3748a1b354b0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.535008 Nov 02 12:10:41.318236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.318236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.318236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.318236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2074/4182] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:40 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.318878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.627513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:41.637146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2696ad74-c214-44c9-9f25-255554a44b52 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.360719 Nov 02 12:10:41.637830 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2075/4183] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:41 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:41.643516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1966132333", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:41.678682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:41.686486 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84955fd3-5648-4408-98f8-aa7789064c6b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.451532 Nov 02 12:10:41.687082 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2109/4184] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:41 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:41.692046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-plugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:41.704763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.705286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.705721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.722176 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] Creating event network-vif-plugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:10:41.723052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9bb9f370-87c4-4989-a1b6-93d3a197bd24 req-90f05d2d-9254-4b15-8c86-e6face62d942 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Nov 02 12:10:41.723778 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2110/4185] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:41.729592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:41.730293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:41.736988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.737471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.737934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:41.738621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:41.739100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:41.739528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.398257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.security_group_api [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Neutron security group does_not_exist not found {{(pid=127568) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 12:10:42.399899 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 258 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1966132333", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1966132333', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 12:10:42.413836 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:42.418681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:42.423117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4776a7bd-0b4f-41ea-995b-325d5436102b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.777876 Nov 02 12:10:42.423117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2076/4186] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:41 2022] POST /compute/v2.1/servers => generated 106 bytes in 779 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:10:42.432310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:42.440217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:42.440918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:42.444562 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7c04c73-e4af-4b12-8082-554617e4f5b1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.719468 Nov 02 12:10:42.445970 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2111/4187] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:41 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:42.451435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:42.452320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:42.460115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.460917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.461623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.462555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.463293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.463938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.484249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.485690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.486145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.494452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.498740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.499625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.802891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:42.821232 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef0554a3-82b3-4f54-94c9-4813689d6ae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1524 microversion: 2.1 time: 0.373602 Nov 02 12:10:42.822563 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2112/4188] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:42 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1524 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:42.827844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:42.828494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:42.833711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:42.836160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.836678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.837113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.837899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.838385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.838814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.845147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:42.854197 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02bdc92a-fa15-4c5b-a691-f3df43271ac9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.431846 Nov 02 12:10:42.854955 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2077/4189] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:42 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:42.861084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:42.862453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:42.868684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.869513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.883133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:42.883133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:42.883133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:42.883133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.059941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:43.061342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:43.073048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fc0927a-65cd-40e3-8775-03226efb15b6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.215797 Nov 02 12:10:43.075224 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2078/4190] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:42 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:43.075388 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5e28071-d3a4-45c9-85d7-3d4ec26fefa6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.251388 Nov 02 12:10:43.076334 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2113/4191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:42 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:43.080688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.081740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.089346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.090403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.091734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.092948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.093600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.094898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.119484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.120362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.129587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.130401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.131073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.132431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.133104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.133911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.151295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:43.552164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:43.579572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6bd9ea9-d0f9-4c3e-b14e-f3e67653925c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.448863 Nov 02 12:10:43.579672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:43.588650 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2114/4192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:43 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:43.591742 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f1d85da-8414-4cbf-8aaa-ea57ee620fee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1475 microversion: 2.1 time: 0.515281 Nov 02 12:10:43.592372 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2079/4193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:43 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1475 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:43.603167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.603868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ab9d6208-5a95-40a9-aecd-2a81b2108c10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.605756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.605756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.610661 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/ab9d6208-5a95-40a9-aecd-2a81b2108c10 HTTP/1.1 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ab9d6208-5a95-40a9-aecd-2a81b2108c10'} Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:43.612532 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. Nov 02 12:10:43.616780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:43.618106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance ab9d6208-5a95-40a9-aecd-2a81b2108c10 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:43.619202 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6b0934f-cd90-407f-9c11-56b4d86a5a24 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ab9d6208-5a95-40a9-aecd-2a81b2108c10" status: 404 len: 111 microversion: 2.1 time: 0.025801 Nov 02 12:10:43.620379 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2080/4194] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:10:43 2022] DELETE /compute/v2.1/servers/ab9d6208-5a95-40a9-aecd-2a81b2108c10 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:10:43.623918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.624556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.625707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.627382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.628425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.634623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.634774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:43.634774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:43.668761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.673307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.674348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:43.675150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:43.675625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:43.676066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.085181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:44.097391 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64bb16be-79e1-43c5-a550-8d51af81d8e8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.472380 Nov 02 12:10:44.098009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2081/4195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:43 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:10:44.102661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc67fb33-8548-49cd-8c26-197dde67e797", "name": "network-vif-plugged", "status": "completed", "tag": "f5943c53-39f0-4a53-b832-e906977d1138"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:44.116781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:44.131906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c866d4ae-7da2-48f8-8532-792ea4f7815b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.541560 Nov 02 12:10:44.132882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2115/4196] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:43 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:44.138370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:44.139775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:44.146895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.147719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.148178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.148676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.148798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.149128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.150262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.151225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.151887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.170057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] Creating event network-vif-plugged:f5943c53-39f0-4a53-b832-e906977d1138 for instance dc67fb33-8548-49cd-8c26-197dde67e797 on n-h2-855649-4 Nov 02 12:10:44.176915 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3be293d3-05d2-4a19-9b75-9418a47110c8 req-d858ecd8-c461-4ed7-b933-c1d604ea7dbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077435 Nov 02 12:10:44.178261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2082/4197] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:44.201412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:44.202194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:44.219904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.224011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.224745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.225765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.226238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.226680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.709715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:44.724271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3fe6d2cf-1a87-45f3-aa90-b465d19b0105 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1506 microversion: 2.1 time: 0.589751 Nov 02 12:10:44.724868 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2116/4198] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:44 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:44.729581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:44.735936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:44.745452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.745973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.746423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:44.749943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:44.750446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:44.750892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:45.118840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:45.128467 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03bcfc04-391a-4086-8bf7-87508fc26367 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1309 microversion: 2.1 time: 0.948882 Nov 02 12:10:45.129362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2083/4199] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:44 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1309 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:45.136270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:45.136969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:45.144407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:45.145188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:45.145819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:45.146692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:45.147509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:45.152233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:45.472860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:45.482436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c91c1a59-5d9a-4a0b-9268-d53024b433e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.756521 Nov 02 12:10:45.489531 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2117/4200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:44 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:45.495605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:45.504287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:45.521212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:45.521812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:45.522618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:45.524675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:45.525279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:45.525991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:46.196152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:46.207049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04b5bd56-dc8c-4bae-bd13-a4b29bf3678a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.076340 Nov 02 12:10:46.207646 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2084/4201] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:45 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:46.225094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:46.225979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:46.246381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:46.247293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:46.247931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:46.250952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:46.254392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:46.255219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:46.378064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:46.404979 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-928904c3-01ba-4f46-83d1-6afe8f4e897a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1474 microversion: 2.1 time: 0.913914 Nov 02 12:10:46.406264 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2118/4202] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:45 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1474 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:46.418247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:46.419182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:46.439592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:46.442896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:46.443599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:46.453701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:46.454380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:46.455059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:46.487433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:47.378424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:47.388722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68bd6bdd-4d1a-4061-b2e6-38579b01cbfc tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1506 microversion: 2.1 time: 0.980449 Nov 02 12:10:47.403466 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2119/4203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:46 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1506 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:47.412679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:47.413827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.429557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.502166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:47.512968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5f9e1bf-dd9d-4ef1-8e90-4a8eac37c7c2 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 1.300694 Nov 02 12:10:47.513560 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2085/4204] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:46 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:47.537270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:47.538626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:10:47.541709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 9223372036854775808 could not be found. Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '9223372036854775808'} Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:47.542890 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:47.547221 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:47.547221 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:47.547221 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:47.547221 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 12:10:47.547221 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:10:47.549240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:47.550500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0f1422d-e0aa-476c-ad6c-cec8c7a527d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.035716 Nov 02 12:10:47.574423 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2086/4205] 10.222.0.48 () {58 vars in 1188 bytes} [Wed Nov 2 12:10:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:10:47.584781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:47.585413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:47.609795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.610367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.611054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.611854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.612433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.613816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.850508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:47.859727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0e3f6ba-51b0-4b2a-8049-a5194a1ed724 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1491 microversion: 2.1 time: 0.454759 Nov 02 12:10:47.860362 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2120/4206] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:47 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1491 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:47.865145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:47.865766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:47.871892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.872382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.872818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.873522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.873976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.874401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.885186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:47.893921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7172cba7-3917-4805-afa3-fe4f72ddcdc3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.336567 Nov 02 12:10:47.894711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2087/4207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:47 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:47.899050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:47.908704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.909218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.909653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.921805 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Creating event network-vif-unplugged:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h1-855649-4 Nov 02 12:10:47.927875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:10:47.940455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d74617c2-682b-4a9c-9b43-f0cf0b91c1f3 req-7e5835e3-9c93-4659-a6d4-924b0758f278 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044593 Nov 02 12:10:47.940994 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2088/4208] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:47.946680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:47.947420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:47.954414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.954915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.955383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:47.956097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:47.956555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:47.956988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.174046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:48.182686 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37cdf5a3-afa0-4112-8fb8-fd4d95fdf525 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1474 microversion: 2.1 time: 0.321138 Nov 02 12:10:48.183342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2121/4209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:47 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:48.188190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85127f38-e58f-43ae-afc0-e7a74f7b1d61", "name": "network-vif-unplugged", "status": "completed", "tag": "99c40e87-d0ff-40d5-b939-20bfc69921a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:48.199302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.199883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.200849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.220788 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] Creating event network-vif-unplugged:99c40e87-d0ff-40d5-b939-20bfc69921a7 for instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 on n-h1-855649-4 Nov 02 12:10:48.245432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-58ea417b-e35a-4cba-a681-2a65b05b313c req-9b4ab5ba-44ac-4f03-99d3-020545b3b8b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045701 Nov 02 12:10:48.247221 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2122/4210] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:48.258949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1995904228"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:48.262925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:48.280527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.282426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.283789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.284760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.285396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.286157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.471748 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f12bb89d-e2df-471b-a631-0aab08804a02 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "PUT /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1076 microversion: 2.1 time: 0.222156 Nov 02 12:10:48.474001 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2123/4211] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:10:48 2022] PUT /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1076 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:48.504972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:48.505611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:48.516054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.516561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.517189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.518302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.518949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.519692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.538291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:48.548951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40b8733b-8fdd-415d-b7b8-7093214d2266 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.606743 Nov 02 12:10:48.551746 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2089/4212] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:47 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:48.559435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:48.560000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:48.576628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.577151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.577604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:48.578378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:48.584151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:48.585253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.235617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:49.245945 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4242184-27ee-4640-bacf-121f1bdd608c tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1502 microversion: 2.1 time: 0.692666 Nov 02 12:10:49.247245 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2090/4213] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:48 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1502 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:49.252534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:49.253322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:49.268435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.269447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.270089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.271072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.271726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.272424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.304252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:49.322622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9e2126e-b5e1-448c-a53a-69696ea2fd81 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1506 microversion: 2.1 time: 0.827624 Nov 02 12:10:49.327362 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2124/4214] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:48 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1506 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:49.342745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:49.342963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:49.349291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.349785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.350228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.351012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.351523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.351964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.728269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:49.737246 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-093bbbee-c11b-49d8-a1a0-d24c42991c37 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.488784 Nov 02 12:10:49.748169 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2091/4215] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:49 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:49.753707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:49.754314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:49.773366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.773366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.773366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.773643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:49.774086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:49.774713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:49.996162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:50.032612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66539cf7-7f22-41d0-973e-75f6e1ac78e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.701398 Nov 02 12:10:50.036380 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2125/4216] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:49 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:50.062313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:50.072404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:50.087622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.088330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.091052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.094414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.097654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.098820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.317294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:50.329635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56e4017b-bd91-4568-915a-eca8b360cde4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.579508 Nov 02 12:10:50.342157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2092/4217] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:49 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:50.354597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:50.355658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:50.363857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.364578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.365275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.366395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.367034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.367802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.521222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:50.530599 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cb286fa-9bb6-40c6-b3a3-9e8434920f71 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1474 microversion: 2.1 time: 0.492771 Nov 02 12:10:50.531853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2126/4218] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:50 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1474 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:50.556007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:50.569902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.570905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.571592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.588204 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Creating event network-changed:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h1-855649-4 Nov 02 12:10:50.596069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:10:50.611886 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-afb67944-faa4-4f1b-822d-63b0ecdceb21 req-7e64f6dc-bf15-47a5-aa19-79fc3d578ec6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059790 Nov 02 12:10:50.612748 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2127/4219] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:10:50.618768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:50.619597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Failed to fetch instance by id -1 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:10:50.620276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance -1 could not be found. Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '-1'} Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:50.622326 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:50.626703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:50.626703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:50.626703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 12:10:50.626703 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:50.627757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:50.629094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-071d1e60-9c51-47ff-b3ed-b337c634670a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015069 Nov 02 12:10:50.629835 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2128/4220] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:10:50 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:10:50.636233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:50.644304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:50.652221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.652971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.653579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.654568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.655244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.655876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.738746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:50.752490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e1f50944-78c8-4d34-9ea3-7f6b980476ab tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1502 microversion: 2.1 time: 0.407825 Nov 02 12:10:50.753369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2093/4221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:50 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:50.777935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:50.780260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:50.791036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.791877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.792467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:50.793376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:50.793843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:50.794460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:51.779278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:51.791648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8fbb328-5e59-4bf1-a58c-0a9467972d76 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.036916 Nov 02 12:10:51.792263 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2094/4222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:50 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:51.798795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:51.800165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:51.800818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:51.814464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:51.814968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:51.815600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:51.816406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:51.816862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:51.820923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cf630fe-9467-40bc-8f6d-2f2d36f36b46 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 200 len: 1509 microversion: 2.1 time: 1.188312 Nov 02 12:10:51.821844 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2129/4223] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:50 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 1509 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:51.824112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:51.835196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:51.852023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:51.854562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:51.855458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.005794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:10:52.402029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7f2f9b5-0dcb-450b-a5a7-19756eb267a7 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "POST /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797/action" status: 202 len: 0 microversion: 2.1 time: 0.573470 Nov 02 12:10:52.404710 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2130/4224] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:51 2022] POST /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:10:52.412679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:52.413405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:52.461195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.461711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.462398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.463592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.464109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.464550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.750513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:52.760739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4fc24d5-ece5-4348-907d-aafbd6eee27c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.967082 Nov 02 12:10:52.761982 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2095/4225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:51 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:52.768702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:52.769603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:52.777981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.778813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.779290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.780023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.780493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.781184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.852756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:52.862239 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24dfe2c3-c968-4d67-91e2-4990f33d201a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.456002 Nov 02 12:10:52.862946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2131/4226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:52 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:52.868241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:52.869078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:52.876484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.877394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.878022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:52.880777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:52.887134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:52.887134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.103509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:53.138444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ec3cf4a-fea1-4555-87d2-63dfdd229eee tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1472 microversion: 2.1 time: 0.374858 Nov 02 12:10:53.155472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:53.157686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2096/4227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:52 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:53.165804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7475051c-17df-4585-9990-722531cdd1c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.301466 Nov 02 12:10:53.171375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:53.177651 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2132/4228] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:52 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:53.177976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:53.190873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.192855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.194686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.195945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.198805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.201867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:53.202011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.204130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:53.222137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.222645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.223123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.223864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.224328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.232064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.263480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:10:53.271937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Working on deleting snapshot 720dce4d-4039-489c-b881-d58fd3af2edc from shelved instance... Nov 02 12:10:53.482072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:53.495924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b391d7b-7cb7-495e-aac2-9c6e68d9f06f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.317192 Nov 02 12:10:53.512195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2133/4229] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:53 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:53.512195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:53.512195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 099fec53-219c-432e-ab57-87177d0b5dec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:53.532673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/099fec53-219c-432e-ab57-87177d0b5dec/action HTTP/1.1 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 19 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: {"forceDelete": {}} Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '099fec53-219c-432e-ab57-87177d0b5dec', 'body': {'forceDelete': {}}} Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:53.543724 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:53.548714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:53.548714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:53.548714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. Nov 02 12:10:53.548714 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:53.550864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 099fec53-219c-432e-ab57-87177d0b5dec could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:53.552277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e71125c7-982a-4b7c-82a5-61ec8329be30 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/099fec53-219c-432e-ab57-87177d0b5dec/action" status: 404 len: 111 microversion: 2.1 time: 0.050369 Nov 02 12:10:53.553531 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2134/4230] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:53 2022] POST /compute/v2.1/servers/099fec53-219c-432e-ab57-87177d0b5dec/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:10:53.569685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:53.572111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:53.591412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.595063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.596001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:53.599467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:53.600341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:53.602436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:54.102030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:54.113675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50a293df-74cd-4a6d-84bf-a446e2e8df0f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.555951 Nov 02 12:10:54.115145 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2135/4231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:53 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:54.121572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:54.122630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:54.142482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:54.147617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:54.154642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:54.154642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:54.157282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:54.157930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:54.608732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:54.620128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad07e56c-93b1-4589-883e-21d047394a2e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.503646 Nov 02 12:10:54.621079 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2136/4232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:54 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:54.637007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:54.638220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:54.645732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:54.646474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:54.648128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:54.661534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:54.662711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:54.667030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:54.717797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:55.180416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:55.194156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bfa6e3b-514b-49ee-840d-1aad01b71195 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.571652 Nov 02 12:10:55.197243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2137/4233] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:54 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:55.219850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:55.220796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:55.228931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.231120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.231120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:55.231120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.232049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.232643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:55.460333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:55.471319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb46013c-6fb0-4ffd-b54a-7c734dd531c1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.255840 Nov 02 12:10:55.472504 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2138/4234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:55 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:55.477759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:55.478818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:55.485794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.486560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.487201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:55.488339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.489877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.490486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:55.794487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:55.812137 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8d62af1-76b0-4678-85bd-15636aa9914c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1469 microversion: 2.1 time: 0.338194 Nov 02 12:10:55.835782 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2139/4235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:55 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:55.850763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:55.855328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:55.873679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.874184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.874685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:55.875460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:55.887223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:55.890942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:56.101673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Doing local delete in cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127568) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 12:10:56.105120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:56.107413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:56.119491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:56.120267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 12:10:56.131355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] deallocate_for_instance() {{(pid=127568) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 12:10:56.382439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:56.398113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78b2f70f-948b-42ad-860c-d76a7fb46775 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.557042 Nov 02 12:10:56.398792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2140/4236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:55 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:56.423750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:56.427511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: deae650f-904a-462b-bdba-dc6c5b1a5826] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:56.436757 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/deae650f-904a-462b-bdba-dc6c5b1a5826/action HTTP/1.1 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 39 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: {"os-getConsoleOutput": {"length": 10}} Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'deae650f-904a-462b-bdba-dc6c5b1a5826', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:56.447979 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance deae650f-904a-462b-bdba-dc6c5b1a5826 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:10:56.452831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f4fcf74-fa09-41c1-8014-c0314f9e703a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/deae650f-904a-462b-bdba-dc6c5b1a5826/action" status: 404 len: 111 microversion: 2.1 time: 0.047168 Nov 02 12:10:56.453772 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2141/4237] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:56 2022] POST /compute/v2.1/servers/deae650f-904a-462b-bdba-dc6c5b1a5826/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:10:56.465313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:56.466017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:56.485815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:56.491528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:56.492737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:56.495934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:56.497907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:56.498593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:56.881761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:56.892250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97acbf77-acab-4993-b03e-eea07bdd4f5b tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.436153 Nov 02 12:10:56.897582 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2142/4238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:56 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:56.912944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:56.916537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:56.931661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:56.932635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:56.935505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:56.936527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:56.937677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:56.940028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:57.427559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acb9c305-9864-46ae-9384-af65b8b6aa07 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "POST /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.524259 Nov 02 12:10:57.435402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2143/4239] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:10:56 2022] POST /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:10:57.443064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:57.444449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:57.461742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:57.462586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:57.463843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:57.470425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:57.470425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:57.470425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:57.524175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:10:57.632945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Updating instance_info_cache with network_info: [] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:10:57.855970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:57.869857 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66fae1ac-f8db-4dd6-861f-9b1c8e116ada tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.432686 Nov 02 12:10:57.872151 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2144/4240] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:57 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:57.897447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:57.898117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:57.915833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:57.917088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:57.922502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:57.924382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:57.925376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:57.926398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:58.513881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:58.527992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-187d83f2-f90b-4225-9628-98664098b12f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.648359 Nov 02 12:10:58.536126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2145/4241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:57 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:58.885292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1405648578", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "a9ea2d53-9fb6-40c6-8e2c-8dfe43a886a3"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:58.975207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2db7b817-959c-4feb-a43f-c26b72298271 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 204 len: 0 microversion: 2.1 time: 5.815810 Nov 02 12:10:58.975846 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2097/4242] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:10:53 2022] DELETE /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 0 bytes in 5817 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:10:58.985786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:58.986421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:58.996382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] validate_networks() for [('a9ea2d53-9fb6-40c6-8e2c-8dfe43a886a3', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:10:59.002378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.002952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.003444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.004182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.009170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.009676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.433072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:59.447740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a3afccd-540b-46af-ab01-beb62d17866d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.470768 Nov 02 12:10:59.448903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2098/4243] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:58 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:59.455625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:59.456488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:59.465681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.466423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.467277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.468400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.470226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.472316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.811495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:10:59.824564 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32efabdc-3ce9-44f1-81ba-f27f07069ff0 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.374280 Nov 02 12:10:59.828459 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2099/4244] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:59 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:10:59.840999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85127f38-e58f-43ae-afc0-e7a74f7b1d61", "name": "network-vif-deleted", "tag": "99c40e87-d0ff-40d5-b939-20bfc69921a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:10:59.872588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.877089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.877089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.911048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_external_events [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] Unable to find a host for instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61. Dropping event network-vif-deleted {{(pid=127568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:10:59.912408 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7da62a33-eeef-41df-8d0f-65a19f542fe1 req-7d598583-e64f-409e-9344-439cc2148bfd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.082594 Nov 02 12:10:59.915219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2100/4245] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:10:59.931698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:10:59.933329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:10:59.948565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:10:59.949263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:10:59.950247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:10:59.950882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:10:59.951601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:10:59.953689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.955400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.961357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.961357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.961357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.962600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.976575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.979793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:10:59.982620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:10:59.984435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:10:59.999297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.000228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.061497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Getting quotas for project 89828af388aa4e9e96c081dba53344b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:11:00.075986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Getting quotas for user 7db4d8cee82b40b08b8f335cd27114ef and project 89828af388aa4e9e96c081dba53344b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:11:00.113329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:11:00.123094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:11:00.307655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:00.323262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2fb7bb94-9e9d-4bac-b366-302d515289ca tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.406646 Nov 02 12:11:00.326267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2101/4246] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:10:59 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:00.341823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-plugged", "status": "completed", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:00.349481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ddec925-5810-4bf0-92b1-99f0d9ceff04 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.811816 Nov 02 12:11:00.350387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2146/4247] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:11:00.361121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:00.361750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:00.368409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.369248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.369956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.409464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.409990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.410452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.411261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.412287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.412287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.426461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Creating event network-vif-plugged:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h1-855649-4 Nov 02 12:11:00.507905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:11:00.636446 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-db43af20-468d-4f07-8e42-466f9989fb52 req-693078f3-ca8b-44fa-9fac-bd54c974f69b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287045 Nov 02 12:11:00.637891 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2102/4248] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:00.644531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:00.645277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:00.683575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.683575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.694447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.700239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.701151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.701790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed3b14c6-fdce-490b-954e-5d1f4f13f37a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.530407 Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2147/4249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:00 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:00.942097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:00.949433 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 HTTP/1.1 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '85127f38-e58f-43ae-afc0-e7a74f7b1d61'} Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:00.951903 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:11:00.956937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:00.961438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:00.962466 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb26a396-88be-480c-9382-53804b37cc62 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 404 len: 111 microversion: 2.1 time: 0.079254 Nov 02 12:11:00.969630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2148/4250] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:00 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:00.972807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93f400ca-12f0-45ca-bc9b-3474767f7dfa tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:00.986797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93f400ca-12f0-45ca-bc9b-3474767f7dfa tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:01.221025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93f400ca-12f0-45ca-bc9b-3474767f7dfa tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:01.229335 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93f400ca-12f0-45ca-bc9b-3474767f7dfa tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1225 microversion: 2.1 time: 0.262419 Nov 02 12:11:01.247009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2149/4251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:00 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:01.255176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:01.259357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:01.275389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:01.283837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8bba785f-d66c-4e06-a0e8-cd6992d9ab4e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.644217 Nov 02 12:11:01.293350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:01.304429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:01.309950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:01.309950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:01.309950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:01.309950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:01.318263 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2103/4252] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:00 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:01.326339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:01.327027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:01.355577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:01.360754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:01.361913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:01.365853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:01.366384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:01.366965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:01.806046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:01.817766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef6f0aa6-60a3-46a1-b01e-0edf5d607787 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.580599 Nov 02 12:11:01.842395 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2150/4253] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:01 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:01.853415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:01.855807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ea05d5a2-0da8-4f6b-b72b-c94dda125859] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:01.867657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ea05d5a2-0da8-4f6b-b72b-c94dda125859 HTTP/1.1 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ea05d5a2-0da8-4f6b-b72b-c94dda125859'} Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:01.869599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:01.874460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:01.874460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:01.874460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:01.874460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. Nov 02 12:11:01.874460 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:01.881347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance ea05d5a2-0da8-4f6b-b72b-c94dda125859 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:01.884649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0832a275-5811-4a96-8686-b57685b18fcd tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ea05d5a2-0da8-4f6b-b72b-c94dda125859" status: 404 len: 111 microversion: 2.1 time: 0.034396 Nov 02 12:11:01.884649 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2151/4254] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:01 2022] GET /compute/v2.1/servers/ea05d5a2-0da8-4f6b-b72b-c94dda125859 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:01.904687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-991198827", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:02.049604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:11:02.070959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:02.090243 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27e34ea4-248e-441e-a222-c749468a950f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.770578 Nov 02 12:11:02.095961 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2104/4255] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:01 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:02.134140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:02.136802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:02.168150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:02.170090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:02.170750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:02.173016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:02.177400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:02.180847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:02.688447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:02.699651 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e1a537d-f983-4d7a-9ebb-22771f8ecdf0 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.589168 Nov 02 12:11:02.700527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2105/4256] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:02 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:02.730200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:02.730931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:02.746361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:02.747029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:02.750686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:02.750686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:02.750686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:02.750686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.138213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:03.147256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:11:03.148957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:11:03.150152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:11:03.151008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:11:03.151958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:11:03.165616 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a484859d-ce90-43ff-bd24-90a43e60baf3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.452136 Nov 02 12:11:03.167935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2106/4257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:02 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:03.175502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.177117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.177846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:03.179008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.189488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:03.196476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.202131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.202131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.204858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.205443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.205963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.206945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.207525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.208052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.253383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:03.290235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:11:03.309124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:11:03.316746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:03.331371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d886d4fb-0bd1-4a3e-b4fa-2f7fbbdf081a tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1221 microversion: 2.1 time: 0.160997 Nov 02 12:11:03.343298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2107/4258] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:03 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:03.343298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:03.343298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:03.347677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:03.349496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.350186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.350802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.351700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.352506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.354107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.371514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:11:03.376486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:11:03.540028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:03.549336 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58419a04-d9ce-4e6b-b2c3-a79f171cbaea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1682 microversion: 2.1 time: 0.214147 Nov 02 12:11:03.549943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2108/4259] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:03.557881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:03.558771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:03.567741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.568259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.568710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.569471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.569923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.570626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.580137 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9091370c-9e96-4272-a5e1-97cb4d3f14f5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695565 Nov 02 12:11:03.581195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2152/4260] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:11:03.586495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:03.587656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:03.603571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.603571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.603571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:03.604550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:03.605196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:03.605805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.024979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.037030 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45233b14-1433-470d-8c1b-843c3b5884fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.454537 Nov 02 12:11:04.037631 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2153/4261] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:03 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.042864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.043521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.051215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.051719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.052161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.052886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.053538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.054011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.062226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.071080 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc935a2a-1a99-4b5d-8000-068b0716b404 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.519800 Nov 02 12:11:04.071678 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2109/4262] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:03 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.079106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-513caede-186b-4f21-b364-d34b02d36b3b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.082688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-513caede-186b-4f21-b364-d34b02d36b3b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.152919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-513caede-186b-4f21-b364-d34b02d36b3b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.163053 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-513caede-186b-4f21-b364-d34b02d36b3b tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1214 microversion: 2.1 time: 0.088558 Nov 02 12:11:04.166934 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2110/4263] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.173204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.174035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.180941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.185629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.190256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.193666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.198934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.199794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.236995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=15,nova_cell1:SELECT=81,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:04.345667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.363060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c08908e-af98-42ba-8622-457adf577ff0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.323800 Nov 02 12:11:04.363749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2154/4264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.377857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:04.391844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.397612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.398557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.421691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Creating event network-vif-unplugged:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:11:04.430085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:11:04.446596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.446871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d2cc6085-7367-40b5-b861-a3f3a4e4a6b8 req-269351e3-5233-4dab-a867-83a7caf7617a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077709 Nov 02 12:11:04.456873 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2155/4265] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:04.458218 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27a0d3d0-5fd4-4bfe-9d2d-19929b94560c tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1482 microversion: 2.1 time: 0.289092 Nov 02 12:11:04.458925 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2111/4266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1482 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.486371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:04.486931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.487205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.488499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.508351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.510507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.511232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.512320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.512634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.514260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.516195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.516705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.517000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.517486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.518335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.520466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.664920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:04.687510 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b56daafb-288f-4718-a8ca-a908c9527b58 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1277 microversion: 2.1 time: 0.228460 Nov 02 12:11:04.688657 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2156/4267] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:04.694106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.695358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.702847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.703731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.704494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.705457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.706776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.707895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.759082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:04.902906 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a011776b-5928-4298-80fb-7e4e614cbce9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "POST /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c/action" status: 202 len: 0 microversion: 2.1 time: 0.421355 Nov 02 12:11:04.907117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2112/4268] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:04 2022] POST /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:04.916986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f8a7f2b-c244-4a5e-bbb8-3e53d990aa6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2144006278", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f8a7f2b-c244-4a5e-bbb8-3e53d990aa6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 238 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2144006278", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2144006278', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.937863 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 12:11:04.942828 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:04.948521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f8a7f2b-c244-4a5e-bbb8-3e53d990aa6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:04.950011 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f8a7f2b-c244-4a5e-bbb8-3e53d990aa6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041324 Nov 02 12:11:04.951213 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2113/4269] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:11:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:11:04.956779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:04.958097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:04.971455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.971455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.971455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:04.971455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:04.971944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:04.972406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.580403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:05.594581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-858151a6-bf0e-417a-8eb9-767dfa909a08 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.902276 Nov 02 12:11:05.606830 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2157/4270] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:05.625179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:05.626035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:05.647934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.651380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.651982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:05.652766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:05.657484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:05.657997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.164218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:06.188312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-235d9021-0893-49c5-96f1-3615bdf516d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1490 microversion: 2.1 time: 1.231576 Nov 02 12:11:06.189952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2114/4271] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:04 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1490 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:06.198947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:06.212465 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bce7819-35b8-4605-b9a4-6bd9f9ed8271 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.598485 Nov 02 12:11:06.227745 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2158/4272] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:05 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:06.233576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:06.238265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:06.244119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:06.247581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:06.256193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.256977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.258653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.258882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.259002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.259093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.259503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.260469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.260584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.264104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.264804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.265576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.857569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:06.870498 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2237cdce-8d5b-4a0d-8745-37beb5d468ae tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.678445 Nov 02 12:11:06.875457 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2115/4273] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:06 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:06.890736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:06.891688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:06.907362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.911220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.913151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:06.914816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:06.915854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:06.916360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.074598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:07.084519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:07.084685 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3cb730c-4960-48a3-8437-e48f05a86481 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.855487 Nov 02 12:11:07.085331 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2159/4274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:06 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:07.091618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:07.092546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:07.095666 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69a7cd27-3a32-4a72-8262-4e44de0e0c38 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1266 microversion: 2.1 time: 0.216420 Nov 02 12:11:07.100083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.109387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.109387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.109387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.109387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.109387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.109819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2116/4275] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:06 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:07.139951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:07.140864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:07.148738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.149702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.150149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.151088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.151694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.152335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.590794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:07.603404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d349859-bfd7-42c1-b90b-0dca5cade6cc tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.515886 Nov 02 12:11:07.604810 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2160/4276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:07 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:07.610290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:07.610910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:07.618175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.618956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.619430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.620377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.620999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.621582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.721878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:07.732711 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0bef1de-4cb9-43b9-ace7-5124fd549c54 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.620741 Nov 02 12:11:07.734119 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2117/4277] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:07 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:07.742826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:07.745888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:07.761405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.765694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.765694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:07.765694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:07.765694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:07.767336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.157749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.169677 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-babc0df8-0b28-4076-b7cd-9f4f58f8ce62 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.563368 Nov 02 12:11:08.191307 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2161/4278] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:07 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.194012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.198375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e955d576-f2c0-4c2e-af70-05fbbc0ea6d8", "tag": "a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:08.208917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aea1c7fc-6114-4ead-a1c9-a81041dff8d8 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1490 microversion: 2.1 time: 0.473295 Nov 02 12:11:08.210905 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2118/4279] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:07 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1490 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.214218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.214450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.215126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.230265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a26c475b-0af7-4ac7-b8ed-a54d3e9cd833 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-150981475", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:08.232499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] Creating event network-changed:a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9 for instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 on n-h2-855649-4 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a26c475b-0af7-4ac7-b8ed-a54d3e9cd833 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 234 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-150981475", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-150981475', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.235617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a26c475b-0af7-4ac7-b8ed-a54d3e9cd833 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a26c475b-0af7-4ac7-b8ed-a54d3e9cd833 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.027347 Nov 02 12:11:08.244990 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2119/4280] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:11:08 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:11:08.257580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5db14b73-6e11-408d-89a2-2826f457d168 req-fa6a5907-c831-40a3-a62f-6927741af81b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065971 Nov 02 12:11:08.259914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.262914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2162/4281] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:08.270479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-unplugged", "status": "completed", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:08.276914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:08.300575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.308126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.309876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.310967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.316430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.319111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.323357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.323839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.324277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.345537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] Creating event network-vif-unplugged:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:11:08.352561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1f4393ad-014f-4c7c-af06-0d145ac2b447 req-ef8e2414-32ec-4c56-b348-8267c64dd7b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087796 Nov 02 12:11:08.353242 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2163/4282] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:08.361326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:08.387456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.388763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.389370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.409026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Creating event network-changed:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:11:08.435582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:11:08.456610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a6c8c459-211c-4ac0-ae3c-22029c3e728b req-61eed715-4f54-429b-9177-4007e02ecb8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101704 Nov 02 12:11:08.458350 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2164/4283] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:08.462909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.463761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:08.471447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.472104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.472613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.473396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.473923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.474509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.781536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.790379 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f397ee50-bdc9-457c-8e25-3efd17eb3fdf tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.541924 Nov 02 12:11:08.791228 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2120/4284] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.792657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.796529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.797147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:08.800949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fe0e842-4ce0-403e-b4dc-cc98e38238c4 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1512 microversion: 2.1 time: 0.342479 Nov 02 12:11:08.802389 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2165/4285] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.808156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.809088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:08.816017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.816838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.817284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.818000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.818490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.818897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.834847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.835402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.836058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.836956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:08.837594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:08.838027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:08.982514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:08.991009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e8d7e3c6-c9c8-4698-b851-d48a6092954c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1272 microversion: 2.1 time: 0.198391 Nov 02 12:11:08.991616 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2121/4286] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:08.996175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:08.996833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.004472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.007669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.007669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.007669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.007669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.007669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.118460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:09.127713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cde71eb-c6fb-4392-b5e9-1d6852449032 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.323405 Nov 02 12:11:09.128533 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2166/4287] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:09.153500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:09.154346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.164065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.165370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.166078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.167644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.168747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.169661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.206096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:09.214586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ffad0d2-2df9-4a45-b04f-b3289bfa104f tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.221920 Nov 02 12:11:09.238889 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2122/4288] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:08 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:09.244045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:09.255934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.263092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.263595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.264040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.264750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.265251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.265709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.655125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:09.667047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdf21142-5c62-4511-9b64-e29c380509b4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.518311 Nov 02 12:11:09.668213 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2167/4289] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:09 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:09.697219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:09.697867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 4dffc56a-4a1f-4f06-b774-ee77f1f7f005] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.713288 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/4dffc56a-4a1f-4f06-b774-ee77f1f7f005/action HTTP/1.1 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 13 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: {"pause": {}} Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4dffc56a-4a1f-4f06-b774-ee77f1f7f005', 'body': {'pause': {}}} Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:09.721294 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 4dffc56a-4a1f-4f06-b774-ee77f1f7f005 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1dbb68d-5e89-46d5-896d-22e97a4c641a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/4dffc56a-4a1f-4f06-b774-ee77f1f7f005/action" status: 404 len: 111 microversion: 2.1 time: 0.030502 Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2168/4290] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:09 2022] POST /compute/v2.1/servers/4dffc56a-4a1f-4f06-b774-ee77f1f7f005/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:09.734295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.751924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.752359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.752884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.753603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.754058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.754485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.782655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:09.797169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e4def0f-ca8c-422f-8e53-42b9ceceb20e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1490 microversion: 2.1 time: 0.556870 Nov 02 12:11:09.798527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2123/4291] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:09 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1490 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:09.822802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:09.823725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:09.831942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.833810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.833810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:09.833810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:09.834118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:09.834622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.516966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:10.524114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:10.537937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-800ecb2e-fcc4-494f-b714-362c2fae73b9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.809339 Nov 02 12:11:10.538564 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2169/4292] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:09 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:10.542373 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d00fcc56-060b-4e06-a58f-8464377dfd6c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.716474 Nov 02 12:11:10.559210 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2124/4293] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:09 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:10.563778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:10.567791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:10.568810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:10.571730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:10.579362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.579904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.580315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.581509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.581973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.582595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.584267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.584774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.585242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.585951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.586406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.586874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.962076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:10.970652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:10.976117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ffdddaa-d38a-4faf-9506-40984638af9f tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.427776 Nov 02 12:11:10.976117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2125/4294] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:10 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:10.981253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:10.982044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:10.984964 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d94b5208-8238-4b66-b307-eca38dabf92b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1489 microversion: 2.1 time: 0.445057 Nov 02 12:11:10.985606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2170/4295] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:10 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1489 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:10.991148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.991148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.991148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.991754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:10.992220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:10.992655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:10.997167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:10.997928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.004487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.005212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.005715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.006492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.007382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.007902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.236639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:11.236809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:11.243374 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-92852d6d-a248-4930-99d6-91d6b06a4be4 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.267903 Nov 02 12:11:11.243554 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e3b0c92-a42c-4f02-a9f8-77fbf4fa3429 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.250361 Nov 02 12:11:11.247041 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2126/4297] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:10 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:11.247180 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2171/4297] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:10 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:11.250130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1191507966"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:11.252682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.255298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:11.256831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.260948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.261453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.261901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.262619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.263179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.263569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.264121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.265450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.266182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.271146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.271146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.271146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.380765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f45bad9-dd08-4321-9e66-96135ee93f3b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "PUT /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1062 microversion: 2.1 time: 0.134815 Nov 02 12:11:11.381742 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2172/4298] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:11:11 2022] PUT /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1062 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:11.387996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:11.388734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.396742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.397713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.398155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.398862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.399374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.399801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.511379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:11.523169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa273d7a-b518-4125-87f1-b412e47f07f1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1496 microversion: 2.1 time: 0.277516 Nov 02 12:11:11.533195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2127/4299] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:11 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1496 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:11.547032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:11.547969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.561227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.562384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.562843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.563680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.564313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.564754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.639607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5f6953d-fa0f-4936-82b5-b84766da19ec tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.256101 Nov 02 12:11:11.643407 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2173/4300] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:11 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:11.667327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:11.668223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:11.675909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.676887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.677622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:11.678665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:11.679371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:11.680008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.047777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:12.057807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0c2193f-a889-47cb-81de-31da46a4491f tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1489 microversion: 2.1 time: 0.523153 Nov 02 12:11:12.069005 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2128/4301] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:11 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1489 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.074826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.075583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.082787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.083456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.084135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.085117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.087487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.088241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.094617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:12.125519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:12.216876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:12.227069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee23637e-5c29-4dc6-bd36-5354882ca2d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.584907 Nov 02 12:11:12.239342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2174/4302] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:11 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.251652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.252451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.258946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.259795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.260523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.263551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.264315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.266069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.271150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:12.492210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afd236a4-860b-4a66-a7f1-2a53adb562b4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "DELETE /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 204 len: 0 microversion: 2.1 time: 0.421584 Nov 02 12:11:12.492826 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2129/4303] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:12 2022] DELETE /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:12.500038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.500785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.501487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:12.509823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.511796 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c250200-6faf-4749-9cf9-4b9a80d6d8cd tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.270927 Nov 02 12:11:12.512227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.512870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.513607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.514265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.514920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.515633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2175/4304] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.531472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.532380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.540617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.541353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.547731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.548766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.549413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.550013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.904829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:12.910172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:12.922840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ef6ce40-6454-4051-9d99-64759d242691 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1491 microversion: 2.1 time: 0.428060 Nov 02 12:11:12.923461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2130/4305] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1491 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.926702 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95d01f32-9736-45f3-871a-7a50fedd0e29 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.409688 Nov 02 12:11:12.930497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2176/4306] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:12.938509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.939814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:12.941487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.942457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:12.954318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.955331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.955451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.956211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.956620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.957082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.958866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.959411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.959860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:12.960684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:12.961997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:12.962679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.222760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:13.246170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.253553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.260982 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b273c801-45ac-4bd1-baa8-a7ff9c258078 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1489 microversion: 2.1 time: 0.332703 Nov 02 12:11:13.261585 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2131/4307] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1489 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:13.267104 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0ff83b2-adf7-4e1e-8b95-7ebed2a87114 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.331885 Nov 02 12:11:13.267104 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2177/4308] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:12 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:13.267303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:13.268027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.271009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:13.271442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.274808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.283039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.283039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.283039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.283358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.283445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.283519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.283594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.283594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.283735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.283735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.284091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.330758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:13.550114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.557291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.562911 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71d597ff-1b87-4099-b7c0-23761edd90c2 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.299962 Nov 02 12:11:13.565500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bd9d3f7-423b-490c-8356-7381c9a336e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.299592 Nov 02 12:11:13.571156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2178/4309] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:13 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:13.576094 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2132/4310] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:13 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:13.584028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:13.584831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.587356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:13.588077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.594234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.594739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.595267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.596050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.596514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.596839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.597086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.597703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.598329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.599295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.599969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.600721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.625120 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'pause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state paused Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 13 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: {"pause": {}} Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'pause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state paused Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'pause': {}}} Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state paused. Cannot pause while the instance is in this state. Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state paused Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:13.627040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state paused Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'pause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state paused {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b57d77b5-6006-4f87-869d-976f1e53f35e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 143 microversion: 2.1 time: 0.056188 Nov 02 12:11:13.630558 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2179/4311] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:13 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 143 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:11:13.635312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:13.636098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.639155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:13.643637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.644600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.645239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.646329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.647296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.649136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.795350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:13.804034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17676ca4-e4d0-4a3c-9201-e710a4000200 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.173552 Nov 02 12:11:13.804620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2180/4312] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:13 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:13.809115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e7b9d8-522b-418e-9b91-6ad44cede4f6", "tag": "ecefc547-1979-4db4-bceb-e2e0852e4f23"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:13.821560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.822226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.822662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.836007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] Creating event network-changed:ecefc547-1979-4db4-bceb-e2e0852e4f23 for instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 on n-h2-855649-4 Nov 02 12:11:13.840896 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9a38f651-d1f5-461e-85e5-07123db46e18 req-0bc2618b-d2be-4c3e-bcad-010682ce9d19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Nov 02 12:11:13.841500 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2181/4313] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:13.847617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:13.848330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.855015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.855740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.856188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.856909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:13.857361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:13.857954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:13.981808 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-196b411b-a80d-48eb-b543-e7fe12f73e48 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 204 len: 0 microversion: 2.1 time: 0.404298 Nov 02 12:11:13.982842 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2133/4314] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:13 2022] DELETE /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:13.992239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:13.992890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:13.999649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.000168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.000822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.001687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.002152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.002587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.029310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.039520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-909b6ccb-36d1-44e0-961c-d364bdfaedda tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.196492 Nov 02 12:11:14.040454 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2182/4315] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:13 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.046021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:14.048781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.056474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.057058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.057559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.058369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.058900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.059419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.157940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:14.233638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9165cad-ae5c-4b95-8648-b7cf80ce7cad tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.248305 Nov 02 12:11:14.234222 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2134/4316] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:13 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:14.239980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.240685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.247273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.250654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.250654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.250654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.250654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.250654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.285145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb31963e-585d-4a39-866a-6c2ad99888d4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.243223 Nov 02 12:11:14.302731 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2183/4317] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:14 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:14.308391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.309095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.316575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.317094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.318260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.318260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.318767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.319299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.436004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.445682 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d09ff97-b5ed-4056-a9e7-97323400d359 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.209903 Nov 02 12:11:14.447018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2135/4318] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.458015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.458756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.465806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.466349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.466927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.467824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.468244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.468674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.494653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.504935 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f485bc8-d2ab-4812-acd4-637e2f71ea41 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1495 microversion: 2.1 time: 0.200665 Nov 02 12:11:14.505619 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2184/4319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1495 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.510156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.510836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.520450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.521155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.521632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.522355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.522815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.523275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.666303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.677811 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9dfd92a-f065-4c66-87e1-a12a1bbceebb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1498 microversion: 2.1 time: 0.230422 Nov 02 12:11:14.678413 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2136/4320] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.683367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.684195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.691905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.692683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.693246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.694081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.694646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.695578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.698787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.707785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8451d5e9-9515-4643-a95e-5cf870476ce3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 0.201051 Nov 02 12:11:14.708365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2185/4321] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.713784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:14.714399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:14.721193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.722207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.722867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.723819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.724492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.725112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.912713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.920587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2539a77a-f1af-4101-a28a-6028944b08af tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.241015 Nov 02 12:11:14.930776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2137/4322] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.930776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e955d576-f2c0-4c2e-af70-05fbbc0ea6d8", "name": "network-vif-plugged", "status": "completed", "tag": "a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:14.931303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:14.936013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:14.936508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:14.937485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:14.939394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31ccfbe0-e56f-4dad-9805-a2a8879f3be9 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.229838 Nov 02 12:11:14.940163 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2186/4323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:14 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:14.950931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] Creating event network-vif-plugged:a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9 for instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 on n-h2-855649-4 Nov 02 12:11:14.956566 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9b910cc0-93ba-4209-af95-d732ce2c5c61 req-5844d724-56ef-497a-823f-61c666c76421 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034051 Nov 02 12:11:14.957160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2138/4324] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:15.063641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:15.064257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:15.071663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.072335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.072940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.073638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.074125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.074577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.259963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:15.269960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94ffc503-66d4-40d3-a7ab-2deb326bb160 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.210466 Nov 02 12:11:15.270552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2187/4325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:15 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:15.472127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:15.472860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:15.480008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.480539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.480972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.481673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.482158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.482557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.533398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:15.534131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:15.543582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.544378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.552397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:15.552397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:15.552397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:15.552397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.011104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:16.020934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-926d313b-5b42-4926-abd5-8ef632cb12a8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.554509 Nov 02 12:11:16.021715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2139/4326] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:15 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:16.038430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:16.039104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:16.046779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.052788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.052788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.052788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.052788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.052788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.066194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:16.076530 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01cfe4e5-0788-4899-8fd3-ec0085ca8111 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1495 microversion: 2.1 time: 0.547715 Nov 02 12:11:16.092239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2188/4327] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:15 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1495 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:16.099061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:16.099706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:16.105715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.106446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.106886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:16.107624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:16.108076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:16.109073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.029976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:17.040311 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1cbba64-5eba-41b0-ae8a-781cee844c93 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.017512 Nov 02 12:11:17.051402 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2140/4328] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:16 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:17.051402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:17.051402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:17.053301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.054251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.054870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.055863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.056325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.056758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.086056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:17.095108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3aa10f3a-3207-47d0-a202-86d73d30e7fd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 1.001679 Nov 02 12:11:17.097220 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2189/4329] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:16 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:17.102591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:17.103366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:17.110011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.110579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.111116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.111891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.112501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.112993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.684046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:17.695590 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68dc20d5-173d-4472-9aac-1b3df45a377c tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.653174 Nov 02 12:11:17.696398 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2141/4330] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:17 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:17.701567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:17.702209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:17.708733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.709222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.709655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.710431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.710880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.711329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.714593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:17.771178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:17.779547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-674cb40d-3ccb-4e6c-8162-3f3d9625f7d3 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1502 microversion: 2.1 time: 0.680975 Nov 02 12:11:17.780150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2190/4331] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:17 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1502 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:17.787323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:17.787323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:17.807942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.808475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.809157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:17.810014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:17.810516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:17.810945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.222593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:18.231344 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abd1ad3a-a0ff-417d-aec7-ec6994dfd7d2 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1468 microversion: 2.1 time: 0.533805 Nov 02 12:11:18.231935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2142/4332] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:17 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:18.241609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:18.245984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:18.250842 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e072aaae-1b16-4378-b995-5935c1affde7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.469146 Nov 02 12:11:18.251720 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2191/4333] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:17 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:18.251855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:18.252411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.256233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:18.256827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.260212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.261020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.261808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.263099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.264229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.265557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.273380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.274086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.274541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.275286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.275745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.276174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.552269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:18.555587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:18.562419 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c5176fb-0aa0-4435-ac02-de131317e28e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.313589 Nov 02 12:11:18.572973 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2143/4334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:18 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:18.585132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:18.585132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.588198 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-85a8dc59-e4de-4f53-ae58-f16fc9b732c1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1495 microversion: 2.1 time: 0.335627 Nov 02 12:11:18.591698 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2192/4335] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:18 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1495 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:18.607818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.608732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.609549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.610860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.611744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.612545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.628560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dd51b8-72ba-4c20-993c-2f71c5972d2c", "name": "network-vif-deleted", "tag": "4511f225-d05d-4b64-b003-a6e217af326d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:18.660280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.660964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.661475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.675770 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] Creating event network-vif-deleted:4511f225-d05d-4b64-b003-a6e217af326d for instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c on n-h1-855649-4 Nov 02 12:11:18.682313 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5466c2e5-bfb6-49c1-bd3f-4227e2b67d46 req-d926f85b-969c-4ac4-81b5-78b4373f8b7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073168 Nov 02 12:11:18.683452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2193/4336] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:18.691105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:18.695922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.708975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.710041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.711177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.712623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.713542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.714290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.743849 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action HTTP/1.1 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 28 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: {"reboot": {"type": "SOFT"}} Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '63d0b55c-9f35-4afd-ba10-58445d7403c2', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:18.745591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f541155-29fa-4dba-8bdb-87f1810a252e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action" status: 404 len: 111 microversion: 2.1 time: 0.062098 Nov 02 12:11:18.754212 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2194/4337] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:18 2022] POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:18.756421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:18.757095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:18.763749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.764260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.765302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:18.766127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:18.766528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:18.767026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.003085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:19.023289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7fcfd0e6-5f55-425e-bb0f-83a5c6797b5e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 0.448762 Nov 02 12:11:19.043509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2144/4338] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:18 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:19.055503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:19.058234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:19.076131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.079839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:19.080327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.080789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.081545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.082004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.082433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.109681 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6e0b657-c497-4e4f-9bab-8d1cf80d14c3 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1325 microversion: 2.1 time: 0.356983 Nov 02 12:11:19.112599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2195/4339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:18 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1325 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:19.130934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:19.131852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:19.145356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.146466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.147460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.148471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.149925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.150528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.267440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:19.273194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.273823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.274443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.275085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lazy-loading 'fault' on Instance uuid 04dd51b8-72ba-4c20-993c-2f71c5972d2c {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:19.410168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:19.486154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f373da1-26e1-42ca-9fda-d05335fa662e tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 200 len: 1302 microversion: 2.1 time: 0.357764 Nov 02 12:11:19.490769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2196/4340] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:19 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 1302 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:19.540073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:19.542235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:19.560441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.561002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.563280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.564035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.564517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.565016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.836191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:19.847828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f3cb4b8-d0ba-4c0f-92ae-71d6332195d4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.803002 Nov 02 12:11:19.851941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2145/4341] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:19 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:19.857724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-plugged", "status": "completed", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:19.876492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.877571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.878204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.891961 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] Creating event network-vif-plugged:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:11:19.898137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ff56b7af-5752-457c-a006-8992eb35f8cc req-cd9da7fb-db9b-4fe8-ac32-ee28766d953f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044424 Nov 02 12:11:19.898903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2146/4342] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:19.908073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:19.908073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:19.912432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.913063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.913708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:19.914446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:19.914907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:19.915373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.121852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:20.131914 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c7638c-c99f-4711-9f99-ebad9f63ba7c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1461 microversion: 2.1 time: 0.639475 Nov 02 12:11:20.132898 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2197/4343] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:19 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1461 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:20.138378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc67fb33-8548-49cd-8c26-197dde67e797", "name": "network-vif-deleted", "tag": "f5943c53-39f0-4a53-b832-e906977d1138"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:20.148416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.148939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.149371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.176080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] Creating event network-vif-deleted:f5943c53-39f0-4a53-b832-e906977d1138 for instance dc67fb33-8548-49cd-8c26-197dde67e797 on n-h2-855649-4 Nov 02 12:11:20.181227 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67d41f7c-f392-44db-beca-4447462e4b2f req-5f27efea-6330-4a54-8ad3-ac3c86a78ee2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046870 Nov 02 12:11:20.181853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2198/4344] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:20.188002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:20.188721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:20.196628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.197141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.197588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.198662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.199141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.200438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.274450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.275246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.275936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.276747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lazy-loading 'fault' on Instance uuid dc67fb33-8548-49cd-8c26-197dde67e797 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:20.302924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:20.317229 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c04eef36-1253-4c7f-80f6-3bca48d6c076 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.416330 Nov 02 12:11:20.318196 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2147/4345] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:19 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:20.327018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:20.327976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:20.338258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.339190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.340689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.342024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.344460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.349772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.772044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:20.781020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60567815-7749-4f77-a5c8-87218fe95cd1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 200 len: 1310 microversion: 2.1 time: 0.597350 Nov 02 12:11:20.781628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2199/4346] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:20 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 1310 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:20.786345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:20.786963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:20.797510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.798023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.798505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:20.799361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:20.799824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:20.800257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.001101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.010784 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a22bea9-0bf5-418e-a56b-d544c246e977 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.690947 Nov 02 12:11:21.011430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2148/4347] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:20 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.016793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.017743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.024564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.025428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.026127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.027125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.027789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.028459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.066815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.077975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0568f822-4efc-4c25-bdd5-1b744b6f938f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.294685 Nov 02 12:11:21.078605 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2200/4348] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:20 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.219789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.234365 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2badb381-e732-4a91-b980-8fda6c943814 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1522 microversion: 2.1 time: 0.220838 Nov 02 12:11:21.235370 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2149/4349] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.248027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.249945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: 04dd51b8-72ba-4c20-993c-2f71c5972d2c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.260987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.261995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.262749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.264410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.265463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.266194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.278682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.279403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.284774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] HTTP exception thrown: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. Nov 02 12:11:21.286286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Request method failure captured: Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c HTTP/1.1 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3UCjcgm-wT2rVuYL0eMVTQxwDa264r4nU4JmkcQz1np4VyZ35S_ho5gwJ7t_CESG8B_3mbpRdI64WcyvDQBiFOjQ9wCrjONcd4RBAvc6253QRL_AP0mHRwyUoqN9eYob3uACrcNpQhuArbXqwtkbX7uw4viHN_ne_amPUNHJLRL0s Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b94fe0c880364fc08c529278a30b2079 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b94fe0c880364fc08c529278a30b2079", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b94fe0c880364fc08c529278a30b2079 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueTestJSON-1405657906-project Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 51600b50f5594d4b8ae305d518a6ae1d Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueTestJSON-1405657906-project Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '04dd51b8-72ba-4c20-993c-2f71c5972d2c'} Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.286482 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. Nov 02 12:11:21.290155 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.292057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.292773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.293239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Returning 404 to user: Instance 04dd51b8-72ba-4c20-993c-2f71c5972d2c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:21.294126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.294868 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6c72c2f1-f91c-4064-bec6-cb2cccca7819 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c" status: 404 len: 111 microversion: 2.1 time: 0.057808 Nov 02 12:11:21.295205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.296411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.296815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2150/4350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/04dd51b8-72ba-4c20-993c-2f71c5972d2c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:21.305790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:21.309916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 8a72f127-f216-42e4-815b-17f50895ea52] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.317213 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/8a72f127-f216-42e4-815b-17f50895ea52/action HTTP/1.1 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 28 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: {"reboot": {"type": "SOFT"}} Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '8a72f127-f216-42e4-815b-17f50895ea52', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. Nov 02 12:11:21.318932 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 8a72f127-f216-42e4-815b-17f50895ea52 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa8ad6cb-a748-4519-a585-c2f494f18081 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/8a72f127-f216-42e4-815b-17f50895ea52/action" status: 404 len: 111 microversion: 2.1 time: 0.022701 Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2151/4351] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:21 2022] POST /compute/v2.1/servers/8a72f127-f216-42e4-815b-17f50895ea52/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:21.326569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:21.328597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.336067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.336670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.337081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.337919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.338376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.338803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.392333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68e1b752-673e-4172-a15a-eaf0950e87f4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 200 len: 322 microversion: 2.1 time: 0.068624 Nov 02 12:11:21.394726 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2152/4352] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:21 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 322 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:21.401575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.404052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.408939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:21.411309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.411805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.412321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.413222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.413621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.414049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.445238 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Request method failure captured: Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8/ips/invalid HTTP/1.1 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl5Q58UPPSP_Y8t1EaWI6mz9fu1khF40QgOJ6mYCGCTUJXS2_eBmx4d4MiDz5HMl-FRBeiTrF-VDr8DG-SBvTCZeQvhpyOEDDzj0-zkqfOzQiFyse8JnlKK44rRJDg7RpKtMEDxq6Ufo2SzPKtUdr_P5FuwmzHTHX4weg_Adwumm0Sg Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89828af388aa4e9e96c081dba53344b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7db4d8cee82b40b08b8f335cd27114ef Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance is not a member of specified network Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': 'e955d576-f2c0-4c2e-af70-05fbbc0ea6d8', 'id': 'invalid'} Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 12:11:21.451864 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.467121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:21.467121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c938110-31f9-4a25-8f48-d7bee527bc42 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.057012 Nov 02 12:11:21.467121 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2153/4353] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8/ips/invalid => generated 91 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:11:21.467121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.467121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.469927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.470227 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faf0c2f5-647e-496c-bc5d-f066937ab609 tempest-MigrationsAdminTest-18589353 tempest-MigrationsAdminTest-18589353-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1612 microversion: 2.1 time: 0.390263 Nov 02 12:11:21.470750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.471379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.472377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.473004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.473661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.475699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2201/4354] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1612 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.490356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.492062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.506783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:21.507428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.508076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.508811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.510127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.511133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.511688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.659840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.670015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75d1716a-a699-4f53-ad04-3c701824141c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.193016 Nov 02 12:11:21.670638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2202/4355] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.676265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.678544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.683260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.683749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.684182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.684963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.685453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.685835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.834648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:21.846568 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35face01-fa41-425d-aa10-0920584e4065 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.174453 Nov 02 12:11:21.847555 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2203/4356] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:21.847798 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8502816d-3e69-4097-9a5c-dbfa8efae730 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 204 len: 0 microversion: 2.1 time: 0.391507 Nov 02 12:11:21.848917 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2154/4357] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:21 2022] DELETE /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:21.856302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.862826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.864377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.864868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.865307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.865411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.865963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Failed to fetch instance by id 999 {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:11:21.866054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.866449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.866751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 12:11:21.866871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Request method failure captured: Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl5Q58UPPSP_Y8t1EaWI6mz9fu1khF40QgOJ6mYCGCTUJXS2_eBmx4d4MiDz5HMl-FRBeiTrF-VDr8DG-SBvTCZeQvhpyOEDDzj0-zkqfOzQiFyse8JnlKK44rRJDg7RpKtMEDxq6Ufo2SzPKtUdr_P5FuwmzHTHX4weg_Adwumm0Sg Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89828af388aa4e9e96c081dba53344b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7db4d8cee82b40b08b8f335cd27114ef Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 999 could not be found. Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '999'} Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 12:11:21.868548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:21.872318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:21.872318 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c920b9be-d5fd-43b8-be72-22cb4da8f906 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020370 Nov 02 12:11:21.879279 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2155/4358] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:11:21.884840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:21.885931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:21.896275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.896771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.897266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.897908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:21.898515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:21.898949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:21.947081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:22.055853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:22.066261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90b1e562-accd-4251-873e-8b902c8f9f31 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.217128 Nov 02 12:11:22.067064 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2204/4359] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:21 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:22.075906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.077926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.090394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.091202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.091784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.093334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.093894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.094434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.290919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:22.306431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21963949-4d37-4e5a-b4a8-a4b3796594ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.233809 Nov 02 12:11:22.307652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2205/4360] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:22.316464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.317480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.328907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.329714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.330412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.331604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.340624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.340624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.359525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 HTTP/1.1 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dc67fb33-8548-49cd-8c26-197dde67e797'} Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.362300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07fe89ce-a36c-4747-86db-516f2e192bf1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 404 len: 111 microversion: 2.1 time: 0.055181 Nov 02 12:11:22.366170 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2206/4361] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:22.373422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.374957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.379415 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7bb94cdd-0cbe-41d3-ae4d-7b5ead966f87 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 204 len: 0 microversion: 2.1 time: 0.498152 Nov 02 12:11:22.386839 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2156/4362] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:21 2022] DELETE /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:22.387215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.387215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.387215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.389435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.389435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.389435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.391758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.391758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.399527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.400025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.400506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.401237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.401694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.402130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.429911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:22.590804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:22.605650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:22.617781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1981db2-1677-4346-9337-bf3190b3c6c7 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.250506 Nov 02 12:11:22.619240 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2207/4363] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:22.625143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.626331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.639404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.641117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.642298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.643647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.644574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.645397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.867846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:22.871785 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cea966d7-b204-4103-9d95-b590c0e05967 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 204 len: 0 microversion: 2.1 time: 0.488192 Nov 02 12:11:22.872996 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2157/4364] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:22 2022] DELETE /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:22.882327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:22.887451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.887688 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4484818-64b1-4094-9700-afb546235a25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.266810 Nov 02 12:11:22.888390 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2208/4365] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:22.895874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.896629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.897223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.898108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.898736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.899194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.899425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.900467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.912804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.913910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.916403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.916832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.918338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.919269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.921131 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action HTTP/1.1 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 65 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '63d0b55c-9f35-4afd-ba10-58445d7403c2', 'body': {'rebuild': {'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043'}}} Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:11:22.923038 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af10913c-8312-41f1-9472-148c0bdaa43f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action" status: 404 len: 111 microversion: 2.1 time: 0.050722 Nov 02 12:11:22.932151 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2158/4366] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:22 2022] POST /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:22.937702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.937702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.948014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.948789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.949421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.950254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.950878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.951456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 HTTP/1.1 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dc67fb33-8548-49cd-8c26-197dde67e797'} Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:22.960915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b18749f-84af-4721-ac53-492d30b9ee68 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 404 len: 111 microversion: 2.1 time: 0.068542 Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2209/4367] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:22 2022] DELETE /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:22.976039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:22.981553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.985531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.985531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:22.985531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:22.985531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:22.985531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.301097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:23.313471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:23.316238 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00941fb2-7e5a-49fc-b266-51a9ae0410ef tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1467 microversion: 2.1 time: 0.387530 Nov 02 12:11:23.317001 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2159/4368] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1467 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.323430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62add932-5b3e-4f17-8810-8c82d86e42ff tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.363235 Nov 02 12:11:23.324007 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2210/4369] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:22 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.329873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.330090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.330564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:23.331126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:23.337408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.338155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.338895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.339644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.340101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.340789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.345703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:23.358756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.359651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.360346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.361116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.361857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.362073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.645285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:23.650804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:23.657056 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f3a28b8-5279-4e85-9cc7-6359c0f2dc77 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.338282 Nov 02 12:11:23.671190 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2160/4370] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.671395 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93f2e08d-8b5a-4fbf-b9b8-657c6da7f05f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.341205 Nov 02 12:11:23.671395 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2211/4371] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.671627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.671627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:23.677722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.678763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: dc67fb33-8548-49cd-8c26-197dde67e797] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:23.681811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.682643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.683433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.684706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.685735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.687045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.691616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.692772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.693770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.696364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.696364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.697216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.729793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 HTTP/1.1 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dc67fb33-8548-49cd-8c26-197dde67e797'} Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:23.733024 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance dc67fb33-8548-49cd-8c26-197dde67e797 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45c192b2-bb7b-4dd0-8517-91bb6c38de11 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797" status: 404 len: 111 microversion: 2.1 time: 0.066322 Nov 02 12:11:23.746659 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2212/4372] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/dc67fb33-8548-49cd-8c26-197dde67e797 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:23.756800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.756800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:23.762751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.763372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.763952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.764724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:23.765192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:23.765634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:23.963720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:23.977215 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3c46feb-db4e-410e-b3b4-f531d327846b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.317092 Nov 02 12:11:23.978073 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2161/4373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:23.985349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:23.986336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.001618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.003372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.004737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.006011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.006388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:24.006819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.007739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.016262 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-203611fa-8aa4-4cf0-95b1-ea5cea083008 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.274764 Nov 02 12:11:24.016957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2213/4374] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:24.022255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.022758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.031030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.031874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.032624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.033625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.034299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.034936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.052023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 HTTP/1.1 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'e9bc5d5c-374f-41c3-b062-22c514b5b861'} Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:24.053917 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.057406 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.058648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:24.060267 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c95ce41-4a85-4dcf-aff2-c5744a67bee8 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 404 len: 111 microversion: 2.1 time: 0.041864 Nov 02 12:11:24.064819 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2214/4375] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:24 2022] DELETE /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:24.070546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.071209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.078161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.078627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.079083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.079858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.080299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.080902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.282419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:24.303959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d57c5726-ec78-417c-9830-8324249fe5ca tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.323698 Nov 02 12:11:24.305160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2162/4376] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:24.315042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.317217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: e9bc5d5c-374f-41c3-b062-22c514b5b861] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.338276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:24.343452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.344878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.344878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.345141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.345531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.345950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.353259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5fc47f4-9c24-49df-9013-8f2882dc87b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.286858 Nov 02 12:11:24.354020 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2215/4377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:24 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:24.362764 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 HTTP/1.1 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e9bc5d5c-374f-41c3-b062-22c514b5b861'} Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.363981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance e9bc5d5c-374f-41c3-b062-22c514b5b861 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bef6d03b-b2e3-4f93-aff7-628788902e5d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861" status: 404 len: 111 microversion: 2.1 time: 0.058266 Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2163/4378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:24 2022] GET /compute/v2.1/servers/e9bc5d5c-374f-41c3-b062-22c514b5b861 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.382366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.383725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:24.384459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: d3913d57-c803-4ca1-9938-bf6ded3f4cec] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.386502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.387461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.387882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.388862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.389338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.390403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.393988 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/d3913d57-c803-4ca1-9938-bf6ded3f4cec/action HTTP/1.1 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 65 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd3913d57-c803-4ca1-9938-bf6ded3f4cec', 'body': {'rebuild': {'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043'}}} Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:11:24.397347 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance d3913d57-c803-4ca1-9938-bf6ded3f4cec could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:24.401286 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b5131e5-163b-4823-8dbf-cf3144aff615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/d3913d57-c803-4ca1-9938-bf6ded3f4cec/action" status: 404 len: 111 microversion: 2.1 time: 0.044665 Nov 02 12:11:24.402722 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2216/4379] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:24 2022] POST /compute/v2.1/servers/d3913d57-c803-4ca1-9938-bf6ded3f4cec/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:24.411060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.411876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.423633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.424771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.425483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.426585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.427295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.427963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.693472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:24.705926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:24.709941 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f10ad1df-7d78-4b03-8c18-f13c47ae5ccf tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.342034 Nov 02 12:11:24.711255 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2164/4380] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:24 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:24.720369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.721410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.729345 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a29707c5-8848-410f-bc0b-6674f63baf26 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1467 microversion: 2.1 time: 0.325556 Nov 02 12:11:24.730365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2217/4381] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:24 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1467 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:24.740891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:24.742022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:24.743431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.744307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.745527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.748025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.749858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.750690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.753577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.754773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.755607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.756857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:24.757688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:24.758453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:24.780802 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d HTTP/1.1 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '81b643d7-78e9-46d9-91c6-9b032c041e8d'} Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:24.783943 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a31593f-6f34-42da-bbb4-6511fa09c20b tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 404 len: 111 microversion: 2.1 time: 0.073850 Nov 02 12:11:24.792031 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2165/4382] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:24 2022] DELETE /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:24.796480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1688218992", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "f3132260-2b5f-490b-9b53-8a040d77422f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:24.908228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] validate_networks() for [('f3132260-2b5f-490b-9b53-8a040d77422f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:11:25.104647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:25.119214 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c10db25-a685-432c-80ca-1f9e49e32509 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.386782 Nov 02 12:11:25.122364 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2218/4383] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:24 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:25.129633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:25.130876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:25.143752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.144846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.146289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.147912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.149444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.150502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.454535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:25.469868 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc86f68a-1eaa-49fd-860d-913dd45f5820 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.347418 Nov 02 12:11:25.470931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2219/4384] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:25 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:25.479520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:25.480869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 81b643d7-78e9-46d9-91c6-9b032c041e8d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:25.492073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.492942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.493750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.495079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.495935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.496724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.520118 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d HTTP/1.1 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '81b643d7-78e9-46d9-91c6-9b032c041e8d'} Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:25.521767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 81b643d7-78e9-46d9-91c6-9b032c041e8d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b7dae86-7696-4bc9-952b-1dfb56706728 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d" status: 404 len: 111 microversion: 2.1 time: 0.051024 Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2220/4385] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:25 2022] GET /compute/v2.1/servers/81b643d7-78e9-46d9-91c6-9b032c041e8d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:25.536973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:25.538505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.538663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.539139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.539891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.540352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.540793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.655990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:11:25.656577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:11:25.657236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:11:25.657780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:11:25.658306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:11:25.669959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.670464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.672825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.674243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.675233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.676303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.705883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:11:25.713399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:11:25.731899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:25.734399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:11:25.737230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:11:25.743156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53608d91-0250-4474-809f-0434d1ffb091 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.217694 Nov 02 12:11:25.743864 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2221/4386] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:25 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:25.751552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:25.755141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:25.759747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.760863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.761435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.762847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.763586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.764244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.933202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:25.943332 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d944fdc5-0fb3-429a-be81-afb1847dde97 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.198110 Nov 02 12:11:25.944366 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2222/4387] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:25 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:25.955630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:25.956701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:25.969702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.971050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.972173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.973810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:25.974712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:25.975521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:25.996328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c29c857-ee22-467b-be0e-1b92bced91a2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206920 Nov 02 12:11:26.007646 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2166/4388] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:11:26.013440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.015393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.017509 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f HTTP/1.1 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '899aa726-7adf-4032-b6b0-184ce8a40b7f'} Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:26.021855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:26.030784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81be98a4-cc62-4a1f-9226-2eca217fb175 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 404 len: 111 microversion: 2.1 time: 0.077987 Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.036102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.037612 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2223/4389] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:25 2022] DELETE /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:26.047620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.048789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.080715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.081201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.085146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.086111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.086600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.089669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.455453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:26.463865 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe4b20cd-0f7e-45a7-a54b-d40c14dc91c3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.454693 Nov 02 12:11:26.464466 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2167/4390] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:26.470174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:26.470751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 878f6627-1b7d-4168-b773-2057f2da70ef] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.477702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:26.484461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/878f6627-1b7d-4168-b773-2057f2da70ef/action HTTP/1.1 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: {"restore": {}} Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '878f6627-1b7d-4168-b773-2057f2da70ef', 'body': {'restore': {}}} Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.489744 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 878f6627-1b7d-4168-b773-2057f2da70ef could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f8e5a7f-4e2b-448d-9149-d5a1ffab19ee tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/878f6627-1b7d-4168-b773-2057f2da70ef/action" status: 404 len: 111 microversion: 2.1 time: 0.022430 Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2168/4391] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:26 2022] POST /compute/v2.1/servers/878f6627-1b7d-4168-b773-2057f2da70ef/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:26.494056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a6ada6e-d49a-4f37-8366-80910bb93ed5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.494624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a6ada6e-d49a-4f37-8366-80910bb93ed5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.500610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97a86a1e-41ab-4b71-8f7f-62c653b4dc37 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1467 microversion: 2.1 time: 0.460534 Nov 02 12:11:26.502162 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2224/4392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1467 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:26.517371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.519200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 899aa726-7adf-4032-b6b0-184ce8a40b7f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.527508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.528362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.529014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.529975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.535575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.535575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.552848 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f HTTP/1.1 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '899aa726-7adf-4032-b6b0-184ce8a40b7f'} Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.554915 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 899aa726-7adf-4032-b6b0-184ce8a40b7f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad8ec72b-4d8f-46cd-bd9e-a22f54d1862e tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f" status: 404 len: 111 microversion: 2.1 time: 0.053298 Nov 02 12:11:26.562035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2225/4393] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/899aa726-7adf-4032-b6b0-184ce8a40b7f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:26.564191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.565024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.572969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.573509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.573953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.575929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.575929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.576233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a6ada6e-d49a-4f37-8366-80910bb93ed5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:26.576396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.584908 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a6ada6e-d49a-4f37-8366-80910bb93ed5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1215 microversion: 2.1 time: 0.095087 Nov 02 12:11:26.595420 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2169/4394] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:26.604732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.606584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.616635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.617187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.617811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.623208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.623208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.623208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.852491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:26.860726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:26.870476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5a6b96e-87b7-4020-a3df-beefecfc91d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.272768 Nov 02 12:11:26.870866 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2170/4395] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:26.888160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8048ae58-46ac-487e-9038-d41ca4f87f36 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.329582 Nov 02 12:11:26.888868 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2226/4396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:26.890606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.891304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.893774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.894422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.900928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.901176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.901575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.901876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.902295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.902396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.902756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.902858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.903218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.903711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.904171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.904775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.921985 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e HTTP/1.1 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '94b50c0c-1c29-480c-b19d-abaa92626a6e'} Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:26.923647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0d7a611-540d-4e38-bc13-65417246de10 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 404 len: 111 microversion: 2.1 time: 0.053767 Nov 02 12:11:26.928692 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2171/4397] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:26 2022] DELETE /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:26.932174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:26.932879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:26.940079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.940580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.941031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:26.941865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:26.942338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:26.942787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.236374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:27.252593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:27.258916 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e28999dc-577d-4a3d-97c7-092a8e7942e4 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.358487 Nov 02 12:11:27.258916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2227/4398] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:27.265137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a0824fe-e0ba-4838-bcab-99c66bd4cdd8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.336580 Nov 02 12:11:27.266246 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2172/4399] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:27.277380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.277976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: 94b50c0c-1c29-480c-b19d-abaa92626a6e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.286058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.287332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.287964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.288938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.289549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.290143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.305806 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e HTTP/1.1 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '94b50c0c-1c29-480c-b19d-abaa92626a6e'} Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.307701 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance 94b50c0c-1c29-480c-b19d-abaa92626a6e could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b5a6754-45fc-478e-886e-5d0362202e16 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e" status: 404 len: 111 microversion: 2.1 time: 0.035726 Nov 02 12:11:27.312134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2228/4400] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/94b50c0c-1c29-480c-b19d-abaa92626a6e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:27.315675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:27.315866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.317880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.318559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.322638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.327903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.327903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.327903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.327903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.328256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.328351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.328434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.328434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.328434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.328434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.328434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.342035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 HTTP/1.1 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc7e6380-6b10-41a0-b7a1-30f9a1e9b182'} Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:27.344648 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.348451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.349152 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47d43be1-c679-49de-9b94-9e460ad95214 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 404 len: 111 microversion: 2.1 time: 0.034703 Nov 02 12:11:27.349615 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2229/4401] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:27 2022] DELETE /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:11:27.353733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'restore' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: {"restore": {}} Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'restore' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'restore': {}}} Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state active. Cannot restore while the instance is in this state. Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.355398 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'restore' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.360125 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa5708f6-433a-4c32-aa4b-544c500d0790 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 145 microversion: 2.1 time: 0.048014 Nov 02 12:11:27.360855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.360971 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2173/4402] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:27 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:11:27.365476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: fc7e6380-6b10-41a0-b7a1-30f9a1e9b182] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.365700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.366273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.371875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.372565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.379825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.379963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.380068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.380147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.380221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.380303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.380392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.380466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.380466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.380466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.392226 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 HTTP/1.1 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'fc7e6380-6b10-41a0-b7a1-30f9a1e9b182'} Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.393804 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10a9dbc1-ae95-4675-a4f2-d9ff3a2fa3c9 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182" status: 404 len: 111 microversion: 2.1 time: 0.041373 Nov 02 12:11:27.398037 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2230/4403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/fc7e6380-6b10-41a0-b7a1-30f9a1e9b182 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:11:27.405641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.406806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.414481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 HTTP/1.1 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ef7da13b-6a84-4612-905f-46e1a05f1d20'} Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.416536 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.421136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce9ce7b2-40f1-45ab-b27a-dd5acca11e56 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20" status: 404 len: 111 microversion: 2.1 time: 0.017041 Nov 02 12:11:27.423698 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2231/4404] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:27 2022] DELETE /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:27.429321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.430028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: ef7da13b-6a84-4612-905f-46e1a05f1d20] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.437138 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 HTTP/1.1 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ef7da13b-6a84-4612-905f-46e1a05f1d20'} Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:27.439085 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance ef7da13b-6a84-4612-905f-46e1a05f1d20 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f6a87d6-3e35-44ca-ad50-c7399ae921f1 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20" status: 404 len: 111 microversion: 2.1 time: 0.017277 Nov 02 12:11:27.447666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2232/4405] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/ef7da13b-6a84-4612-905f-46e1a05f1d20 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:27.451402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.452460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.459417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.459924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.461945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.463008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.463508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.463954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.498888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:27.591893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:27.600622 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a89d1fb-9586-4092-9218-41db6f4ace8d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.238654 Nov 02 12:11:27.601216 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2174/4406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:27.606127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.607027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.614509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.615968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.616708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.617690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.618549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.618932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.772079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:27.781216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e13e94ce-3956-4072-96db-2f62c6cbbfb8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.178930 Nov 02 12:11:27.796334 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2175/4407] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:27.805204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e7b9d8-522b-418e-9b91-6ad44cede4f6", "name": "network-vif-plugged", "status": "completed", "tag": "ecefc547-1979-4db4-bceb-e2e0852e4f23"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:27.815932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.816413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.816846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.829062 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] Creating event network-vif-plugged:ecefc547-1979-4db4-bceb-e2e0852e4f23 for instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 on n-h2-855649-4 Nov 02 12:11:27.834831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d91ff945-cd49-4e96-823d-b9b948788962 req-88d05cd5-c895-4ffa-8606-5b1934812d37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037137 Nov 02 12:11:27.835756 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2176/4408] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:27.845500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.845500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.849948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.850436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.851055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.851940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.852566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.852915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.937507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa9be3e8-3d84-4fc3-ad5e-77f43727066d tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 204 len: 0 microversion: 2.1 time: 0.489863 Nov 02 12:11:27.938166 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2233/4409] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:27 2022] DELETE /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:11:27.944310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:27.950810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:27.953589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.954131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.954576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.955356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:27.955822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:27.956270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:27.979007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:28.040194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.043019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.050672 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdbbf07f-766c-46d2-8ee4-db1eefdd01c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1211 microversion: 2.1 time: 0.110932 Nov 02 12:11:28.050924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5704cdc-f062-4d2d-8ece-88da41e56a5b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1467 microversion: 2.1 time: 0.214049 Nov 02 12:11:28.051863 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2177/4410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1467 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.056646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.057273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.063453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.063972 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2234/4411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:27 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.064193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.064567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.065309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.065977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.066323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.073011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.073969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.081275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.081758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.082199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.082949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.084114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.084546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.309340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.315190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.324317 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddc2e083-af17-4436-8bc7-3d9882f3e198 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.259083 Nov 02 12:11:28.335024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2235/4412] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.335214 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5f5e80c-fa04-46a3-9712-882ab56e008a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.274939 Nov 02 12:11:28.335214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2178/4413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.335399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.335399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.335535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.335535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.343425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.343693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.343786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.343786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.343948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.343948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.344103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.344194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.344280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.344280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.344473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.344559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.557772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.560883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.568911 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eba20e4-cee8-4074-9a9a-0b0aa3736b28 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.238749 Nov 02 12:11:28.569872 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2179/4414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.571667 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d32541da-70ea-464f-b6a7-a6fca3141314 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1480 microversion: 2.1 time: 0.244541 Nov 02 12:11:28.572255 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2236/4415] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1480 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.576300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:28.577424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.594161 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/424a7ee3-4fbc-4a2c-b8c9-b5a481f10482/action HTTP/1.1 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 14 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: {"resume": {}} Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '424a7ee3-4fbc-4a2c-b8c9-b5a481f10482', 'body': {'resume': {}}} Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:28.600287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 424a7ee3-4fbc-4a2c-b8c9-b5a481f10482 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31489660-9565-43d8-b656-25ea6cc4756f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/424a7ee3-4fbc-4a2c-b8c9-b5a481f10482/action" status: 404 len: 111 microversion: 2.1 time: 0.030849 Nov 02 12:11:28.604316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2180/4416] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:28 2022] POST /compute/v2.1/servers/424a7ee3-4fbc-4a2c-b8c9-b5a481f10482/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:28.614262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.614926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.622189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.622674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.623143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.624368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.624819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.625242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.766318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:28.774394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42fafb53-1230-47e0-9cc2-03ede5a65417 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.164728 Nov 02 12:11:28.774966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2237/4417] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:28.798522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.799270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.807007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.807515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.807992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.808702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.808816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:28.809164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.809373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:28.809597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.816531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.817030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.817474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:28.818199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:28.818669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:28.819146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.160563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:29.163829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:29.176777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ddf7cc0-7faa-457c-89e8-82ab29c526a9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.382106 Nov 02 12:11:29.177905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:29.178099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2181/4418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:29.183357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:29.184053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:29.188502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6de4f1d4-ff9e-441c-b2e7-085deff07e48 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.383433 Nov 02 12:11:29.189803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2238/4419] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:28 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:29.197504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:29.198998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:29.207772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.208867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.209713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.216839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.218329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.219255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.219809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.220326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.220780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.221561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.222088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.222488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.397371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:29.414962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9221a464-af43-4f5c-b53e-dc00d3f6f3ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1267 microversion: 2.1 time: 0.223828 Nov 02 12:11:29.427347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2239/4420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:29 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:29.443247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:29.444229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:29.456094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.456894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.457854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.458949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.459635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.460069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.503406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'resume' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 14 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: {"resume": {}} Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: exception: Cannot 'resume' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'resume': {}}} Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state active. Cannot resume while the instance is in this state. Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:29.505743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'resume' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8556aec9-974b-4cb2-91d4-17b3c6239a82 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 144 microversion: 2.1 time: 0.079942 Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2240/4421] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:29 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 144 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:29.521470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:29.533376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.533933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.535547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.536766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.537233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.537712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.872323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:29.885197 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0389227f-6573-41c6-9127-5691c6a4e749 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1467 microversion: 2.1 time: 0.705951 Nov 02 12:11:29.885809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2182/4422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:29 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1467 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:29.892211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:29.893069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:29.906520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.909673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.910419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:29.914825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:29.914825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:29.914825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:30.045757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:30.054019 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-741359ef-0899-4334-9704-9d6a0c33f9a8 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.543606 Nov 02 12:11:30.070600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2241/4423] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:29 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:30.075913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:30.076820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:30.080624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:30.087264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:30.088044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:30.088652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:30.089544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:30.090178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:30.090755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:30.747271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:30.756064 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf591f1e-e260-47e1-b72a-05dd360e3e9e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.868623 Nov 02 12:11:30.767740 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2183/4424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:29 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:30.779562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:30.780741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:30.787118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:30.787458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:30.787900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:30.788624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:30.789081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:30.789509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.038099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:31.050495 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66bc7041-fdf4-4009-8976-defaec6a1d72 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1490 microversion: 2.1 time: 0.978369 Nov 02 12:11:31.051191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2242/4425] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:30 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1490 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:31.055757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:31.060282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:31.067040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.067543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.067984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.072853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.072853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.072853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.382177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:31.395343 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b34fbc3-8e5d-47a6-aed6-2851df954aa6 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1480 microversion: 2.1 time: 0.626286 Nov 02 12:11:31.396907 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2184/4426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:30 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1480 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:31.402313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4deaca1-0044-4227-ad3e-04f13e6e3e27", "name": "network-vif-deleted", "tag": "44528961-4e14-409f-8e98-2d3367350901"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:31.416964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] Creating event network-vif-deleted:44528961-4e14-409f-8e98-2d3367350901 for instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 on n-h2-855649-4 Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-531c24e6-f787-430b-bb94-2fa6e8f6bb55 req-e55a8db8-c477-4f3e-9be4-36cf974dbf49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036706 Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2185/4427] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:31.443824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:31.454145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.454642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.455376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.456527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.457423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.458059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.573228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:31.581265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:31.583460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd770dbf-13d9-490f-921d-9e2aaf8e72cf tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1273 microversion: 2.1 time: 0.145409 Nov 02 12:11:31.591856 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2186/4428] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:31 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:31.591856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:31.591856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:31.593311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:31.596908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.597394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.597829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.598528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.599005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.599429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.599889 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c50c9bba-2861-413f-b2f0-e9ec3d03c614 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1314 microversion: 2.1 time: 0.546751 Nov 02 12:11:31.601024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2243/4429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:31 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:31.606312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:31.608503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:31.618038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.618898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.619822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.620816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.621421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.622896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.810794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:31.828107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb09152d-bb2f-4568-9bf7-08ea50ef3110 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1425 microversion: 2.1 time: 0.226080 Nov 02 12:11:31.843407 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2244/4430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:31 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1425 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:31.849195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:31.850906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:31.869433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.869920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.870433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:31.871206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:31.871662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:31.872097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.345454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:32.357832 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8292edd9-2b09-40f7-9c82-3b6ebe0bd251 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.770693 Nov 02 12:11:32.368052 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2187/4431] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:31 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:32.373028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c876ade2-ded4-4f9f-b3ea-bad18284204c", "name": "network-vif-deleted", "tag": "370eff64-47a4-40a7-9f63-2aa3a22a5ed0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:32.379670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:32.390296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.390782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.391243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.397094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf1a3cd2-7a06-465c-8c0d-f8312673545e tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1528 microversion: 2.1 time: 0.548250 Nov 02 12:11:32.397094 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2245/4432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:31 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:32.412971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:32.413526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:32.432357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.433765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.434743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.435983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.436834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.437492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.438284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] Creating event network-vif-deleted:370eff64-47a4-40a7-9f63-2aa3a22a5ed0 for instance c876ade2-ded4-4f9f-b3ea-bad18284204c on n-h1-855649-4 Nov 02 12:11:32.457057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f49d788c-f162-4eda-94a3-dcce421d2fc4 req-0fff3683-3164-4af7-b8cd-9ef4b8d66aef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087319 Nov 02 12:11:32.458013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2188/4433] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:32.463783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:32.464813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:32.473077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.473578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.474024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.474756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.475245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.475679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.514693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.515396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.515897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.516417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lazy-loading 'fault' on Instance uuid c876ade2-ded4-4f9f-b3ea-bad18284204c {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:32.528218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.528930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.529388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.530447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lazy-loading 'fault' on Instance uuid c4deaca1-0044-4227-ad3e-04f13e6e3e27 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:32.624152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061232b519354d529edb34dba5dc41d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9740bb86881748288bac1afe5929bdff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:32.634893 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba239b69-858d-4dec-b182-3e19d6bd10e0 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 200 len: 1283 microversion: 2.1 time: 0.175694 Nov 02 12:11:32.635555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2189/4434] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:32 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:32.641126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07b6a168-4448-4c5a-8e3b-00cbf3e48c53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07b6a168-4448-4c5a-8e3b-00cbf3e48c53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 160 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "30d4505b-c465-4ce4-958f-871528754b05"}]}} Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': '', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'networks': [{'uuid': '30d4505b-c465-4ce4-958f-871528754b05'}]}}} Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '' Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:11:32.657741 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:11:32.662734 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:32.670587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07b6a168-4448-4c5a-8e3b-00cbf3e48c53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:32.676056 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07b6a168-4448-4c5a-8e3b-00cbf3e48c53 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.035360 Nov 02 12:11:32.676056 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2190/4435] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:11:32 2022] POST /compute/v2.1/servers => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:11:32.680012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:32.680890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:32.689495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.690326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.690971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.691909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.692583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.693218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.693332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51600b50f5594d4b8ae305d518a6ae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94fe0c880364fc08c529278a30b2079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:32.702784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8f96291-e53f-4182-a068-ed471c8efdd1 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 200 len: 1304 microversion: 2.1 time: 0.303262 Nov 02 12:11:32.714457 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2246/4436] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:32 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 1304 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:32.714457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:32.715178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:32.737616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.738213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.739622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.740507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.741104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.742472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.858838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:32.869315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71aa9969-9095-4a75-91df-20ca7181e6c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1273 microversion: 2.1 time: 0.193988 Nov 02 12:11:32.883042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2191/4437] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:32 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:32.883042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:32.883042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:32.896944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.897463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.897911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:32.898734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:32.899242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:32.899689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.184679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:33.194079 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8845146b-034c-4343-b496-aea9745891ab tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1501 microversion: 2.1 time: 0.486070 Nov 02 12:11:33.215738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2247/4438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:32 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1501 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:33.232004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.232004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.235064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.235735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.236811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.237755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.238380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.239045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.263211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:33.279448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd94583e-06e4-4979-97b9-98659da14634 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.406590 Nov 02 12:11:33.283783 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2192/4439] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:32 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:33.286620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.288440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.289980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.290893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lazy-loading 'fault' on Instance uuid 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:33.293216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:33.316955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.317643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.318102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.384316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:33.391674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97980dcc-e3c7-490c-8251-5af2935542c1 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 200 len: 1302 microversion: 2.1 time: 0.173851 Nov 02 12:11:33.392601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:11:33.393491 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2248/4440] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 1302 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:33.405615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.406511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.421015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.421877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.422540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.423537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.424209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.424846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.609113 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90c8aaed-cbdf-4698-ae1e-3bea1dd62e13 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6/action" status: 202 len: 0 microversion: 2.1 time: 0.323859 Nov 02 12:11:33.614060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2193/4441] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:33 2022] POST /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:33.624846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.627493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.664530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.664530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.664530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.664530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.664921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.665221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.710474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:33.721712 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3b3f4c2-e311-46ed-9741-49c4ebdf46e3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.325215 Nov 02 12:11:33.721926 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2249/4442] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:33.735161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.735161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.740636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.740636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.740636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.741915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.742401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.742929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.768577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.771115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.772167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.776283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lazy-loading 'fault' on Instance uuid e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:33.884169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7db4d8cee82b40b08b8f335cd27114ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89828af388aa4e9e96c081dba53344b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:33.900231 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61a4eeb4-0079-4e08-9b57-48192aa64396 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 200 len: 1315 microversion: 2.1 time: 0.284453 Nov 02 12:11:33.900991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2194/4443] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:33.905741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.906432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] [instance: c876ade2-ded4-4f9f-b3ea-bad18284204c] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.914255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.914526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.914933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.915805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.916365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.916832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.932396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] HTTP exception thrown: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Request method failure captured: Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c HTTP/1.1 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1MDPBaJuGJS3sJ-0jiQClyKL5PBTHWdQZd73kwN_HIrXTcB3OdtDOUhXxndHgIEvLASuHAp3gO4WJmJoYIRiu9lVkpbeILJtOkga-kwYc4eTa77b90cuU8qD8HMVCrB5DtKADt7PMvOnjaT9Qx0eXK_W6XB4lnccQY9PkTMHz6PqY Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9740bb86881748288bac1afe5929bdff", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9740bb86881748288bac1afe5929bdff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9740bb86881748288bac1afe5929bdff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersTestJSON-2003362943 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9740bb86881748288bac1afe5929bdff Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersTestJSON-2003362943 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 061232b519354d529edb34dba5dc41d1 Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersTestJSON-2003362943-project Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c876ade2-ded4-4f9f-b3ea-bad18284204c'} Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:33.934151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] Returning 404 to user: Instance c876ade2-ded4-4f9f-b3ea-bad18284204c could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:33.938830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82255122-dcda-4d1e-81e5-be8434f13110 tempest-ServersTestJSON-2003362943 tempest-ServersTestJSON-2003362943-project] 10.222.0.48 "GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c" status: 404 len: 111 microversion: 2.1 time: 0.035266 Nov 02 12:11:33.942167 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2195/4444] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/c876ade2-ded4-4f9f-b3ea-bad18284204c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:33.948155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:33.949407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] [instance: c4deaca1-0044-4227-ad3e-04f13e6e3e27] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:33.956400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.956952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.957815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.958099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:33.958703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:33.961017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:33.975023 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] HTTP exception thrown: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Request method failure captured: Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 HTTP/1.1 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3UCjcgm-wT2rVuYL0eMVTQxwDa264r4nU4JmkcQz1np4VyZ35S_ho5gwJ7t_CESG8B_3mbpRdI64WcyvDQBiFOjQ9wCrjONcd4RBAvc6253QRL_AP0mHRwyUoqN9eYob3uACrcNpQhuArbXqwtkbX7uw4viHN_ne_amPUNHJLRL0s Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b94fe0c880364fc08c529278a30b2079 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b94fe0c880364fc08c529278a30b2079", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b94fe0c880364fc08c529278a30b2079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b94fe0c880364fc08c529278a30b2079 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueTestJSON-1405657906 Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueTestJSON-1405657906-project Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 51600b50f5594d4b8ae305d518a6ae1d Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueTestJSON-1405657906-project Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c4deaca1-0044-4227-ad3e-04f13e6e3e27'} Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:33.984826 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. Nov 02 12:11:33.989404 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:33.990823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] Returning 404 to user: Instance c4deaca1-0044-4227-ad3e-04f13e6e3e27 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:33.991854 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17edcc5d-668e-4f57-a1df-779bd14d3763 tempest-ServerRescueTestJSON-1405657906 tempest-ServerRescueTestJSON-1405657906-project] 10.222.0.48 "GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27" status: 404 len: 111 microversion: 2.1 time: 0.049075 Nov 02 12:11:33.992432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2196/4445] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/c4deaca1-0044-4227-ad3e-04f13e6e3e27 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:33.997763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:33.998364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 01144dc9-a960-452d-8f84-db5e559cfcf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.008767 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/01144dc9-a960-452d-8f84-db5e559cfcf3/action HTTP/1.1 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 14 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: {"shelve": {}} Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '01144dc9-a960-452d-8f84-db5e559cfcf3', 'body': {'shelve': {}}} Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:34.021618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 01144dc9-a960-452d-8f84-db5e559cfcf3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcb24bac-5849-4ecd-90c3-7d802c823516 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/01144dc9-a960-452d-8f84-db5e559cfcf3/action" status: 404 len: 111 microversion: 2.1 time: 0.031147 Nov 02 12:11:34.026454 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2197/4446] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:33 2022] POST /compute/v2.1/servers/01144dc9-a960-452d-8f84-db5e559cfcf3/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:34.033703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:34.038640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.041513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:34.045264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:34.048154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.048714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.049169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.050053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.050464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.051137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.053547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e53dacdd-0591-4feb-8e0e-29f3253e98e5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.330441 Nov 02 12:11:34.063830 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2250/4447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:33 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:34.076551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:34.077305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.087006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.087562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.088221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.096092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.096900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.097602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.490165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:34.503892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:34.507366 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-16d28141-81ea-49a5-95b7-15f6ac1b5f92 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.478752 Nov 02 12:11:34.510157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2198/4448] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:34 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:34.514100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3acbe6c4-d2c8-4f6c-977c-dfb9a1372c74 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.448912 Nov 02 12:11:34.515010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2251/4449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:34 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:34.520264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a", "name": "network-vif-deleted", "tag": "6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64"}, {"server_uuid": "e955d576-f2c0-4c2e-af70-05fbbc0ea6d8", "name": "network-vif-deleted", "tag": "a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:34.529016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:34.530729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.536486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.543124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.543124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.543378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.543378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.543378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.543830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.544507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.546290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.558643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Creating event network-vif-deleted:6a6836c3-0fff-4d35-8d2d-b3c5a85c2c64 for instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a on n-h2-855649-4 Nov 02 12:11:34.559404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] Creating event network-vif-deleted:a11c6a4a-3ac3-42c9-bdc4-53a178dd40b9 for instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 on n-h2-855649-4 Nov 02 12:11:34.568295 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-435018a6-23b1-4267-944a-70ad49fd5f34 req-441955d6-e9c8-43b7-8ffd-cbbb97b6665c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051656 Nov 02 12:11:34.569888 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2252/4450] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:34.570002 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] HTTP exception thrown: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Request method failure captured: Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a HTTP/1.1 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0D1w0wqAgkSHBUsoSu9SLbhHyPW7NW-Ehoaqsh2buIgqHyQvJ3CjKVB0axoZ71ppyqa4C0TnHiz_ziHGHFtzF7jTgZYfQtlwuKTFhpNfH6MhnUu_tGooLk_9QNv1PD68wGrMPa-_M-nQDoRL3f1idUFezbtKh1z3-Ypg0bOibgim4 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b682b29c6b1e4ec5ba8150751c940ff7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: dcc5d089a97c4aac8ea9a1920e2f64e6 Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a'} Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:34.571501 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Returning 404 to user: Instance 9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:34.575364 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1df11a6e-e7a5-4779-9a04-b15ad068d02b tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a" status: 404 len: 111 microversion: 2.1 time: 0.061427 Nov 02 12:11:34.576986 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2199/4451] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:34 2022] GET /compute/v2.1/servers/9dfbbe52-3535-4a03-8ad8-aa1b193d5d5a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:34.581895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:34.582661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.587596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:34.587596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.590096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.590669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.591222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.591868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.592063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.593195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.593546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.593770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.594328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.595318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.596006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.596612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.627960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:34.814194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:34.825509 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-877264fe-c661-49c1-8093-aa8eeed54aba tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.253834 Nov 02 12:11:34.828134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2253/4452] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:34 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:34.853306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:34.853862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:34.869732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.869732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.879243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.879243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:34.879243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:34.879243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:34.892256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:34.913132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'flavor' on Instance uuid ee124e40-ea65-4c8f-a1aa-2886a999e4cf {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:35.127300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-11a84060-bbef-4b79-a63f-20f8c8e7c569 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 204 len: 0 microversion: 2.1 time: 0.547972 Nov 02 12:11:35.131962 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2200/4453] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:34 2022] DELETE /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:35.138492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:35.140638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] [instance: e955d576-f2c0-4c2e-af70-05fbbc0ea6d8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:35.154401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.160561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.160561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.160561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.160561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.160561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.199076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] HTTP exception thrown: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Request method failure captured: Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 HTTP/1.1 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl5Q58UPPSP_Y8t1EaWI6mz9fu1khF40QgOJ6mYCGCTUJXS2_eBmx4d4MiDz5HMl-FRBeiTrF-VDr8DG-SBvTCZeQvhpyOEDDzj0-zkqfOzQiFyse8JnlKK44rRJDg7RpKtMEDxq6Ufo2SzPKtUdr_P5FuwmzHTHX4weg_Adwumm0Sg Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89828af388aa4e9e96c081dba53344b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89828af388aa4e9e96c081dba53344b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 89828af388aa4e9e96c081dba53344b3 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-533726577 Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7db4d8cee82b40b08b8f335cd27114ef Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-533726577-project Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e955d576-f2c0-4c2e-af70-05fbbc0ea6d8'} Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:35.204096 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] Returning 404 to user: Instance e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:35.218811 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6b7dc7e-e8a5-49f5-9499-fce335f12086 tempest-ServerAddressesNegativeTestJSON-533726577 tempest-ServerAddressesNegativeTestJSON-533726577-project] 10.222.0.48 "GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8" status: 404 len: 111 microversion: 2.1 time: 0.076849 Nov 02 12:11:35.231172 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2201/4454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:35 2022] GET /compute/v2.1/servers/e955d576-f2c0-4c2e-af70-05fbbc0ea6d8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:35.243911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:35.249201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:35.262833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.264772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.266151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.267859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.269028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.270075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.624781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3955ae56-b4da-4b8a-8458-442671d09d98 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.774288 Nov 02 12:11:35.626767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2254/4455] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:34 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:11:35.632990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:35.640660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:35.643511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.644235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.644871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.645777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.647431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.648165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.690154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:35.862686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:35.882567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcf4f057-6b77-4dd8-976a-d711fdf4588c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.652620 Nov 02 12:11:35.886224 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2202/4456] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:35 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:35.899622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:35.900348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:35.917640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.919153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.919633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:35.920458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:35.931706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:35.933215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:36.124472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:36.148803 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad4629e5-999d-4f70-9d10-ebcdf3bd9875 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1535 microversion: 2.1 time: 0.520005 Nov 02 12:11:36.165463 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2255/4457] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:35 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1535 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:36.165463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:36.165463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:36.176237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:36.178006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:36.179275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:36.180637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:36.181938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:36.182821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:36.400381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:36.409099 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce65d568-5883-471d-af2a-7500ad4d1c49 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.522316 Nov 02 12:11:36.411521 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2203/4458] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:35 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:36.627763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5436a9-0450-45b4-8a00-db0f6ff9f134", "tag": "415972ad-4904-4f8b-bba9-60b574163136"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:36.634778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:36.646805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:36.647473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:36.648402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:36.666285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] Creating event network-changed:415972ad-4904-4f8b-bba9-60b574163136 for instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 on n-h1-855649-4 Nov 02 12:11:36.672572 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec796549-7e35-41cc-b61f-d02e1e40c5ff req-9c3e575d-a460-47ef-9cfe-13fdfdb6d563 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050445 Nov 02 12:11:36.673519 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2204/4459] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:11:36.936603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:36.939573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:36.953192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:36.954383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:36.955473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:36.956988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:36.958055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:36.959082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:37.443512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:37.446381 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db3bc5ad-ac6f-4790-84ba-3fc895e9227a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 1.294153 Nov 02 12:11:37.455224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2256/4460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:36 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:37.476680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:37.477622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:37.488224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:37.488957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:37.489684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:37.491132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:37.491979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:37.492703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:38.119359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:38.133257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73ddecde-599f-4b28-9f22-a44f43ded36c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 1.205390 Nov 02 12:11:38.139223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2205/4461] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:36 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:38.143694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:38.148886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:38.182415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:38.183336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:38.184066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:38.184847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:38.185334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:38.191775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:38.464751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:38.478462 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7df90d31-17b5-49bc-a138-06241977a52c tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1535 microversion: 2.1 time: 1.013467 Nov 02 12:11:38.479468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2257/4462] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:37 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1535 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:38.489296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:38.490124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:38.502489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:38.504497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:38.505110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:38.506037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:38.506650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:38.507320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:38.952625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:38.967706 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2e2e25b-e39c-4d87-8662-391db1470684 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.832571 Nov 02 12:11:38.972213 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2206/4463] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:38 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:39.310189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:39.340791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-902b0b18-f270-4320-b687-5f83d0fe16a3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 0.858580 Nov 02 12:11:39.343115 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2258/4464] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:38 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:39.378655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:39.381282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:39.399056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:39.400412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:39.401394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:39.403359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:39.404645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:39.406164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:39.546549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:39.550414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:39.584214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:39.586538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:39.587490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:39.588301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:39.589049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:39.589649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:39.822813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:39.864015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40ba7f06-fa9a-4bff-a70a-3ca8ec459009 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1493 microversion: 2.1 time: 0.337187 Nov 02 12:11:39.868995 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2259/4465] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:39 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1493 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:39.887603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ebcdaf-e013-418e-9c2a-df708f03dbf3", "name": "network-vif-deleted", "tag": "101bfa8a-6d54-42eb-a487-5348e5b3a013"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:39.932624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:39.934970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:39.935612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:39.961852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] Creating event network-vif-deleted:101bfa8a-6d54-42eb-a487-5348e5b3a013 for instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 on n-h1-855649-4 Nov 02 12:11:39.984947 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-470f6c3e-81f5-4b2c-a34b-a4e19386a803 req-8fac401c-c817-46ea-a891-8230e4834c58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112205 Nov 02 12:11:39.985897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2260/4466] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:40.018160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:40.020521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:40.021443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:40.032065 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb56336b-600e-4140-bad7-6c6e0396c2d9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.851241 Nov 02 12:11:40.032449 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2207/4467] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:39 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:40.051477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.052284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.056453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:40.057492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.058135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.058731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:40.370419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:40.371331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:40.393339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:40.405562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.411803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.413083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:40.414788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.416428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.419799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:40.426542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd28d772-bd33-4245-8e2d-b46e4bbc37aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.415887 Nov 02 12:11:40.442825 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2261/4468] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:40 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:40.894637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:40.895431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:40.905722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.906239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.906687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:40.907463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:40.907925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:40.912470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:41.352170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:41.396614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ede0536e-56b3-46ba-9040-a28ff725c084 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1364 microversion: 2.1 time: 0.505423 Nov 02 12:11:41.397766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2262/4469] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:40 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:41.466255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:41.472251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:41.488441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:41.491591 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05c8268d-fa93-4a73-a8cb-777ff44a1aa0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 1.125547 Nov 02 12:11:41.492211 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2208/4470] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:40 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:41.503282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:41.507769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:41.521805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:41.527637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:41.528614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:41.529682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:41.530391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:41.531101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:41.536763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:41.539395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:41.549493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:41.551609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:41.552132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:41.552589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:42.290284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:42.368249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-892ef811-7072-474c-b110-3cbb183208b9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.869879 Nov 02 12:11:42.377900 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2209/4471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:41 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:42.448955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:42.454025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:42.488040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:42.489134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:42.494887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:42.496216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:42.497036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:42.497768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:42.757871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:42.758948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:42.762378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:42.763461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lazy-loading 'fault' on Instance uuid 63ebcdaf-e013-418e-9c2a-df708f03dbf3 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:42.827711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:42.861184 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c406399a-e822-458b-867e-501029229967 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 1.442259 Nov 02 12:11:42.891059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2263/4472] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:41 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:42.891542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:42.893253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:42.931395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:43.785344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:43.805233 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-415d3de8-f2e4-4f3e-8f90-f8815ec4ecc6 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 200 len: 1369 microversion: 2.1 time: 1.368760 Nov 02 12:11:43.821393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2210/4473] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:42 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 1369 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:43.835146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:43.836121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:43.853971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:43.855003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:43.855217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:43.856014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:43.856612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:43.857148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:44.612580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:44.655808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a27cc96c-84d5-49cf-bc76-047963621b8c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 1.772608 Nov 02 12:11:44.660649 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2264/4474] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:42 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:44.675350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:44.677536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:44.709854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:44.713051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:44.715005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:44.724205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:44.731741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:44.737070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:44.742119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:44.794947 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43efcf95-bcf4-4733-9f0d-db7dd87281c1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.964418 Nov 02 12:11:44.800368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2211/4475] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:43 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:44.862339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:44.864370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 63ebcdaf-e013-418e-9c2a-df708f03dbf3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:44.893451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:44.893451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:44.898062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:44.902853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:44.906383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:44.907357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:44.960765 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] HTTP exception thrown: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Request method failure captured: Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 HTTP/1.1 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0D1w0wqAgkSHBUsoSu9SLbhHyPW7NW-Ehoaqsh2buIgqHyQvJ3CjKVB0axoZ71ppyqa4C0TnHiz_ziHGHFtzF7jTgZYfQtlwuKTFhpNfH6MhnUu_tGooLk_9QNv1PD68wGrMPa-_M-nQDoRL3f1idUFezbtKh1z3-Ypg0bOibgim4 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b682b29c6b1e4ec5ba8150751c940ff7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: dcc5d089a97c4aac8ea9a1920e2f64e6 Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '63ebcdaf-e013-418e-9c2a-df708f03dbf3'} Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:44.965104 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Returning 404 to user: Instance 63ebcdaf-e013-418e-9c2a-df708f03dbf3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:44.978162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89b050b6-0ca7-4ba0-a413-7d7a3f848de5 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3" status: 404 len: 111 microversion: 2.1 time: 0.124275 Nov 02 12:11:44.985397 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2212/4476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:44 2022] GET /compute/v2.1/servers/63ebcdaf-e013-418e-9c2a-df708f03dbf3 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:11:45.003478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ea220ea-6aa3-4ecb-b2ea-8ff5a1eda42f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '.version_select at 0x7ff1b274d8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:45.180617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ea220ea-6aa3-4ecb-b2ea-8ff5a1eda42f tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795868134" status: 202 len: 0 microversion: 2.1 time: 0.188988 Nov 02 12:11:45.182895 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2213/4477] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795868134 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:11:45.379399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:45.400640 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad9d8d96-5ea2-46cf-b82f-7cf7e02ee0b8 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.737504 Nov 02 12:11:45.403198 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2265/4478] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:44 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:45.448630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5436a9-0450-45b4-8a00-db0f6ff9f134", "name": "network-vif-plugged", "status": "completed", "tag": "415972ad-4904-4f8b-bba9-60b574163136"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:45.469998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:45.471277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:45.497471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:45.549462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] Creating event network-vif-plugged:415972ad-4904-4f8b-bba9-60b574163136 for instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 on n-h1-855649-4 Nov 02 12:11:45.573131 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-29efb4bb-54c2-4f03-87e2-82b4e6a8e66b req-bca5c929-59c8-4102-ac02-580a5c2381ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292308 Nov 02 12:11:45.582650 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2214/4479] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:45.685630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:45.693298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:45.721173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:45.722065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:45.723110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:45.734662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:45.735475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:45.736251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:45.849900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:45.851331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:45.868848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:45.869934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:45.874088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:45.875645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:45.876287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:45.877945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:46.295312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:46.303961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:46.331455 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9289f53d-302b-4776-9766-764699c6c3e1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 0.634973 Nov 02 12:11:46.331455 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2266/4480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:45 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:46.332268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:46.343769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bba925ea-996b-4201-824d-0a4f0e379c07 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.497499 Nov 02 12:11:46.344898 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2215/4481] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:45 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:46.427532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:46.428157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:46.449313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:46.449934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:46.450383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:46.454147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:46.455598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:46.456234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:46.806870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:46.817154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bf9ef10-1b1f-4399-9745-edb4eae2ba06 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.393970 Nov 02 12:11:46.820050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2267/4482] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:46 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:47.363605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:47.373779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:47.397251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:47.397251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:47.426781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:47.427171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:47.428022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:47.428808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:47.431086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:47.433114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:47.434189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:47.434814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:47.436352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:47.437872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:47.438134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:47.438669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.023556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:48.036494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1c9a0a2-60d9-4072-b587-4d675d59b5d2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1533 microversion: 2.1 time: 0.679945 Nov 02 12:11:48.036715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:48.041517 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2216/4483] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:47 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1533 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:48.050351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:48.054551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:48.073057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.074614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74b2e1d0-72ff-445b-b2aa-264c35b3d71b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1315 microversion: 2.1 time: 0.688784 Nov 02 12:11:48.075965 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2268/4484] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:47 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:48.082110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.083002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.088667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.093046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.094523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.166269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:48.167099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:48.174354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.175295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.175950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.176869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.177336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.177929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.223798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:48.570872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:48.594531 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7eee9a38-4c9e-4be8-8d7f-c43e00f900e1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.551680 Nov 02 12:11:48.608294 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2217/4485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:48 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:48.660062 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-047ade43-7acd-4fd8-8be0-df34467e9384 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 204 len: 0 microversion: 2.1 time: 0.496990 Nov 02 12:11:48.661582 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2269/4486] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:48 2022] DELETE /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:48.674997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:48.676547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:48.692236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.694763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.694763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:48.695897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:48.696859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:48.697968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.081736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:49.085909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:49.106150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:49.138361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.139847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.140643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.141954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.142798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.143486 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-206f9456-3b60-42b5-af79-cb4c5a87e036 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1469 microversion: 2.1 time: 0.456485 Nov 02 12:11:49.144720 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2218/4487] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:48 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1469 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:11:49.161427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:49.162574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:49.167900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.199432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.199432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.199808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.200561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.201070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.202178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.630458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:49.660023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99ef5c81-732e-4f4a-8d28-1cf1fdff5f4c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1533 microversion: 2.1 time: 0.569789 Nov 02 12:11:49.660893 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2270/4488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:49 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1533 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:49.743608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:49.762863 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa07ccb4-5d28-404b-8905-ef8df094f0d1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1501 microversion: 2.1 time: 0.612275 Nov 02 12:11:49.771301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2219/4489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:49 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1501 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:49.774469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:49.776103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:49.787487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.790372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.791827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.796615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:49.798038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:49.799137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:49.843350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:50.182017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:50.197231 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af682d6c-91d8-4746-aef8-d8c62d23c35a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.428937 Nov 02 12:11:50.211452 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2220/4490] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:49 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:50.230762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:50.250805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.252582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.259537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:50.316193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:11:50.392600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-529535925", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:50.611511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:11:50.612222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:11:50.617317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:11:50.630134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:11:50.630134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:11:50.650044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.651279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.652057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:50.653510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.654406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.655434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:50.683315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ceabda80-8d3e-48ca-a85e-58b2613628c5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134/action" status: 202 len: 0 microversion: 2.1 time: 0.469296 Nov 02 12:11:50.694426 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2221/4491] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:11:50 2022] POST /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:50.703303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Getting quotas for project 2293ce5683fd44b69d896103a25e0641. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:11:50.709985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Getting quotas for user 12d7ce651b3e4e779b9ca71c6e09aab5 and project 2293ce5683fd44b69d896103a25e0641. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:11:50.710305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:50.715987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:50.728837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:11:50.731732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:11:50.738460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.739354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.740153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:50.746531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.747642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.748513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:50.910241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ce4f8d3-de5b-4007-8a67-c3c4459c8f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.247934 Nov 02 12:11:50.910939 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2271/4492] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:11:50.928497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "name": "network-vif-plugged", "status": "completed", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:50.985072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:50.987301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:50.987760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:51.025224 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] Creating event network-vif-plugged:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h1-855649-4 Nov 02 12:11:51.041133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0d557ab7-a224-42ad-ae97-bd65ad1e603a req-c57de2ab-fadf-4f64-b798-a41e4f7a9e63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123377 Nov 02 12:11:51.046767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2272/4493] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:51.058925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:51.061977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:51.079147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:51.079858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:51.080454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:51.081353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:51.081969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:51.082573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:51.494324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:51.516686 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adae9307-a0e0-4441-b5a1-df18cb8f221e tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1469 microversion: 2.1 time: 0.816643 Nov 02 12:11:51.517366 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2222/4494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:50 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1469 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:51.531344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:51.532308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:51.556833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:51.557708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:51.560000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:51.561768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:51.563906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:51.567786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:51.684435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:51.701785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09c8ee9f-56cc-47be-be12-23fd27a04c2e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.651540 Nov 02 12:11:51.702374 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2273/4495] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:51 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:51.707203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:51.707992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:51.874650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:51.888253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:51.897576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:51.899047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b45d968c-425c-46fb-ac56-cbc7238e6f2a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1277 microversion: 2.47 time: 0.195395 Nov 02 12:11:51.900497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2274/4496] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:11:51 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:11:52.024491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:52.041097 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d08faddf-37d7-4200-b1f3-f7d0a080a9cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.514882 Nov 02 12:11:52.043023 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2223/4497] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:51 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:52.070344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:52.072175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:52.119642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:52.138131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:52.142842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:52.147193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:52.150805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:52.151857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:52.611584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:52.647621 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5322220-5bcf-4eca-9285-4af554b3bae0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.593110 Nov 02 12:11:52.649853 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2224/4498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:52 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:52.787033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-872a7346-7fb0-4e54-9079-90b2c5c118c0 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Action: 'create', calling method: .version_select at 0x7ff1bb9618b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1616399733", "metadata": {"Type": "work"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:52.937369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3d93be-e3fc-43d5-b07e-371612caa450", "name": "network-vif-deleted", "tag": "89f3c7d7-3fa8-4b3e-9885-52d168fa0862"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:52.989242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:52.990603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:52.991380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:53.010400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] Creating event network-vif-deleted:89f3c7d7-3fa8-4b3e-9885-52d168fa0862 for instance 4c3d93be-e3fc-43d5-b07e-371612caa450 on n-h1-855649-4 Nov 02 12:11:53.019021 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-24baec92-22bc-464a-9856-846a908f28da req-4c05bda0-2ade-4b02-acb0-6c38d6021a28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.366871 Nov 02 12:11:53.021045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2225/4499] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:53.031934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-606653386", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:53.273042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:11:53.273826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:11:53.275703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:11:53.276992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:11:53.283981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:11:53.318926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:53.321045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:53.321586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:53.329673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:53.331827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:53.335706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:53.422784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Getting quotas for project 2293ce5683fd44b69d896103a25e0641. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:11:53.434485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Getting quotas for user 12d7ce651b3e4e779b9ca71c6e09aab5 and project 2293ce5683fd44b69d896103a25e0641. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:11:53.478651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:53.484238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:11:53.490310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:11:53.794799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65268829-e049-4ba6-b291-eb4b1ecfd665 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.771231 Nov 02 12:11:53.796711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2226/4500] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:11:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:11:53.817115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:53.818199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:53.831009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:53.831868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:53.832802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:53.834383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:53.835271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:53.836695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.026391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:54.027673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:54.028695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.030445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lazy-loading 'fault' on Instance uuid 4c3d93be-e3fc-43d5-b07e-371612caa450 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:11:54.153954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:54.191128 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-080ddfc0-a495-40e5-95e2-a7364b840628 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 200 len: 1303 microversion: 2.1 time: 0.381887 Nov 02 12:11:54.200559 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2227/4501] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:53 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 1303 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:54.229289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:54.233246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:54.257951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:54.258851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:54.259724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.261684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:54.262777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:54.265425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.464828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-872a7346-7fb0-4e54-9079-90b2c5c118c0 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.562212 Nov 02 12:11:54.466777 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2275/4502] 10.222.0.48 () {60 vars in 1156 bytes} [Wed Nov 2 12:11:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2565 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:11:54.489667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:54.491699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:54.524842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:54.525677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:54.526405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.533742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:54.535815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:54.537855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:54.899309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:54.942106 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5eca6076-3c17-445f-9372-cef7663b6548 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.739018 Nov 02 12:11:54.959941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2228/4503] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:54 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:55.019858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:55.019858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.062668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.071420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.072749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.077172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.078168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.079605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.115755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:55.127654 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b203ad79-5e9f-4f82-899c-657c31717a95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.658657 Nov 02 12:11:55.128610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2276/4504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:54 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:55.147041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e5ba6d4-f03f-4119-9e21-0bb2952e706f tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:11:55.150306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e5ba6d4-f03f-4119-9e21-0bb2952e706f tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.230619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:55.251771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e5ba6d4-f03f-4119-9e21-0bb2952e706f tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "PUT /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 991 microversion: 2.47 time: 0.120672 Nov 02 12:11:55.253622 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2277/4505] 10.222.0.48 () {62 vars in 1297 bytes} [Wed Nov 2 12:11:55 2022] PUT /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:11:55.264208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1680740b-1f84-4bd1-a5bf-29237419f76d tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b37145e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:55.533261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1680740b-1f84-4bd1-a5bf-29237419f76d tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.275913 Nov 02 12:11:55.534492 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2278/4506] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:11:55 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:55.554536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:55.558344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 4c3d93be-e3fc-43d5-b07e-371612caa450] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.614479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.615355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.616104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.617392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.618206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.618965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.714495 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] HTTP exception thrown: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Request method failure captured: Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 HTTP/1.1 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl0D1w0wqAgkSHBUsoSu9SLbhHyPW7NW-Ehoaqsh2buIgqHyQvJ3CjKVB0axoZ71ppyqa4C0TnHiz_ziHGHFtzF7jTgZYfQtlwuKTFhpNfH6MhnUu_tGooLk_9QNv1PD68wGrMPa-_M-nQDoRL3f1idUFezbtKh1z3-Ypg0bOibgim4 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b682b29c6b1e4ec5ba8150751c940ff7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: dcc5d089a97c4aac8ea9a1920e2f64e6 Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MigrationsAdminTest-81690541-project Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4c3d93be-e3fc-43d5-b07e-371612caa450'} Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:11:55.719116 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Returning 404 to user: Instance 4c3d93be-e3fc-43d5-b07e-371612caa450 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:11:55.737866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-486ecd49-5ddd-4df0-b38c-ef863bcfb946 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450" status: 404 len: 111 microversion: 2.1 time: 0.189059 Nov 02 12:11:55.739003 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2279/4507] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:55 2022] GET /compute/v2.1/servers/4c3d93be-e3fc-43d5-b07e-371612caa450 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:55.797864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:55.797864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.806339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:55.840372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9880cb9-6132-44aa-9d4d-7f07d2d9c5b3 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.878490 Nov 02 12:11:55.849334 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2229/4508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:54 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:55.870571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:55.875197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:55.893484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.900055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.903856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:55.908305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:55.909910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:55.914671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.067540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:11:56.162603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:56.246709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:56.263641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:56.266487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c4abcac-2f94-464d-9fda-6eae11d56931 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1277 microversion: 2.47 time: 0.523666 Nov 02 12:11:56.268031 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2280/4509] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:11:55 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1277 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:11:56.314366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:56.324480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:56.359592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:56.361158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:56.362206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.364087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:56.365348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:56.366564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.858845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:56.891817 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f370e6e6-f52c-4708-8158-859767aa933b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.608496 Nov 02 12:11:56.893588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2281/4510] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:56 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:56.903138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:56.904274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:56.916277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:56.917509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:56.918502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.920225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:56.921439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:56.922425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:56.923013 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98853b59-419a-4604-9479-e99a86c5eb9a tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 204 len: 0 microversion: 2.1 time: 1.068274 Nov 02 12:11:56.924016 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2230/4511] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:11:55 2022] DELETE /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:56.929941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-809c36ad-3842-4fec-968c-41d5db0c4aa4 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b2809790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:57.028681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-809c36ad-3842-4fec-968c-41d5db0c4aa4 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.103254 Nov 02 12:11:57.029927 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2231/4512] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:11:56 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:57.035721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:57.036829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:57.057525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.058353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.059053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.059998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.061192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.061974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.521386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:57.543872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6cec14ec-712b-464f-8d52-4883f1b32076 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.648510 Nov 02 12:11:57.550361 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2282/4513] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:56 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:57.555862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:57.560142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:57.578067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.582086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.582826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.583844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:57.584513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:57.588814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:57.965360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:57.999356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb0b923e-1681-49e0-be9d-1f4943d43f0a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.959583 Nov 02 12:11:58.001068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2232/4514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:57 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:58.010911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.014299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:58.029972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.030463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.031068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.032561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.033040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.033484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.291141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:58.334117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:58.336086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:58.337593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:58.340224 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce78cb41-636b-4d8c-9f01-9e4ea31d663e tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1273 microversion: 2.47 time: 0.337152 Nov 02 12:11:58.346952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2233/4515] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1273 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:11:58.347936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12b932a4-7b96-42d1-a902-f6ffb91fc9ca tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1469 microversion: 2.1 time: 0.796041 Nov 02 12:11:58.348541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2283/4516] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:57 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1469 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:58.366537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-229a1a22-46d8-4322-af43-68099efda610 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b3714dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.371319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.371319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:58.409230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.415457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.415457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.416528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.418118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.419237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.507083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-229a1a22-46d8-4322-af43-68099efda610 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 354 microversion: 2.1 time: 0.152834 Nov 02 12:11:58.523536 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2284/4517] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:58.529803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5072f9b-5986-47a1-8c76-953040a3a687 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1bb9955e0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.616960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5072f9b-5986-47a1-8c76-953040a3a687 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 354 microversion: 2.1 time: 0.091431 Nov 02 12:11:58.627959 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2285/4518] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:11:58.633657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:58.634573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:58.651165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.651939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.652604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:58.653559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:58.654415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:58.655210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.051090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:59.068559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c6fb686-ce29-424e-b2e6-94d7189c5c06 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.439098 Nov 02 12:11:59.072934 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2286/4519] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:59.096478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20f34420-054a-4898-a3bd-e6eabdc18a76 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1bb995310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:59.180902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:11:59.193635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c09e0127-f96e-41f6-a132-5f185f172a9d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.843810 Nov 02 12:11:59.194532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2234/4520] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:58 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:11:59.230136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:59.230407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:59.250311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.250840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.254491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.255463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.258905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.261150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.431246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20f34420-054a-4898-a3bd-e6eabdc18a76 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 202 len: 0 microversion: 2.1 time: 0.352296 Nov 02 12:11:59.434090 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2287/4521] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:11:59 2022] DELETE /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:11:59.446025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:11:59.446666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:11:59.476077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.479645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.481609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:11:59.488235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:11:59.489792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:11:59.490638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.007333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.066314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.069764 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e39f49c1-3b23-4d77-b04b-6018be2cff03 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1427 microversion: 2.1 time: 0.623512 Nov 02 12:12:00.070503 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2288/4522] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:59 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1427 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:00.079449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:00.079962 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ae6f3a5-39cb-47f1-b80f-e9c9b9d5d3e7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1511 microversion: 2.1 time: 0.856603 Nov 02 12:12:00.080556 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2235/4523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:11:59 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1511 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:00.080810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:00.095194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97318fb1-695f-4234-8e26-5a13a7dcd983 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b27991f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:00.106943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.112615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.113143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.113941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.115562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.122611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.216033 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97318fb1-695f-4234-8e26-5a13a7dcd983 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.134395 Nov 02 12:12:00.217580 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2236/4524] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:12:00 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:00.222483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:00.223666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:00.250483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.254096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.265959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.267091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.267581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.280947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.306077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.319447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:00.323366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.324975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.327500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08261f8f-9643-44eb-b548-7c28dfadae37 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1329 microversion: 2.47 time: 0.252940 Nov 02 12:12:00.330516 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2289/4525] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:00 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1329 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:00.336913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074cf49c-afef-46a3-9e03-05ee05510a2e", "name": "network-vif-deleted", "tag": "8ab57400-85c7-4699-ac0b-df77190257a6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:00.366569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.367089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.367598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.428860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] Creating event network-vif-deleted:8ab57400-85c7-4699-ac0b-df77190257a6 for instance 074cf49c-afef-46a3-9e03-05ee05510a2e on n-h1-855649-4 Nov 02 12:12:00.445621 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dfc4e306-e791-4e5d-ab58-10fd049924a5 req-a053e679-10e5-4b41-87fc-e88efcec6d0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113377 Nov 02 12:12:00.447300 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2290/4526] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:00.456258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:00.458300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:00.474770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.479838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.480574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.481504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:00.484783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:00.487125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:00.680579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:00.867347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:00.880666 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f3a5d16-6923-49bf-8064-62633f465ba9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.661410 Nov 02 12:12:00.895413 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2237/4527] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:00 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:01.027434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.047982 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9fd40b3c-68b5-4e8f-af25-0cf123be0c03 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.595160 Nov 02 12:12:01.051153 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2291/4528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:00 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:01.095276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.096003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.110593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.111698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.119331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.120174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.120918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.121827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.122452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.123147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.135321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.136112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.136714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.137584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.138174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.140008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.191014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:01.308441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.309587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.310059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.311961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lazy-loading 'fault' on Instance uuid 074cf49c-afef-46a3-9e03-05ee05510a2e {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:12:01.494322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc5d089a97c4aac8ea9a1920e2f64e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682b29c6b1e4ec5ba8150751c940ff7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.536262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fca6e8fb-f2eb-4c4e-8f8b-3ec2582916fb tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 200 len: 1303 microversion: 2.1 time: 0.446171 Nov 02 12:12:01.545555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2238/4529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 1303 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:01.568856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d16b561b-4f78-41f0-9f09-8c888fd33371 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b357fa60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.603172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.618601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c6f8321-1e38-46f8-af9d-622156743751 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1488 microversion: 2.1 time: 0.512388 Nov 02 12:12:01.631778 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2292/4530] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1488 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:01.655411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.656326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.677867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.679618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.680920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.682340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.684602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.692009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.727828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d16b561b-4f78-41f0-9f09-8c888fd33371 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.180538 Nov 02 12:12:01.728836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2239/4531] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:01.750002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.753951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.782563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.782563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.791924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.793735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.800093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.805145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.862145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.874779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.882368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:01.885848 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b599236d-d432-4986-87ce-2722d6448545 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1347 microversion: 2.47 time: 0.250605 Nov 02 12:12:01.887232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2293/4532] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1347 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:01.925364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:01.926471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:01.936510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.943352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.943352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.943352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:01.943352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:01.943352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:01.950249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:02.386762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:02.401759 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5fb8923-ceb8-43fb-892b-550824bd4957 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.485658 Nov 02 12:12:02.406495 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2294/4533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:01 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:02.413247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:02.413880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:02.426688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.436437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.436437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.436437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.436437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.436437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.579107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef881f74-8078-4f59-9116-b37067e1bfa5 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 204 len: 0 microversion: 2.1 time: 0.848704 Nov 02 12:12:02.581251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2240/4534] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:12:01 2022] DELETE /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:02.595205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:02.597830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] [instance: 074cf49c-afef-46a3-9e03-05ee05510a2e] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:02.635035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.636066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.643845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.644934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.645433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.646039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.672069 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] HTTP exception thrown: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Request method failure captured: Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e HTTP/1.1 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl0D1w0wqAgkSHBUsoSu9SLbhHyPW7NW-Ehoaqsh2buIgqHyQvJ3CjKVB0axoZ71ppyqa4C0TnHiz_ziHGHFtzF7jTgZYfQtlwuKTFhpNfH6MhnUu_tGooLk_9QNv1PD68wGrMPa-_M-nQDoRL3f1idUFezbtKh1z3-Ypg0bOibgim4 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b682b29c6b1e4ec5ba8150751c940ff7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b682b29c6b1e4ec5ba8150751c940ff7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MigrationsAdminTest-81690541 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b682b29c6b1e4ec5ba8150751c940ff7 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MigrationsAdminTest-81690541 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MigrationsAdminTest-81690541-project Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: dcc5d089a97c4aac8ea9a1920e2f64e6 Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MigrationsAdminTest-81690541-project Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '074cf49c-afef-46a3-9e03-05ee05510a2e'} Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:02.682010 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. Nov 02 12:12:02.687088 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:02.689145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] Returning 404 to user: Instance 074cf49c-afef-46a3-9e03-05ee05510a2e could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:02.690239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3894e9d-3ed5-4cc9-85ca-4501502dd816 tempest-MigrationsAdminTest-81690541 tempest-MigrationsAdminTest-81690541-project] 10.222.0.48 "GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e" status: 404 len: 111 microversion: 2.1 time: 0.104480 Nov 02 12:12:02.691751 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2241/4535] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:02 2022] GET /compute/v2.1/servers/074cf49c-afef-46a3-9e03-05ee05510a2e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:12:02.701473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:02.705764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:02.721517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.722389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.723261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:02.724468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:02.725122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:02.725765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.105806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:03.119418 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c733bc8-6887-48d2-b4dd-cadbf74529f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.711254 Nov 02 12:12:03.121420 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2295/4536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:02 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:03.128925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37dd7e25-aa96-4814-af6c-ce7392312011 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b3007ca0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:03.149135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:03.168646 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-863f17df-3518-42a9-a9a5-665e91889f3c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1494 microversion: 2.1 time: 0.474935 Nov 02 12:12:03.172780 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2242/4537] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:02 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:03.183148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:03.184845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:03.200403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.200978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.204597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.206632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.209699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.211232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.384100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:03.427432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37dd7e25-aa96-4814-af6c-ce7392312011 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.302669 Nov 02 12:12:03.428904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2296/4538] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:12:03 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:03.452523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:03.458230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:03.464425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:03.471507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:03.495054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.496332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.497152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.499027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:03.504587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:03.506099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:03.508661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:03.508869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:03.511216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d9341b5-d0d2-48c9-897a-fbde202c5e73 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1335 microversion: 2.47 time: 0.332987 Nov 02 12:12:03.511863 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2243/4539] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:03 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1335 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:04.144685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:04.150296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:04.151108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:04.165038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:04.171766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:04.174367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:04.175309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:04.176703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:04.179306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:04.194966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0dda8a97-549e-4300-a2d9-d8b45e958332 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.731059 Nov 02 12:12:04.212000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2297/4540] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:03 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:04.252843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:04.263926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:04.287309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:04.295603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:04.302294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:04.303834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:04.318699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:04.319918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:04.815213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:04.839013 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf0deb53-b92e-45df-aae9-2d3b9a080d80 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.692732 Nov 02 12:12:04.843612 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2244/4541] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:04 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:04.860384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95d36e71-d338-478a-8988-80e5313c028c tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b2809670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:04.950104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:04.965040 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b17e961-a20c-421d-ab55-9954aafde3c9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1494 microversion: 2.1 time: 0.750606 Nov 02 12:12:04.966306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2298/4542] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:04 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1494 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:04.985879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:04.987269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:04.994629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:04.998507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.002449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.003862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:05.004581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.008628 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95d36e71-d338-478a-8988-80e5313c028c tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 200 len: 353 microversion: 2.1 time: 0.161981 Nov 02 12:12:05.010097 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2245/4543] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:12:04 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:05.011213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.219853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:05.243527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:05.245288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:05.254291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:05.257650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:05.271032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a60de20d-72e8-4548-8d87-04988dac4c2b tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1335 microversion: 2.47 time: 0.301927 Nov 02 12:12:05.405155 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2299/4544] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:04 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1335 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.405357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.770401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:05.796104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ae2a818-98c1-4d01-986b-310deeb4c730 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.556849 Nov 02 12:12:05.823532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2246/4545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:05 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:05.877143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:05.879514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:05.896397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:05.898819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.902406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.903424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:05.904097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:05.904710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:05.991731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:05.991731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:06.014872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.016351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.019652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.030047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:06.033027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:06.034355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:06.175301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.890940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:06.901917 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7168d77d-ecf7-4d3c-ad63-707dea2cded0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 1.035872 Nov 02 12:12:06.902604 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2300/4546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:05 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:06.921799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6df062aa-1716-4863-955a-e2d59798d082 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Calling method '.version_select at 0x7ff1b3815430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:06.925189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:06.965507 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de645489-9e54-40bc-a1c6-792edd9cd758 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1494 microversion: 2.1 time: 0.974789 Nov 02 12:12:06.966187 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2247/4547] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:05 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1494 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:06.990837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:06.990837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:07.021635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.021635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.021635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.022437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6df062aa-1716-4863-955a-e2d59798d082 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] HTTP exception thrown: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6df062aa-1716-4863-955a-e2d59798d082 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Request method failure captured: Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 HTTP/1.1 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl6GcrfmPpg41-Of3uybnVJ1iPZhnE54LKJmms4JahnVlPPasAvIh4NbIEpA-j2-buGIy8gt9GcNno0LIwsWPy2Gp4a9vx7RZYnSNl09OIzx-23m57ZUiAEAPOwlxElVvWFfP2T-E30SSMuoe3EHUdE_88gNJTRCfGT5TO1TbGM0NL4 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 52a74c623993461e89d5e49c9afcf008 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesGetTestJSON-747514019 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52a74c623993461e89d5e49c9afcf008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52a74c623993461e89d5e49c9afcf008", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52a74c623993461e89d5e49c9afcf008"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52a74c623993461e89d5e49c9afcf008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesGetTestJSON-747514019 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 52a74c623993461e89d5e49c9afcf008 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesGetTestJSON-747514019 Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesGetTestJSON-747514019-project Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2d6d88df93cb4da6ad45a1fc7a27c4fc Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesGetTestJSON-747514019-project Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'cebec307-cf2a-4293-92fb-94974b8c9b36'} Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. (HTTP 404) (Request-ID: req-3b453da1-cbac-4418-a98e-e6df6e81167c) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:12:07.026489 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. Nov 02 12:12:07.031759 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:07.039652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6df062aa-1716-4863-955a-e2d59798d082 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] Returning 404 to user: Volume cebec307-cf2a-4293-92fb-94974b8c9b36 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:07.039652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6df062aa-1716-4863-955a-e2d59798d082 tempest-VolumesGetTestJSON-747514019 tempest-VolumesGetTestJSON-747514019-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36" status: 404 len: 109 microversion: 2.1 time: 0.124119 Nov 02 12:12:07.039652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2301/4548] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:12:06 2022] GET /compute/v2.1/os-volumes/cebec307-cf2a-4293-92fb-94974b8c9b36 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:12:07.040053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.047502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.048313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.062632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:07.063323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:07.089594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.098270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.098947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.099978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.101908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.106304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.219440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:07.241031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:07.246441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:07.255500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed42a5e-bb04-47db-9c4a-61c1fdb659fa tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1335 microversion: 2.47 time: 0.287472 Nov 02 12:12:07.264856 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2248/4549] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:06 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:07.949336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:07.950182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:07.972788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.978341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.978341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:07.978341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:07.978341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:07.978341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:08.529512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:08.541429 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bb6a7298-4272-4bdc-8705-e39bdb3a0da9 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 1.503849 Nov 02 12:12:08.543896 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2302/4550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:07 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:08.570378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:08.571363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:08.604391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:08.608744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:08.610528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:08.613516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:08.614416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:08.616114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:09.469954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:09.487967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9f153ba-625b-45e5-8d4b-dad05178a05a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1494 microversion: 2.1 time: 0.940011 Nov 02 12:12:09.490896 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2303/4551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:08 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1494 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:09.510596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:09.514347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:09.539191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:09.541732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:09.543455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:09.545994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:09.547758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:09.551515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:09.694628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:09.714331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad09246d-1c54-4eeb-88b5-6fa8bfb532ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 1.768841 Nov 02 12:12:09.717950 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2249/4552] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:07 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:09.731773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:09.733713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:09.752319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:09.755828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:09.756627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:09.771559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:09.772750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:09.773675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:09.865682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:09.906504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:09.923370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:09.940598 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eae7b446-cf37-4119-81ad-f4040ca4d3e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1356 microversion: 2.47 time: 0.441187 Nov 02 12:12:09.956279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2304/4553] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:09 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1356 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:10.004159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:10.039068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:10.100817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:10.102873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.109483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:10.113001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:10.115045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.119266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:10.698729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:10.730825 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f829a50a-eb75-4836-80f5-2b9f786c6585 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 1.009537 Nov 02 12:12:10.733259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2250/4554] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:09 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:10.747019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:10.760136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:10.814219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:10.820104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.820104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:10.820104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:10.820104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:10.821698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:11.150791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:11.150791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44e4a218-8a74-4f87-af57-0c6db26fec8a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1452 microversion: 2.1 time: 0.398484 Nov 02 12:12:11.150791 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2251/4555] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:10 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1452 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:11.151261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e7b9d8-522b-418e-9b91-6ad44cede4f6", "name": "network-vif-deleted", "tag": "ecefc547-1979-4db4-bceb-e2e0852e4f23"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:11.179227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:11.182293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:11.182293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:11.208707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] Creating event network-vif-deleted:ecefc547-1979-4db4-bceb-e2e0852e4f23 for instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 on n-h2-855649-4 Nov 02 12:12:11.220192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7978a0bb-2510-404a-b0ab-fbb2b3574a8b req-6065111c-4421-448e-82ee-2a9eff0a742c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076148 Nov 02 12:12:11.221555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2252/4556] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:11.250514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:11.262297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:11.290448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:11.291492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:11.292404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:11.293807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:11.295238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:11.295982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:11.823941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:11.853090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b04ddd70-8dae-4b44-80f7-deae914d88e1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.629236 Nov 02 12:12:11.867742 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2253/4557] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:11 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:11.882100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:11.882743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:11.904551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:11.907085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:11.911275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:11.914749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:11.914749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:11.914749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:12.542557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:12.559565 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-03904803-3023-4477-b4e9-63c3d9ec3fb2 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 0.690496 Nov 02 12:12:12.587218 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2254/4558] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:11 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:12.633144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:12.636668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:12.702246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:12.709141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:12.711938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:12.714959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:12.718032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:12.719021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:12.982709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.020632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:13.031485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:13.031485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:13.031485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'fault' on Instance uuid 45e7b9d8-522b-418e-9b91-6ad44cede4f6 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:12:13.227430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:13.264965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8895f317-99c1-4450-bd37-c77f222eebf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 200 len: 1304 microversion: 2.1 time: 0.675700 Nov 02 12:12:13.275086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2255/4559] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:12 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 1304 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:13.292699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:13.292699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:13.316381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:13.322553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:13.322553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:13.323316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:13.336447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:13.336447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:13.830789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:13.843869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e702690-5736-4979-9afd-8c44ab2d7582 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 0.567575 Nov 02 12:12:13.851110 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2256/4560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:13 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:13.853743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:13.854438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:13.880301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:13.880852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:13.881333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:13.882095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:13.882576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:13.883053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:15.011229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:15.069775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fd451cb-8bbe-47a6-8baa-8b8ace147f7e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1528 microversion: 2.1 time: 1.214283 Nov 02 12:12:15.120766 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2257/4561] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:13 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1528 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:15.141032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:15.145836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:15.175672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:15.184094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:15.189428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:15.197477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:15.198900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:15.200177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:15.256505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 HTTP/1.1 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '45e7b9d8-522b-418e-9b91-6ad44cede4f6'} Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:15.277737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:12:15.282111 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:15.286630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:15.290772 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd2d844a-de90-470d-8dfa-ba7e55daf7a4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 404 len: 111 microversion: 2.1 time: 0.172553 Nov 02 12:12:15.299815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2258/4562] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:15 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:12:15.329299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:15.330466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:15.354280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:15.360837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:15.361755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:15.365692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:15.371485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:15.372463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:16.624931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:16.624931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be98ef3a-b175-47fd-9051-a18c28c523d6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1511 microversion: 2.1 time: 1.277777 Nov 02 12:12:16.624931 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2259/4563] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:15 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1511 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:16.624931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1202589064", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:20.080759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=46 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:20.268456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=66 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:22.419669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] validate_networks() for [('82e7fbf5-1382-4e32-a3e1-b95c4ae36cb0', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:12:22.454013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:22.457723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:22.457723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:22.457723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:22.458214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:22.817468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:22.839891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:22.841994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:22.845968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:22.848553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:22.858314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:22.859629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:23.014182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b343134b-c01c-42e4-b2d1-ba4b4eb67287 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "POST /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871/action" status: 202 len: 1078 microversion: 2.47 time: 13.024131 Nov 02 12:12:23.031209 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2305/4564] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:12:09 2022] POST /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871/action => generated 1078 bytes in 13039 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 12:12:23.048229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:23.049224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:23.075379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:23.078042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:23.078042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:23.086595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:23.091455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:23.105432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:24.621882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:24.644232 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57300d98-cf12-4b07-bb50-72552abf91c8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1510 microversion: 2.1 time: 1.615055 Nov 02 12:12:24.651896 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2306/4565] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1510 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:25.181600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:25.182805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:25.183509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:25.184325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:25.185219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:25.223571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:25.247503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:25.252011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:25.264863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:25.266245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:25.267334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:25.272194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:25.380282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:25.416279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Getting quotas for user 2ce4613692b64ad7b7b8cf1f71189e58 and project 5ee082f52e7c47cd8c1e43a9c98dfaef. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:25.511796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:12:25.519190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:12:25.547611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1883648384", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "7262dc51-acbf-45b8-b6d3-5b3c74e9f00c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:25.707636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] validate_networks() for [('7262dc51-acbf-45b8-b6d3-5b3c74e9f00c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:12:25.803722 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29f7b3b4-1f71-4b8c-aab5-f0dbb8179cce tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.220327 Nov 02 12:12:25.818128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2260/4566] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 9227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:12:25.818427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:25.828461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:25.864574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:25.869505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:25.877307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:25.879667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:25.883004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:25.883688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.221658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:26.238677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e86e6513-0c08-46a8-947c-1ad2f5df8495 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1488 microversion: 2.1 time: 0.425582 Nov 02 12:12:26.239883 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2261/4567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:25 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1488 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:26.247063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:26.248754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:26.258037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.259886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.260585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.261599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.262540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.263445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.820193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:26.831563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:26.847122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:26.847122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ebf7c22-14ae-41ec-a661-71aea2547236 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1365 microversion: 2.47 time: 0.593732 Nov 02 12:12:26.847122 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2262/4568] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:26 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1365 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:26.864988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:26.865876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:26.873234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.878701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.879674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:26.889171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:26.889951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:26.892947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.420723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:27.422765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:27.424057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:27.431389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:27.431389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:27.493601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.502622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.504092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.505871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.508806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.516205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.531866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:27.544461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-058a08cf-0e38-4bb6-9b61-4f59e4589926 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1510 microversion: 2.1 time: 0.698951 Nov 02 12:12:27.545815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2263/4569] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:26 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1510 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:27.571596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Getting quotas for project ad1f121085d6411c8d15333c58c2ae39. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:27.581062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Getting quotas for user 2a2252b8545946c9842390807e9a8f7d and project ad1f121085d6411c8d15333c58c2ae39. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:27.588154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:27.589772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:27.607462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:12:27.614444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:12:27.641858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.642771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.643622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.644969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.664917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.666720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.829005 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd15df0f-2f46-4d41-9585-c679169a3ab8 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.175569 Nov 02 12:12:27.830400 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2307/4570] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:12:27.838568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:27.843303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:27.852098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.865204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:27.865564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.866406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.867386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:27.868045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:27.868761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:27.969486 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5134212f-ae6b-4816-b7ed-b8b23fb10fa9 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1219 microversion: 2.1 time: 0.379189 Nov 02 12:12:27.970546 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2264/4571] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:27 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1219 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:28.005539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41588c45-5a5d-4c72-8420-ed18c8c4953f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 200 len: 168 microversion: 2.1 time: 0.172800 Nov 02 12:12:28.007933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2308/4572] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:12:27 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:28.017921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5eb74c8-eaf7-433f-9239-6fdec4748044 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:28.022431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5eb74c8-eaf7-433f-9239-6fdec4748044 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:28.024967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:28.025683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:28.048800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.052507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.054906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.056100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.056744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.057355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.374845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.399270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5eb74c8-eaf7-433f-9239-6fdec4748044 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.403652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.408309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.420452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cb4f982-1b4d-4736-8104-7d32b557c31d tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1365 microversion: 2.47 time: 0.405800 Nov 02 12:12:28.420673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5eb74c8-eaf7-433f-9239-6fdec4748044 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1216 microversion: 2.1 time: 0.441983 Nov 02 12:12:28.421750 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2265/4573] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:27 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1216 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:28.438427 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2309/4574] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:28 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1365 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:28.455729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:28.457070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:28.490083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.490721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.492212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.492339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.495674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.496149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.592400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:28.593929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:28.611153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.613100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.613632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.616151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:28.616646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:28.620728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:28.894587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:28.924876 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2fd5f95-59bc-401b-95e4-bcd55a98451e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.501213 Nov 02 12:12:28.951850 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2266/4575] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:28 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:29.067220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:29.079168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dec9b2f4-698a-47c3-92b5-19dc1500f099 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1513 microversion: 2.1 time: 0.490858 Nov 02 12:12:29.079770 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2310/4576] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:29.104597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "name": "network-vif-unplugged", "status": "completed", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:29.122500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.127420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.127420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.139080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] Creating event network-vif-unplugged:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h1-855649-4 Nov 02 12:12:29.145036 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3ad812eb-4edd-4c45-8330-8ea09c20ee6f req-8feee6df-3e53-47b2-8273-981b5f1d186b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063881 Nov 02 12:12:29.146119 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2311/4577] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:29.152527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:29.153631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:29.162101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.163034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.166079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.166079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.166079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.166079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.553326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:29.565894 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49676191-1642-44c9-b224-752941464707 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.417548 Nov 02 12:12:29.566909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2312/4578] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:29 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:29.573907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:29.574846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:29.584271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.586269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.587188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.590281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.590281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.590281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.729047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:29.738966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db8ef90c-9263-4a0b-a581-a3928391b034 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1267 microversion: 2.1 time: 0.170501 Nov 02 12:12:29.739778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1837601097", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "b39a9ec4-215b-49b8-9103-7db62e004b73"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:29.755673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2313/4579] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:29 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:29.761678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:29.766783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:29.771519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.772039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.772512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.774019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:29.775088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:29.775564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:29.880275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] validate_networks() for [('b39a9ec4-215b-49b8-9103-7db62e004b73', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:12:30.307545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:30.362554 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b702c82c-82bf-4f07-b936-6b48405e8e87 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1453 microversion: 2.1 time: 0.578843 Nov 02 12:12:30.362554 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2314/4580] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:29 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1453 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:30.381587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:30.381868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:30.416135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:30.416506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:30.418347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:30.419393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:30.423759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:30.424710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:30.710784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:30.726495 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11e0ba83-f80a-4fea-85b9-423417d166dc tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1220 microversion: 2.1 time: 0.363031 Nov 02 12:12:30.739271 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2315/4581] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:30 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1220 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:30.748561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:30.749682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:30.756303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:30.757463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:30.758402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:30.759411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:30.760197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:30.760843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.068764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.079677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.088625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.092889 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70e75570-2ba8-4ce1-b060-5d146c390c50 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1383 microversion: 2.47 time: 0.352047 Nov 02 12:12:31.094248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2316/4582] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:30 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1383 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:31.105262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:31.107585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.135390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.138795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.139435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.143588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.144199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.144887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.225508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:31.226096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:31.226625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:31.227168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:31.227966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:31.256609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.257527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.258054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.258842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.260461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.261102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.312013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Getting quotas for project e70bbe80057d4e3a8f529b47970d5fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:31.320628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Getting quotas for user 4be892bbdd2146529d0ad0e297588159 and project e70bbe80057d4e3a8f529b47970d5fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:31.343528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:12:31.344918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:12:31.481221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.498651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93e14d69-c907-443d-87f7-e43987e107dd tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.401596 Nov 02 12:12:31.517748 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d19678c1-0f09-4996-abf4-b3609f9b714d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563556 Nov 02 12:12:31.519300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2267/4583] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:12:31.524779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:31.526027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2317/4584] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:31 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:31.526259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.533990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.544820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.544820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.544820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.544820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.544820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.559863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:31.568600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'flavor' on Instance uuid ee124e40-ea65-4c8f-a1aa-2886a999e4cf {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:12:31.570195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.584820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'shelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state shelved_offloaded Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 14 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: {"shelve": {}} Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'shelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state shelved_offloaded Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'shelve': {}}} Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:12:31.587169 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state shelved_offloaded Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state shelved_offloaded Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'shelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state shelved_offloaded {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-498be913-1a90-43be-9f69-fc642a79a02a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 155 microversion: 2.1 time: 0.071182 Nov 02 12:12:31.603716 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2268/4585] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:12:31 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 155 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:12:31.605548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.605548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.605548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.605548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.605548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.606182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82d6a2a3-e5a7-4f89-9fa8-7d11104c8428 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:31.606390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.607843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82d6a2a3-e5a7-4f89-9fa8-7d11104c8428 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.719348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82d6a2a3-e5a7-4f89-9fa8-7d11104c8428 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.733989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82d6a2a3-e5a7-4f89-9fa8-7d11104c8428 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1224 microversion: 2.1 time: 0.135226 Nov 02 12:12:31.737697 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2269/4586] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:31 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:31.747483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:31.748240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.784971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.787619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.788162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.791656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.794825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:31.803349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.803349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.820623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b97fa56f-44ec-4e15-8070-f46e2831b764 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1273 microversion: 2.1 time: 0.268025 Nov 02 12:12:31.821280 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2318/4587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:31 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:31.835240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:31.835853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:31.872604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.873103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.876380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:31.876380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:31.876380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:31.876380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.017186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:12:32.208411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:32.237873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22b98e23-1abf-4563-8f5e-442470c12ff4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.498930 Nov 02 12:12:32.238776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2270/4588] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:31 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:32.259622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:32.261836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:32.273575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.274341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.275283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.276231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.277602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.278750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.539417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89aa2017-c399-4e41-a43c-22b6795e849e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.716819 Nov 02 12:12:32.540162 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2319/4589] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:12:31 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:12:32.565813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:32.566462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:32.597394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.600677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.601959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:32.606062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:32.609491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:32.610190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.218708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.219444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.244798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:33.253448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab53e89e-300c-473d-b215-f9ef28c2e52d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1276 microversion: 2.1 time: 1.007392 Nov 02 12:12:33.255148 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2271/4590] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:32 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1276 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:33.255441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.257866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.259909 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff43d39a-fc27-4cbb-9c7f-6073e18e6e8a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1371 microversion: 2.47 time: 0.718720 Nov 02 12:12:33.261629 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2320/4591] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:32 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1371 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:33.271553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:33.272640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:33.281687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.282780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.283672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.285355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.285972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1091074160", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "f3132260-2b5f-490b-9b53-8a040d77422f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:33.286615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.305033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.405984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] validate_networks() for [('f3132260-2b5f-490b-9b53-8a040d77422f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:12:33.886203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:33.911772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ef70ec2-5a23-4f23-9596-c5400ca7ca86 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1461 microversion: 2.1 time: 0.647005 Nov 02 12:12:33.925951 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2321/4592] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:33 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1461 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:33.935246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:33.935894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:33.944277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.944844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.945292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:33.946103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:33.946570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:33.947041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:34.518703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:34.547675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1841a6f4-9f03-4e72-a7d3-ddfe53f56f28 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1228 microversion: 2.1 time: 0.619861 Nov 02 12:12:34.579842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2322/4593] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:33 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1228 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:34.634729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:34.643218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:34.689216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:34.693136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:34.703851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:34.707660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:34.713427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:34.717192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.268814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:35.277784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-041d828f-4564-4fb2-8b1b-dc19d8e2fe73 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 0.689758 Nov 02 12:12:35.282247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2323/4594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:34 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:35.314554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:35.315230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:35.329363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.330000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.332586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.333492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.335340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.335866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.642891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:35.658930 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc8eaefe-6d16-400b-b06d-d1c02a1d888f tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1274 microversion: 2.1 time: 0.375011 Nov 02 12:12:35.660371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2324/4595] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:35 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:35.667673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:35.668868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:35.686045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.686918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.687630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.689519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.691160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.692698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.782538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:12:35.784053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:12:35.784053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:12:35.784053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:12:35.784283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:12:35.801213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.802172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.802854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.803963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.804701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.805311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.846503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:12:35.853367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:12:35.859828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:35.872348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:12:35.875171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:12:35.876766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:35.878520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:35.879855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c5a243b-08c6-418f-b04a-8e5c817fb14a tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1371 microversion: 2.47 time: 0.217842 Nov 02 12:12:35.885824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2325/4596] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:35 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:35.916863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:35.917494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:35.940854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.941442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.941892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:35.944492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:35.948037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:35.948710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.205070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f47c4c4-1331-4266-884b-35a16230c44b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.945435 Nov 02 12:12:36.214651 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2272/4597] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:12:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:12:36.227587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:36.228329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:36.238796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.239491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.239960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.240851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.241462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.241926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.447457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:36.467934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-beccf7c0-aa2f-45e6-94c9-5a3a0b3956cf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1276 microversion: 2.1 time: 0.249380 Nov 02 12:12:36.469945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2273/4598] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:36 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:36.503128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-110f36a0-6cde-464d-8821-337a04fbea48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:36.507471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-110f36a0-6cde-464d-8821-337a04fbea48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:36.726730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-110f36a0-6cde-464d-8821-337a04fbea48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:36.745768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-110f36a0-6cde-464d-8821-337a04fbea48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1215 microversion: 2.1 time: 0.267687 Nov 02 12:12:36.747364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2274/4599] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:36 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:36.758814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:36.761070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:36.774515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.775791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.776893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.777075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:36.781405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.784410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.787619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.790665 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-992d5016-525d-4ce6-84ad-f66de2a7696f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1461 microversion: 2.1 time: 0.898856 Nov 02 12:12:36.801373 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2326/4600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:35 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1461 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:36.822694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:36.824723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:36.850345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.854683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.855417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:36.859572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:36.861154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:36.863571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.556072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:37.565379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.576606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72819ef8-59cd-40cd-8a98-ec004738b7c5 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 0.783542 Nov 02 12:12:37.577381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2327/4601] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:36 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:37.584094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:37.585061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:37.594322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.595107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.595806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.596805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.597409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.598058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.598751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:37.701091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.710648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8c8da22-2d97-4f66-9b4f-33e7eb0e43d0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 0.960630 Nov 02 12:12:37.711323 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2275/4602] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:36 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:37.717469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:37.718423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:37.739118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.739578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.740248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.741007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.741489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.741925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.800306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.815408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.818498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.820341 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-236c2f72-a04a-4bbc-9872-81c23a005183 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1356 microversion: 2.47 time: 0.241606 Nov 02 12:12:37.822782 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2328/4603] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:37 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:37.833757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:37.838395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:37.856275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.857779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.858843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.860767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.861937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.862958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.898120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:37.927048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab8b9468-37fb-4fc7-a636-22254b36191a tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1282 microversion: 2.1 time: 0.213114 Nov 02 12:12:37.928408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2276/4604] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:37 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:37.940912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:37.942878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:37.963741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.965342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.966968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:37.968958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:37.970535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:37.971626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.010345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:38.160580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:38.176220 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18d26985-87bb-492e-94cf-8c129bfa2b88 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1219 microversion: 2.1 time: 0.350713 Nov 02 12:12:38.178684 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2329/4605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:37 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1219 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:38.188641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:38.201046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:38.203543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Searching by: {'deleted': False, 'project_id': '2293ce5683fd44b69d896103a25e0641'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:12:38.215403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:38.215966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:38.216487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.217318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:38.218084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:38.218772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.362589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:12:38.563770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:38.577796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:38.578695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:38.579555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:38.605289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:38.609245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:39.048722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef9bf6d6-558c-4331-837a-255cbab4c9c3 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.867324 Nov 02 12:12:39.050378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2330/4606] 10.222.0.48 () {60 vars in 1187 bytes} [Wed Nov 2 12:12:38 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:39.067536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:39.069587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:39.089392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.091299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.093527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.095428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.096994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.098098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.272421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:39.302901 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b0165f5f-9040-4b75-b5b1-162ac5ad5e77 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.372203 Nov 02 12:12:39.304559 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2277/4607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:37 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:39.321892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:39.323804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:39.338889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.340379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.342161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.344081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.345287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.347779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.870158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:39.885477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc201089-2f5e-4175-9c34-3cb9ab42efa4 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 0.833067 Nov 02 12:12:39.886369 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2331/4608] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:39 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:39.900578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:39.902203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:39.915278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.916544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.917571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:39.919609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:39.920761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:39.922031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.105687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:40.124035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97a549b4-c704-49d8-90e1-5f10a038fad2 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 0.816911 Nov 02 12:12:40.124878 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2278/4609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:39 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:40.128730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:40.164906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c932cfe7-6f3a-45cc-80e5-d7ac160fc4b7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1282 microversion: 2.1 time: 0.274341 Nov 02 12:12:40.170541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2332/4610] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:39 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1282 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:40.183732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:40.186643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:40.194779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:40.200246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:40.202567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.211071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.211071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.211071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.211071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.211071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.237290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.242287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.244620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.246202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.251324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.253809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.333652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:40.597554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:40.608869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cf331e2-8967-46a2-9881-6454f6b79be9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1275 microversion: 2.1 time: 0.435244 Nov 02 12:12:40.615387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2333/4611] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:40 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1275 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:40.620307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2919cb0d-bf89-4a5d-89b5-e1e6f5a21609", "tag": "dad5b275-c704-4b29-9008-0c0000cbf0b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:40.647304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.647816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.648529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.681122 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] Creating event network-changed:dad5b275-c704-4b29-9008-0c0000cbf0b8 for instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 on n-h1-855649-4 Nov 02 12:12:40.686875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0a284d0c-bdff-419d-a6d3-84e26a68f616 req-19aae231-9b17-4e7e-b921-bf36024873f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070055 Nov 02 12:12:40.688081 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2334/4612] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:40.706100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:40.709088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:40.730746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.731792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.732589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:40.736371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:40.738311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:40.739084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:41.089623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d46879fa-d9b1-4ac2-a469-cd815a18e5e0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 204 len: 0 microversion: 2.47 time: 0.946895 Nov 02 12:12:41.090902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2279/4613] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:12:40 2022] DELETE /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 0 bytes in 965 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:12:41.106809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:41.107614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:41.127062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:41.127569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:41.142415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:41.142935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:41.148978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:41.149647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.179631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:42.232976 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-814ee2ba-8569-492f-9c73-b92ede05a797 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.538918 Nov 02 12:12:42.239226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2335/4614] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:40 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:42.280613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:42.298669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:42.324201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.325457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.326406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.329215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.329215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.330237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.673374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:42.694443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c4b3845-16be-4920-8c30-178054a955bd tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 1.601099 Nov 02 12:12:42.696681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2280/4615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:41 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:42.709812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:42.712112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:42.728896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.733267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.733267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.733662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:42.733958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.735569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.737103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.762192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:42.762192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:42.762683 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4ff4074-3f90-4c23-bacd-0e6fd1445f85 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 200 len: 1362 microversion: 2.47 time: 0.517438 Nov 02 12:12:42.764132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2336/4616] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:42 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:42.784816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:42.797518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:42.822913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.825765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.829095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.831156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:42.832480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:42.835356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:42.889438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:43.713190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:43.723673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8017456f-4be1-4efe-b59a-4a7a1e99c824 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 1.024874 Nov 02 12:12:43.725661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2281/4617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:42 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:43.739262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:43.740374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:43.753299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:43.753945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:43.754589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:43.755604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:43.756234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:43.756830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:43.949620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:43.958105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76d5de2f-4b3f-4bde-bcad-6b2a98ee7031 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 1.192365 Nov 02 12:12:43.971347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2337/4618] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:42 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:43.987830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e74307-5f35-47a8-b330-cc6ead549d41", "tag": "db1ff23a-bf42-48ff-ad0e-725c3a4b04f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:43.999459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:43.999943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:44.000521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:44.045722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] Creating event network-changed:db1ff23a-bf42-48ff-ad0e-725c3a4b04f6 for instance 16e74307-5f35-47a8-b330-cc6ead549d41 on n-h1-855649-4 Nov 02 12:12:44.054848 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-34139920-486a-4169-907e-d6ff7b32ec05 req-b6a266ea-f37b-4514-8b92-d420e9a8bb29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082029 Nov 02 12:12:44.057462 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2338/4619] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:44.064678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:44.065621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:44.095259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:44.098539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:44.100460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:44.102142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:44.103147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:44.104903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:44.745667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:44.783909 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d0fbd96-d6f8-424a-af6b-d265bc1e42c3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 1.055720 Nov 02 12:12:44.796273 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2282/4620] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:43 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:44.807771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:44.808910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:44.818402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:44.819309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:44.820015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:44.820956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:44.821705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:44.822394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.492977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:45.505370 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79fb8c22-1c85-4ef2-b06a-8838a045bfa5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.446282 Nov 02 12:12:45.506156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2339/4621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:44 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:45.520866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:45.521778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 97419b9c-25d8-4e23-be2e-7c23b32ea871] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:45.543466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.544262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.544857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.545761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.546212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.546798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.587535 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] HTTP exception thrown: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Request method failure captured: Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 HTTP/1.1 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl6EHv2RUGvxCXKI7bf8T3n6Nxqe0BKWUAQzIEOXnJkLmHp3pF0ZtkOzq96EuU9OdODIgCnGK3vHe9gIYOSMfhuR8UV0KivcoNEvAKFTVHCqCn1Y_dGmCjBjqE2SRVbDYamofCoSIjWMTYj1FDoW0aC7Zm_QOOiurrRW6LoyAGF8Vv4 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2293ce5683fd44b69d896103a25e0641 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2293ce5683fd44b69d896103a25e0641", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2293ce5683fd44b69d896103a25e0641 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerShowV247Test-1415890885-project Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 12d7ce651b3e4e779b9ca71c6e09aab5 Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerShowV247Test-1415890885-project Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '97419b9c-25d8-4e23-be2e-7c23b32ea871'} Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:45.593069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:45.602246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Returning 404 to user: Instance 97419b9c-25d8-4e23-be2e-7c23b32ea871 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:45.603537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34bda4ec-1dd7-4c74-bcdf-a112bda2b116 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871" status: 404 len: 111 microversion: 2.47 time: 0.091554 Nov 02 12:12:45.613142 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2340/4622] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:45 2022] GET /compute/v2.1/servers/97419b9c-25d8-4e23-be2e-7c23b32ea871 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:12:45.633330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f67d36-cb5a-4803-9864-aab92876917b", "tag": "00d99ae6-a067-4a12-a687-1d30c3914279"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:45.666500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.671436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.673514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.726115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] Creating event network-changed:00d99ae6-a067-4a12-a687-1d30c3914279 for instance a8f67d36-cb5a-4803-9864-aab92876917b on n-h2-855649-4 Nov 02 12:12:45.751466 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5862dbc8-e256-40a6-86be-db7bc00691b7 req-87b089e8-626f-4c15-ad79-194e851ae6ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129219 Nov 02 12:12:45.756273 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2341/4623] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:45.769423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:45.782039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:45.798792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.800029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.801094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.802384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.803227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.804274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.815789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.923844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:45.942530 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e136bc6c-86cc-4579-9dd7-5ba245e14943 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 1.143538 Nov 02 12:12:45.944315 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2283/4624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:44 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:45.956396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:45.958319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:45.971875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.978621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.980558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.983403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:45.985564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:45.988188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:45.989205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.241463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.253993 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b869937a-4d91-4e96-b677-564fcb6eb142 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 0.494733 Nov 02 12:12:46.254841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2342/4625] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:45 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:46.261961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:46.262800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:46.270055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.272436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.273100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.273728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.274661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.275834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.276460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.300133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.309991 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fcc0b77-ea2e-46f6-bab7-fac43651651f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 0.363995 Nov 02 12:12:46.312690 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2284/4626] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:45 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:46.317700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:46.318587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:46.328350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.329109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.329705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.331526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.332159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.332777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.348904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:46.559393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.576970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db5b4a74-3522-4cce-a329-9fc1fd5faca5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 0.262147 Nov 02 12:12:46.591940 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2285/4627] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:46 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:46.613157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:46.624240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.624816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.625226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.641643 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] Creating event network-changed:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h2-855649-4 Nov 02 12:12:46.655110 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9b04e101-1454-4bb3-bec8-13a2915c843a req-c5243871-0762-42d1-9e6e-515279136dac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061257 Nov 02 12:12:46.656060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2286/4628] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:46.664034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:46.664742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:46.682970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.685552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.686366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.692153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.692948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.693891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.747284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=24 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.768354 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2e83909-4321-446b-ba24-cfebd10f8687 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 204 len: 0 microversion: 2.47 time: 0.511589 Nov 02 12:12:46.769888 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2343/4629] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:12:46 2022] DELETE /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:12:46.781209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2919cb0d-bf89-4a5d-89b5-e1e6f5a21609", "name": "network-vif-plugged", "status": "completed", "tag": "dad5b275-c704-4b29-9008-0c0000cbf0b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:46.799111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.799830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.800483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.818846 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] Creating event network-vif-plugged:dad5b275-c704-4b29-9008-0c0000cbf0b8 for instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 on n-h1-855649-4 Nov 02 12:12:46.829468 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-594ad743-c94a-4666-9fd8-d76a2792db58 req-83c238ca-3309-4cc9-88e7-e87dfefe9878 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056743 Nov 02 12:12:46.830519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2344/4630] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:46.839367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:46.840332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:46.849686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.850182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.850617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.851477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:46.851935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:46.852498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:46.938478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.955442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.969566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.980472 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1767bf7-cdf7-4e77-a590-d26da7e77fd1 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.322042 Nov 02 12:12:46.981990 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2287/4631] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:46 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:46.995128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:46.998095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:46.999785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:47.004765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-518dea4e-e9c3-4752-a44b-e33ee1384a36 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1362 microversion: 2.47 time: 0.172105 Nov 02 12:12:47.007382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.008423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.009111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.010210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.011107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.011740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.013621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2345/4632] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:46 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:47.289063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:47.289675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:47.298604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.299220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.299942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.300670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.301298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.302284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.595953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:47.607906 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bdf40f02-5ea6-41f0-98d1-bbb77f5f60b0 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 0.624469 Nov 02 12:12:47.609082 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2288/4633] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:46 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:47.616151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:47.616978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:47.625815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.626436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.627172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.628054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.628607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.629142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.687766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:47.697412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba76c8d4-e438-4dc9-938c-08209088aaa7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1315 microversion: 2.1 time: 0.412363 Nov 02 12:12:47.698021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2346/4634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:47 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:47.703642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:47.704321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:47.711854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.712733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.713082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:47.713834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:47.714354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:47.714788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.260723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:48.407987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:48.427975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35304a1c-21b4-4143-8ecd-2e2557311ef3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 0.816579 Nov 02 12:12:48.429686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2289/4635] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:47 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:48.431817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:48.438491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:48.439674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:48.441879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f7e594f-11c9-4cf9-ba4f-85b02cd57e4c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 0.742748 Nov 02 12:12:48.442755 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2347/4636] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:47 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:48.451183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.464107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:48.465015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:48.471854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.474593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.475208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.475653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.476354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.479624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.479624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.479624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.481468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.493793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.498262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.557217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:48.849250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:48.861545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:48.870179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:48.872463 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29e64b7a-8a1c-4630-badf-8abea2c8d7e9 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1362 microversion: 2.47 time: 0.419289 Nov 02 12:12:48.873346 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2348/4637] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:48 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:48.882040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:48.888324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:48.895027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.896889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.897466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:48.899308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:48.901617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:48.902322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:49.802598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:49.835312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-318c63c6-f122-4fbc-8e3a-17047f30fd6e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.398500 Nov 02 12:12:49.836477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2290/4638] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:48 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:49.891393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:49.903889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:49.915977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:49.916903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:49.917689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:49.919531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:49.920330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:49.921267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.208034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.243511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b21fbb0-f188-4eab-aedf-a36196fe73bf tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 1.351612 Nov 02 12:12:50.246215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2349/4639] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:48 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:50.257277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:50.278898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.279820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.280909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.296831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] Creating event network-changed:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:12:50.306187 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5b4f19ff-84c7-4e1b-9a92-e5981735967a req-ea7059bc-682f-4f5b-865b-f60d1cdb0793 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057420 Nov 02 12:12:50.307249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2350/4640] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:50.315392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:50.316509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:50.325567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.326104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.326659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.327513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.328200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.328626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.474187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.484404 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6297f4b4-9a62-47ed-9653-2162f779f914 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1502 microversion: 2.1 time: 0.613070 Nov 02 12:12:50.486665 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2291/4641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:49 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1502 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:50.490146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:50.491020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:50.497553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.497947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.498646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.499652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.500118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.500550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.592640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.613937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82d28b5b-0fa8-4663-9883-cd246003df4b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 0.295361 Nov 02 12:12:50.613937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2351/4642] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:50 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:50.637540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:50.638551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:50.645360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.646143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.646779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.647719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.648348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.648938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.742158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.751668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8f72107f-9ee0-4125-93b9-504d4e6c6a18 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 0.265323 Nov 02 12:12:50.752191 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2292/4643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:50 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:50.772206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:50.772765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:50.783220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.783750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.784211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.785093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.785578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.786721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.791965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.794346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:50.802809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.804709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:50.806190 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4d3629b-a97c-42af-b485-a591c3642598 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1362 microversion: 2.47 time: 0.177968 Nov 02 12:12:50.816093 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2352/4644] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:50 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:50.816093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e74307-5f35-47a8-b330-cc6ead549d41", "name": "network-vif-plugged", "status": "completed", "tag": "db1ff23a-bf42-48ff-ad0e-725c3a4b04f6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:50.828022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.828022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.828022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.841675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'flavor' on Instance uuid 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:12:50.842272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] Creating event network-vif-plugged:db1ff23a-bf42-48ff-ad0e-725c3a4b04f6 for instance 16e74307-5f35-47a8-b330-cc6ead549d41 on n-h1-855649-4 Nov 02 12:12:50.847266 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1c49ccc7-0e52-417b-8e48-c21bc4db910a req-10a64ad0-b2ef-4f6e-9fe3-833fabf2f6f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038758 Nov 02 12:12:50.848232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2353/4645] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:50.882536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:50.886553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:50.919379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.920171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.922043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:50.923396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:50.926905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:50.927585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.218459 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33562647-c191-44d5-87ff-49b71484a671 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "POST /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609/action" status: 202 len: 0 microversion: 2.1 time: 0.464938 Nov 02 12:12:51.219440 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2293/4646] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:12:50 2022] POST /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:12:51.228727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:51.229543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:51.237513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.238805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.240208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.241556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.242133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.242578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.275612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:51.298527 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b1ce754-f4dd-4cd9-b623-9c46c0928172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.424133 Nov 02 12:12:51.299890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2354/4647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:50 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:51.306925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:51.307809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:51.316251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.316887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.317437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.318676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.319276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.319776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.548047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:51.552150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:51.561110 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0822bf8-edaf-456c-a41c-24935415f7da tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1316 microversion: 2.1 time: 0.259584 Nov 02 12:12:51.561717 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2355/4648] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:51 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:51.562831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83b29df9-af4a-41ec-89b5-444bcb03e129 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1510 microversion: 2.1 time: 0.339044 Nov 02 12:12:51.565666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2294/4649] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:51 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:51.642470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:51.643528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:51.652192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.653461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.654313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.655670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.656537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.657276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.678628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:51.788070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:51.789866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:51.804453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.805845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.806712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.809035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.810229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.811220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.850175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:51.859244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88fe4a3d-29fe-4649-98df-c9d2879d3072 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 0.223057 Nov 02 12:12:51.859854 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2356/4650] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:51 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:51.864649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:51.865417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:51.878335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.879413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.881627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:51.882024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:51.883224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:51.884103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.032862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:52.044216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:52.049655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:52.053954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d43bf917-4c38-4dcf-b6b0-a5354aa55adf tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1362 microversion: 2.47 time: 0.191580 Nov 02 12:12:52.056308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2357/4651] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:51 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:52.123620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:52.135828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a464cab8-3e20-4cde-91f8-17fdcefe7579 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 0.356679 Nov 02 12:12:52.151015 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2295/4652] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:51 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:52.327608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:52.328446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:52.343299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.352300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.353006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.353781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.360548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.360548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.595653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:52.600635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:52.629463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.635015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.635015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.636068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.640254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.641681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.680101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:52.702549 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a41df07c-d0c1-45c7-af70-aa600c8033de tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.379415 Nov 02 12:12:52.703542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2358/4653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:52 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:52.717232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:52.718641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:52.740403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.749697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.749697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:52.749697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:52.749697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:52.749697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.136701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.170523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d456d91-3911-4675-b0a8-b99308b0cbf9 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1504 microversion: 2.1 time: 0.577301 Nov 02 12:12:53.171630 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2296/4654] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:52 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:53.194527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f67d36-cb5a-4803-9864-aab92876917b", "name": "network-vif-plugged", "status": "completed", "tag": "00d99ae6-a067-4a12-a687-1d30c3914279"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:53.207502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.216008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.216703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.217252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.232577 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] Creating event network-vif-plugged:00d99ae6-a067-4a12-a687-1d30c3914279 for instance a8f67d36-cb5a-4803-9864-aab92876917b on n-h2-855649-4 Nov 02 12:12:53.237698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17fa2221-0dbf-4417-9eee-e309c160f8c0 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1493 microversion: 2.1 time: 0.532121 Nov 02 12:12:53.238834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b501b8c0-346c-4fb6-b2b8-1baedf5eab13 req-169efa9c-732c-4469-a4bc-5ef269a89b15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065552 Nov 02 12:12:53.239711 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2297/4655] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:53.244908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2359/4656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:52 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1493 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:53.255542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:53.257661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:53.265738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:53.266835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:53.277252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.279960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.281248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.282582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.283801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.284658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.287319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.288603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.289703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.291384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.292357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.295299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.582109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.607704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.611082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.613616 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd74338d-8b43-4b1c-84cf-4473f44745ce tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1362 microversion: 2.47 time: 0.366590 Nov 02 12:12:53.614859 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2360/4657] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:53 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:53.650736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:53.653330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:53.685752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:53.686714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.710355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d36cd200-a27f-4e6f-8311-9a63974769b4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1315 microversion: 2.1 time: 0.468540 Nov 02 12:12:53.712583 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2298/4658] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:53 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:53.713563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.716136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.717716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.724118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.725195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.787239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:53.788128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:53.825770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.847370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.848541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:53.849143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:53.849896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:53.850602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:54.275475 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8719066f-cc57-49f1-97ae-2232e3668163 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.541289 Nov 02 12:12:54.281312 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2299/4659] 10.222.0.48 () {58 vars in 1296 bytes} [Wed Nov 2 12:12:53 2022] DELETE /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41/os-server-password => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:54.320392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:54.326363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:54.371357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:54.386352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:54.390268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:54.393410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:54.396424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:54.399456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:54.559671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:55.131361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:55.166749 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40063b83-5831-480b-a8c0-50c7f29c714b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 1.547727 Nov 02 12:12:55.179636 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2361/4660] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:53 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:55.199036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:55.202091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:55.217727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7527500-71f6-4fbe-9e09-4ae28b0c7bf1 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 204 len: 0 microversion: 2.1 time: 0.928124 Nov 02 12:12:55.219226 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2300/4661] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:12:54 2022] DELETE /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:55.238497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:55.241386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.250453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.251603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:55.252749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.261347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.264157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.268353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.313440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.314298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.325155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.329295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.334251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.335580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.475872 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-399ab173-4dd8-4654-8725-b9d76c04491b tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.254204 Nov 02 12:12:55.477283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2301/4662] 10.222.0.48 () {58 vars in 1293 bytes} [Wed Nov 2 12:12:55 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41/os-server-password => generated 16 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:12:55.486368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:55.488334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:55.502686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.503927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.504880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.506416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.507625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.508581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.652401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:55.653425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:55.654105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:55.654773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lazy-loading 'fault' on Instance uuid 72a57419-f33b-4f1e-89df-fc2fdc477dbe {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:12:55.995204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:56.013575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:56.017344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d7ce651b3e4e779b9ca71c6e09aab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2293ce5683fd44b69d896103a25e0641', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:56.026060 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-780bc318-e9fe-4952-bf20-77a244552585 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 200 len: 1367 microversion: 2.47 time: 0.539765 Nov 02 12:12:56.047718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2302/4663] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:55 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:12:56.057652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:56.058695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:56.072327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.075714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.078415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.079458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.080120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.088674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.261687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:56.321501 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-acc7cf9e-b000-4394-85f6-fa46a9489615 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.133699 Nov 02 12:12:56.327465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2362/4664] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:55 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:56.333064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:56.342121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:56.358104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.358754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.359342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.360237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.360957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.361644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.850064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:56.862073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18c3fdcb-a54f-4a76-a5bb-667ad5ff96ed tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1501 microversion: 2.1 time: 0.812807 Nov 02 12:12:56.865135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2303/4665] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:56 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1501 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:56.883237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:56.884116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:56.891513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.896011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.896804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.903768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:56.904836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:56.905594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:56.938516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:12:56.988996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=5,nova_cell1:INSERT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.304431 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2887260-7fa7-4666-833c-72999c66ea48 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 204 len: 0 microversion: 2.1 time: 0.437016 Nov 02 12:12:57.313653 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2304/4666] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:12:56 2022] DELETE /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:57.313653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:57.320983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:57.339308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:57.340948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:57.345491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:57.347499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:57.389360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:57.390913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.286062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:58.315587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49223c85-3d57-4518-b917-059019d03d92 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1499 microversion: 2.1 time: 1.986038 Nov 02 12:12:58.324747 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2363/4667] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:56 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1499 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:58.339193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:58.342359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:58.352610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.359777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.360506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.361454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.362066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.362644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.439932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d30558d8-52fd-45ac-b631-da6edf78b484 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 14 microversion: 2.1 time: 0.117577 Nov 02 12:12:58.442376 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2364/4668] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:12:58 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:12:58.456530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:58.459418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] [instance: 72a57419-f33b-4f1e-89df-fc2fdc477dbe] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:58.483549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.486340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.488593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.489588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.492522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.493223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.526639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] HTTP exception thrown: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Request method failure captured: Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe HTTP/1.1 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl6EHv2RUGvxCXKI7bf8T3n6Nxqe0BKWUAQzIEOXnJkLmHp3pF0ZtkOzq96EuU9OdODIgCnGK3vHe9gIYOSMfhuR8UV0KivcoNEvAKFTVHCqCn1Y_dGmCjBjqE2SRVbDYamofCoSIjWMTYj1FDoW0aC7Zm_QOOiurrRW6LoyAGF8Vv4 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2293ce5683fd44b69d896103a25e0641 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2293ce5683fd44b69d896103a25e0641", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2293ce5683fd44b69d896103a25e0641"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2293ce5683fd44b69d896103a25e0641 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerShowV247Test-1415890885 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerShowV247Test-1415890885-project Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 12d7ce651b3e4e779b9ca71c6e09aab5 Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerShowV247Test-1415890885-project Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '72a57419-f33b-4f1e-89df-fc2fdc477dbe'} Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:12:58.542267 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. Nov 02 12:12:58.547885 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:12:58.550755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] Returning 404 to user: Instance 72a57419-f33b-4f1e-89df-fc2fdc477dbe could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:12:58.552281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc91a07e-09e3-4965-99b8-cf1d8ba1ada0 tempest-ServerShowV247Test-1415890885 tempest-ServerShowV247Test-1415890885-project] 10.222.0.48 "GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe" status: 404 len: 111 microversion: 2.47 time: 0.106798 Nov 02 12:12:58.558441 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2365/4669] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:12:58 2022] GET /compute/v2.1/servers/72a57419-f33b-4f1e-89df-fc2fdc477dbe => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:12:58.572298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "name": "network-vif-plugged", "status": "completed", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:12:58.603572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.605088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.607322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.649881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] Creating event network-vif-plugged:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:12:58.665858 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dce0f299-5bd9-4fdb-afc5-954763824561 req-67096576-9f43-4f26-9a81-3b2aa1eded45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111230 Nov 02 12:12:58.673244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2366/4670] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:12:58.682471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:58.685541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:58.702511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.703663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.712408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:58.712408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:58.712408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:58.712408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:59.803029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:12:59.862304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62a51ea7-e070-41d6-bee7-8ba5b62897fa tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 2.550586 Nov 02 12:12:59.865960 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2305/4671] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:57 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:59.902655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:12:59.907760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:12:59.926607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:59.928299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:59.928724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:12:59.930102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:12:59.931098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:12:59.932519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:01.097937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:01.132779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0c184b9-d894-47ca-b314-78796e7bb2a1 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1510 microversion: 2.1 time: 2.461569 Nov 02 12:13:01.164434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2367/4672] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:58 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1510 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:01.243938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:01.248657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:01.268057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:01.269292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:01.270522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:01.272287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:01.273703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:01.276630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:01.689469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:01.707666 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7598b8f0-cd3c-4125-a561-7eee9e8024c7 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1457 microversion: 2.1 time: 0.486822 Nov 02 12:13:01.725271 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2368/4673] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:01 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1457 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:01.765756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:01.770995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:01.786784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:01.788078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:01.789094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:01.790660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:01.801026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:01.802326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.081635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:02.091164 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84911bf9-aad3-4fc9-8036-4e3ac1b73490 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 2.220638 Nov 02 12:13:02.095336 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2306/4674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:12:59 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:02.110372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:02.115397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:02.136868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.137376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.137828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.138603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.148598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.149663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.444197 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41f45476-35d1-4a85-bf76-01722a000d85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 14 microversion: 2.1 time: 0.716403 Nov 02 12:13:02.451081 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2369/4675] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:01 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 14 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:13:02.460500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2919cb0d-bf89-4a5d-89b5-e1e6f5a21609", "name": "network-vif-deleted", "tag": "dad5b275-c704-4b29-9008-0c0000cbf0b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:02.570842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.572901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.575247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.597975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] Creating event network-vif-deleted:dad5b275-c704-4b29-9008-0c0000cbf0b8 for instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 on n-h1-855649-4 Nov 02 12:13:02.608511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:02.623157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dfbbde0-a1e2-42d2-8be4-e52de097309c tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1324 microversion: 2.1 time: 0.525686 Nov 02 12:13:02.629086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2307/4676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:02 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:02.629822 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2638bdc9-31d4-4b55-adde-a3d99d2c9d92 req-17afc848-725e-473a-8a31-e1f5381db718 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172604 Nov 02 12:13:02.631996 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2370/4677] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:02.655932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:02.655932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:02.696678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.698729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.702786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.703802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.704926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.705544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.758448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:02.759911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:02.781049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.781857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.814327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.815296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.816620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.821817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.869271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:02.870598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:02.874874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:02.875658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lazy-loading 'fault' on Instance uuid 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:13:03.040912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:03.062954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce4613692b64ad7b7b8cf1f71189e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee082f52e7c47cd8c1e43a9c98dfaef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:03.073923 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb456bbf-fbdd-4b12-8dec-cee1f6844c97 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1468 microversion: 2.1 time: 0.443601 Nov 02 12:13:03.096007 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2308/4678] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:02 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1468 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:03.097446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6ed04b9-00b2-4765-9cdb-82b79f427083 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 200 len: 1305 microversion: 2.1 time: 0.327448 Nov 02 12:13:03.098331 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2371/4679] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:02 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 1305 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:03.132821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:03.134485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:03.155164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.157610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.159893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:03.162354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.164492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.167171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:03.457707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:03.460975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:03.498893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.499747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.500475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:03.501633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.520584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.520584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:03.563896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:03.583181 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a30c0f8-a6c5-414c-acbc-0dffb9c65e2d tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.453815 Nov 02 12:13:03.587980 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2309/4680] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:03 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:03.633021 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4038244-4991-43c7-8be4-057d7cc10259 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 14 microversion: 2.1 time: 0.180421 Nov 02 12:13:03.637904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2372/4681] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:03 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:13:03.659310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:03.676704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:03.690066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.693081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.693602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:03.694357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:03.697452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:03.699182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.050092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:04.058770 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6da57285-8e71-46eb-a158-4f411f7a21f7 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1519 microversion: 2.1 time: 0.412018 Nov 02 12:13:04.071888 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2310/4682] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:03 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1519 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:04.084840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3efeb5cc-9486-41fd-9324-d6ec12049244 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'create', calling method: .version_select at 0x7ff1b2bdbee0>, body: {"pool": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:04.117432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:04.117432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:04.146059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:04.148541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:04.149656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.151356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:04.153620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:04.154916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.263057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:04.264270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:04.265402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.266583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lazy-loading 'fault' on Instance uuid 16e74307-5f35-47a8-b330-cc6ead549d41 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:13:04.395271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2252b8545946c9842390807e9a8f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1f121085d6411c8d15333c58c2ae39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:04.421934 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30c2bca8-4167-403b-b388-34ae2538489d tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 200 len: 1306 microversion: 2.1 time: 0.317113 Nov 02 12:13:04.423033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2311/4683] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:04 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:04.439630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:04.440272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:04.455374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:04.489891 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 HTTP/1.1 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2919cb0d-bf89-4a5d-89b5-e1e6f5a21609'} Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:04.490619 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:04.498786 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e6cb231-2177-4b95-8909-f6552390024a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 404 len: 111 microversion: 2.1 time: 0.068401 Nov 02 12:13:04.507259 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2312/4684] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:04 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:05.360001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed4a540-7fab-401b-bdfe-f7a8a5c9f0a4 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] Calling method '.version_select at 0x7ff1b271ed30>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:06.141271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed4a540-7fab-401b-bdfe-f7a8a5c9f0a4 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4/defaults" status: 200 len: 371 microversion: 2.1 time: 1.632312 Nov 02 12:13:06.153151 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2313/4685] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:13:04 2022] GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4/defaults => generated 371 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:06.153151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:06.153151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:06.214582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:06.236589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:06.237563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:06.250097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:06.254764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:06.259003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:06.364575 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 HTTP/1.1 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2919cb0d-bf89-4a5d-89b5-e1e6f5a21609'} Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:06.371454 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:06.383915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:06.389013 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc363f48-5728-4d0b-9900-06b1ed5033b4 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 404 len: 111 microversion: 2.1 time: 0.241096 Nov 02 12:13:06.391779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2314/4686] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:06 2022] DELETE /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:06.420203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:06.424093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:06.443700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:06.446082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:06.447817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:06.450541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:06.451678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:06.452925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.360641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:07.394957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7034fe4-c83b-46a0-8379-77bf124710d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.000320 Nov 02 12:13:07.401626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2315/4687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:06 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:07.435861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:07.457656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:07.488283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:07.489156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:07.499882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.505926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:07.507239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:07.514837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.614107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0cd91d35-b2f2-4e3c-92c0-f97aa61c006e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 14 microversion: 2.1 time: 0.209246 Nov 02 12:13:07.615583 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2316/4688] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:07 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:13:07.653457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e74307-5f35-47a8-b330-cc6ead549d41", "name": "network-vif-deleted", "tag": "db1ff23a-bf42-48ff-ad0e-725c3a4b04f6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:07.718263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:07.730363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:07.737218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.794217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] Creating event network-vif-deleted:db1ff23a-bf42-48ff-ad0e-725c3a4b04f6 for instance 16e74307-5f35-47a8-b330-cc6ead549d41 on n-h1-855649-4 Nov 02 12:13:07.830267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8fa99c3a-4289-42f1-baa8-8b9c83398a16 req-cd6f9061-ca4b-4877-be0d-58b14953d0ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205726 Nov 02 12:13:07.830267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2317/4689] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:07.852556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:07.853897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] [instance: 16e74307-5f35-47a8-b330-cc6ead549d41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:07.866514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:07.867772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:07.868754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.870379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:07.872053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:07.873278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:07.900405 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] HTTP exception thrown: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Request method failure captured: Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 HTTP/1.1 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl6fAjXM9wGSDB1h5QWAoewcySju6GRVWbACK52cBk6QHcxjV5STDFDS0_4TCNhChaHvu1ygqmhZ8JD7dByIqB43b1BLT1OWo3Gr1H7KciupaYtJEPB63zzvRwSwmVacp4z5NpHH61EtHtcbyyHrCgNSq3kFJYULSnJScproShMVZfs Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ad1f121085d6411c8d15333c58c2ae39 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerPasswordTestJSON-1994617892 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad1f121085d6411c8d15333c58c2ae39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ad1f121085d6411c8d15333c58c2ae39", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ad1f121085d6411c8d15333c58c2ae39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad1f121085d6411c8d15333c58c2ae39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerPasswordTestJSON-1994617892 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ad1f121085d6411c8d15333c58c2ae39 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1994617892 Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerPasswordTestJSON-1994617892-project Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2a2252b8545946c9842390807e9a8f7d Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerPasswordTestJSON-1994617892-project Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '16e74307-5f35-47a8-b330-cc6ead549d41'} Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:07.903817 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] Returning 404 to user: Instance 16e74307-5f35-47a8-b330-cc6ead549d41 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb064b81-5138-4148-9185-8ba28b99dc82 tempest-ServerPasswordTestJSON-1994617892 tempest-ServerPasswordTestJSON-1994617892-project] 10.222.0.48 "GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41" status: 404 len: 111 microversion: 2.1 time: 0.074029 Nov 02 12:13:07.908875 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2318/4690] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:07 2022] GET /compute/v2.1/servers/16e74307-5f35-47a8-b330-cc6ead549d41 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:07.920031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-467f2755-f286-4d8a-85a4-66e8d178d880 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] Calling method '.version_select at 0x7ff1b270cc10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:08.507604 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3efeb5cc-9486-41fd-9324-d6ec12049244 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.421002 Nov 02 12:13:08.512034 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2373/4691] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:13:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:13:08.539133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:08.546665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:08.579505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:08.584082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:08.585446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:08.589021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:08.608337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:08.609141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:08.639263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 HTTP/1.1 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '2919cb0d-bf89-4a5d-89b5-e1e6f5a21609'} Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:08.642468 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. Nov 02 12:13:08.650593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:08.654556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:08.656413 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c9cb738-8f90-45af-9afc-8d869fd5f99d tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609" status: 404 len: 111 microversion: 2.1 time: 0.142691 Nov 02 12:13:08.661608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2374/4692] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:08 2022] GET /compute/v2.1/servers/2919cb0d-bf89-4a5d-89b5-e1e6f5a21609 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:08.669275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:08.670343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:08.680439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:08.681480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:08.682367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:08.684807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:08.685625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:08.686446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.040593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:09.054632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-497f071b-b34d-4af7-b097-aeb449f05897 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.390132 Nov 02 12:13:09.055918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2375/4693] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:08 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:09.062298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:09.065086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:09.073699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.080612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.080612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.080612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.080612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.080612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.147585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74cf9b0c-22f0-4484-aa75-c63a8544eac1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 14 microversion: 2.1 time: 0.082778 Nov 02 12:13:09.151477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2376/4694] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:09 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:13:09.154717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:09.155432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:09.164000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.166737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.166737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.167575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.168764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.169557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.223045 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 HTTP/1.1 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '45e7b9d8-522b-418e-9b91-6ad44cede4f6'} Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:09.227463 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.236400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.238736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:09.241199 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-339ef3a9-8197-42e1-aca3-457a6fc50c09 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 404 len: 111 microversion: 2.1 time: 0.091236 Nov 02 12:13:09.242275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2377/4695] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:09 2022] DELETE /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:09.252402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:09.258480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 45e7b9d8-522b-418e-9b91-6ad44cede4f6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:09.290372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.292427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.294709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.298563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.299988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.300952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.343905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 HTTP/1.1 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '45e7b9d8-522b-418e-9b91-6ad44cede4f6'} Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.348393 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. Nov 02 12:13:09.357535 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.360601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 45e7b9d8-522b-418e-9b91-6ad44cede4f6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:09.362401 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c1f16c1-4e7e-451a-951b-1fee831cd237 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6" status: 404 len: 111 microversion: 2.1 time: 0.113984 Nov 02 12:13:09.364249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2378/4696] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:09 2022] GET /compute/v2.1/servers/45e7b9d8-522b-418e-9b91-6ad44cede4f6 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:09.376221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1764257976", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "b39a9ec4-215b-49b8-9103-7db62e004b73"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:09.537010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] validate_networks() for [('b39a9ec4-215b-49b8-9103-7db62e004b73', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:13:09.685415 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-467f2755-f286-4d8a-85a4-66e8d178d880 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4" status: 200 len: 371 microversion: 2.1 time: 1.776029 Nov 02 12:13:09.687163 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2319/4697] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 12:13:07 2022] GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4 => generated 371 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:09.693461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:09.694635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:09.705004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.705881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.706526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.707634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:09.711488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:09.712227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:09.761335 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 HTTP/1.1 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '85127f38-e58f-43ae-afc0-e7a74f7b1d61'} Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:09.764601 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45802f15-1d8f-4b1f-95d1-c372fb671002 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 404 len: 111 microversion: 2.1 time: 0.078485 Nov 02 12:13:09.770355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2320/4698] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:09 2022] DELETE /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:09.782600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a593b6fb-ee90-48a6-b89a-78b1021b61f5 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] Calling method '.version_select at 0x7ff1b276a0d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:10.491324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:13:10.491763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:13:10.492403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:13:10.492821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:13:10.493611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:13:10.512850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.513915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.514691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.515785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.516434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.517255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.542708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:10.568490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Getting quotas for project e70bbe80057d4e3a8f529b47970d5fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:13:10.581762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Getting quotas for user 4be892bbdd2146529d0ad0e297588159 and project e70bbe80057d4e3a8f529b47970d5fd7. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:13:10.611872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:13:10.618416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:13:10.723850 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a593b6fb-ee90-48a6-b89a-78b1021b61f5 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.952845 Nov 02 12:13:10.724710 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2321/4699] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:13:09 2022] GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4/defaults => generated 371 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:10.749680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:10.750763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 85127f38-e58f-43ae-afc0-e7a74f7b1d61] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:10.801866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.803092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.806230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.806884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.819624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.820371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.856370 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 HTTP/1.1 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '85127f38-e58f-43ae-afc0-e7a74f7b1d61'} Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:10.858635 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. Nov 02 12:13:10.863583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:10.864911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 85127f38-e58f-43ae-afc0-e7a74f7b1d61 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:10.865968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab7989f9-f639-414f-9f26-4e24f290a1cb tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61" status: 404 len: 111 microversion: 2.1 time: 0.131670 Nov 02 12:13:10.866718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2322/4700] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:10 2022] GET /compute/v2.1/servers/85127f38-e58f-43ae-afc0-e7a74f7b1d61 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:10.874303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:10.890949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b796f2f8-64ed-4d71-af60-b9a1b034db77 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523875 Nov 02 12:13:10.894817 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2379/4701] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:13:10.906017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:10.922757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:10.927551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:10.943693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.944110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.944254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.944583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.944740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.945099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.945356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.945827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.946079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:10.946258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:10.946566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:10.947244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:11.065879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0520e08-ea5e-4130-b2ac-99e65c5d9f3d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action" status: 200 len: 16395 microversion: 2.1 time: 0.154928 Nov 02 12:13:11.067466 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2380/4702] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:10 2022] POST /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b/action => generated 16395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:11.084888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-212381b4-79fd-4acd-b4f7-335845cac7c1 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] Calling method '.version_select at 0x7ff1b2fe1c10>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:11.382819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a0fe833-76ad-44ea-8c3f-eaff7dc1c68c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.529579 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2323/4703] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:10 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 HTTP/1.1 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:11.495707 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc127e98-cc29-4bfc-8ce2-32d029e1c842'} Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:11.499383 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:11.517507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:11.517507 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f794725-a997-4a65-9e22-dd4068e6f957 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 404 len: 111 microversion: 2.1 time: 0.075943 Nov 02 12:13:11.517507 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2324/4704] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:11 2022] DELETE /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:11.531631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9345f0e-6e17-4660-8a6d-3e358db58194 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:11.532339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9345f0e-6e17-4660-8a6d-3e358db58194 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:11.542153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.697886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9345f0e-6e17-4660-8a6d-3e358db58194 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:11.719219 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9345f0e-6e17-4660-8a6d-3e358db58194 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1224 microversion: 2.1 time: 0.226041 Nov 02 12:13:11.720658 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2325/4705] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:11 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1224 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:11.729171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:11.730212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:11.744620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:11.745707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:11.746418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:11.748157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:11.748953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:11.749568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cce56a1-fbb8-4655-9927-a024ba58a7e4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.319014 Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2326/4706] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:11 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: cc127e98-cc29-4bfc-8ce2-32d029e1c842] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.084268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.120252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 HTTP/1.1 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'cc127e98-cc29-4bfc-8ce2-32d029e1c842'} Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:12.123287 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. Nov 02 12:13:12.127761 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.140063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance cc127e98-cc29-4bfc-8ce2-32d029e1c842 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:12.142150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-682db15e-b9c4-4925-9379-955cebe58a3a tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842" status: 404 len: 111 microversion: 2.1 time: 0.098794 Nov 02 12:13:12.143129 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2327/4707] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:12 2022] GET /compute/v2.1/servers/cc127e98-cc29-4bfc-8ce2-32d029e1c842 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:12.169686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:12.184409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:12.195264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.206031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.207490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.209089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.210292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.211441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.813292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:12.841018 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfc5d679-99fb-4476-a66a-0473efe40d15 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.677963 Nov 02 12:13:12.861149 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2328/4708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:12 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:12.873180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:12.881265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:12.894596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 HTTP/1.1 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a05494d6-50f5-459d-83fd-fe99884695d5'} Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:12.898642 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:12.903990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:12.907071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:12.911206 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c8a5b72-1a89-498c-8992-28fc5341ec47 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5" status: 404 len: 111 microversion: 2.1 time: 0.048475 Nov 02 12:13:12.913080 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2329/4709] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:12 2022] DELETE /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:12.922202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:12.933953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:12.956970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.960767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.961620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.966052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:12.966891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:12.969532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:12.990107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-212381b4-79fd-4acd-b4f7-335845cac7c1 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4" status: 200 len: 371 microversion: 2.1 time: 1.919954 Nov 02 12:13:12.992942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2381/4710] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 12:13:11 2022] GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4 => generated 371 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:12.998603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc2bf19c-45ed-4543-971d-34c694d44550 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:13.009678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc2bf19c-45ed-4543-971d-34c694d44550 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:13.028468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.163980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc2bf19c-45ed-4543-971d-34c694d44550 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:13.181628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc2bf19c-45ed-4543-971d-34c694d44550 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1224 microversion: 2.1 time: 0.187122 Nov 02 12:13:13.231327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2382/4711] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:12 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1224 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:13.237308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:13.268612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:13.293324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:13.295806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:13.298654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:13.299747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:13.302517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:13.303209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:13.339151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:13.357576 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b740da0-0b30-4549-b68e-90c5966c6770 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.440641 Nov 02 12:13:13.377779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2330/4712] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:12 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:13.405888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:13.407974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: a05494d6-50f5-459d-83fd-fe99884695d5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:13.421942 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 HTTP/1.1 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a05494d6-50f5-459d-83fd-fe99884695d5'} Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:13.425853 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance a05494d6-50f5-459d-83fd-fe99884695d5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:13.440574 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a24d7302-3a36-4ee7-9931-0f5cd80fc64c tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5" status: 404 len: 111 microversion: 2.1 time: 0.048109 Nov 02 12:13:13.452076 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2331/4713] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:13 2022] GET /compute/v2.1/servers/a05494d6-50f5-459d-83fd-fe99884695d5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:13.466034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2aeea976-9be2-4dc6-bc8b-b2bf0fdca268 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] Calling method '.version_select at 0x7ff1b26d1670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:14.270358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:14.281332 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1b7aa47-78ef-4917-9e71-4505b9f33a85 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.048378 Nov 02 12:13:14.285449 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2383/4714] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:13 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:14.289317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:14.303263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:14.320783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:14.325496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:14.326025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:14.331379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:14.332075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:14.332563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:14.360754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2aeea976-9be2-4dc6-bc8b-b2bf0fdca268 tempest-QuotasTestJSON-75909491 tempest-QuotasTestJSON-75909491-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4?user_id=73a0b5c7d326491fa4dc7d05aaf7da08" status: 200 len: 371 microversion: 2.1 time: 0.902256 Nov 02 12:13:14.361446 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2332/4715] 10.222.0.48 () {58 vars in 1323 bytes} [Wed Nov 2 12:13:13 2022] GET /compute/v2.1/os-quota-sets/28039ab773d84eb180915ad702502da4?user_id=73a0b5c7d326491fa4dc7d05aaf7da08 => generated 371 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:14.481625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:14.492200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee20ee59-9e09-4ff4-8373-24d681dd0209 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1220 microversion: 2.1 time: 0.207726 Nov 02 12:13:14.495943 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2384/4716] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:14 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1220 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:14.504588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:14.507823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:14.534455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:14.535345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:14.536846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:14.538336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:14.544178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:14.546586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:14.945227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:14.962119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b741ce24-bdfe-4bb1-a0fe-ce203e1b682e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.464709 Nov 02 12:13:14.969755 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2385/4717] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:14 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:15.099310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:15.099944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:15.133853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.135548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.136100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:15.138272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.139866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.140327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:15.159953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:15.527771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:15.529518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:15.538707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.539718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.540245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:15.541091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.541640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.542146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:15.727359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:15.750708 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba34cc03-c93f-438e-b838-5413ff1ad000 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1276 microversion: 2.1 time: 0.229549 Nov 02 12:13:15.769982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:15.775163 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2386/4718] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:15 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:15.804902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-521d75ff-4845-4a16-bc9b-f9280e2b59cc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.433325 Nov 02 12:13:15.806008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2333/4719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:14 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:15.862948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:15.864504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:15.880897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.882286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.883376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:15.884972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:15.887053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:15.888438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:16.028183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:16.029646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:16.048144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.049155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.050241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:16.053747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.058890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.058890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:16.242829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Locking {{(pid=127567) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 02 12:13:16.656894 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10b50d18-c501-463b-aa98-089628ae2c42 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.801638 Nov 02 12:13:16.658570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2387/4720] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:15 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:16.699312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:16.703925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:16.713854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.715213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.716278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:16.728260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:16.734698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:16.736081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:17.004134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:17.031623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14dde3aa-9571-4bc0-bf20-bcc0e73862a8 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.012336 Nov 02 12:13:17.049890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2334/4721] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:16 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:17.083571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:17.095468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:17.123347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:17.126356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:17.128961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:17.131059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:17.134831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:17.138149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:17.506791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:17.527116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dc4d15a-6499-44a3-9b15-eaa3dba750cc tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1282 microversion: 2.1 time: 0.475139 Nov 02 12:13:17.539926 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2335/4722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:17 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1282 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:17.683194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:17.706048 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5ab0358-c9e9-46cf-a49c-ff747bb2a3db tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.040287 Nov 02 12:13:17.715270 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2388/4723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:16 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:13:17.772733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:17.814318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:17.815642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:17.818844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:17.911840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action HTTP/1.1 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: {"os-stop": {}} Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd8289f28-6ecb-49ba-8ff6-b2f4679a888f', 'body': {'os-stop': {}}} Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked Nov 02 12:13:17.919647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:17.931087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 409 to user: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f is locked {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:17.931087 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d768565b-4977-43c2-b480-5ad51fc97261 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 409 len: 107 microversion: 2.1 time: 0.165684 Nov 02 12:13:17.947870 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2336/4724] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:17 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 107 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:13:17.959547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:17.962597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:17.989805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:17.994102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:17.998319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:18.000052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:18.005177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:18.006797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:18.086305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:18.087172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:18.125566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:18.127695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:18.130735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:18.133374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:18.135871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:18.142441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:18.437779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Unlocking {{(pid=127567) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 12:13:18.778123 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd17724f-4501-48b2-9320-93f81c7eadb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.825349 Nov 02 12:13:18.780165 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2389/4725] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:17 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:18.802434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:18.805791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:18.838678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:18.840779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:18.843661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:18.847449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:18.851801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:18.854212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:19.318029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:19.332602 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba1547b4-ef7b-436c-8b63-86942db5b2b3 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.251943 Nov 02 12:13:19.333917 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2337/4726] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:18 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:13:19.358096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:19.368556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:19.369315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:19.369875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:19.491599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:13:19.561892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:19.648002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e248f6c-0ac1-4760-9f47-76fd9e61c084 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.856843 Nov 02 12:13:19.651608 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2390/4727] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:18 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:19.825954 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1bdf10f5-5840-4334-a269-1837a45b1bad tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.487291 Nov 02 12:13:19.827258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2338/4728] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:19 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:19.836649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:19.837347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:19.863882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:19.864384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:19.864885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:19.866050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:19.866521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:19.871639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:20.374831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:20.378067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:20.393286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:20.394716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:20.396145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:20.397742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:20.399839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:20.401388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:20.488506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:20.502434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7dc184ad-523d-4ed3-9cfd-7e91ad932594 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.670261 Nov 02 12:13:20.503076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2391/4729] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:19 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:20.690005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:20.691187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:20.694626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.714952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:20.714952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:20.715696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:20.716612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:20.717247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:20.717842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:20.828140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:20.839971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7490c1e-cef5-4bd4-af7e-d9129cfd5a9a tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.480955 Nov 02 12:13:20.855090 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2339/4730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:20 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:21.082568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:21.093194 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5269131-2338-4e5c-bcdc-b15ab848d3d9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.410455 Nov 02 12:13:21.094430 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2392/4731] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:20 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:21.532471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:21.533569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:21.580400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.581336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.586366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.588002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.590532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.591411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.813108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:21.813751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:21.822313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.823530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.824332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.826078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.827211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.827779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.847884 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 HTTP/1.1 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b09ad267-c38d-44d2-883f-ba3e8e9b2467'} Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:21.849872 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e566a549-61cd-43c8-b749-86841ae25e4e tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 404 len: 111 microversion: 2.1 time: 0.043843 Nov 02 12:13:21.860462 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2393/4732] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:21 2022] DELETE /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:13:21.868088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:21.868088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: b09ad267-c38d-44d2-883f-ba3e8e9b2467] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:21.873673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.874182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.874885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.875686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.876147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.876756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.919506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 HTTP/1.1 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b09ad267-c38d-44d2-883f-ba3e8e9b2467'} Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:21.922574 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance b09ad267-c38d-44d2-883f-ba3e8e9b2467 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d28deb75-724d-4468-8518-e97d31c27dfd tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467" status: 404 len: 111 microversion: 2.1 time: 0.066472 Nov 02 12:13:21.933937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2394/4733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:21 2022] GET /compute/v2.1/servers/b09ad267-c38d-44d2-883f-ba3e8e9b2467 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:13:21.941607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:21.943754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:21.956500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.957019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.957519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.958458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:21.958788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:21.959299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:21.976872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:22.101401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:22.114685 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63e2871b-451d-4492-8ac9-65da57dbf348 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.592284 Nov 02 12:13:22.115609 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2340/4734] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:21 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:22.154437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:22.155251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:22.164351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.166563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.170072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.171246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.171908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.172524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.208775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 HTTP/1.1 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '79ad3ff9-ee40-447f-b112-b23280e5b752'} Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:22.211548 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b11e457-a182-494a-942f-9dee815af561 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 404 len: 111 microversion: 2.1 time: 0.074049 Nov 02 12:13:22.221280 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2341/4735] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:13:22 2022] DELETE /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:22.236513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:22.237735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:22.251409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.252524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.253227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.254371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.255402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.256080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.560076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:22.650118 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da5e229c-1f6d-4223-8b14-7e7f08bfef95 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.717038 Nov 02 12:13:22.666000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2395/4736] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:21 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:22.712932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:22.717521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] [instance: 79ad3ff9-ee40-447f-b112-b23280e5b752] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:22.751261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.751261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.751261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.752230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.752798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.753240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.790852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] HTTP exception thrown: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Request method failure captured: Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 HTTP/1.1 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl1OBy1vDnGu4WfIvPUqhvrTJbNL0-Mr9WnD_QK78X2gDRhvLRjQS2YfqUF0GouFNUaotYb4O6JYdDQtZhLKJfkugJVTL2FOuG1lBC0OnSzkASq1LPB3G4XKqbxXZAW_SFqbwlNwbmfLfIjOKoEW1VIpMdfCqVxMNId_AHegldGJWE8 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ee082f52e7c47cd8c1e43a9c98dfaef", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ee082f52e7c47cd8c1e43a9c98dfaef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5ee082f52e7c47cd8c1e43a9c98dfaef Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-923986204 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2ce4613692b64ad7b7b8cf1f71189e58 Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-923986204-project Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '79ad3ff9-ee40-447f-b112-b23280e5b752'} Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:22.799636 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] Returning 404 to user: Instance 79ad3ff9-ee40-447f-b112-b23280e5b752 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-629e1465-d664-4af4-b2e4-9d019f2f7f80 tempest-DeleteServersTestJSON-923986204 tempest-DeleteServersTestJSON-923986204-project] 10.222.0.48 "GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752" status: 404 len: 111 microversion: 2.1 time: 0.130748 Nov 02 12:13:22.809040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2396/4737] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:22 2022] GET /compute/v2.1/servers/79ad3ff9-ee40-447f-b112-b23280e5b752 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:22.821296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cdfa2d-af52-4aaf-98a6-271f896a9bff", "tag": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:22.837502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:22.837996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:22.838559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:22.874669 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] Creating event network-changed:fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf for instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff on n-h1-855649-4 Nov 02 12:13:22.899820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2a1eb688-ea84-4af8-9187-e8195a40ccf1 req-3a22a160-c813-4766-bfc9-6eee97c6095a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089038 Nov 02 12:13:22.901600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2397/4738] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:23.144674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:23.152984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:23.153765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:23.154467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:23.155251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:23.156238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:23.156918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:23.157566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:23.180537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:23.224609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:23.242680 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8396bea5-0211-4e19-a748-99d86761f3e0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 1.022446 Nov 02 12:13:23.245041 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2342/4739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:22 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:23.252459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "name": "network-vif-plugged", "status": "completed", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:23.265227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:23.266094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:23.266958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:23.289914 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] Creating event network-vif-plugged:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h2-855649-4 Nov 02 12:13:23.306001 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-504a5087-56c8-4e40-9dd0-db03141c440b req-72285f2a-8d6e-46b2-8f19-b6b9f29f444a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058569 Nov 02 12:13:23.307868 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2343/4740] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:23.705439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:23.711044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:23.724912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:23.725880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:23.726346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:23.727141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:23.727644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:23.729728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:23.760877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:23.787333 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38b7e61b-ee39-422d-b048-d4ef5cbfa55f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.635555 Nov 02 12:13:23.787333 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2398/4741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:23 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:13:23.983865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:23.991912 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82ffe4b7-88df-4fca-80c4-92a4472605d5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.299421 Nov 02 12:13:24.003403 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2344/4742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:23 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:24.289347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:24.290856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:24.307329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:24.309319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:24.310385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:24.311999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:24.313142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:24.313993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:24.598734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:24.620843 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54155a54-f91c-42c5-a354-6a88b4eaddde tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.339067 Nov 02 12:13:24.622466 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2399/4743] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:24 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:13:24.806606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:24.807512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:24.809897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:24.822746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:24.825320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:24.825894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:24.827690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:24.828309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:24.828871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.145797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-460678848", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:25.230028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:25.231689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:13:25.232376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:13:25.233496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:13:25.234107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:13:25.234731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:13:25.245271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.246153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.246774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.251415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.251415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.251415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.287818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b51d729-9e6e-468f-b2e8-ad6ca28ec9fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.483088 Nov 02 12:13:25.291780 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2345/4744] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:24 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:25.302797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Getting quotas for project 5c06616382404eed86d30d215f69bc42. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:13:25.313722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Getting quotas for user a11e4251999d4987b579b54bae2e9753 and project 5c06616382404eed86d30d215f69bc42. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:13:25.336467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:25.337358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:25.337727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:13:25.341405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:13:25.362579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.363181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.364906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.365713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.366195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.372450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.552940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f05fdd0-b953-4ab4-a11d-cf86d44a0d77 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.644401 Nov 02 12:13:25.564393 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2400/4745] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 12:13:25.581193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:25.581701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:25.800388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:25.820607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:25.831994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:25.837406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e04d52c0-7051-4322-a997-6d4b1a16b388 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1277 microversion: 2.54 time: 0.261032 Nov 02 12:13:25.842606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2401/4746] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:25 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:13:25.875109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:25.876023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:25.892161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.898686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.899501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:25.900448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:25.901445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:25.902339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:26.534627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:26.559026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:26.561866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-411fb545-75e8-40db-a807-5b1da837474d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.702934 Nov 02 12:13:26.564314 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2402/4747] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:25 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:26.574176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:26.575733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:26.587194 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b274a16-9db3-4bf5-b112-659540feb4c6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 1.294151 Nov 02 12:13:26.588159 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2346/4748] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:25 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:26.611401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:26.618473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:26.620853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:26.620853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:26.620853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:26.620853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:26.873274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:26.873906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:26.950200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:26.968819 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14f14e22-6137-4e87-ad74-a2c90d9e8397 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.402657 Nov 02 12:13:26.994625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2403/4749] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:26 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:27.025191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:27.035338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:27.037638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:27.039502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ee474f1-5675-4d70-bad6-178165206f44 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1277 microversion: 2.54 time: 0.170619 Nov 02 12:13:27.045347 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2347/4750] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:26 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:13:27.593136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:27.594306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:27.609395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:27.611429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:27.622599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:27.623438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:27.628572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:27.631430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:27.635382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:27.638237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:27.639534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:27.646098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:27.652339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:27.652339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:27.652339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:27.653427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:28.309902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:28.311439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:28.322136 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17f1145d-4783-4427-bbd0-4fbc3ba6f835 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1519 microversion: 2.1 time: 0.703773 Nov 02 12:13:28.323099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2348/4751] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:27 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1519 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:28.329030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:28.329956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:28.337691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:28.338473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:28.339306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:28.340726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:28.341483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:28.342516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:28.366347 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7f72003-1ccf-43ee-bf01-a0c7c876c840 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.734601 Nov 02 12:13:28.375086 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2404/4752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:27 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:28.405133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:28.405627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:28.445454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:28.448161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:28.451655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:28.455174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:28.455808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:28.456274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:29.207271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:29.224521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:29.226302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:29.227574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65511393-d4f1-4aa2-b380-cf1310fc052e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1273 microversion: 2.54 time: 0.850958 Nov 02 12:13:29.233026 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2405/4753] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:28 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1273 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:29.374746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:29.375403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:29.384303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:29.385202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:29.385873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:29.389424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:29.391287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:29.391749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:29.938655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:29.957766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74732437-2df4-433b-aca5-cb845b5c8183 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 1.632216 Nov 02 12:13:29.982492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:29.988678 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2349/4754] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:28 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:30.008349 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a7b8d3b-83f4-45ba-b869-d69be3606aae tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.639132 Nov 02 12:13:30.010929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:30.012421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:30.038174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2406/4755] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:29 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:30.073271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.074307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.080345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5763d040-c955-4bae-be40-be35b12c6bb4 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b2b4fd30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:30.089738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.091789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.092958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.107857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.241467 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5763d040-c955-4bae-be40-be35b12c6bb4 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4b7736ba-5856-470b-bde8-ec3d10e5b81f" status: 200 len: 351 microversion: 2.1 time: 0.195533 Nov 02 12:13:30.243345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2407/4756] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:13:30 2022] GET /compute/v2.1/os-volumes/4b7736ba-5856-470b-bde8-ec3d10e5b81f => generated 351 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:30.263712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:30.270994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:30.297439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.298284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.302453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.303714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.304439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.305119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.775903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:30.802793 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a896703-27a4-4872-8cf2-5edfb0ba5bf6 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.810172 Nov 02 12:13:30.805515 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2350/4757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:29 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:30.846468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:30.846468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:30.877245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.877245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.877245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.877245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:30.878275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:30.878519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:30.963611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:30.978106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:31.041356 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36546c56-1e72-458a-ba01-489c060abbf4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.783574 Nov 02 12:13:31.041356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2408/4758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:30 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:31.053221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:31.055134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:31.070616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:31.072230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:31.073334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:31.074891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:31.075899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:31.076777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:31.122312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:31.139563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:31.142828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:31.145516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7240cbcf-2a46-4bfc-bfa3-8c60d4a68e6e tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1347 microversion: 2.54 time: 0.329033 Nov 02 12:13:31.146842 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2351/4759] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:30 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1347 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:31.155772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:31.163334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:31.173539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:31.175293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:31.176426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:31.178405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:31.179666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:31.181156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:31.889966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:31.934540 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e13659f4-9100-468e-bba8-fa928dfbacc2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1656 microversion: 2.1 time: 0.891540 Nov 02 12:13:31.958658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2409/4760] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:31 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1656 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:31.985889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cdfa2d-af52-4aaf-98a6-271f896a9bff", "name": "network-vif-plugged", "status": "completed", "tag": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:31.998197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:32.032388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41f57481-8831-40dd-8244-a22c07def9ef tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.881423 Nov 02 12:13:32.033442 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2352/4761] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:31 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:32.077409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.083150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.083893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.090889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:32.092226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:32.114515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.115380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.116131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.117345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.123443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.124411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.138149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] Creating event network-vif-plugged:fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf for instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff on n-h1-855649-4 Nov 02 12:13:32.156760 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f74cbf2d-e65c-4a0b-a375-a619f4d25586 req-bbf07bca-f79c-44f3-a452-82bb656b8f8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201483 Nov 02 12:13:32.161480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2410/4762] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:32.182089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:32.202435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.208298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.209139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.348716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Going to try to start instance {{(pid=127567) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:13:32.507034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:32.530956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0c24681f-22e8-4bf0-9c1a-aa5bbe5df7f3 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.474464 Nov 02 12:13:32.548674 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2353/4763] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:32 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:32.561307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac5a9410-fdfc-468a-8a33-4195aa0725a4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:32.581562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ac5a9410-fdfc-468a-8a33-4195aa0725a4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac5a9410-fdfc-468a-8a33-4195aa0725a4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/b9c70d33-7a8a-4587-ab56-f59ae7e95210/action HTTP/1.1 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: {"os-stop": {}} Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'b9c70d33-7a8a-4587-ab56-f59ae7e95210', 'body': {'os-stop': {}}} Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:32.596568 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. Nov 02 12:13:32.611572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:32.614576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ac5a9410-fdfc-468a-8a33-4195aa0725a4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance b9c70d33-7a8a-4587-ab56-f59ae7e95210 has no mapping to a cell. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:32.617972 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ac5a9410-fdfc-468a-8a33-4195aa0725a4 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/b9c70d33-7a8a-4587-ab56-f59ae7e95210/action" status: 404 len: 117 microversion: 2.1 time: 0.081501 Nov 02 12:13:32.621743 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2354/4764] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:32 2022] POST /compute/v2.1/servers/b9c70d33-7a8a-4587-ab56-f59ae7e95210/action => generated 117 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:32.632070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:32.633807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:32.650675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.654050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.654923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.656311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.657777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.658924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.805679 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b976428-fa9e-44dd-b7f9-a06fe7c4072e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.634280 Nov 02 12:13:32.805679 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2411/4765] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:32 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:32.827034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:32.828255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:32.849226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.850071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.855673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:32.864522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:32.865779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:32.866739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:33.137147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:33.155219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:33.156754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:33.165331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54a6efc0-bcd1-4590-a160-be7eff664709 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1335 microversion: 2.54 time: 0.541851 Nov 02 12:13:33.167906 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2355/4766] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:32 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1335 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:33.193861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:33.203830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:33.247062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:33.248074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:33.248804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:33.260203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:33.280279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:33.280279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:34.441013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:34.451411 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ebcd03f-c84f-4694-b042-dcd411945d67 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.646263 Nov 02 12:13:34.452422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2412/4767] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:32 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:34.460036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:34.461068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:34.471205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:34.472062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:34.472736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:34.473884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:34.474694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:34.475446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:34.515740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:34.538804 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd3d2f2b-bf7d-4bb5-8b22-2b756ea6d438 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1665 microversion: 2.1 time: 1.362407 Nov 02 12:13:34.551291 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2356/4768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:33 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1665 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:34.564356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:34.572423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:34.597194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:34.597972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:34.600761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:34.600761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:34.600761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:34.601300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:34.816318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:34.972578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:34.977945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:34.981727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c9113c0-3930-400c-9df9-80c3a6cc873b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1356 microversion: 2.54 time: 0.430307 Nov 02 12:13:34.983250 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2357/4769] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:34 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1356 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:35.006602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:35.008828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:35.027666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:35.044661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:35.047865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:35.052936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:35.053969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:35.055628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:35.145026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:35.171814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53c5a675-b54f-4cec-a35e-fa186f52a319 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1324 microversion: 2.1 time: 0.717473 Nov 02 12:13:35.173401 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2413/4770] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:34 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:35.183407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2895c3f3-95cb-4682-be49-8bc3b1ace1c7 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b2ff8670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:35.257908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:35.309141 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2895c3f3-95cb-4682-be49-8bc3b1ace1c7 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/89caf0ce-364c-47eb-ad31-7c9631faca5a" status: 200 len: 351 microversion: 2.1 time: 0.133417 Nov 02 12:13:35.310672 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2414/4771] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:13:35 2022] GET /compute/v2.1/os-volumes/89caf0ce-364c-47eb-ad31-7c9631faca5a => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:35.325305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Action: 'create', calling method: .version_select at 0x7ff1b2bdbca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1745647484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpD9D77UtJIb/MPbTCgeu2GGbi5XyRc37ySyKxhunE15uLwqWJ7yCyJvcLGk2c2p/y1tNkEdG5cw9GwvfD5kyF5dgeSTJHf+DbJSVP3GTSOhkymk+L1qnCS+4fia361vA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:35.387441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Getting quotas for project 5c06616382404eed86d30d215f69bc42. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:13:35.401488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Getting quotas for user a11e4251999d4987b579b54bae2e9753 and project 5c06616382404eed86d30d215f69bc42. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:13:35.431507 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:13:35.829510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:35.854105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae12974a-5dea-4fbb-acae-f059871ed542 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.863824 Nov 02 12:13:35.854105 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2358/4772] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:34 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:35.873232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:35.874234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:35.884819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:35.887052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:35.888111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:35.889685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:35.890793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:35.891615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.240173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:36.252342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10158f3d-9c37-44fd-a434-ded98d27bb71 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1665 microversion: 2.1 time: 0.396789 Nov 02 12:13:36.253058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2359/4773] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:35 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1665 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:36.259371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:36.260141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: f4374060-c27e-415f-96e0-e215512f4f2a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:36.268544 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/f4374060-c27e-415f-96e0-e215512f4f2a/action HTTP/1.1 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: {"suspend": {}} Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'f4374060-c27e-415f-96e0-e215512f4f2a', 'body': {'suspend': {}}} Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:36.271725 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance f4374060-c27e-415f-96e0-e215512f4f2a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-535d4d1d-dd03-44fe-bb25-bda95a9cc172 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/f4374060-c27e-415f-96e0-e215512f4f2a/action" status: 404 len: 111 microversion: 2.1 time: 0.019579 Nov 02 12:13:36.279399 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2360/4774] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:36 2022] POST /compute/v2.1/servers/f4374060-c27e-415f-96e0-e215512f4f2a/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:13:36.293182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:36.297617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:36.307370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.309374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.310728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.312347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.313102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.313660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.453603 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39534. Nov 02 12:13:36.586677 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-616315be-65eb-4be7-9c08-4a943a35e682 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 1.268480 Nov 02 12:13:36.586677 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2415/4775] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 12:13:35 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 1271 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:36.597076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:36.598481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:36.608482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.609567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.610612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.614878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.614878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.614878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.815501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:36.846405 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a2571c5-13fb-4608-b3d9-3355f8d8702b tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 200 len: 1520 microversion: 2.1 time: 0.564402 Nov 02 12:13:36.846405 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2361/4776] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:36 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 1520 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:36.875848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1745647484", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:36.889208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:36.930168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.931042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.934936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:36.940626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:36.945135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:36.946439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.019158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:37.035523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.037482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d8f50ee-f582-49c1-84eb-34c526ea891e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.451770 Nov 02 12:13:37.040312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2416/4777] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:36 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:37.078019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.66"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:37.088570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:37.116476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.120603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.122300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.129506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.130415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.131215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.202159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.234587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:13:37.237011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:13:37.237978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:13:37.238634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:13:37.240809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:13:37.241592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:13:37.242000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquired lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:13:37.790547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:37.815923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.818456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.819623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.821269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.822427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.824203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.902142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7920e1f3-0258-4b22-bc2a-35b358a61f76 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "POST /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817/action" status: 202 len: 1139 microversion: 2.54 time: 1.053723 Nov 02 12:13:37.906018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2362/4778] 10.222.0.48 () {62 vars in 1320 bytes} [Wed Nov 2 12:13:36 2022] POST /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817/action => generated 1139 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:13:37.916414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:37.918707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:37.935787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.938165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.939317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:37.941319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:37.943839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:37.945006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:38.804378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:38.833692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d31df487-d95c-430f-ac01-da8bb9074308 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.925586 Nov 02 12:13:38.835478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2363/4779] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:37 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:38.841218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:38.842644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:38.851277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:38.852267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:38.853386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:38.860928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:38.860928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:38.860928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:39.256901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:39.294609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4520a6a-0ab3-44bb-926f-3a35b04db21c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.457413 Nov 02 12:13:39.303923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2364/4780] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:38 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:39.321646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:39.321646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:39.343509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:39.345008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:39.346341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:39.347964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:39.353091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:39.353091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:39.500190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:39.524002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:39.525484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:39.532905 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-319a8742-9c12-4550-b30f-e8ab3b7a26ab tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1408 microversion: 2.54 time: 0.226257 Nov 02 12:13:39.538416 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2365/4781] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:39 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:39.544446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:39.548316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:39.561814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:39.562311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:39.562753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:39.563510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:39.568506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:39.568978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:39.611566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'flavor' on Instance uuid ee124e40-ea65-4c8f-a1aa-2886a999e4cf {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:13:39.811092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:40.128738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7bfc99c9-c2f4-4fda-8bc7-519a68e251eb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.588686 Nov 02 12:13:40.130637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2366/4782] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:39 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:40.143288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:40.149919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:40.169465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:40.171061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:40.172109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:40.173596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:40.174719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:40.175726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:40.529966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:13:40.531356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:40.556687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad91cf9c-2f20-4c9e-b8a1-ffea4ab0dad9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.422716 Nov 02 12:13:40.563480 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2367/4783] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:40 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:40.587085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b1a04b8-7738-441a-ad14-93b2e9a2f479 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b27a8ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:40.770723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b1a04b8-7738-441a-ad14-93b2e9a2f479 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41bdb27a-f072-4221-86c6-9902b0f2e6c1" status: 200 len: 351 microversion: 2.1 time: 0.205178 Nov 02 12:13:40.772792 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2368/4784] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:13:40 2022] GET /compute/v2.1/os-volumes/41bdb27a-f072-4221-86c6-9902b0f2e6c1 => generated 351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:40.783620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:40.801224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:40.820763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:40.824163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:40.829357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:40.835217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:40.839801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:40.839801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:40.839801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:41.279289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:41.359856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2426fb47-192a-46d9-a2ed-66258e68f895 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1514 microversion: 2.1 time: 0.584119 Nov 02 12:13:41.369811 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2369/4785] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:40 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1514 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:41.392311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:41.429996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:41.431734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:41.436093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:41.490751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] Creating event network-changed:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:13:41.509648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-19cca704-cdf1-4982-ac52-e0f6895f2a0e req-4610f4e4-bf40-4331-84d2-ab729100becc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137413 Nov 02 12:13:41.514644 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2370/4786] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:41.544219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:41.561338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:41.586144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:41.586896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:41.587659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:41.597995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:41.599148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:41.599894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:42.772116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:42.788745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:42.792857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:42.795473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24941a94-2e07-45d3-bd4c-cafbfc51cb38 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1408 microversion: 2.54 time: 1.276570 Nov 02 12:13:42.796648 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2371/4787] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:41 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1408 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:42.805906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:42.807042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:42.817969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:42.818958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:42.820140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:42.821543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:42.822530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:42.823488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:43.146572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Unlocking {{(pid=127568) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 12:13:43.361806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Updating instance_info_cache with network_info: [{"id": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b", "address": "fa:16:3e:a2:dc:a3", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6025fa7f-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:13:43.466092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Releasing lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:13:43.468244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67d6c5d5-9bc1-4369-bfd4-78f16f0fed38 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action" status: 202 len: 0 microversion: 2.1 time: 6.425942 Nov 02 12:13:43.469574 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2417/4788] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:37 2022] POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action => generated 0 bytes in 6428 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:13:43.484078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fa26dcc-241e-4525-9123-1d4d3689cdf3 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b2bd3dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:43.622597 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab25f6c4-7855-4263-8393-1fb0ecae1312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.823766 Nov 02 12:13:43.635261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2372/4789] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:42 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:43.677804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:43.682588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:43.720635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:43.726751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:43.728895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:43.732720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:43.734752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:43.739365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:43.911456 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fa26dcc-241e-4525-9123-1d4d3689cdf3 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.438312 Nov 02 12:13:43.913452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2418/4790] 10.222.0.48 () {58 vars in 1134 bytes} [Wed Nov 2 12:13:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:43.930789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.66"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:43.941894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:43.967437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:43.982836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:43.984023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:43.988493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:43.989760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:43.990606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:43.991409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:44.104158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:13:44.111457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquired lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:13:44.750185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:44.767764 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6484ebe7-90be-4fe2-8c2f-138f3b9d4a5f tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1497 microversion: 2.1 time: 1.129507 Nov 02 12:13:44.768838 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2373/4791] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:43 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1497 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:44.789824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:44.791291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:44.828426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:44.831745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:44.833761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:44.836555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:44.839904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:44.841639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:45.419298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.518767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:45.531777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20337009-25cc-45f5-911d-0b2f1cafc6a1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.760883 Nov 02 12:13:45.532923 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2374/4792] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:44 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:45.543753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:45.546079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:45.556504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:45.557273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:45.559063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:45.576780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:45.576780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:45.576780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:45.738487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:45.772514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:45.781709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:45.783880 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86d572e9-1303-442e-8e5e-5708e936142f tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1408 microversion: 2.54 time: 0.249499 Nov 02 12:13:45.803017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2375/4793] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:45 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:45.810695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04f4d933-7101-4fd3-9757-b6902b1052b0 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1bb9c6dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:46.106098 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04f4d933-7101-4fd3-9757-b6902b1052b0 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.314363 Nov 02 12:13:46.107639 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2376/4794] 10.222.0.48 () {58 vars in 1149 bytes} [Wed Nov 2 12:13:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:46.117274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:46.129546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:46.163428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.164432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.165346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'flavor' on Instance uuid ee124e40-ea65-4c8f-a1aa-2886a999e4cf {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'suspend' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state suspended Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: {"suspend": {}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'suspend' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state suspended Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'suspend': {}}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:13:46.302856 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state suspended Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state suspended Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'suspend' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state suspended {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4fb2e87d-1a96-408f-819c-78168f58cf69 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 148 microversion: 2.1 time: 0.147232 Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2377/4795] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:46 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 148 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:46.310400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.341214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.341214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:46.341214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.341214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.341214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:46.703571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:46.703571 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b798d47-6e7f-46cd-9e18-9c87c195cf84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.420171 Nov 02 12:13:46.703571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2378/4796] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:46 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:46.706625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d051e228-5bb6-44ca-8702-af1d3d6ee27a tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1bb9c6790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:46.908044 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d051e228-5bb6-44ca-8702-af1d3d6ee27a tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.209777 Nov 02 12:13:46.927307 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2379/4797] 10.222.0.48 () {58 vars in 1134 bytes} [Wed Nov 2 12:13:46 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:46.943734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:46.959303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:46.975114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.980975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.982846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:46.987083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:46.990160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:46.991388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:47.463316 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ad7c4dd-337c-4eb4-b982-6ac2bc4703dc tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 202 len: 0 microversion: 2.1 time: 0.533018 Nov 02 12:13:47.470736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2380/4798] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:46 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:47.489372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:47.490952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:47.517631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:47.518812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:47.519732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:47.521086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:47.522036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:47.522877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:48.056942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:48.092187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4583aea2-87c6-43f7-bb10-34022020cd10 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.623206 Nov 02 12:13:48.094126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2381/4799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:47 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:48.115338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:48.119040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:48.148892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:48.152022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:48.153459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:48.156841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:48.162224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:48.163880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:48.501334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:48.536176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:48.564697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:48.576376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:48.588359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b9bef53-6b90-4040-9e5d-f6afb867355b tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1408 microversion: 2.54 time: 0.486429 Nov 02 12:13:48.592401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2382/4800] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:48 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:48.656535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad715b8a-756d-483d-93aa-e75b1a6607bb tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b276a670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:49.433516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad715b8a-756d-483d-93aa-e75b1a6607bb tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.832246 Nov 02 12:13:49.434537 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2383/4801] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 12:13:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:49.454296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:49.455380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:49.479232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:49.487644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:49.488793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:49.490405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:49.491541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:49.497713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:51.737172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:51.769368 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebf96ac9-8c1c-414b-9194-1611dd99a105 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1503 microversion: 2.1 time: 2.331421 Nov 02 12:13:51.770803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2384/4802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:49 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1503 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:51.795480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:51.803482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:51.842662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:51.852710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:51.858938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:51.860815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:51.871892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:51.873223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:52.429361 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-171195ad-8d41-4ee2-ad2a-297e02fd43e2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.655740 Nov 02 12:13:52.434634 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2385/4803] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:51 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:52.461393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8577f698-1b3d-404c-a886-d6e5c57eb602 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b34e1550>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:52.911739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8577f698-1b3d-404c-a886-d6e5c57eb602 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.474848 Nov 02 12:13:52.912977 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2386/4804] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 12:13:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:52.919648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:52.920984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:52.954554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:52.955845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:52.958355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:52.960948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:52.964236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:52.965475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:53.042119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.neutron [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] re-assign floating IP 172.25.8.66 from instance 34ce0bd3-74aa-40e5-b560-1e015e87182b Nov 02 12:13:53.223278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:13:53.239641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:53.304671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:53.320656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:53.331476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79b38ead-19a0-4439-9a58-9bb30a723321 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1408 microversion: 2.54 time: 0.408998 Nov 02 12:13:53.332604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2387/4805] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:52 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1408 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:53.358390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:53.359504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:53.381372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:53.382122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:53.382824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:53.384223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:53.395614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:53.396606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:54.138183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.240729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:54.325125 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d7d4f0e4-1ead-4964-9781-a803a9f370bb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1654 microversion: 2.1 time: 0.990758 Nov 02 12:13:54.326446 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2388/4806] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:53 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1654 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:54.340332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:54.362696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:54.363485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:54.364981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:54.391105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] Creating event network-changed:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:13:54.405620 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4f50b426-b8be-459f-abf4-8c85893cc7f9 req-016765c2-3ea1-4f4a-bac0-7f8421062462 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073475 Nov 02 12:13:54.407319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2389/4807] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:54.423967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:54.425657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:54.450802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:54.458375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:54.470746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:54.472357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:54.476973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:54.478087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:55.457655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:55.482624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44186dda-deed-412f-9854-a213cd6ee801 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.072449 Nov 02 12:13:55.484715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2390/4808] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:54 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:55.506612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b67fdf4a-3c72-420b-82f5-aa051012b19f tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b34e1940>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:55.883085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b67fdf4a-3c72-420b-82f5-aa051012b19f tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.396020 Nov 02 12:13:55.889799 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2391/4809] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 12:13:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:55.904799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:55.905991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:55.944540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.945567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.946616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:55.948611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:55.949567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:55.950493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:56.321774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecc4fac9-b501-4110-af70-44f522280ae4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.427655 Nov 02 12:13:56.327533 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2392/4810] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:55 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:13:56.348850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:56.358278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:56.381018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:56.387121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:56.388303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:56.389838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:56.391918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:56.395305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:56.880675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:56.917491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:56.920981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:56.924922 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c6539ba-8ffb-481a-8b25-dd3f3aff5638 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1414 microversion: 2.54 time: 0.594541 Nov 02 12:13:56.940539 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2393/4811] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:56 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1414 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:13:56.988555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:56.993194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:56.999799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Updating instance_info_cache with network_info: [{"id": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b", "address": "fa:16:3e:a2:dc:a3", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6025fa7f-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:13:57.009430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:57.021333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:57.026706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:57.029115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:57.035937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:57.043707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:57.137421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:13:57.973675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:58.005361 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4269124e-390f-4882-8918-2a261fa33b13 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.059446 Nov 02 12:13:58.008102 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2394/4812] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:56 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:58.027376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f43db5e-3cd3-43a7-95ce-f2476e75dc50 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b39a4dc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:58.372074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f43db5e-3cd3-43a7-95ce-f2476e75dc50 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.360346 Nov 02 12:13:58.409733 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2395/4813] 10.222.0.48 () {58 vars in 1188 bytes} [Wed Nov 2 12:13:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:58.432988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:58.438597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:58.481686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.483324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.484316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:58.487193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:58.488206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:58.489333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.436433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:59.471215 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09cc9e60-6b2b-4e1a-8b3b-fc93b037fbb6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.053840 Nov 02 12:13:59.472634 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2396/4814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:13:58 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:59.504570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cdfa2d-af52-4aaf-98a6-271f896a9bff", "tag": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:13:59.539285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:59.540509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:59.541114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.571132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] Creating event network-changed:fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf for instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff on n-h1-855649-4 Nov 02 12:13:59.586372 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6b1b63e0-fedf-4330-93cb-ee8d73c37850 req-3159c1ba-7e5a-4489-9db4-8102ff0a82b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110809 Nov 02 12:13:59.589404 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2397/4815] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:13:59.608174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:13:59.608174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:13:59.624511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:59.625983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:59.627183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.629195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:13:59.631597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:13:59.632813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:13:59.907014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:59.937306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:59.942451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:13:59.946803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd2b23ad-415e-4d9a-8760-4ea56b5b76d7 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1399 microversion: 2.54 time: 0.354020 Nov 02 12:13:59.963012 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2398/4816] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:13:59 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1399 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:14:00.141620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Updating instance_info_cache with network_info: [{"id": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf", "address": "fa:16:3e:a6:ec:d2", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb4918b8-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:14:00.236367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Releasing lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:14:00.237854 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2026c27-ee6c-4b31-a655-554953524eff tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff/action" status: 202 len: 0 microversion: 2.1 time: 16.322568 Nov 02 12:14:00.239262 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2419/4817] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:43 2022] POST /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff/action => generated 0 bytes in 16325 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:14:00.252134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11f88a1a-bb69-433f-800f-c9598291e492 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] Calling method '.version_select at 0x7ff1b2b4f700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:00.563739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:00.568021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 535ef92a-012f-4b4c-b69c-145bd241ef4d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:00.592158 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11f88a1a-bb69-433f-800f-c9598291e492 tempest-VolumesTestJSON-314412645 tempest-VolumesTestJSON-314412645-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.350241 Nov 02 12:14:00.592660 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. Nov 02 12:14:00.594588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2420/4818] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 12:14:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/535ef92a-012f-4b4c-b69c-145bd241ef4d/action HTTP/1.1 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: {"unpause": {}} Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '535ef92a-012f-4b4c-b69c-145bd241ef4d', 'body': {'unpause': {}}} Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:00.597385 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 535ef92a-012f-4b4c-b69c-145bd241ef4d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43a348bc-08ae-4424-8022-df9ff49d9c8e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/535ef92a-012f-4b4c-b69c-145bd241ef4d/action" status: 404 len: 111 microversion: 2.1 time: 0.661056 Nov 02 12:14:00.636011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2399/4819] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:13:59 2022] POST /compute/v2.1/servers/535ef92a-012f-4b4c-b69c-145bd241ef4d/action => generated 111 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:00.638222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:00.638222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:00.643840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf9f1e99-4dbc-4c1d-ab72-12361b79cded tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '.version_select at 0x7ff1b2f24ee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:00.655647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:00.659976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:00.659976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:00.659976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:00.662267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:00.663426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:00.824690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf9f1e99-4dbc-4c1d-ab72-12361b79cded tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1745647484" status: 204 len: 0 microversion: 2.54 time: 0.205961 Nov 02 12:14:00.825660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2400/4820] 10.222.0.48 () {60 vars in 1319 bytes} [Wed Nov 2 12:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1745647484 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:14:00.848157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.66"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:01.765172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:01.786465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.792642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.796572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.798625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:01.802583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:01.803435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:01.879919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:01.917942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86515e9a-c52d-4495-b090-2f90356a72ae tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.305468 Nov 02 12:14:01.960419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2421/4821] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:00 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:01.998093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:01.999554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:02.014192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.015580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.018387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.020081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.021423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.022700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.671432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:02.705974 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6636cf7d-4909-4fd9-ae72-f503ca05e0fe tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.737325 Nov 02 12:14:02.724292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2422/4822] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:01 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:02.753886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:02.753886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:02.761400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] HTTP exception thrown: Floating IP 172.25.8.66 is not associated with instance 34ce0bd3-74aa-40e5-b560-1e015e87182b. Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Request method failure captured: Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action HTTP/1.1 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 48 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl6spACBe6QSA4cTsB1EUeKv05NTtXn94WoH2nbMCM_v_8EFObSO5barbTieEFlo7FUC7LRhrCuWidPUL31XBlDiTbEvz9af_IzBrEdnp9i66tn6YqlI3g6WawX3wwgcOJoJ1FbHQfdigwLkGUwLblGDxxwTkNuLn4jyjwrWh1eI-do Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e70bbe80057d4e3a8f529b47970d5fd7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4be892bbdd2146529d0ad0e297588159 Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: {"removeFloatingIp": {"address": "172.25.8.66"}} Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: exception: Floating IP 172.25.8.66 is not associated with instance 34ce0bd3-74aa-40e5-b560-1e015e87182b. Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '34ce0bd3-74aa-40e5-b560-1e015e87182b', 'body': {'removeFloatingIp': {'address': '172.25.8.66'}}} Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.66 is not associated with instance 34ce0bd3-74aa-40e5-b560-1e015e87182b. Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.66 is not associated with instance 34ce0bd3-74aa-40e5-b560-1e015e87182b. Nov 02 12:14:02.767049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:02.788506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Returning 409 to user: Floating IP 172.25.8.66 is not associated with instance 34ce0bd3-74aa-40e5-b560-1e015e87182b. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:02.788506 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be3947af-caf4-4612-b5f5-4c8de7da3fdf tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action" status: 409 len: 145 microversion: 2.1 time: 1.941300 Nov 02 12:14:02.788506 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2401/4823] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:00 2022] POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action => generated 145 bytes in 1950 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:14:02.790126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.790126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.790660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.791564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.792294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.793302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.794806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:02.795911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:02.830493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.831474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.832244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.833465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:02.834228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:02.845463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:02.862256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:14:03.339946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:03.379696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c033acbe-b96e-44a0-a7dd-7d57248bf5f0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.583859 Nov 02 12:14:03.381155 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2402/4824] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:02 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:03.398547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:03.400210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:03.424660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:03.425764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:03.432569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:03.436208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:03.436208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:03.436208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:03.523574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68510386-c8d4-453f-8518-18bdf93a82c9 tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "DELETE /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 204 len: 0 microversion: 2.54 time: 0.796626 Nov 02 12:14:03.530736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2423/4825] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:14:02 2022] DELETE /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:14:03.545442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: .version_select at 0x7ff1b9436ee0>, body: {"removeFloatingIp": {"address": "172.25.8.66"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:04.515840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:04.538570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.540608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.552255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.554050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.555249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.564495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.595455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:04.615602 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59a1cc2a-459b-4e6d-a945-2ea93843f15e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.230676 Nov 02 12:14:04.617655 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2403/4826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:03 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:04.670772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:04.676590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:04.693926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.696086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.728282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:04.731023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:04.732794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:04.734165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:05.494575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:05.521196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7694ce6f-086c-4f30-9e4b-8bccc372aee4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.883442 Nov 02 12:14:05.531170 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2404/4827] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:04 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:05.554842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:05.558152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:05.582582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:05.590509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:05.595448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:05.605667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:05.607118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:05.612194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:05.638521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:05.653499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:14:05.653499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquired lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:14:05.893831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:05.916753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:05.918555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a11e4251999d4987b579b54bae2e9753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06616382404eed86d30d215f69bc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:05.919969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27cd5cd2-d9f5-45d1-b8fe-c22ddfa38fbe tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 200 len: 1405 microversion: 2.54 time: 0.385634 Nov 02 12:14:05.938474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2405/4828] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:14:05 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 1405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:14:05.974639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:05.984028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:06.014476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:06.015025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:06.024718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:06.025543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:06.031804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:06.036797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:06.158685 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'unpause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 15 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: {"unpause": {}} Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'unpause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'unpause': {}}} Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state active. Cannot unpause while the instance is in this state. Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:06.161246 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:06.171718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'unpause' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:06.229759 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf6793c1-bf75-45a6-bd6b-4153cce73b09 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 145 microversion: 2.1 time: 0.285465 Nov 02 12:14:06.235503 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2406/4829] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:05 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 145 bytes in 295 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:14:06.267844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:06.268952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:06.320056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:06.335668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:06.336346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:06.337257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:06.337885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:06.338503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:06.995105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:07.044503 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-320a4fad-6c45-4292-96ec-290d60ef4867 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.804292 Nov 02 12:14:07.048098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2407/4830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:06 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:07.062155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:07.065290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:07.106944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:07.109726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:07.112477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:07.117180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:07.118741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:07.121305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:08.700933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:08.727017 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b657cb17-120f-45e2-828c-ef0d72e02f4e tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.676407 Nov 02 12:14:08.735764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2408/4831] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:07 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:08.741116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:08.757041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] [instance: 75ab6ebc-4a54-42a8-b639-ee2f36d53817] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:08.779424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:08.780418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:08.781141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:08.782050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:08.782660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:08.783274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] HTTP exception thrown: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Request method failure captured: Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 HTTP/1.1 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl7kfjzoeL02zsQ4s2SSIAYB0mjNX3DJ5eTebE-0KbKxrj8-yxhEPoQnvc-C5T1bK1KOb94DBdf7-P9w7Nt6KDjM1VLDMrrzwApQHRcs2Cr5cS2ibdr4tKjUL3SCAv4BMoJJVR4L86Fl-ls8NKwl5VrH9FGOwf6LkFnXY3hTTTlThko Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5c06616382404eed86d30d215f69bc42 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerShowV254Test-1367597113 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c06616382404eed86d30d215f69bc42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5c06616382404eed86d30d215f69bc42", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5c06616382404eed86d30d215f69bc42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c06616382404eed86d30d215f69bc42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerShowV254Test-1367597113 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5c06616382404eed86d30d215f69bc42 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerShowV254Test-1367597113 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerShowV254Test-1367597113-project Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: a11e4251999d4987b579b54bae2e9753 Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerShowV254Test-1367597113-project Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '75ab6ebc-4a54-42a8-b639-ee2f36d53817'} Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:08.822675 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] Returning 404 to user: Instance 75ab6ebc-4a54-42a8-b639-ee2f36d53817 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f869feca-697c-465b-a811-f6886300fd0c tempest-ServerShowV254Test-1367597113 tempest-ServerShowV254Test-1367597113-project] 10.222.0.48 "GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817" status: 404 len: 111 microversion: 2.54 time: 0.082714 Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2409/4832] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:14:08 2022] GET /compute/v2.1/servers/75ab6ebc-4a54-42a8-b639-ee2f36d53817 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:14:08.846947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:08.849058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:08.867189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:08.867866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:08.868569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:08.869480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:08.874345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:08.874345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:10.060528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:10.106651 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e57c4002-2c1e-4aef-8645-73a0300d925a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.270945 Nov 02 12:14:10.110781 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2410/4833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:08 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:10.133723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:10.137966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:10.169147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:10.173468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:10.180257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:10.181575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:10.182496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:10.183345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:10.792780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:10.833913 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73f3d586-185f-4c7f-be88-3981b6fd610b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.718935 Nov 02 12:14:10.837889 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2411/4834] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:10 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:10.870599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cdfa2d-af52-4aaf-98a6-271f896a9bff", "tag": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:10.907887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:14:10.919696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=49,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:10.925901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:10.933163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:10.933163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:10.999477 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] Creating event network-changed:fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf for instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff on n-h1-855649-4 Nov 02 12:14:11.020641 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-763dc162-9732-47f8-b680-d981c8423ba6 req-e1acc6ab-0cf7-4d07-9e11-3a0e854fa153 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176707 Nov 02 12:14:11.026606 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2412/4835] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:11.085997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:11.095896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:11.133445 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725/action HTTP/1.1 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 18 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: {"unshelve": null} Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725', 'body': {'unshelve': None}} Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:11.140840 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:11.153667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:11.175297 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-925cc3c2-aeed-4a41-9fa9-d778168db058 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725/action" status: 404 len: 111 microversion: 2.1 time: 0.116451 Nov 02 12:14:11.178428 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2413/4836] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:11 2022] POST /compute/v2.1/servers/2d4cd9ab-158f-4b4a-8c43-2d58e7ccf725/action => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:11.205331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:11.206879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:11.218077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:11.246088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:11.251941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:11.253041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:11.258556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:11.261167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:11.266689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:12.725856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:12.777074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b4a0ad2-9367-4777-bfc4-f6daccda0c84 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.591826 Nov 02 12:14:12.786234 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2414/4837] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:11 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:12.838058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:12.840100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:12.871174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:12.874422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:12.877984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:12.880708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:12.887744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:12.890534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:13.660399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Updating instance_info_cache with network_info: [{"id": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf", "address": "fa:16:3e:a6:ec:d2", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb4918b8-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:14:13.828624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Releasing lock "refresh_cache-75cdfa2d-af52-4aaf-98a6-271f896a9bff" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:14:13.830464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2706db45-1c28-4381-b8db-2bf9f76b95b8 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff/action" status: 202 len: 0 microversion: 2.1 time: 10.297586 Nov 02 12:14:13.832488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2424/4838] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:03 2022] POST /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff/action => generated 0 bytes in 10301 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:14:13.846183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:13.849985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:13.881983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:13.883418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:13.887290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:13.889044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:13.890821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:13.892093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:13.998038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:14:14.095433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:14.138803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e08a792-92da-45d3-9aa9-a7f67478cba5 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.313487 Nov 02 12:14:14.142209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2415/4839] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:12 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:14.172604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:14.180574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:14.210617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.216016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.217113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.219694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.220626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.221471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.361041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Cannot 'unshelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action HTTP/1.1 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 18 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: {"unshelve": null} Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: exception: Cannot 'unshelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'unshelve': None}} Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:14:14.368767 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:14.377290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 409 to user: Cannot 'unshelve' instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf while it is in vm_state active {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:14.378897 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1c15b42-7f7b-46f8-b1aa-1f8f396487f0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action" status: 409 len: 146 microversion: 2.1 time: 0.213600 Nov 02 12:14:14.384079 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2416/4840] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:14 2022] POST /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf/action => generated 146 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:14:14.398746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:14.405994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:14.448457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.451786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.454835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.461575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.468032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.469046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.471355 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b125b94-2b71-4865-8f20-3a5986a7ab34 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "DELETE /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 204 len: 0 microversion: 2.1 time: 0.631631 Nov 02 12:14:14.472778 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2425/4841] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:13 2022] DELETE /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:14:14.511004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.66"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:14.520350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:14.548325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.549187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.551890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.553239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:14.554067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:14.561348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:14.698165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:14:14.699196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquired lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:14:15.396881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:15.426688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6987abd1-6fc3-41f4-91be-2ad91b87f3e0 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.034126 Nov 02 12:14:15.427928 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2417/4842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:14 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:14:15.479174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:15.485147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:15.518319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:15.521946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:15.528126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:15.542416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:15.545296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:15.549379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:16.894596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:16.929727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-074c5953-b2f7-48b4-8fe9-f5f21b48199b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.459394 Nov 02 12:14:16.939288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2418/4843] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:15 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:17.675603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64310899-5c83-482c-918a-ab1ac91d9561 tempest-ExtensionsTest-132844845 tempest-ExtensionsTest-132844845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:17.675603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64310899-5c83-482c-918a-ab1ac91d9561 tempest-ExtensionsTest-132844845 tempest-ExtensionsTest-132844845-project] 10.222.0.48 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.722629 Nov 02 12:14:17.675603 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2419/4844] 10.222.0.48 () {58 vars in 1170 bytes} [Wed Nov 2 12:14:16 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:17.713267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-999893400_updated"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:17.721281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:17.752382 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc HTTP/1.1 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 80 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-999893400_updated"}} Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-999893400_updated'}}} Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 12:14:17.755416 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:17.765503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:17.789819 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd129c4e-7a47-4227-9499-519331f2f432 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "PUT /compute/v2.1/servers/5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc" status: 404 len: 111 microversion: 2.1 time: 0.115979 Nov 02 12:14:17.791996 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2420/4845] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:14:17 2022] PUT /compute/v2.1/servers/5dce3bf3-85c1-4cc5-8fed-a4b6e5b1b6cc => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:17.808011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:17.814855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:17.851865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:17.852733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:17.854203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:17.855581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:17.856345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:17.867555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:18.379576 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91ab6148-e76e-4f5f-a4f3-c66b66668163 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.583461 Nov 02 12:14:18.387004 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2421/4846] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:17 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:14:18.418806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d99165-2d85-4222-929a-950f04c46772 tempest-ExtensionsTest-132844845 tempest-ExtensionsTest-132844845-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:18.431390 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6d99165-2d85-4222-929a-950f04c46772 tempest-ExtensionsTest-132844845 tempest-ExtensionsTest-132844845-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.036484 Nov 02 12:14:18.433241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2422/4847] 10.222.0.48 () {58 vars in 1134 bytes} [Wed Nov 2 12:14:18 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:18.453812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:18.453812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:18.480002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:18.481897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:18.485636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:18.487313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:18.492379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:18.492592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:20.306127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:20.334818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8f9c27b-f156-424a-ae72-2d6c47af4256 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.898406 Nov 02 12:14:20.336422 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2423/4848] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:18 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:20.345653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:20.347447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:20.359958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:20.367594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:20.367594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:20.373214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:20.374692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:20.375842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:21.625673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:21.701729 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35986b38-81db-4c5f-ab42-39711c83e4f9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 1.359938 Nov 02 12:14:21.705268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2424/4849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:20 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:21.728079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cdfa2d-af52-4aaf-98a6-271f896a9bff", "name": "network-vif-deleted", "tag": "fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:21.780184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:21.782704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:21.785567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:21.841099 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] Creating event network-vif-deleted:fb4918b8-2f8d-431b-8ad9-5f972fa5d0cf for instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff on n-h1-855649-4 Nov 02 12:14:21.856170 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c4a25c47-5e13-4016-82ec-df777219640c req-e169eb37-af80-4d73-b2ac-8a1f6057d1f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147216 Nov 02 12:14:21.858816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2425/4850] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:21.872204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:21.880183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:21.918292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:21.919529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:21.922087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:21.925280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:21.927919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:21.928738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:22.443339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:22.479255 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d4854b2-0a81-43e1-8bde-965b89abca1c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.618443 Nov 02 12:14:22.480147 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2426/4851] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:21 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:22.549823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95ca1939-fcf4-4b71-938f-0c1bb52bc7aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95ca1939-fcf4-4b71-938f-0c1bb52bc7aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf HTTP/1.1 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 280 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.592238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95ca1939-fcf4-4b71-938f-0c1bb52bc7aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:22.599655 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95ca1939-fcf4-4b71-938f-0c1bb52bc7aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 400 len: 619 microversion: 2.1 time: 0.062364 Nov 02 12:14:22.612237 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2427/4852] 10.222.0.48 () {60 vars in 1257 bytes} [Wed Nov 2 12:14:22 2022] PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 619 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:14:22.624769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:22.629987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:22.652661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:22.652661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:22.664270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:22.667706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:22.668819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:22.669768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:22.719915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:23.283342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:14:23.289387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:23.325897 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-817be104-4008-4ad5-a063-4f1996084a12 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.710458 Nov 02 12:14:23.326809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2428/4853] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:22 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:23.375404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:23.377755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:23.427117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:23.427855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:23.429384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:23.430191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:23.430674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:23.437350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:24.550872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:25.304345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:25.338059 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c6f6f8f-c050-4e09-9147-173ae7102eb2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 2.003261 Nov 02 12:14:25.342217 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2429/4854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:23 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:25.362397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:25.373823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:25.421020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:25.427933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:25.433467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:25.440982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:25.443789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:25.449096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:26.521079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:26.579929 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd67ed6b-db72-46e5-82de-f347d4428b00 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 1.227625 Nov 02 12:14:26.579929 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2430/4855] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:25 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:26.614561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:26.713496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:26.717554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:26.722421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:26.802083 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] Creating event network-changed:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:14:26.830091 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-24c626be-004b-49c6-926e-dcb5431ca083 req-3e70e7dc-6ba3-433c-853f-47672d35e17b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245987 Nov 02 12:14:26.839894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2431/4856] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:26.863969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:26.868508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:26.909965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:26.909965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:26.909965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:26.913662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:26.922241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:26.927882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:27.344306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Updating instance_info_cache with network_info: [{"id": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b", "address": "fa:16:3e:a2:dc:a3", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6025fa7f-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:14:27.435554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Releasing lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:14:27.436772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c50e82fb-07e2-4c25-ae54-a80ab8c69fb9 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action" status: 202 len: 0 microversion: 2.1 time: 12.948661 Nov 02 12:14:27.448052 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2426/4857] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:14 2022] POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action => generated 0 bytes in 12954 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:14:27.448052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3af6ae7a-46d8-483a-9791-1bd3a9313588 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3af6ae7a-46d8-483a-9791-1bd3a9313588 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: request: PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf HTTP/1.1 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 24 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": ""}} Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf', 'body': {'server': {'name': ''}}} Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:14:27.454204 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:27.472257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3af6ae7a-46d8-483a-9791-1bd3a9313588 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:27.479870 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3af6ae7a-46d8-483a-9791-1bd3a9313588 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 400 len: 108 microversion: 2.1 time: 0.013510 Nov 02 12:14:27.480581 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2427/4858] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:14:27 2022] PUT /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:14:27.508635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ac21a8f-fb4b-44d9-ba2c-3cb961481609 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '.version_select at 0x7ff1b2fe1f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:28.902137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:28.934448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b89cf01d-7cc0-4246-a88f-51dab27d8eb4 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1671 microversion: 2.1 time: 2.089263 Nov 02 12:14:28.935850 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2432/4859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:26 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1671 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:28.944182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:28.945057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:28.955298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:28.959314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:28.959314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:28.959982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:28.960976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:28.961917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:29.480660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ac21a8f-fb4b-44d9-ba2c-3cb961481609 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/b17f154a-3842-40b5-81bb-f1fcb8359772" status: 200 len: 183 microversion: 2.1 time: 1.988796 Nov 02 12:14:29.481452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2428/4860] 10.222.0.48 () {58 vars in 1260 bytes} [Wed Nov 2 12:14:27 2022] GET /compute/v2.1/os-floating-ips/b17f154a-3842-40b5-81bb-f1fcb8359772 => generated 183 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:29.701559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:29.742360 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc6704aa-de5a-41c7-b9f2-ae1070a5a8cb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1506 microversion: 2.1 time: 0.802551 Nov 02 12:14:29.744921 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2433/4861] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:28 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1506 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:29.768466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.66"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:29.965983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3ccabfb-1806-40e8-84da-d1b10beb2c12 tempest-ComputeTenantNetworksTest-239044557 tempest-ComputeTenantNetworksTest-239044557-project] Calling method '.version_select at 0x7ff1b2c35e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:30.577237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:30.591088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.592315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.593420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.600412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3ccabfb-1806-40e8-84da-d1b10beb2c12 tempest-ComputeTenantNetworksTest-239044557 tempest-ComputeTenantNetworksTest-239044557-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.115725 Nov 02 12:14:30.602160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2429/4862] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 12:14:29 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:30.612434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.614265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:30.616446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.617562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:30.619334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.641284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.643287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.645713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:30.648327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:30.651789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:30.652509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:31.085099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:31.122253 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10d2dcf4-472e-4ed4-9c14-acc639b6bfe0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.517952 Nov 02 12:14:31.122892 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2430/4863] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:30 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:31.163275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae72c0e2-2b07-4078-b767-a19412d2c8c4 tempest-ComputeTenantNetworksTest-239044557 tempest-ComputeTenantNetworksTest-239044557-project] Calling method '.version_select at 0x7ff1b2c35670>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:31.318781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:14:31.326548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquired lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:14:31.564296 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae72c0e2-2b07-4078-b767-a19412d2c8c4 tempest-ComputeTenantNetworksTest-239044557 tempest-ComputeTenantNetworksTest-239044557-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks/7520b303-3878-4ead-adf8-cc842a5d7a62" status: 200 len: 139 microversion: 2.1 time: 0.431216 Nov 02 12:14:31.565274 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2431/4864] 10.222.0.48 () {58 vars in 1269 bytes} [Wed Nov 2 12:14:31 2022] GET /compute/v2.1/os-tenant-networks/7520b303-3878-4ead-adf8-cc842a5d7a62 => generated 139 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:33.305147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:14:33.346191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:33.371511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:33.380476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:33.381225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:33.414561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] Creating event network-changed:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:14:33.432067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1699e94c-01bf-4cd3-a9c7-11fa2d33be5b req-e1baecca-0783-403a-913f-d748bf2a7aa7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088881 Nov 02 12:14:33.443359 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2432/4865] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:14:35.874343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Updating instance_info_cache with network_info: [{"id": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b", "address": "fa:16:3e:a2:dc:a3", "network": {"id": "b39a9ec4-215b-49b8-9103-7db62e004b73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-977534867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e70bbe80057d4e3a8f529b47970d5fd7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6025fa7f-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:14:35.977706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Releasing lock "refresh_cache-34ce0bd3-74aa-40e5-b560-1e015e87182b" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:14:35.978927 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a197a4cf-b551-40b6-a708-76ab226277d0 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action" status: 202 len: 0 microversion: 2.1 time: 6.231929 Nov 02 12:14:35.982571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2434/4866] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:14:29 2022] POST /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b/action => generated 0 bytes in 6236 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:14:36.019614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:36.020738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:36.036538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:36.037259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:36.039263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:36.039263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:36.039708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:36.040200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:36.061619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] HTTP exception thrown: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Request method failure captured: Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff HTTP/1.1 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl6spACBe6QSA4cTsB1EUeKv05NTtXn94WoH2nbMCM_v_8EFObSO5barbTieEFlo7FUC7LRhrCuWidPUL31XBlDiTbEvz9af_IzBrEdnp9i66tn6YqlI3g6WawX3wwgcOJoJ1FbHQfdigwLkGUwLblGDxxwTkNuLn4jyjwrWh1eI-do Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e70bbe80057d4e3a8f529b47970d5fd7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4be892bbdd2146529d0ad0e297588159 Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '75cdfa2d-af52-4aaf-98a6-271f896a9bff'} Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:36.064318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.069220 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.070782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Returning 404 to user: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:36.072590 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37dcfc97-0b9d-4fe1-a9f2-050fa745f8df tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "DELETE /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 404 len: 111 microversion: 2.1 time: 0.083900 Nov 02 12:14:36.073671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2433/4867] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:35 2022] DELETE /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:36.084304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:36.085581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 75cdfa2d-af52-4aaf-98a6-271f896a9bff] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:36.095426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:36.096281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:36.097050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:36.098293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:36.099387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:36.100048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] HTTP exception thrown: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Request method failure captured: Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff HTTP/1.1 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl6spACBe6QSA4cTsB1EUeKv05NTtXn94WoH2nbMCM_v_8EFObSO5barbTieEFlo7FUC7LRhrCuWidPUL31XBlDiTbEvz9af_IzBrEdnp9i66tn6YqlI3g6WawX3wwgcOJoJ1FbHQfdigwLkGUwLblGDxxwTkNuLn4jyjwrWh1eI-do Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e70bbe80057d4e3a8f529b47970d5fd7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4be892bbdd2146529d0ad0e297588159 Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '75cdfa2d-af52-4aaf-98a6-271f896a9bff'} Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:36.124113 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. Nov 02 12:14:36.129535 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:36.131946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Returning 404 to user: Instance 75cdfa2d-af52-4aaf-98a6-271f896a9bff could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:36.132834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-323512b1-e273-4a7a-a858-fa702f42e3eb tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff" status: 404 len: 111 microversion: 2.1 time: 0.054917 Nov 02 12:14:36.137776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2435/4868] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:36 2022] GET /compute/v2.1/servers/75cdfa2d-af52-4aaf-98a6-271f896a9bff => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:14:36.161525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a10a0c3d-89e8-471b-802e-8ebe80734d91 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '.version_select at 0x7ff1b2fe1040>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:37.580121 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a10a0c3d-89e8-471b-802e-8ebe80734d91 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/b17f154a-3842-40b5-81bb-f1fcb8359772" status: 202 len: 0 microversion: 2.1 time: 1.440329 Nov 02 12:14:37.581515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2434/4869] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:14:36 2022] DELETE /compute/v2.1/os-floating-ips/b17f154a-3842-40b5-81bb-f1fcb8359772 => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:14:37.591529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:37.592881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:37.601356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:37.602114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:37.602522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:37.604566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:37.605245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:37.605851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:37.641693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:14:38.172314 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "DELETE /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 204 len: 0 microversion: 2.1 time: 0.585750 Nov 02 12:14:38.173587 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2436/4870] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:37 2022] DELETE /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:14:38.184315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:38.184995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:38.199947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:38.200978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:38.202012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:38.202245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:38.203006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:38.203740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:38.522113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:38.544487 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1525 microversion: 2.1 time: 0.361475 Nov 02 12:14:38.547716 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2435/4871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:38 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1525 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:14:38.675635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:38.678758 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004014 Nov 02 12:14:38.679875 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2437/4872] 10.222.0.48 () {56 vars in 886 bytes} [Wed Nov 2 12:14:38 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Nov 02 12:14:38.700782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:38.703302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001651 Nov 02 12:14:38.703302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2436/4873] 10.222.0.48 () {54 vars in 1035 bytes} [Wed Nov 2 12:14:38 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Nov 02 12:14:38.725115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:38.730041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4958b662-0521-4abd-be38-dffcc7d3ba1f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.005913 Nov 02 12:14:38.731125 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2438/4874] 10.222.0.48 () {54 vars in 1041 bytes} [Wed Nov 2 12:14:38 2022] GET /compute/v2.1/ => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:38.751710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:38.753914 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb697597-109e-4766-a4d2-190ba3cfeb80 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003670 Nov 02 12:14:38.755134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2437/4875] 10.222.0.48 () {56 vars in 886 bytes} [Wed Nov 2 12:14:38 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Nov 02 12:14:39.581117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:39.582253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:39.591117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:39.591117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:39.619333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.619744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.627524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.628041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.628499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.629242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.629713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.630156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.631030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.631890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.632437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.632877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.685398 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 HTTP/1.1 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '63d0b55c-9f35-4afd-ba10-58445d7403c2'} Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:39.687208 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:39.698349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acaf0b8d-e02d-4619-81bd-8bb72f8b3ed6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 404 len: 111 microversion: 2.1 time: 0.121416 Nov 02 12:14:39.701106 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2439/4876] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:39 2022] DELETE /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:39.724680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:39.728544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: 63d0b55c-9f35-4afd-ba10-58445d7403c2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:39.744347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.745097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.745977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.747517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.748927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.756548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.794359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 HTTP/1.1 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '63d0b55c-9f35-4afd-ba10-58445d7403c2'} Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:39.797074 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance 63d0b55c-9f35-4afd-ba10-58445d7403c2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-771f372b-5853-4192-9a63-a8fec43d1128 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2" status: 404 len: 111 microversion: 2.1 time: 0.096829 Nov 02 12:14:39.805412 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2440/4877] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:39 2022] GET /compute/v2.1/servers/63d0b55c-9f35-4afd-ba10-58445d7403c2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:39.809845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:39.810378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:39.818529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.819231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.819726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.820654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:39.821174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:39.822491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:39.865896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:14:40.170391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:40.199124 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9bda0809-c6f5-4fbc-8954-29bcb01c392f tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1525 microversion: 2.1 time: 0.625155 Nov 02 12:14:40.204377 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2438/4878] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:39 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1525 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:40.342397 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ffc37026-9de0-431b-946e-29e060cc7027 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 204 len: 0 microversion: 2.1 time: 0.536818 Nov 02 12:14:40.343892 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2441/4879] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:14:39 2022] DELETE /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:14:40.360175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:40.361448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:40.375151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:40.376615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:40.377115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:40.377869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:40.378357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:40.378770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:40.771158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:40.791200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42eb3f08-121f-4424-8620-c2f41295e2aa tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 0.441789 Nov 02 12:14:40.792020 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2439/4880] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:40 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:41.057882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34ce0bd3-74aa-40e5-b560-1e015e87182b", "name": "network-vif-deleted", "tag": "6025fa7f-8c34-431c-9e8a-8f2555a9c67b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:41.098538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:41.106379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:41.107296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:41.132839 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] Creating event network-vif-deleted:6025fa7f-8c34-431c-9e8a-8f2555a9c67b for instance 34ce0bd3-74aa-40e5-b560-1e015e87182b on n-h2-855649-4 Nov 02 12:14:41.150850 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-477f6aaa-7211-4c77-a2cf-849addee75f3 req-c6c8fa8a-4c0f-496a-b187-aca86514c6e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099121 Nov 02 12:14:41.151524 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2442/4881] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:41.238023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:41.239216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:41.251190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:41.252059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:41.252859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:41.254168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:41.255032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:41.255797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:41.398591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:41.427009 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7b41f36-4ac2-4d62-bc91-51208d948b46 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1483 microversion: 2.1 time: 0.181585 Nov 02 12:14:41.427009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2440/4882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:41 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1483 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:41.824094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:41.825572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:41.833304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:41.835470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:41.837885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:41.838711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:41.840339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:41.841016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:41.841764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:42.265032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:42.296306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51a34b3d-d182-49a1-ae89-75f8c0e7f7bb tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1512 microversion: 2.1 time: 0.480538 Nov 02 12:14:42.298441 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2443/4883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:41 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:42.510161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:42.524347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:42.556675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:42.563439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:42.567162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:42.568177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:42.568881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:42.569556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:42.583792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=60,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:42.693061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:42.695625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:42.696416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:42.697634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lazy-loading 'fault' on Instance uuid 34ce0bd3-74aa-40e5-b560-1e015e87182b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:14:42.788121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be892bbdd2146529d0ad0e297588159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70bbe80057d4e3a8f529b47970d5fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:42.797855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d377424-ec87-4879-9c96-c96336ff455d tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 200 len: 1314 microversion: 2.1 time: 0.357581 Nov 02 12:14:42.803104 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2441/4884] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:42 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:43.333124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:43.333124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:43.343999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:43.345341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:43.348682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:43.350357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:43.350852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:43.351355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:43.670283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee124e40-ea65-4c8f-a1aa-2886a999e4cf", "name": "network-vif-deleted", "tag": "5cb23231-e071-4107-a73b-1acaf7537863"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:14:43.683632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:43.689700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:43.696408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:43.697624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c3df0d3-be9c-4eb3-94be-29bc91fcec6b tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1470 microversion: 2.1 time: 0.378410 Nov 02 12:14:43.699123 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2444/4885] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:43 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:14:43.708621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:43.729806 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] Creating event network-vif-deleted:5cb23231-e071-4107-a73b-1acaf7537863 for instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf on n-h2-855649-4 Nov 02 12:14:43.769090 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d702e228-ccb7-4b72-ae7f-fc00e47e92e2 req-11f662e5-3e80-4f57-93f3-db2fd390e465 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096838 Nov 02 12:14:43.772848 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2442/4886] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:14:43.839365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:43.840573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] [instance: 34ce0bd3-74aa-40e5-b560-1e015e87182b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:43.876209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:43.877227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:43.882644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:43.884165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:43.885816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:43.897440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:43.961609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] HTTP exception thrown: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Request method failure captured: Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b HTTP/1.1 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl6spACBe6QSA4cTsB1EUeKv05NTtXn94WoH2nbMCM_v_8EFObSO5barbTieEFlo7FUC7LRhrCuWidPUL31XBlDiTbEvz9af_IzBrEdnp9i66tn6YqlI3g6WawX3wwgcOJoJ1FbHQfdigwLkGUwLblGDxxwTkNuLn4jyjwrWh1eI-do Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e70bbe80057d4e3a8f529b47970d5fd7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e70bbe80057d4e3a8f529b47970d5fd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e70bbe80057d4e3a8f529b47970d5fd7 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1240215587 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4be892bbdd2146529d0ad0e297588159 Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1240215587-project Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '34ce0bd3-74aa-40e5-b560-1e015e87182b'} Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:43.973780 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] Returning 404 to user: Instance 34ce0bd3-74aa-40e5-b560-1e015e87182b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:43.986186 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b3617ea-8945-4bb1-aadb-a69ca8648741 tempest-FloatingIPsAssociationTestJSON-1240215587 tempest-FloatingIPsAssociationTestJSON-1240215587-project] 10.222.0.48 "GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b" status: 404 len: 111 microversion: 2.1 time: 0.150166 Nov 02 12:14:43.994822 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2445/4887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:43 2022] GET /compute/v2.1/servers/34ce0bd3-74aa-40e5-b560-1e015e87182b => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:14:44.726597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:44.729452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:44.763650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:44.764483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:44.765217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:44.766156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:44.767077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:44.767802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:44.940335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:44.942579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:44.943468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:44.948862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lazy-loading 'fault' on Instance uuid ee124e40-ea65-4c8f-a1aa-2886a999e4cf {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:14:45.146704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f290b12f9f48b7a9d59cd81df44cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b20d26c9b454b88b0202395055cb18f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:14:45.172813 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7838b878-553f-49b5-a81c-e0f396fdbec6 tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 200 len: 1306 microversion: 2.1 time: 0.452635 Nov 02 12:14:45.175709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2443/4888] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:44 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 1306 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:14:46.215458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:14:46.221585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] [instance: ee124e40-ea65-4c8f-a1aa-2886a999e4cf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:14:46.237363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:46.248633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:46.248633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:46.248633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:14:46.248633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:14:46.248633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:14:46.278455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] HTTP exception thrown: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Request method failure captured: Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf HTTP/1.1 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl3aB1aBpevcauyrB4GlVouTE6clldK91pLEa4_rifxM05yZZaZpL7tlsc0_dTwzYluzjG9kZqlHQa5jKu0q21gnOYpPoP68--a1fZJ86lYILyOgqVomqF3z_nur1ZolJ2pDiftW_GTENCUR9iIErxmoRgd74DiMJnXG7_aMD570Mxk Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b20d26c9b454b88b0202395055cb18f", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b20d26c9b454b88b0202395055cb18f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8b20d26c9b454b88b0202395055cb18f Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2145448665 Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: f8f290b12f9f48b7a9d59cd81df44cbf Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-2145448665-project Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ee124e40-ea65-4c8f-a1aa-2886a999e4cf'} Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:14:46.281873 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Returning 404 to user: Instance ee124e40-ea65-4c8f-a1aa-2886a999e4cf could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:14:46.295737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf" status: 404 len: 111 microversion: 2.1 time: 0.089490 Nov 02 12:14:46.299441 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2446/4889] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:14:46 2022] GET /compute/v2.1/servers/ee124e40-ea65-4c8f-a1aa-2886a999e4cf => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:14:59.463718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:00.125476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b50f27d0-d778-4dc7-9b1b-b0b5a8ee12df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: .version_select at 0x7ff1b2b19820>, body: {"keypair": {"name": "tempest-keypair-1702542058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIYGh/e07L13WCajv+tSFEfGjwAKNmJflbdCkERC42huyeWHSdliq6UpWvkFjT8X+bTa64YQu5xCaTY8J3BuW4HyhGOFMZVtQw3QHSlI06LEdBXWfopJ0Hue0blIeKU2Q=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:00.165936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b50f27d0-d778-4dc7-9b1b-b0b5a8ee12df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for project 35cd9f7745c7496ab54140b648471e6a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:00.180748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-b50f27d0-d778-4dc7-9b1b-b0b5a8ee12df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for user c1e0f9913abf4ea7b14677dea2dd9012 and project 35cd9f7745c7496ab54140b648471e6a. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:00.408288 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b50f27d0-d778-4dc7-9b1b-b0b5a8ee12df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.952328 Nov 02 12:15:00.414629 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2444/4890] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 12:14:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 959 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:15:00.949038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:00.950703 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73aad113-0671-42b8-871e-92fce1c5619c tempest-ServersNegativeTestJSON-2145448665 tempest-ServersNegativeTestJSON-2145448665-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004847 Nov 02 12:15:00.954032 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2447/4891] 10.222.0.48 () {56 vars in 886 bytes} [Wed Nov 2 12:15:00 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:15:03.113860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:03.114573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:03.149681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.150198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.154591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:03.155556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.156039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.156500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:03.415923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:03.417252 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-560b00ea-0de4-40dd-927a-f3d69318c653 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.308504 Nov 02 12:15:03.418576 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2445/4892] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:03.444260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:03.445164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:03.448199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:03.460135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:03.466217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.468806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.469371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:03.470824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.475959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.476462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:03.784666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:03.797051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9566637a-0475-42c2-a8e3-3a4945ff4a9a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.357188 Nov 02 12:15:03.799946 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2448/4893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:03.828091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:03.829805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:03.854775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.856411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.857281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:03.860246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:03.862116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:03.879244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:04.347497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:04.358585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ec3f46c-1a6b-4319-bfac-1577288ef070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.537622 Nov 02 12:15:04.378616 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2446/4894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:04.397543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:04.400141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:04.417614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:04.418609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:04.420755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:04.424675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:04.425705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:04.426321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:05.040627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:05.055833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b92a8c6a-f0c3-432f-841d-c03f8d2c1f54 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.667698 Nov 02 12:15:05.059223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2449/4895] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:04 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:05.388044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-228052584", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "f3132260-2b5f-490b-9b53-8a040d77422f"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:05.555957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] validate_networks() for [('f3132260-2b5f-490b-9b53-8a040d77422f', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:15:06.365553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfad3cc2-7c68-43e8-b14e-cf54d452e66d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Action: 'create', calling method: .version_select at 0x7ff1b352dee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-136015980", "metadata": {"Type": "work"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfad3cc2-7c68-43e8-b14e-cf54d452e66d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 121 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-136015980", "metadata": {"Type": "work"}}} Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-136015980', 'metadata': {'Type': 'work'}}}} Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:15:06.377618 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:15:06.382808 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.385758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfad3cc2-7c68-43e8-b14e-cf54d452e66d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:06.386804 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfad3cc2-7c68-43e8-b14e-cf54d452e66d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.431416 Nov 02 12:15:06.391821 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2450/4896] 10.222.0.48 () {60 vars in 1156 bytes} [Wed Nov 2 12:15:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:15:06.405102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-122012844", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9dc1f885-3670-491b-9450-5326900f025d"}], "security_groups": [{"name": "tempest-securitygroup--1881685979"}], "key_name": "tempest-keypair-1702542058", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:06.512567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:15:06.513970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:15:06.514780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:15:06.515443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:15:06.516088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:15:06.551226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:06.552421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:06.553621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:06.554823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:06.556342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:06.557076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:06.583106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:06.590637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:06.607250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:15:06.610652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:15:06.706471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] validate_networks() for [('9dc1f885-3670-491b-9450-5326900f025d', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:15:06.762774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cad97d7-b630-4360-936e-d701bef54e38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380804 Nov 02 12:15:06.770226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2447/4897] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:15:06.774740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a0ca819-ba8e-43db-aebc-5042a704d78d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Action: 'create', calling method: .version_select at 0x7ff1b2c0faf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-176512450", "metadata": {"Type": "work"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a0ca819-ba8e-43db-aebc-5042a704d78d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 119 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-176512450", "metadata": {"Type": "work"}}} Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-176512450', 'metadata': {'Type': 'work'}}}} Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '0' Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:15:06.783719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.796396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a0ca819-ba8e-43db-aebc-5042a704d78d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:06.801659 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a0ca819-ba8e-43db-aebc-5042a704d78d tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033122 Nov 02 12:15:06.808252 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2448/4898] 10.222.0.48 () {60 vars in 1156 bytes} [Wed Nov 2 12:15:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:15:06.820753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-667def0f-260e-4782-86e3-17e328a89b64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:06.828675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-667def0f-260e-4782-86e3-17e328a89b64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:06.945247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-667def0f-260e-4782-86e3-17e328a89b64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:06.950804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-667def0f-260e-4782-86e3-17e328a89b64 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1214 microversion: 2.1 time: 0.140145 Nov 02 12:15:06.953146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2449/4899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:06 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:06.968895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c4643b-5766-4b18-9495-c2c74cecfd23 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Action: 'create', calling method: .version_select at 0x7ff1b2b8d8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1524022998", "metadata": {"Type": "work"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c4643b-5766-4b18-9495-c2c74cecfd23 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 119 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1524022998", "metadata": {"Type": "work"}}} Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1524022998', 'metadata': {'Type': 'work'}}}} Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:15:06.981753 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2c4643b-5766-4b18-9495-c2c74cecfd23 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:06.986575 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2c4643b-5766-4b18-9495-c2c74cecfd23 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025973 Nov 02 12:15:06.988619 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2450/4900] 10.222.0.48 () {60 vars in 1156 bytes} [Wed Nov 2 12:15:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:15:07.001364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e666ac61-f92a-42fa-a1b7-cab376ad6066 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Calling method '.version_select at 0x7ff1b2c0f3a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:07.092674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e666ac61-f92a-42fa-a1b7-cab376ad6066 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] HTTP exception thrown: Volume tempest-invalid-626124808 could not be found. Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e666ac61-f92a-42fa-a1b7-cab376ad6066 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-626124808 HTTP/1.1 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume tempest-invalid-626124808 could not be found. Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'tempest-invalid-626124808'} Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-626124808 could not be found. (HTTP 404) (Request-ID: req-f649f645-cd34-4695-ba35-c345011c0d57) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.095910 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-626124808 could not be found. Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-626124808 could not be found. Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-626124808 could not be found. Nov 02 12:15:07.100086 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.106234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e666ac61-f92a-42fa-a1b7-cab376ad6066 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 404 to user: Volume tempest-invalid-626124808 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:07.106234 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e666ac61-f92a-42fa-a1b7-cab376ad6066 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-626124808" status: 404 len: 98 microversion: 2.1 time: 0.112090 Nov 02 12:15:07.107361 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2451/4901] 10.222.0.48 () {58 vars in 1215 bytes} [Wed Nov 2 12:15:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-626124808 => generated 98 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:15:07.135007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05d223c7-488b-4527-b787-ee3679652111 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013269 Nov 02 12:15:07.141113 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2452/4902] 10.222.0.48 () {58 vars in 1140 bytes} [Wed Nov 2 12:15:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:15:07.157956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-157ae34f-69d8-49f2-90b2-1354421e75ad tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011982 Nov 02 12:15:07.163310 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2453/4903] 10.222.0.48 () {58 vars in 1137 bytes} [Wed Nov 2 12:15:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:15:07.178340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1797d8d4-39bf-45fd-a12e-0f55cf78cbf1 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Calling method '.version_select at 0x7ff1b2b8d4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:07.280872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1797d8d4-39bf-45fd-a12e-0f55cf78cbf1 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] HTTP exception thrown: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1797d8d4-39bf-45fd-a12e-0f55cf78cbf1 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-volumes/4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 HTTP/1.1 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49'} Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. (HTTP 404) (Request-ID: req-ecbc65f7-3ad1-4adb-94cd-a5eb6fa3f91e) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:15:07.282881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1797d8d4-39bf-45fd-a12e-0f55cf78cbf1 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 404 to user: Volume 4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:07.287169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1797d8d4-39bf-45fd-a12e-0f55cf78cbf1 tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49" status: 404 len: 109 microversion: 2.1 time: 0.120203 Nov 02 12:15:07.304163 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2454/4904] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:15:07 2022] DELETE /compute/v2.1/os-volumes/4c189dc6-66d8-4dd2-b2a4-54c2e7f0fb49 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:07.309986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fa06e3-5f56-4030-b2e9-ed124676ce3b tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Calling method '.version_select at 0x7ff1b2b884c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:07.390305 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-89fa06e3-5f56-4030-b2e9-ed124676ce3b tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] HTTP exception thrown: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fa06e3-5f56-4030-b2e9-ed124676ce3b tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Request method failure captured: Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/43041197-91e1-424a-85cf-4c182e15837c HTTP/1.1 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9Jzo7U6jvZ2MXbj9BkTA705kwQImqa0T8ffuiFEMenyOqnHIOky5hXA80225CMYSYIjPjsgovEbrEdwwtZDhpaGClEdkYy52LoQAfuZTkleYZzpyXUwLQaHTvCSJD0_hfw0knuSWveW7TDPInOpSTUD3gTG-3CbcuNnamG84SLH_Q Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0204b2e1a88462c855157a7dc6cba70", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0204b2e1a88462c855157a7dc6cba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0204b2e1a88462c855157a7dc6cba70 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-284989340 Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4ed71c3039b54540af295c4ee76eb05c Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-284989340-project Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '43041197-91e1-424a-85cf-4c182e15837c'} Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. (HTTP 404) (Request-ID: req-d6347d38-f0ca-4db5-bd36-1dc008553b66) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:15:07.394258 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89fa06e3-5f56-4030-b2e9-ed124676ce3b tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] Returning 404 to user: Volume 43041197-91e1-424a-85cf-4c182e15837c could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89fa06e3-5f56-4030-b2e9-ed124676ce3b tempest-VolumesNegativeTest-284989340 tempest-VolumesNegativeTest-284989340-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/43041197-91e1-424a-85cf-4c182e15837c" status: 404 len: 109 microversion: 2.1 time: 0.091177 Nov 02 12:15:07.402154 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2455/4905] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:15:07 2022] GET /compute/v2.1/os-volumes/43041197-91e1-424a-85cf-4c182e15837c => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:07.915502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:15:07.916765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:15:07.917415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:15:07.918093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:15:07.919147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:15:07.942198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:07.944647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:07.946593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:07.948953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:07.950342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:07.955668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:07.987008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-967ac75f-4882-4767-be56-899ca31fae1a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:07.991154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-967ac75f-4882-4767-be56-899ca31fae1a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:08.079404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for project 35cd9f7745c7496ab54140b648471e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:08.112276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for user c1e0f9913abf4ea7b14677dea2dd9012 and project 35cd9f7745c7496ab54140b648471e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:08.165906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:15:08.175945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:15:08.378896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-967ac75f-4882-4767-be56-899ca31fae1a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:08.396866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-967ac75f-4882-4767-be56-899ca31fae1a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1214 microversion: 2.1 time: 0.425390 Nov 02 12:15:08.404797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2456/4906] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:07 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1214 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:08.464757 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60682dbc-7bfd-40e4-90de-5a71804a51ef tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.066406 Nov 02 12:15:08.479464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:08.480228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:08.480608 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2451/4907] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:15:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:15:08.770457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:08.781864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:08.794921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:08.796948 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-038d9eee-5077-4354-ab00-6a7acffa49db tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1281 microversion: 2.20 time: 0.322661 Nov 02 12:15:08.814424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2457/4908] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:08 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1281 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:09.433121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:09.433883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:09.449924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:09.450657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:09.451272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:09.452087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:09.455347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:09.466562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:09.843896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:09.844587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:10.074065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:10.087692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acbadc88-3217-47eb-9544-7292a8062289 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1266 microversion: 2.1 time: 0.658677 Nov 02 12:15:10.089541 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2452/4909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:09 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1266 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:10.096929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:10.119353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:10.121816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:10.123658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21dc993e-0249-443a-bfd9-6cc8424b013b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1281 microversion: 2.20 time: 0.283368 Nov 02 12:15:10.124645 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2458/4910] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:09 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:11.112957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:11.114087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:11.132095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:11.132758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:11.135420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:11.138248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:11.138248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:11.138248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:11.150263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:11.151130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:11.179399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:11.183824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:11.186946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:11.189303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:11.197357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:11.201295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:11.447092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:11.461129 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b70b1468-4043-4c52-80fc-339f5c73aa65 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1272 microversion: 2.1 time: 0.353722 Nov 02 12:15:11.466211 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2453/4911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:11 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:11.476600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:11.497960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:11.502245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:11.505270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f8b22a5-2e6b-42c1-b885-fe31fdf75762 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1277 microversion: 2.20 time: 0.359553 Nov 02 12:15:11.526886 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2459/4912] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:11 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:12.501083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:12.502192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:12.539146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:12.539648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:12.587712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:12.588232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:12.592557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:12.596619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:12.598303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:12.598470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:12.599151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:12.599812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:12.601122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:12.602579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:12.603157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:12.609325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:13.094896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:13.109236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:13.116781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:13.125238 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71271bbb-413e-4396-b892-8644b0de68c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1341 microversion: 2.20 time: 0.595277 Nov 02 12:15:13.128221 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2460/4913] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:12 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1341 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:13.503119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:13.518829 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a5876cd-f96c-4542-b728-9d926763307a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 1.027551 Nov 02 12:15:13.520007 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2454/4914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:12 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:14.167932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:14.174050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:14.212532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:14.214476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:14.222435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:14.222435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:14.222435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:14.222435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:14.458799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:14.479322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:14.485279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:14.496260 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c738af2d-33a7-453c-8949-0526f54ad77f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1339 microversion: 2.20 time: 0.336391 Nov 02 12:15:14.499410 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2461/4915] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:14 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1339 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:14.556231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:14.558536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:14.592176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:14.596662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:14.597518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:14.604015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:14.604602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:14.607761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:15.345147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:15.356452 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-605d3942-d838-49a5-969c-0b8e01557e25 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.811353 Nov 02 12:15:15.359530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2455/4916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:14 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:15.544985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:15.547795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:15.575305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:15.582579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:15.583051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:15.583816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:15.584290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:15.584724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:15.808140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6238c906-eb2c-48fb-9a6a-d0dc4996152b", "tag": "f2984058-234b-4b36-98a1-5bff7c5f4546"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:15.832678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:15.834609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:15.835356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:15.866678 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] Creating event network-changed:f2984058-234b-4b36-98a1-5bff7c5f4546 for instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b on n-h2-855649-4 Nov 02 12:15:15.883684 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a87d2627-ba74-4f90-8d60-112e0866c3ab req-09587c23-ca38-4ade-99b7-552be2bfc034 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077678 Nov 02 12:15:15.884894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2456/4917] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:16.388084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:16.398869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:16.416957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:16.417932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:16.442260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:16.444213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:16.448023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:16.452350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:16.572353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:16.723317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:16.734296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:16.746431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:16.749657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d36578df-1b0f-4b36-8270-7643c63d46a6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 1.223714 Nov 02 12:15:16.776011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2462/4918] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:15 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:17.216855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:17.233450 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61d2a099-4006-4882-a720-6ecebcaf21ac tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.850992 Nov 02 12:15:17.235982 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2457/4919] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:16 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:17.785539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:17.787024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:17.803349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:17.806586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:17.816196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:17.816196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:17.816196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:17.816196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:18.266333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:18.268343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:18.308151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:18.310139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:18.314887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:18.316774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:18.322052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:18.333094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:18.338642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:18.339313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:18.629643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:18.649146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:18.658648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:18.665076 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e271cf1-cbe4-496c-a0ce-e935fd897023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.884586 Nov 02 12:15:18.685567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2463/4920] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:17 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:18.873563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:18.893068 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c966004e-7d60-430f-a269-9a4cc0e5d8d8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.635754 Nov 02 12:15:18.900990 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2458/4921] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:18 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:19.421538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2134601048", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "63796289-aefc-41fc-8618-0e499feb3f58"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:19.557042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] validate_networks() for [('63796289-aefc-41fc-8618-0e499feb3f58', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:15:19.701011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:19.701659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:19.721542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:19.724746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:19.727821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:19.729048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:19.731151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:19.732273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:20.107519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:20.790418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:15:20.791159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:15:20.791335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:15:20.791956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:15:20.792538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:15:20.823311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:20.824626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:20.829150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:20.830200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:20.830844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:20.831518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:20.875851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Getting quotas for project c2bf26d46424468d8c82be8b8a0648a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:20.886056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Getting quotas for user d2d9199c77d4453c94a8ff7285a51ca9 and project c2bf26d46424468d8c82be8b8a0648a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:20.941322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:15:20.948412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:15:21.078028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:21.088381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:21.089859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:21.091098 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0570dfb5-7437-49fa-91bf-6930b1655bd4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 1.394585 Nov 02 12:15:21.093479 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2459/4922] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:19 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:21.118317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:21.123839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:21.144584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:21.147722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:21.147722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:21.147722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:21.147722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:21.148413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:21.255547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c30c30c-97c4-485d-b5ba-2593c19da4df tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.565557 Nov 02 12:15:21.264161 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2464/4923] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:15:21.266503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:21.302151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:21.304782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:21.305854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:21.336788 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] Creating event network-changed:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:15:21.347421 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-35e59c15-0be7-40f3-b70c-a45182d8b065 req-b9430275-dcc5-4326-857d-1d94a5b6d162 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089805 Nov 02 12:15:21.354038 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2465/4924] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:21.369336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6636422c-cb43-4274-8ee7-d7ac03590a50 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:21.370584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6636422c-cb43-4274-8ee7-d7ac03590a50 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:21.862096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6636422c-cb43-4274-8ee7-d7ac03590a50 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:21.875345 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6636422c-cb43-4274-8ee7-d7ac03590a50 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1216 microversion: 2.1 time: 0.519351 Nov 02 12:15:21.875942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2466/4925] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:21 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1216 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:22.120818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:22.121898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:22.138555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:22.139557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:22.140595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:22.141519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:22.143521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:22.145181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:22.847185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:22.875377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd995b17-14bf-40e6-8fe6-e81f414f7868 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 1.780447 Nov 02 12:15:22.876535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2460/4926] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:21 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:22.906719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebb419ec-db68-4ac1-956f-4fc4a387f16f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:22.915221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebb419ec-db68-4ac1-956f-4fc4a387f16f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:23.216303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebb419ec-db68-4ac1-956f-4fc4a387f16f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:23.226358 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebb419ec-db68-4ac1-956f-4fc4a387f16f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1216 microversion: 2.1 time: 0.327896 Nov 02 12:15:23.240094 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2461/4927] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:22 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1216 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:23.454058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:23.471960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:23.474719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:23.476026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5de57232-6ae9-4484-8476-934383b18ab3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 1.359651 Nov 02 12:15:23.480787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2467/4928] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:22 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:23.903445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:23.904837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:23.947989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:23.952219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:23.953731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:23.956404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:23.958687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:23.963929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:24.253210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:24.253845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:24.266103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:24.266622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:24.267095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:24.273414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:24.275171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:24.283261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:24.556905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:24.573004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4efd1dcf-2e93-4413-a484-c6f16be74c43 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1268 microversion: 2.1 time: 0.324428 Nov 02 12:15:24.573983 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2468/4929] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:24 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1268 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:24.589880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:24.593933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:24.606182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:24.606909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:24.607629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:24.608524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:24.611755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:24.612479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:24.775605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:24.786718 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c54702c1-25f0-42c3-b9f2-7efca6e11e89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.888051 Nov 02 12:15:24.789219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2462/4930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:23 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:25.098069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:25.108456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:25.122018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:25.122799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8986c50f-f2de-427e-95a2-595f4a4c1843 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.547590 Nov 02 12:15:25.124831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2469/4931] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:24 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:25.599640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:25.607998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:25.614215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:25.619389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:25.619944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:25.622353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:25.622852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:25.623339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:25.771224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:25.788291 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6bf15b6-1802-4205-8439-2615be09fd14 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1274 microversion: 2.1 time: 0.191238 Nov 02 12:15:25.793453 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2463/4932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:25 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:25.816215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:25.816843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:25.837832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:25.837832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:25.837832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:25.837832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:25.840760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:25.841655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:26.081549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:26.093349 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d34b95f9-6acb-43a0-9689-b90c2a4e18c6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.285178 Nov 02 12:15:26.105576 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2470/4933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:25 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:26.152768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:26.158667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:26.170340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:26.180930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:26.183404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:26.187066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:26.190449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:26.191519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:26.582718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:26.597377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:26.603870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:26.614957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-817b778d-22cf-4764-8697-6ee2d7859ab6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.468336 Nov 02 12:15:26.615858 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2464/4934] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:26 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:26.821055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:26.822355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:26.848125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:26.851080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:26.858759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:26.858759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:26.858759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:26.875226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:27.121728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:27.122944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:27.133322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:27.134476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:27.136436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:27.137517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:27.142517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:27.143903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:27.564338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:27.568755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:27.578146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d154b8f-be9f-444c-bd57-f951af1d26c9 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.464205 Nov 02 12:15:27.582860 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2465/4935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:27 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:27.586968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1102fb7-6083-4e6d-bb4e-c4ba4ea305c7 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.770734 Nov 02 12:15:27.587831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2471/4936] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:26 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:27.644123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:27.645306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:27.662612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:27.663142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:27.663593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:27.664893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:27.665353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:27.665993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.226203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6238c906-eb2c-48fb-9a6a-d0dc4996152b", "name": "network-vif-plugged", "status": "completed", "tag": "f2984058-234b-4b36-98a1-5bff7c5f4546"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:28.261348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:28.262173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:28.262770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.305919 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] Creating event network-vif-plugged:f2984058-234b-4b36-98a1-5bff7c5f4546 for instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b on n-h2-855649-4 Nov 02 12:15:28.317291 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-617b3543-4abf-41cf-aa69-69f0393fa233 req-c535cb32-4c02-4420-898d-4c7be4702acc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096597 Nov 02 12:15:28.323819 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2472/4937] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:15:28.431598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:28.446210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:28.451934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:28.470824 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db792c5c-a725-4d12-90bc-d4deba2664b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.824034 Nov 02 12:15:28.483049 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2466/4938] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:27 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:28.620192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:28.620831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:28.627005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:28.630879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:28.633669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:28.636680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:28.637259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.638239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:28.639016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:28.639618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.663174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:28.663174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:28.665222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.672124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:28.672910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:28.674458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:28.744964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:30.081067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:30.105409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:30.108280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d648aa19-f259-4b8f-bb85-da151dad04b1 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 1.499903 Nov 02 12:15:30.109443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2467/4939] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:28 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:30.149781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:30.164854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:30.180345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:30.186464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:30.187291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:30.190092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:30.192175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:30.193171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:30.645261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:30.656630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d3bde7a-35db-4f44-89f1-e3b6be638eb7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 2.053921 Nov 02 12:15:30.659239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2473/4940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:28 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:30.838075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:30.858919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:30.869467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:30.870709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7a0b84f-d062-4b56-b1bd-3fc4be1bb11b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.760048 Nov 02 12:15:30.877751 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2468/4941] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:30 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:31.140030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:31.140847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:31.144948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:31.151609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:31.152606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:31.153336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:31.154403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:31.155298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:31.155947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:31.647010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800b8921-5072-452d-bb06-94cbb0b754c1", "tag": "395c05a8-9b68-47ee-bfd3-36431d080626"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:31.682712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:31.683284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:31.683803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:31.732704 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] Creating event network-changed:395c05a8-9b68-47ee-bfd3-36431d080626 for instance 800b8921-5072-452d-bb06-94cbb0b754c1 on n-h1-855649-4 Nov 02 12:15:31.744688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-812679cb-d7d3-4831-8c31-ac43dc097066 req-da3b846d-075e-470d-8493-7ec1acc9ccd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102043 Nov 02 12:15:31.747340 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2469/4942] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:15:31.764286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:31.774861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:31.787686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:31.793017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:31.793017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:31.793017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:31.793017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:31.793017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:31.867138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:32.138279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:32.138279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6371c9f8-004f-4cd3-ae22-15c61be7f867 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.999849 Nov 02 12:15:32.139836 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2474/4943] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:31 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:32.167160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:32.167791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:32.185600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:32.186108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:32.186549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:32.188181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:32.188808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:32.189405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:32.515611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:32.546826 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71edef4d-228c-4920-beff-9bb406fe3189 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1314 microversion: 2.1 time: 0.797459 Nov 02 12:15:32.557327 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2470/4944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:31 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:33.163057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:33.163811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:33.176557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:33.177971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:33.179345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:33.182275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:33.184641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:33.184641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:33.230370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:33.366402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:33.388341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:33.392055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:33.394000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef109daf-0937-497c-9ab5-4ae196d78046 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 1.239192 Nov 02 12:15:33.394850 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2475/4945] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:32 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:33.585262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:33.585943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:33.596344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:33.608949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:33.609757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:33.610172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:33.614224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:33.615434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:33.616083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:33.621690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:33.622684 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-045ac917-8032-4d5d-857d-121841e12211 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.464177 Nov 02 12:15:33.629464 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2471/4946] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:33 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:34.043514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "name": "network-vif-plugged", "status": "completed", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:34.057716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:34.068628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a351430f-df63-458b-a945-29bd35eba895 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1500 microversion: 2.1 time: 0.492315 Nov 02 12:15:34.072307 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2476/4947] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:33 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1500 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:34.080831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:34.081492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:34.083161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:34.101961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:34.103026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:34.118529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:34.119081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:34.119595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:34.120369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:34.120847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:34.121286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:34.136815 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] Creating event network-vif-plugged:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:15:34.153063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e08de6db-0b5b-4a0f-b7f2-3318a6368172 req-e21eca79-e12f-4542-99e9-439765aac3bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117276 Nov 02 12:15:34.154811 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2472/4948] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:34.441423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:34.442703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:34.457839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:34.460839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:34.461689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:34.462539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:34.463164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:34.463727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:34.692060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Removing security group 5d68d112-fbc8-4977-b6b2-a8d01e4f14b3 from port f2984058-234b-4b36-98a1-5bff7c5f4546 Nov 02 12:15:34.993438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:35.003193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:35.004982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:35.006351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f601117-61eb-4254-9831-cbb8a8eb704e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.586327 Nov 02 12:15:35.006921 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2473/4949] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:34 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:35.013852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:35.014702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:35.021882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:35.024240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.024894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.025523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.026429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.027073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.027660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.348376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:35.358246 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa3a7da8-5813-44e3-962e-2bb2f989fd5f tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.348650 Nov 02 12:15:35.376747 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2474/4950] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:35 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:35.379067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-319397ba-84dd-45c8-b908-1062bad0255c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Action: 'create', calling method: .version_select at 0x7ff1b271e820>, body: {"keypair": {"name": "tempest-keypair-440497936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi98eOiwzvO4Gx2oxHq563uuelFzZ4Wxm4k7NIttRqOv2xk4Kug5W/GjYFfNvtaSjhym7Hd5ccPZHCCjWPpnJM/POqee0mG1ZJQLa98rf41M7ZboNFKHnxT4FEhr/C7dQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:35.396761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-319397ba-84dd-45c8-b908-1062bad0255c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Getting quotas for project 6daece1ed0dd48f2827d3f51319b0a66. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:35.403121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-319397ba-84dd-45c8-b908-1062bad0255c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Getting quotas for user 9323f6adf51b4577b7a5d9931744af8c and project 6daece1ed0dd48f2827d3f51319b0a66. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:35.522044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0894943-6e8a-41dc-b368-3907294ccf89 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b/action" status: 202 len: 0 microversion: 2.1 time: 1.428010 Nov 02 12:15:35.523805 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2477/4951] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:15:34 2022] POST /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b/action => generated 0 bytes in 1430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:15:35.531804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:35.532767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:35.536088 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-319397ba-84dd-45c8-b908-1062bad0255c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.161867 Nov 02 12:15:35.537030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2475/4952] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 12:15:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:15:35.545992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.548259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.549229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.550835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.553645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.554421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.593723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6238c906-eb2c-48fb-9a6a-d0dc4996152b", "tag": "f2984058-234b-4b36-98a1-5bff7c5f4546"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:35.623417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.624466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.626095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.648761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] Creating event network-changed:f2984058-234b-4b36-98a1-5bff7c5f4546 for instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b on n-h2-855649-4 Nov 02 12:15:35.656572 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7e184260-fd52-4425-9ea8-30a5c4a2c7f2 req-af22c4fb-bd78-450f-9466-a21b49de0fc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067017 Nov 02 12:15:35.668589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2476/4953] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:35.712090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:35.724370 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dd614b3-f151-4c37-8427-94fe0d0011b3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1458 microversion: 2.1 time: 0.196382 Nov 02 12:15:35.725404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2478/4954] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:35 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1458 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:35.747710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:35.748439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:35.762101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.762599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.763254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.764146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:35.764774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:35.765415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:35.976385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:36.006675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ece8375-a82b-499c-b5a4-3fe82691363b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.263317 Nov 02 12:15:36.011140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2477/4955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:35 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:36.039455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:36.040397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:36.048732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.049231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:36.049736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.050233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:36.050660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.051794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.052480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.053150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.065213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.065213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.065213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.065213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.065979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.066686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.589658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:36.598810 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da53fb14-1cf0-4891-ad66-7cdfbe0d8fab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.554926 Nov 02 12:15:36.599430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2478/4956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:36 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:36.604928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:36.605356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:36.605989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:36.612405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.613176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.613790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.614742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.615427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.616019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.617804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:36.621427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:36.623648 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a09a6806-4fd2-491a-ad22-901025baa817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1407 microversion: 2.20 time: 0.591203 Nov 02 12:15:36.634902 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2479/4957] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:36 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:36.645826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:36.646819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:36.654629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.655437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.656388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:36.657350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:36.658019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:36.658653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:37.358852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:37.375788 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79f62cdb-350e-4db2-9a06-93e98efefbd6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.773701 Nov 02 12:15:37.379910 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2479/4958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:36 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:37.658915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:37.661909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:37.677504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:37.678014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:37.678458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:37.679826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:37.680315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:37.680746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:37.877754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:37.890966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b6e3e6e-8170-40b3-881b-f130f014c92b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 1.247942 Nov 02 12:15:37.891632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2480/4959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:36 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:37.924259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:37.924901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:37.942610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:37.944274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:37.944746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:37.949558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:37.952598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:37.952995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:38.209117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:38.224280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:38.225981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:38.230006 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ef53bb2-b5e8-4b2a-9aa9-2efb115c98c6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1599 microversion: 2.20 time: 0.576918 Nov 02 12:15:38.233349 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2480/4960] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:37 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1599 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:38.267144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:38.268368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:38.282490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:38.283005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:38.283466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:38.284185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:38.284644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:38.286259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:38.410774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:38.420244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4223663d-0e99-4dcd-9b8f-de09328191fe tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.503044 Nov 02 12:15:38.422688 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2481/4961] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:37 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:38.425480 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3180c72d-ece3-452c-888f-065fe4a93062 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.162501 Nov 02 12:15:38.434463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2481/4962] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:15:38 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:15:38.441316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:38.442303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:38.462119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:38.466786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:38.467525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:38.468488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:38.470547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:38.471269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:38.609898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1023665690", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "f3132260-2b5f-490b-9b53-8a040d77422f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:38.717817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] validate_networks() for [('f3132260-2b5f-490b-9b53-8a040d77422f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:15:39.048916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:39.062543 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06ebc457-557c-43e2-b89a-d54a3e568351 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.637524 Nov 02 12:15:39.063453 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2482/4963] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:38 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:39.911079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:15:39.912094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:15:39.912821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:15:39.913422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:15:39.914589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:15:39.926911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:39.927787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:39.931025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:39.931025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:39.931025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:39.931025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:39.957024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:39.964889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Getting quotas for user d74d8003120246c4a99129c38d4d19ed and project f5889d94676a430780b12bd9ad06a238. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:39.992430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:15:39.995828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:15:40.088159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:40.090014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:40.098946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:40.099918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:40.100664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:40.102338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:40.103536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:40.104116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:40.180137 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c236817-3106-4927-b2e5-d2ae2f00ffd3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568371 Nov 02 12:15:40.187462 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2482/4964] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:15:40.197984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27e8fdd4-c813-417c-a239-3d960727a26d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:40.199267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27e8fdd4-c813-417c-a239-3d960727a26d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:40.423485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27e8fdd4-c813-417c-a239-3d960727a26d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:40.445963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27e8fdd4-c813-417c-a239-3d960727a26d tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1215 microversion: 2.1 time: 0.253127 Nov 02 12:15:40.463142 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2483/4965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:40 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:40.463142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800b8921-5072-452d-bb06-94cbb0b754c1", "name": "network-vif-plugged", "status": "completed", "tag": "395c05a8-9b68-47ee-bfd3-36431d080626"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:40.487073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:40.487666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:40.488130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:40.517493 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] Creating event network-vif-plugged:395c05a8-9b68-47ee-bfd3-36431d080626 for instance 800b8921-5072-452d-bb06-94cbb0b754c1 on n-h1-855649-4 Nov 02 12:15:40.526886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c8357654-3d46-4607-89ed-5970229ca094 req-334e0d4e-62b5-44b0-a889-869c24b5c604 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077916 Nov 02 12:15:40.527544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2484/4966] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:41.175175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:41.183539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9db34955-27f0-4e77-a6ff-24fe9802cd09 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 1.100766 Nov 02 12:15:41.185394 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2483/4967] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:40 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:41.487417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:41.490022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:41.506685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:41.507654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:41.510364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:41.530470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:41.530470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:41.530470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:41.805552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:41.822456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26a7e048-0528-4a94-8e4c-ebf5d9d2e78b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1219 microversion: 2.1 time: 0.349309 Nov 02 12:15:41.837809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2485/4968] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:41 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1219 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:42.213748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:42.214710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:42.219041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:42.234208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:42.235559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:42.236750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:42.240986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:42.241448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:42.243151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:42.246482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:42.247229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:42.247685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:42.314948 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] Creating event network-changed:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:15:42.345484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5a69be3a-63c8-4f9e-8db3-e8f9f5836bcd req-3363e0f7-eb98-48ca-8654-5dd47f13bbd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130394 Nov 02 12:15:42.346502 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2486/4969] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:15:42.729299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:42.738632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f54b42ee-9936-4e18-b49a-dfe38ee85822 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1316 microversion: 2.1 time: 0.530896 Nov 02 12:15:42.744637 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2484/4970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:42 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:42.855821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:42.855821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:42.881523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:42.888492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:42.891925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:42.895078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:42.897619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:42.901522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:43.230340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:43.266341 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d98baf7-20bb-43ac-a7d2-3de5b44a394c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1267 microversion: 2.1 time: 0.422935 Nov 02 12:15:43.289908 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2487/4971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:42 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1267 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:43.771154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:43.771960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:43.786671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:43.786671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:43.791610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:43.794086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:43.796413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:43.799422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.034350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-285747445", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0a2a6d5b-d182-4c5b-94cf-d589c37a75dc"}, {"port": "7419a7c3-3bdf-4ff8-a405-c820499fee6c", "tag": "port-1"}, {"port": "9f57b110-70cf-4553-8955-22f352485443", "tag": "port-2"}, {"uuid": "0d48165e-f9c4-41f1-9c49-702b090eab56", "tag": "net-1"}, {"uuid": "0d48165e-f9c4-41f1-9c49-702b090eab56"}, {"uuid": "4b2ae20d-4e00-4b40-8271-c0fc9cda0a0a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4b2ae20d-4e00-4b40-8271-c0fc9cda0a0a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c5c10bf1-21ac-43b5-96b1-46fc4bc83dff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "340d80f1-3674-496c-beda-7b058a5147bd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "40f7396a-900d-423d-b18a-71ddc53c63a9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2042822236"}], "key_name": "tempest-keypair-440497936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:44.416284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] validate_networks() for [('0a2a6d5b-d182-4c5b-94cf-d589c37a75dc', None, None, None, None, None), (None, None, '7419a7c3-3bdf-4ff8-a405-c820499fee6c', None, None, None), (None, None, '9f57b110-70cf-4553-8955-22f352485443', None, None, None), ('0d48165e-f9c4-41f1-9c49-702b090eab56', None, None, None, None, None), ('0d48165e-f9c4-41f1-9c49-702b090eab56', None, None, None, None, None), ('4b2ae20d-4e00-4b40-8271-c0fc9cda0a0a', '10.2.2.100', None, None, None, None), ('4b2ae20d-4e00-4b40-8271-c0fc9cda0a0a', '10.2.2.200', None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:15:44.546365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:44.555108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c19817c-ad33-47e4-86be-974d010eb29c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1504 microversion: 2.1 time: 0.789142 Nov 02 12:15:44.567969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2485/4972] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:43 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1504 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:44.584752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:44.585996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:44.603328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.603840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.604349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.605089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.605552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.605986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.803332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:44.812523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d6a6a5a-c8f7-46d5-bc1c-723694d2e66c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1273 microversion: 2.1 time: 0.243280 Nov 02 12:15:44.813130 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2486/4973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:44 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:44.818748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:44.819564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:44.835404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:44.862739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:15:45.448049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8df4fabf-02a2-4bdb-af73-43b5a74f0249 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "DELETE /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 204 len: 0 microversion: 2.1 time: 0.633436 Nov 02 12:15:45.452356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2487/4974] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:15:44 2022] DELETE /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:15:45.461215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:45.462045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:45.471484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:45.472251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:45.472919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:45.474268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:45.475003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:45.475678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:46.219496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:46.225761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:46.233508 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7354ffeb-53cd-4d0d-b2f4-b7d368b144bb tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1510 microversion: 2.1 time: 0.777458 Nov 02 12:15:46.263373 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2488/4975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:45 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1510 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:46.272057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:46.275331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:46.285172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:46.285761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:46.286441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:46.288804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:46.289468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:46.291370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:46.445368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:46.458469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82328c51-9758-4bf4-b02b-c24de7a6cdba tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1273 microversion: 2.1 time: 0.193534 Nov 02 12:15:46.459754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2489/4976] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:46 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:47.262484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:47.266016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:47.277697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.278500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.280548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:47.283414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.285341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.285949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:47.872816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:47.890630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c496a469-a554-460a-8a01-31da843595e6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1510 microversion: 2.1 time: 0.630871 Nov 02 12:15:47.891852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2490/4977] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:47 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:47.900479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:47.904343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:47.929875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.930762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.936752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:47.938077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:47.938738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:47.939404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:48.632134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:48.655321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2483e89-eb68-4faa-beb0-de5accb80813 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.759024 Nov 02 12:15:48.664326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2491/4978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:47 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:48.671167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800b8921-5072-452d-bb06-94cbb0b754c1", "name": "network-vif-deleted", "tag": "395c05a8-9b68-47ee-bfd3-36431d080626"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:48.702230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:48.704525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:48.705138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:48.724615 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] Creating event network-vif-deleted:395c05a8-9b68-47ee-bfd3-36431d080626 for instance 800b8921-5072-452d-bb06-94cbb0b754c1 on n-h1-855649-4 Nov 02 12:15:48.731595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0d314e32-3146-4324-a1be-073396b2fcd2 req-17ce2f89-42a5-4afe-a596-6d1af36bccc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064795 Nov 02 12:15:48.732964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2492/4979] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:48.939839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:48.940902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:48.958783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:48.959312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:48.959848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:48.961082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:48.961563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:48.961974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.120834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:49.121327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:49.121958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.122578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lazy-loading 'fault' on Instance uuid 800b8921-5072-452d-bb06-94cbb0b754c1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:15:49.314001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2d9199c77d4453c94a8ff7285a51ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bf26d46424468d8c82be8b8a0648a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:49.331884 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b336681b-03b1-43d5-a8fc-56b1f317484c tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 200 len: 1306 microversion: 2.1 time: 0.396939 Nov 02 12:15:49.337947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2493/4980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:48 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 1306 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:15:49.684865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:49.687198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:49.715182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:49.716463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:49.722970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.725642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:49.727155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:49.730040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:49.945717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:50.339780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:50.359876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-892392bc-9ca8-4f09-9951-71ca8bb53a60 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.681074 Nov 02 12:15:50.376191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2494/4981] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:49 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:50.401918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:50.407610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:50.432994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:50.433959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.434558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.440579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.441450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.442094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.444068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.463108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 HTTP/1.1 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '800b8921-5072-452d-bb06-94cbb0b754c1'} Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.465743 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.470206 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.472586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.473693 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37569925-14c8-4f22-9734-4000fa7310f6 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 404 len: 111 microversion: 2.1 time: 0.094032 Nov 02 12:15:50.479767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2495/4982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:50 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.490656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-774570584", "metadata": {"image_type": "test"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:50.494944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:50.503308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.504139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.504854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.506392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.508072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.508864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.532841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1/action HTTP/1.1 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 111 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-774570584", "metadata": {"image_type": "test"}}} Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '800b8921-5072-452d-bb06-94cbb0b754c1', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-774570584', 'metadata': {'image_type': 'test'}}}} Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:15:50.538767 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-021af2ed-ef71-4759-84dc-fc3f4e7cf592 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "POST /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1/action" status: 404 len: 111 microversion: 2.1 time: 0.058497 Nov 02 12:15:50.552417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2496/4983] 10.222.0.48 () {60 vars in 1279 bytes} [Wed Nov 2 12:15:50 2022] POST /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.556967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-339382650", "metadata": {"image_type": "test"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:50.559784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Failed to fetch instance by id tempest-invalid-994079952 {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:15:50.560517 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance tempest-invalid-994079952 could not be found. Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/tempest-invalid-994079952/action HTTP/1.1 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 111 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-339382650", "metadata": {"image_type": "test"}}} Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance tempest-invalid-994079952 could not be found. Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'tempest-invalid-994079952', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-339382650', 'metadata': {'image_type': 'test'}}}} Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-994079952 could not be found. Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.562602 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-994079952 could not be found. Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-994079952 could not be found. Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance tempest-invalid-994079952 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.571069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17f1d218-98e5-45f0-8e13-4ec5de892311 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "POST /compute/v2.1/servers/tempest-invalid-994079952/action" status: 404 len: 100 microversion: 2.1 time: 0.014391 Nov 02 12:15:50.576750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2497/4984] 10.222.0.48 () {60 vars in 1246 bytes} [Wed Nov 2 12:15:50 2022] POST /compute/v2.1/servers/tempest-invalid-994079952/action => generated 100 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.591372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-611622859"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:50.596119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:15:50.596981 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 56 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-test-snap-611622859"}} Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-611622859'}}} Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.600421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.605412 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.607884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.610267 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c2394b4-5c86-4e69-bebe-8abfc0ee18fd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024202 Nov 02 12:15:50.611586 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2498/4985] 10.222.0.48 () {60 vars in 1275 bytes} [Wed Nov 2 12:15:50 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.623350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1949517552"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:50.629941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:15:50.631100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 57 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: {"createImage": {"name": "tempest-test-snap-1949517552"}} Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1949517552'}}} Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.634251 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:15:50.640644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.646496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.647412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9cc8654d-25e6-4f14-b651-9383b08e1d70 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.029555 Nov 02 12:15:50.655962 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2499/4986] 10.222.0.48 () {60 vars in 1281 bytes} [Wed Nov 2 12:15:50 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.662432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:50.665566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:50.683342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.684150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.684757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.688100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.689192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.690109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.727969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 HTTP/1.1 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '800b8921-5072-452d-bb06-94cbb0b754c1'} Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.729593 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d578ff32-27ac-49db-9803-c5ddb0cbf919 tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "DELETE /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 404 len: 111 microversion: 2.1 time: 0.073781 Nov 02 12:15:50.733821 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2500/4987] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:15:50 2022] DELETE /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:50.743386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:50.743386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] [instance: 800b8921-5072-452d-bb06-94cbb0b754c1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:50.755139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.762667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.763438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.764378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:50.765014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:50.765613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:50.784673 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] HTTP exception thrown: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Request method failure captured: Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 HTTP/1.1 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9VSPe_pflIELPSrH6hxyIk_bJOqv8UskjxLgcgIE1j6bo6plGrbYu1sqFrtVNXKMCLA1zqhc6jj4FyE7jTIIaxKLNlzpQO0xzlflwIf6478xQ88USZkSNxVpi06dzXn6plzfbGsZueeB4NXUWw4dx3olQcpjJJVaNv1m9-ftrGpyY Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2bf26d46424468d8c82be8b8a0648a9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2bf26d46424468d8c82be8b8a0648a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c2bf26d46424468d8c82be8b8a0648a9 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-163589053 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d2d9199c77d4453c94a8ff7285a51ca9 Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ImagesNegativeTestJSON-163589053-project Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '800b8921-5072-452d-bb06-94cbb0b754c1'} Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:15:50.786731 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. Nov 02 12:15:50.791432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:15:50.792884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] Returning 404 to user: Instance 800b8921-5072-452d-bb06-94cbb0b754c1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:15:50.795137 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84046a51-0fa0-440e-a78c-df707628cbcd tempest-ImagesNegativeTestJSON-163589053 tempest-ImagesNegativeTestJSON-163589053-project] 10.222.0.48 "GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1" status: 404 len: 111 microversion: 2.1 time: 0.058986 Nov 02 12:15:50.799553 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2501/4988] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:50 2022] GET /compute/v2.1/servers/800b8921-5072-452d-bb06-94cbb0b754c1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:15:51.399529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:51.399529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:51.416549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:51.417049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:51.417499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:51.418229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:51.418695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:51.419156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:52.022810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:15:52.024238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:15:52.025170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:15:52.028292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:15:52.030871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:15:52.075582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:52.076185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:52.076686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:52.077753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:52.078291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:52.078916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:52.109711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Getting quotas for project 6daece1ed0dd48f2827d3f51319b0a66. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:15:52.116067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Getting quotas for user 9323f6adf51b4577b7a5d9931744af8c and project 6daece1ed0dd48f2827d3f51319b0a66. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:15:52.139895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:52.156863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b68024c6-0dbc-47c3-9e34-692b68e6ba33 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.762211 Nov 02 12:15:52.157965 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2502/4989] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:51 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:52.174241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cef9b9-bace-47ff-908b-b162756c5dcd", "tag": "912d05e1-e856-407b-936d-cf9568526fae"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:52.204634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:52.205954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:52.207955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:52.252111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] Creating event network-changed:912d05e1-e856-407b-936d-cf9568526fae for instance b8cef9b9-bace-47ff-908b-b162756c5dcd on n-h1-855649-4 Nov 02 12:15:52.267352 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-daff11ed-e720-4d3e-b60b-a971787451e2 req-5011a79b-e8ba-4306-a033-f29849a6ad9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103997 Nov 02 12:15:52.268604 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2503/4990] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:52.445535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:15:52.448635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c5c10bf1-21ac-43b5-96b1-46fc4bc83dff',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='340d80f1-3674-496c-beda-7b058a5147bd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40f7396a-900d-423d-b18a-71ddc53c63a9',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:15:53.185553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:53.186359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:53.202189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:53.202189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:53.202189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:53.206018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:53.208987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:53.209603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:53.669732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:53.679882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1466dbc5-2306-4734-9006-0a6c5a5ee897 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.499151 Nov 02 12:15:53.687369 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2504/4991] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:53 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:54.472624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3612c871-e06c-4c4a-82a2-2c581346abf6 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.434913 Nov 02 12:15:54.478889 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2488/4992] 10.222.0.48 () {62 vars in 1189 bytes} [Wed Nov 2 12:15:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 10448 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 12:15:54.480342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:54.481559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:54.580373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:54.591582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:54.593578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:54.595365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-321e9f44-f7d1-41a1-994a-b13f361ff451 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1284 microversion: 2.42 time: 0.120601 Nov 02 12:15:54.607191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2505/4993] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:54 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:54.710761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:54.711663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:54.728385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:54.729183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:54.729829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:54.730788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:54.734336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:54.735054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:55.042490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:55.060032 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e7bbe5f-89ac-48a6-b332-9b998477b1ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.353184 Nov 02 12:15:55.062808 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2489/4994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:54 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:55.624299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:55.625115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:55.781628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:55.793816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:55.799131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:55.804949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97d6d9d3-7123-4ed5-a575-bb09ed3c9f3b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1284 microversion: 2.42 time: 0.181721 Nov 02 12:15:55.806895 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2506/4995] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:55 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:56.097317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:56.097317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:56.141027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:56.146787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:56.151371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:56.153916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:56.157313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:56.165447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:56.401564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:56.417841 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-637a3f2d-b3f2-4728-9058-9de9ce540079 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.333345 Nov 02 12:15:56.419261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2490/4996] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:56 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:56.843549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:56.844332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:57.012748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:57.013906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:57.016193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:57.018628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6500d3d4-4d0e-4dbc-8fbb-53c3eb6b38ab tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1284 microversion: 2.42 time: 0.185797 Nov 02 12:15:57.037519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2507/4997] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:56 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:57.448008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:57.448776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:57.473891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:57.476096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:57.476829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:57.482100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:57.483819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:57.484712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:57.524146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:57.874188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:57.888837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f9c272b-6164-4f42-8671-febe1b52f312 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.451401 Nov 02 12:15:57.903006 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2491/4998] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:57 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:15:58.051344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:58.052041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:58.079239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.080740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.082114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:58.084784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.087447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.088193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:58.235472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:58.253990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:58.255820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:58.257851 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6325567-b82d-4985-8edc-89ad33c85380 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1574 microversion: 2.42 time: 0.213412 Nov 02 12:15:58.260164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2508/4999] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:58 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:15:58.480532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cef9b9-bace-47ff-908b-b162756c5dcd", "name": "network-vif-plugged", "status": "completed", "tag": "912d05e1-e856-407b-936d-cf9568526fae"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:15:58.512872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.513801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.514431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:58.530805 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] Creating event network-vif-plugged:912d05e1-e856-407b-936d-cf9568526fae for instance b8cef9b9-bace-47ff-908b-b162756c5dcd on n-h1-855649-4 Nov 02 12:15:58.537426 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b539a31b-78a3-4b3b-bc9b-631d15509f2a req-553c3f8c-3bcd-4d16-89c0-62de6bf8f37e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073942 Nov 02 12:15:58.540018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2492/5000] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:15:58.915487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:58.916135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:58.926833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.927520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.933089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:58.933089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:58.933089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:58.933089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:59.317723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:15:59.319442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:15:59.327615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:59.328555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:59.329920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:59.330886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:15:59.347477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:15:59.348207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:15:59.544766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:59.569842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:59.579128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:59.583522 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e05e9920-2691-454f-a479-8c39850e31f0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1582 microversion: 2.42 time: 0.298338 Nov 02 12:15:59.584166 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2493/5001] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:15:59 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1582 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:15:59.745911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:15:59.754092 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11bb0544-b101-482f-92ad-27bfde9ff26a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1315 microversion: 2.1 time: 0.843880 Nov 02 12:15:59.754688 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2509/5002] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:15:58 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:00.617811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:00.619158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:00.638464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.639193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.640045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:00.641210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.641891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.642527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:00.768083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:00.780436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:00.782464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:00.785539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:00.787545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:00.792941 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a075e28-0237-47c7-bedd-3769144e587c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1592 microversion: 2.42 time: 0.179936 Nov 02 12:16:00.795489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.796319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2494/5003] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:00 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1592 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:00.800266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.800857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:00.802509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:00.803090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:00.803448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.067750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:01.077300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bacea13a-e89a-4c61-87ec-ec503f2dee8f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1501 microversion: 2.1 time: 0.302823 Nov 02 12:16:01.085794 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2510/5004] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:00 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:01.119170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:01.119905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:01.133763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.134542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.135166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.136029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.136834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.137465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.515026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b91dd80-8f7a-493b-841f-6a5a7c0c6324 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.400000 Nov 02 12:16:01.540066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:01.543086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2495/5005] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:16:01 2022] POST /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:16:01.545249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:01.559911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.560417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.560860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.562316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.564093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.564702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.838889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:01.844743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:01.876893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.881273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.887120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:01.889378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:01.890287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:01.899369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:02.092908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:02.126308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:02.328004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:02.338344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7023ad43-38dc-4e1a-a9b5-04faba26e0a8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1506 microversion: 2.1 time: 0.814068 Nov 02 12:16:02.366668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2511/5006] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:01 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:02.384658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:02.409296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:02.411956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:02.415595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13ef53f3-bb85-43e5-bf20-2795bca4eb3c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1660 microversion: 2.42 time: 0.592885 Nov 02 12:16:02.418001 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2496/5007] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:01 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1660 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:03.372920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:03.374160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:03.387249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:03.387764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:03.388217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:03.388950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:03.389549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:03.389835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:03.450365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:03.451838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:03.474069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:03.476773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:03.480016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:03.486560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:03.487491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:03.489716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:04.259300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:04.274710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ae41548-c115-47f9-bd0b-af8e94b438d7 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1486 microversion: 2.1 time: 0.905814 Nov 02 12:16:04.280602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2512/5008] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:03 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1486 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:04.290745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:04.307005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:04.309507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:04.311575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:04.311968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41fef973-76e7-4640-8b87-5b4081a04920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1707 microversion: 2.42 time: 0.865261 Nov 02 12:16:04.312100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:04.313490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2497/5009] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:03 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1707 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:04.327366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:04.327894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:04.328344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:04.329074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:04.329538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:04.330169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:04.390864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lazy-loading 'flavor' on Instance uuid b8cef9b9-bace-47ff-908b-b162756c5dcd {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:16:04.597401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.217780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d9b021f-82c6-4424-a860-44804311114f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.910167 Nov 02 12:16:05.218517 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2513/5010] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:16:04 2022] POST /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd/action => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:16:05.229219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:05.235354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:05.249346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:05.255235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:05.256468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:05.259655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:05.264323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:05.264962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:05.347085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:05.348152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:05.358542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.362625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:05.364234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:05.365185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:05.368918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:05.369907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:05.370550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:05.929791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:05.951985 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-25e8a634-406a-47d0-ad40-2e52bc683ffb tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1492 microversion: 2.1 time: 0.728953 Nov 02 12:16:05.959326 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2498/5011] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:05 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1492 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:06.078165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:06.093296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:06.094927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:06.106229 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00659985-bb0d-4c64-9237-cf658fdb7476 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1754 microversion: 2.42 time: 0.763902 Nov 02 12:16:06.106787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2514/5012] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:05 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1754 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:06.986856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:06.988153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:07.001944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:07.013776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:07.014528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:07.015530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:07.016185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:07.023732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:07.136662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:07.137391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:07.163628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:07.179362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:07.183903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:07.184462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:07.185235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:07.185721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:07.186163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:07.939844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:07.956611 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87f890e1-2ecb-409c-a673-51257e3e5f56 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1513 microversion: 2.1 time: 0.971365 Nov 02 12:16:07.957277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2499/5013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:06 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1513 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:08.046445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:08.070370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:08.075665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:08.085248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cf4a9a5-034d-4fa5-af22-0973791d8b6e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1754 microversion: 2.42 time: 0.952168 Nov 02 12:16:08.085947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2515/5014] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:07 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1754 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:08.221748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1596236187", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "b16473a2-d258-47fe-b702-c87148e04e1d"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:08.240444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:08.367808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] validate_networks() for [('b16473a2-d258-47fe-b702-c87148e04e1d', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:16:08.992128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:08.992766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:09.009910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.010886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.011844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.013785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.017425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.018154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.610638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:16:09.611286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:16:09.612044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:16:09.612472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:16:09.612924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:16:09.645299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.649116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.649736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.656421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.657502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.659510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.719973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:16:09.721635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:09.734383 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b8b3892b-2485-41c1-899c-e9ea96218c06 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 0.745037 Nov 02 12:16:09.736236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2516/5015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:08 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:09.740477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for user ee616c7ef2a64977ba49b5302a88d0dd and project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:16:09.767460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:09.767997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:09.787052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.788545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.790018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.790999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:09.792083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:16:09.792762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:09.793872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:09.797322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:16:10.076487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a3447c0-415b-4cb3-bf63-df111a6f4936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117800 Nov 02 12:16:10.082229 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2500/5016] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:16:10.086668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cef9b9-bace-47ff-908b-b162756c5dcd", "name": "network-vif-plugged", "status": "completed", "tag": "912d05e1-e856-407b-936d-cf9568526fae"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:10.123712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:10.126198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:10.126692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:10.163217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] Creating event network-vif-plugged:912d05e1-e856-407b-936d-cf9568526fae for instance b8cef9b9-bace-47ff-908b-b162756c5dcd on n-h1-855649-4 Nov 02 12:16:10.179652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b0127e1a-78ad-467b-9d59-2364135d19a1 req-3fb1d30b-75d9-4a9c-9bf3-ade3ea02de16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099550 Nov 02 12:16:10.180522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2501/5017] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:10.390698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2066092461", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "b16473a2-d258-47fe-b702-c87148e04e1d"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:10.514742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:10.541729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:10.548643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:10.551569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] validate_networks() for [('b16473a2-d258-47fe-b702-c87148e04e1d', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:16:10.555809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3796432c-5d30-44ea-a45a-e24d40d4a984 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1801 microversion: 2.42 time: 0.795747 Nov 02 12:16:10.557667 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2517/5018] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:09 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1801 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:10.764756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:10.773158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:10.777340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:10.777709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:10.778183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:10.788618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:10.789324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:10.790663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:11.862248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:11.874747 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2eeb552-f7b6-400f-8aba-d512b21c7f11 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.111105 Nov 02 12:16:11.880193 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2518/5019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:10 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:11.897996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:11.901357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:11.916517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:11.919410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:11.920089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:11.921801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:11.923620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:11.924566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:12.624191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:12.638645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:12.645314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:12.648645 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0d79821-1511-4614-a0af-cc83f29cf3f5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1848 microversion: 2.42 time: 0.767132 Nov 02 12:16:12.651241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2519/5020] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:11 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1848 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:12.883489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:16:12.883489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:16:12.883489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:16:12.883489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:16:12.883489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:16:12.901486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:12.901985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:12.902430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:12.903212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:12.903589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:12.904260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:12.904260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:12.904641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:12.918825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:12.919719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:12.920418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:12.922552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:12.924551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:12.926321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:12.975603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:16:12.994554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for user ee616c7ef2a64977ba49b5302a88d0dd and project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:16:13.029792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:16:13.041594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:16:13.286081 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c6ce613-801a-4d54-9632-5366e83f53fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.900048 Nov 02 12:16:13.286759 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2502/5021] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:16:13.516807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:13.529808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-582e1d02-d7bf-4144-b510-33a3ef24800f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 0.631652 Nov 02 12:16:13.530407 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2520/5022] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:12 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:13.620065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1166003949", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "451", "networks": [{"uuid": "b16473a2-d258-47fe-b702-c87148e04e1d"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:13.704848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:13.705465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:13.720885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:13.727634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:13.732947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:13.736181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:13.738834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:13.742336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:13.788943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] validate_networks() for [('b16473a2-d258-47fe-b702-c87148e04e1d', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:16:14.262528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:14.281288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:14.286311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:14.311950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c125d864-b775-4198-a444-4db37de5dde5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1848 microversion: 2.42 time: 0.611374 Nov 02 12:16:14.327889 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2521/5023] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:13 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1848 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:14.558008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:14.558837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:14.571011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:14.572194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:14.574494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:14.575948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:14.576615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:14.580236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:15.134362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:15.147783 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c64db1aa-aea6-4aff-bca8-4eeaf8b0766b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 0.594245 Nov 02 12:16:15.154644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2522/5024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:14 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:15.348162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:15.349674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:15.368690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:15.376445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:15.380178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:15.381802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:15.385309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:15.388999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:15.443153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:16:15.443643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:16:15.444608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:16:15.445297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:16:15.445898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:16:15.469196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:15.473887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:15.474546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:15.475672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:15.478096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:15.478732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:15.532546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:16:15.539230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Getting quotas for user ee616c7ef2a64977ba49b5302a88d0dd and project 75e3d585afb5464ea97c154b7d84c586. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:16:15.570859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:16:15.579247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:16:15.791867 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c158cc31-abdb-4b5e-8486-73b45e0755d1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175689 Nov 02 12:16:15.804624 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2503/5025] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:16:15.817677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcdade53-3f51-4e40-9015-8be8e7e30c6f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:15.830596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcdade53-3f51-4e40-9015-8be8e7e30c6f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:17.062553 n-d-855649-4 devstack@n-api.service[127568]: Exception ignored in: . at 0x7ff1bbb15310> Nov 02 12:16:17.063323 n-d-855649-4 devstack@n-api.service[127568]: Traceback (most recent call last): Nov 02 12:16:17.063693 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 12:16:17.076582 n-d-855649-4 devstack@n-api.service[127568]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 12:16:17.077538 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 12:16:17.078089 n-d-855649-4 devstack@n-api.service[127568]: connection_record.checkin() Nov 02 12:16:17.078843 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 12:16:17.079338 n-d-855649-4 devstack@n-api.service[127568]: pool.dispatch.checkin(connection, self) Nov 02 12:16:17.085344 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 12:16:17.085839 n-d-855649-4 devstack@n-api.service[127568]: fn(*args, **kw) Nov 02 12:16:17.086027 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 12:16:17.091027 n-d-855649-4 devstack@n-api.service[127568]: time.sleep(0) Nov 02 12:16:17.091273 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 12:16:17.091596 n-d-855649-4 devstack@n-api.service[127568]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 12:16:17.091762 n-d-855649-4 devstack@n-api.service[127568]: AssertionError: do not call blocking functions from the mainloop Nov 02 12:16:17.092513 n-d-855649-4 devstack@n-api.service[127568]: Exception ignored in: . at 0x7ff1b3d30c10> Nov 02 12:16:17.092702 n-d-855649-4 devstack@n-api.service[127568]: Traceback (most recent call last): Nov 02 12:16:17.092969 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 12:16:17.093491 n-d-855649-4 devstack@n-api.service[127568]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 12:16:17.093768 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 12:16:17.094271 n-d-855649-4 devstack@n-api.service[127568]: connection_record.checkin() Nov 02 12:16:17.094422 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 12:16:17.094831 n-d-855649-4 devstack@n-api.service[127568]: pool.dispatch.checkin(connection, self) Nov 02 12:16:17.095251 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 12:16:17.095660 n-d-855649-4 devstack@n-api.service[127568]: fn(*args, **kw) Nov 02 12:16:17.095826 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 12:16:17.096097 n-d-855649-4 devstack@n-api.service[127568]: time.sleep(0) Nov 02 12:16:17.096258 n-d-855649-4 devstack@n-api.service[127568]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 12:16:17.096505 n-d-855649-4 devstack@n-api.service[127568]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 12:16:17.096655 n-d-855649-4 devstack@n-api.service[127568]: AssertionError: do not call blocking functions from the mainloop Nov 02 12:16:17.458080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcdade53-3f51-4e40-9015-8be8e7e30c6f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:17.470497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcdade53-3f51-4e40-9015-8be8e7e30c6f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1221 microversion: 2.1 time: 1.656882 Nov 02 12:16:17.491366 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2504/5026] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:15 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1221 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:17.506947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:17.508026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:17.520594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:17.529144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:17.530698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:17.534512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:17.537234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:17.537959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:18.177223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:18.201584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:18.213183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:18.220219 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63d9c0ce-dbf3-46fd-8cd6-e98a78bb39d9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1848 microversion: 2.42 time: 2.870898 Nov 02 12:16:18.222021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2523/5027] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:15 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1848 bytes in 2879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:18.251508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:18.300126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:18.312230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:18.313532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:18.354313 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] Creating event network-changed:e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:18.375627 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7b18ecde-6d04-4cd2-8526-7a9acffbab7b req-671255c7-6176-464a-9a10-be0f02c5b7f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144358 Nov 02 12:16:18.377536 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2524/5028] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:18.502376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:18.509440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:18.533425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:18.543262 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6aef69d-fb8c-4969-a486-1aad0546606a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.049994 Nov 02 12:16:18.543862 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2505/5029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:17 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:18.572119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:18.573178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:18.578828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:18.579945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:18.580431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:18.583523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:18.986444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:19.001830 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddc78fa4-cae5-4098-b128-81f06d33d408 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1217 microversion: 2.1 time: 0.504018 Nov 02 12:16:19.020511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2525/5030] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:18 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1217 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:19.256473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:19.257447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:19.275348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:19.277597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:19.277597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:19.277597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:19.283985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:19.284929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:19.586785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:19.592245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:19.606038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:19.611752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:19.612678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:19.613637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:19.614123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:19.614566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:21.785012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:21.796681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:21.805839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:21.807204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-965c5654-7f4b-4519-80d5-3723b557a126 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1848 microversion: 2.42 time: 2.557277 Nov 02 12:16:21.807801 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2506/5031] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:19 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1848 bytes in 2558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:21.829481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:21.831553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:21.848978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:21.849693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:21.850359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:21.851334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:21.851972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:21.861424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:22.415703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:22.425420 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d14ac457-1ca8-486a-8c45-28035bb25231 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 2.843252 Nov 02 12:16:22.426027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2526/5032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:19 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:22.843897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:22.845096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:22.873911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:22.874413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:22.874874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:22.888968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:22.893003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:22.897678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:23.211906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:23.241943 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-838ed3a1-c1a0-4431-8d5e-4d019ec50adf tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1279 microversion: 2.1 time: 1.433010 Nov 02 12:16:23.244157 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2507/5033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:21 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1279 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:23.450740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:23.452305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:23.478650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:23.479195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:23.479650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:23.480371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:23.500910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:23.503888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:24.652979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:24.674357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:24.677855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:24.679787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-613e49d2-45a3-4869-ae1f-711e93fc7341 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1869 microversion: 2.42 time: 1.840446 Nov 02 12:16:24.685765 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2527/5034] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:22 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1869 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:24.686710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:24.688338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:24.695482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:24.697145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:24.697948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:24.701096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:24.701885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:24.702554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:24.763789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:24.793401 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cc71be8-cde5-414f-b948-0a593dde4a84 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.346120 Nov 02 12:16:24.815163 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2508/5035] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:23 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:24.909877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "7419a7c3-3bdf-4ff8-a405-c820499fee6c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:24.934891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:24.935929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:24.937361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:24.965002 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] Creating event network-changed:7419a7c3-3bdf-4ff8-a405-c820499fee6c for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:24.983598 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-86ecb586-c94d-482a-90de-cedb87c7979f req-d7e2fe85-3b24-48b1-ab9d-3f5f7124ad51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078225 Nov 02 12:16:24.988153 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2509/5036] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:16:25.718629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:25.721800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:25.753381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:25.772679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:25.780624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:25.783681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:25.788176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:25.788780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:25.789240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:25.841211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:25.858586 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b69c0165-f413-4404-9d0c-32b2f234259b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 1.176860 Nov 02 12:16:25.861959 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2528/5037] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:24 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:25.879042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:25.880717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:25.907248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:25.909529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:25.910412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:25.911757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:25.913553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:25.914159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:27.371036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:27.382128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51cf0b56-0dfa-4635-aeac-1ca5372854ef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.516474 Nov 02 12:16:27.383200 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2529/5038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:25 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:27.389198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:27.390146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:27.398557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:27.399538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:27.400317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:27.401273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:27.401937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:27.402586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:27.432734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:27.470246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:27.690330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:27.756414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:27.769047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:27.778950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f32faa32-f2e6-4da3-8fbc-9bed901c2600 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1869 microversion: 2.42 time: 2.070769 Nov 02 12:16:27.790766 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2510/5039] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:25 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1869 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:28.277323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:28.340210 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4eaa35e-0a91-4520-885c-44854c1d1fc1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 0.928728 Nov 02 12:16:28.340210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2530/5040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:27 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:28.426444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:28.427472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:28.449030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:28.450812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:28.451454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:28.453163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:28.456884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:28.457819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:28.820621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:28.821312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:28.830935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:28.835275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:28.835894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:28.836671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:28.837667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:28.838114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:29.859811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:29.864232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:29.872045 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e467ded-ab5f-4a98-9592-d1a409179d3b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.463117 Nov 02 12:16:29.875734 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2511/5041] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:28 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:29.888102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:29.890448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:29.907445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:29.910284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:29.912400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:29.913249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:29.917316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:29.917820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:30.498966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:30.502210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:30.503713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:30.504952 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e5cb7c0-0acb-4d99-9c33-67c798266920 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1890 microversion: 2.42 time: 1.688804 Nov 02 12:16:30.516536 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2531/5042] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:28 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1890 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:30.820308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e462325-4ba0-45f5-afde-224648670b44", "tag": "afbd0c4f-1364-40e8-8c06-76e5f3df517c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:30.851059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:30.851615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:30.854263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:30.897670 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] Creating event network-changed:afbd0c4f-1364-40e8-8c06-76e5f3df517c for instance 1e462325-4ba0-45f5-afde-224648670b44 on n-h1-855649-4 Nov 02 12:16:30.908836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-68d1056a-f38c-425c-a7e6-c5a2e7eca15d req-29481d64-20c2-4980-87cb-e4209bdc3475 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387255 Nov 02 12:16:30.915367 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2532/5043] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:30.918843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:30.922864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:30.929497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:30.932257 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d250239-92ae-474a-a891-1ca1c3da9e5f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 1.054132 Nov 02 12:16:30.932257 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2512/5044] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:29 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:30.956860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ec1b84-dd44-45f7-8df2-b125893849ae", "tag": "5df0a538-3913-4fd6-bf1a-adc6f1591843"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:30.959730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:30.971817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:30.977960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:30.977960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:30.977960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:30.977960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:30.996988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:31.001157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:31.002711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:31.041840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] Creating event network-changed:5df0a538-3913-4fd6-bf1a-adc6f1591843 for instance 30ec1b84-dd44-45f7-8df2-b125893849ae on n-h2-855649-4 Nov 02 12:16:31.059938 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-46b5b1b9-b965-421c-8459-4cfd36adece4 req-75886fdb-cb2c-4efe-aa21-3be38f587abd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117066 Nov 02 12:16:31.064486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2513/5045] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:31.539977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:31.541064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:31.557374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:31.557876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:31.558323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:31.559080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:31.562717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:31.563294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:34.073494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:34.083007 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7c759a5-e9bc-4ffe-929d-0e0e40aa1e9e tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 3.165050 Nov 02 12:16:34.091779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2533/5046] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:30 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 3175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:34.107692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:34.111876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:34.123601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:34.124727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:34.125502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:34.126557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:34.128204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:34.128859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:34.403814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:34.421933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:34.426020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:34.428645 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ff67ea6-f3e7-4be0-8dc0-2bef23cb3da2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1890 microversion: 2.42 time: 2.893175 Nov 02 12:16:34.429248 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2514/5047] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:31 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1890 bytes in 2896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:34.436493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "9f57b110-70cf-4553-8955-22f352485443"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:34.449793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:34.450424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:34.451156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:34.465385 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] Creating event network-changed:9f57b110-70cf-4553-8955-22f352485443 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:34.488464 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-83ded19f-d949-4343-8181-511654b59cd2 req-7089fd64-ac6c-44bc-8444-e698eea77970 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056020 Nov 02 12:16:34.488573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2515/5048] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:34.494393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "386711e8-b84b-41b6-8852-b468bb24a704"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:34.511279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:34.512072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:34.512728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:34.542817 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] Creating event network-changed:386711e8-b84b-41b6-8852-b468bb24a704 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:34.549883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-972bd3ec-5aac-488e-bdac-a09d61b1e965 req-e2923d6c-cc0d-4c54-be12-dcd20104fa0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059559 Nov 02 12:16:34.553627 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2516/5049] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:35.111956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:35.112897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:35.124804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:35.125781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:35.126450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:35.127604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:35.128306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:35.128903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:35.374545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:35.387984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ea0b4df8-c2f2-482f-8ed7-1848c822b52f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 1.291881 Nov 02 12:16:35.411633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2534/5050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:34 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:35.465374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:35.466144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:35.493086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:35.493740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:35.494177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:35.495159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:35.495784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:35.496373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.461405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:36.479436 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d45b33d-2e59-4f5c-a367-0f0dca23ff67 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.372172 Nov 02 12:16:36.480831 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2517/5051] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:35 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:36.488902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e462325-4ba0-45f5-afde-224648670b44", "name": "network-vif-plugged", "status": "completed", "tag": "afbd0c4f-1364-40e8-8c06-76e5f3df517c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:36.501139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:36.501877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:36.503191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.518053 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] Creating event network-vif-plugged:afbd0c4f-1364-40e8-8c06-76e5f3df517c for instance 1e462325-4ba0-45f5-afde-224648670b44 on n-h1-855649-4 Nov 02 12:16:36.549925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8741cb89-45cb-43aa-b31e-5ae6c7e96068 req-b3f9cf57-666b-4529-8798-47a146541a2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067492 Nov 02 12:16:36.554920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2518/5052] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:36.565999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:36.567092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:36.580502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:36.581318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:36.581726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.582841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:36.585250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:36.586301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.745217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:36.745217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:36.745217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:36.745217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-724f2e6f-9862-4ac4-bb32-fcdf024e127c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1890 microversion: 2.42 time: 1.279136 Nov 02 12:16:36.753909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2535/5053] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:35 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1890 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:36.766438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414e9d8e-a439-42be-aef7-19ffb6cc4689", "tag": "75b5d561-b0ee-4ea0-aaab-9cd79ae6f965"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:36.782744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:36.783806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:36.784419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.801539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] Creating event network-changed:75b5d561-b0ee-4ea0-aaab-9cd79ae6f965 for instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 on n-h2-855649-4 Nov 02 12:16:36.808175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-797d37d9-b257-4912-9514-21046aee10a2 req-5210e55a-ae94-4cb8-9413-5246cf0814a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050983 Nov 02 12:16:36.809317 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2536/5054] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:36.823202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "7589d967-ecb9-4345-901d-65564cbc7e37"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:36.832151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:36.832649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:36.833084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:36.846319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] Creating event network-changed:7589d967-ecb9-4345-901d-65564cbc7e37 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:36.853691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-278ae3fd-20ef-4618-ae95-c141bfccbcfb req-49a2977a-b759-4a21-8f46-4379b0be1728 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042510 Nov 02 12:16:36.855680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2537/5055] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:37.160419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:37.182744 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b587f011-3453-4eca-92e0-eec5e181f9ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 0.622965 Nov 02 12:16:37.182744 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2519/5056] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:36 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:37.513134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:37.515374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:37.524130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=48 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:37.529835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.530347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.531157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.532391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.532864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.533339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.789627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:37.790920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:37.798340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.798925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.799400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.800358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:37.801301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:37.801910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:37.838415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:37.849011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b651456f-eb80-46a7-80b9-cc13fbc517b1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 0.341319 Nov 02 12:16:37.850237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2538/5057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:37 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:38.205310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:38.206167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:38.213210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:38.213979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:38.214659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:38.215561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:38.216279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:38.216872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:38.616257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:38.626729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:38.628498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:38.629687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9183d7b7-d2b9-4e43-b6e0-6b34e2d79f5d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.845052 Nov 02 12:16:38.630320 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2520/5058] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:37 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:38.875946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:38.876827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:38.887343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:38.887858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:38.889438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:38.890365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:38.891095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:38.895455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:39.285362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:39.298864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb0b374e-9a1c-48b4-bb45-74f45cbde7dd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1321 microversion: 2.1 time: 1.097906 Nov 02 12:16:39.301819 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2539/5059] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:38 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1321 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:39.312039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "49cddf13-43ca-43b7-a525-e11d50847a9b"}, {"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "0c74965c-575d-4fb0-a7e7-e737f0d386d4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:39.326851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:39.327406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:39.327847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:39.341860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Creating event network-changed:49cddf13-43ca-43b7-a525-e11d50847a9b for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:39.342364 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] Creating event network-changed:0c74965c-575d-4fb0-a7e7-e737f0d386d4 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:16:39.347352 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f98ad47b-2272-41f8-b1e8-7f4a968cf0c6 req-19d130c9-f829-435b-abc5-d1998606407b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042868 Nov 02 12:16:39.347961 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2540/5060] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:39.659795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:39.660402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:39.668370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:39.668870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:39.669325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:39.670045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:39.670513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:39.670936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:40.149927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:40.173895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f0b9bcd-b11f-48b6-9606-c3d549d0e87c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1505 microversion: 2.1 time: 1.303271 Nov 02 12:16:40.175722 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2521/5061] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:38 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1505 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:40.307165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:40.326292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:40.327310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:40.331089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:40.335680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:40.337179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e673b8c2-a94c-4017-97ea-b4bbc7dd146b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.682756 Nov 02 12:16:40.339824 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2541/5062] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:39 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:40.340696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:40.341263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:40.341801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:40.342554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:40.343140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:40.343615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:40.748546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:40.764580 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-198d2b7a-dda5-4110-9a6a-882d9f75cbfc tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1512 microversion: 2.1 time: 0.442704 Nov 02 12:16:40.766827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2522/5063] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:40 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:40.788378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:40.789325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:40.796869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:40.797667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:40.798275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:40.799352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:40.800013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:40.800502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.187537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:41.198302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d98e642-52e1-4fb0-a292-62997bee2aff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1321 microversion: 2.1 time: 0.413916 Nov 02 12:16:41.200143 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2542/5064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:40 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:41.207145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:41.208441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:41.213111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:41.222673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:41.223131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:41.223790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.225145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:41.225620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:41.226062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.372450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:41.373731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:41.380299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:41.381527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:41.382230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.384233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:41.394628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:41.394628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.395289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:41.403961 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07373ea0-c411-4f00-934f-10609384d221 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1505 microversion: 2.1 time: 0.206346 Nov 02 12:16:41.404810 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2523/5065] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:41 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:41.602226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:41.612181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:41.614238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:41.615236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2217d76-47e4-42fc-9c03-1065ad840a8b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.247006 Nov 02 12:16:41.616010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2543/5066] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:41 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:41.799546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ec1b84-dd44-45f7-8df2-b125893849ae", "name": "network-vif-plugged", "status": "completed", "tag": "5df0a538-3913-4fd6-bf1a-adc6f1591843"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:41.810879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:41.811545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:41.812006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:41.824614 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] Creating event network-vif-plugged:5df0a538-3913-4fd6-bf1a-adc6f1591843 for instance 30ec1b84-dd44-45f7-8df2-b125893849ae on n-h2-855649-4 Nov 02 12:16:41.829629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-95159abc-b7cd-4f79-971e-7dce8c32c2a4 req-b9e4a1a5-3121-4c22-8aed-03c868177414 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034156 Nov 02 12:16:41.830232 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2524/5067] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:42.229720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:42.230348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:42.237715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.238203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.238736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.239504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.241163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.242543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.433587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:42.434965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:42.443465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.444512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.445192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.446139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.446766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.447418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.451167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:42.459958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf41fee8-9621-4da6-852e-7ccd73987512 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1321 microversion: 2.1 time: 0.234441 Nov 02 12:16:42.461526 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2544/5068] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:42 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:42.609433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:42.618733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8570ff41-185c-4566-9a7a-60b722403e13 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1505 microversion: 2.1 time: 0.192158 Nov 02 12:16:42.619511 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2525/5069] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:42 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:42.645914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:42.647223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:42.653633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.654138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.654582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.655336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:42.655799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:42.656232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:42.885111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:42.910153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:42.918434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:42.921600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c311dbb4-ce10-4c9e-810b-af31402d5add tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.279881 Nov 02 12:16:42.926881 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2545/5070] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:42 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:43.485892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:43.486604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:43.511532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:43.515270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:43.515910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:43.516757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:43.518652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:43.521619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:43.670755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:43.674722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:43.719314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:43.720036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:43.720700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:43.738909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:43.742821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:43.743646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:44.679533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:44.697158 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-643d7bce-0e48-40e4-8520-2d0242eed622 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1321 microversion: 2.1 time: 1.216856 Nov 02 12:16:44.717080 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2526/5071] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:43 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1321 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:44.725926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:44.726558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:44.733103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:44.734594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:44.735262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:44.736170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:44.737079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:44.738098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:44.970785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:44.985458 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4da45f1-3ba5-4a53-99a0-25cbc36cba38 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 200 len: 1508 microversion: 2.1 time: 1.346473 Nov 02 12:16:44.986445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2546/5072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:43 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 1508 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:45.223613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cef9b9-bace-47ff-908b-b162756c5dcd", "name": "network-vif-unplugged", "status": "completed", "tag": "912d05e1-e856-407b-936d-cf9568526fae"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:45.241327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:45.252656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.253184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.256674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.266558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:45.266558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:45.267865 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cb14eb6-9c00-4699-aa55-997de91e5686 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.548887 Nov 02 12:16:45.272076 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2527/5073] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:44 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:45.277963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:45.279049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:45.286506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.287511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.288226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.289308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.290078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.290748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.300573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_external_events [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] Unable to find a host for instance b8cef9b9-bace-47ff-908b-b162756c5dcd. Dropping event network-vif-unplugged {{(pid=127567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:16:45.301506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e3059fc1-d0cb-4a37-ad0c-7d2abb56941e req-ddca58f9-0bbf-4620-979d-82ecc62c2080 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.313821 Nov 02 12:16:45.303247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2547/5074] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 316 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:16:45.544887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:45.555551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94c15072-2756-40ea-8250-104486d83e27 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.281590 Nov 02 12:16:45.567980 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2528/5075] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:45 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:45.590536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:45.591269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:45.599649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.600456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.601333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.602281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.602943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.603824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.727068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:45.727847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:45.736324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.737577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.738727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:45.740907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:45.741820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:45.744632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.111066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:46.126787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d17662cd-6a8a-45d8-b7a7-f1ca5fd26ba0 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.541054 Nov 02 12:16:46.130627 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2548/5076] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:45 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:46.162884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:46.181371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3639bd7a-7aad-45d7-a8d9-0dad7d55d936 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1321 microversion: 2.1 time: 0.460262 Nov 02 12:16:46.199139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2529/5077] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:45 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:46.207831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:46.209177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:46.222990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.226205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.226205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.227420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.228386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.229283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.240514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Calling method '.version_select at 0x7ff1b2c359d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:46.247921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.253853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.254886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.279496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.280201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.283699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.303039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.304157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.305120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.317192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96025c98-c3f5-4af7-85a9-a986f9e27e0c tempest-PortsAdminExtendedAttrsTestJSON-1384859557 tempest-PortsAdminExtendedAttrsTestJSON-1384859557-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.188040 Nov 02 12:16:46.318727 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2549/5078] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:16:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:46.326460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:46.327417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:46.338716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.339255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.339703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.340447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:46.340920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:46.341353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:46.359525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:46.939171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:46.965979 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56d21cac-fb88-48e9-9bff-78dec3e99181 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.777924 Nov 02 12:16:46.971640 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2530/5079] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:46 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:46.995653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:47.014147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:47.015008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:47.017404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:47.022500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:47.024759 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b906072-4999-4b6f-86a5-158d0afb3374 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.704297 Nov 02 12:16:47.026030 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2550/5080] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:46 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:47.035396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.036648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.037699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.039371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.040489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.041562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.225532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:47.227727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:47.238883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.240200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.240861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.242165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.242959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.243765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.463965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:47.468971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:47.483272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f695d2e5-5e50-47cf-aec0-09f3c984bccc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.480329 Nov 02 12:16:47.488647 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2531/5081] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:47 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:47.495203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414e9d8e-a439-42be-aef7-19ffb6cc4689", "name": "network-vif-plugged", "status": "completed", "tag": "75b5d561-b0ee-4ea0-aaab-9cd79ae6f965"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:47.509243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.510784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.511440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.526575 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] Creating event network-vif-plugged:75b5d561-b0ee-4ea0-aaab-9cd79ae6f965 for instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 on n-h2-855649-4 Nov 02 12:16:47.532082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-081b72b4-de29-4e3b-b0f9-b9fa8a28f112 req-5484bc0d-f252-4c29-a53e-bed44ecc1d99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041719 Nov 02 12:16:47.532756 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2532/5082] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:47.540400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:47.548008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.548859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.549590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.580147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:16:47.580392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:47.601797 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46f41a5d-d707-425b-acd6-cce6cf909d50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1511 microversion: 2.1 time: 0.382770 Nov 02 12:16:47.621417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2551/5083] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:47 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:47.650827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:47.651487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:47.658617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.659189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.659645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.660378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.660843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.661404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.878012 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f80d7dc-3598-4d5c-811c-cc8a42d64ac3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.343440 Nov 02 12:16:47.882749 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2533/5084] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:16:47 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:16:47.891360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:47.895886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:47.912752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.916055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.916771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:47.919536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:47.920009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:47.920268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:48.009065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:48.028333 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d42f57c8-554b-43e1-925a-b5e2a50719c7 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1321 microversion: 2.1 time: 0.380815 Nov 02 12:16:48.040759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2552/5085] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:47 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:48.081903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:48.083026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:48.097082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:48.097593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:48.098045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:48.098874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:48.099853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:48.100378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:48.416462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:48.425935 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c1be9ad-3dea-43f8-a910-daf04051a396 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.538481 Nov 02 12:16:48.444075 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2534/5086] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:47 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:48.525756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:48.539984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:48.542091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:48.543499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82d267b6-0249-4e7e-88d2-e04a01965e46 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.472347 Nov 02 12:16:48.544190 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2553/5087] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:48 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:49.072995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:49.074022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:49.081419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.081922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.082368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:49.083133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.084462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.085146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:49.358158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:49.387984 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-037c28c2-aa73-45cd-a28b-954943187980 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1321 microversion: 2.1 time: 0.319541 Nov 02 12:16:49.388975 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2535/5088] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:49 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:49.454819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:49.455627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:49.487771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.487771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.487771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:49.495729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.497057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.497810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:49.576739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:49.577415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:49.587330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.588310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.588997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:49.590115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:49.592573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:49.593343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:50.179342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.190508 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d8989b7-4178-4e07-8103-518bddbfa924 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.740362 Nov 02 12:16:50.191816 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2554/5089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:49 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:50.231086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.241659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.243114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.244307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0933110-efe6-47df-9f5e-e100317fa58c tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.676825 Nov 02 12:16:50.245384 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2536/5090] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:49 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:50.414683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:50.415352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:50.429142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:50.431092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:50.432483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:50.436603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:50.437475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:50.439481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:50.801882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.812252 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02947f83-3c5f-4362-8fb1-99d75ff7d257 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1511 microversion: 2.1 time: 0.403383 Nov 02 12:16:50.826381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2555/5091] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:50 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:50.882734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:50.906325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:50.909082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:50.938764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:50.939985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:50.941052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:50.942607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:50.946207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:50.947294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.199046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:51.223328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:51.227324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:51.261760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.261760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.261760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.266315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.270193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.271233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.462923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:51.490849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.494157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.497391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.861888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:51.873282 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97adc104-57d9-4f55-8325-2a411e43d686 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.656637 Nov 02 12:16:51.873964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2556/5092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:51 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:51.878968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:51.879737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:51.886646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.887190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.887640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.888363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.889000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.889443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.900606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8278d852-b6dc-43b4-ade7-50cc1805fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.033905 Nov 02 12:16:51.901569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2537/5093] 10.222.0.48 () {58 vars in 1167 bytes} [Wed Nov 2 12:16:50 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:51.928702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:51.934576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:51.935713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1596236187', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:51.942448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.943909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.947392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:51.947392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:51.947392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:51.947392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.060036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:52.143450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.147462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.147949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.148389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.360026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.373001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.377977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.377977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-475e7bd4-a8ba-4981-81ea-0319876d4e74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.500679 Nov 02 12:16:52.377977 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2557/5094] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:51 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:52.435035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c714fc86-456b-43d2-84b5-f0442b0c6608 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1596236187" status: 200 len: 1514 microversion: 2.1 time: 0.510354 Nov 02 12:16:52.437580 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2538/5095] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:16:51 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1596236187 => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:52.463600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:52.469399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.470467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:52.476562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.481496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.482379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.483373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.496701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.496701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.603338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:52.682254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:52.701998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.715138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.716260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.907382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:52.908048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:52.931803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:52.982061 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf76632b-9908-479d-be6c-8946c5991f94 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.523695 Nov 02 12:16:52.982681 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2558/5096] 10.222.0.48 () {58 vars in 1173 bytes} [Wed Nov 2 12:16:52 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:53.014438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.022195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.022943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:16:53.025470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.033723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.034432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.035201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.037588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.038283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.038917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.081559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.090385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.090881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.091359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.217655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.227435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c025716c-2254-4333-a354-1b161abd3d63 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.324196 Nov 02 12:16:53.258815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2539/5097] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:52 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:53.289502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d2f0a83-2e29-4786-8c7b-d918c1e7cd39 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.279090 Nov 02 12:16:53.290424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2559/5098] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:53.316715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.322193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.323016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.328644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.329139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.329643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.330374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.331014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.331311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.364298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:53.400751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-901efaee-5e70-473b-aba9-906d7626a5b8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.088738 Nov 02 12:16:53.401626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2540/5099] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:53.404606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.405384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:53.414548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.415134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.415732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.416045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.416770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.417807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.418221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.421205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.421807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.servers [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Removing options 'limit' from query {{(pid=127568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:16:53.422497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.432485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.433007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.434200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.434200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.434699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.435216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.467145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:53.519917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0db54f48-8d3c-4929-a1b9-e95b175ed604 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.108190 Nov 02 12:16:53.529929 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2541/5100] 10.222.0.48 () {58 vars in 1150 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:53.535944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.541569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.542338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.549184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.549743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.550245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.551104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.551761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.552485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.591975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:53.652198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f761212-d2de-4b14-bac0-7818a9b4d061 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.120065 Nov 02 12:16:53.663042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2542/5101] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers => generated 1012 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:53.674902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.680405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.681186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.698503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.699004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.699461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.700191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.700642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.701164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.713184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.731453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.733271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.744325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-857d30f8-f290-4269-8022-4226cde23088 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.335092 Nov 02 12:16:53.747836 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2560/5102] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:53.827973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:53.898620 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abb4d372-b50d-4f76-805b-b4596b74eb49 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.235149 Nov 02 12:16:53.909071 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2543/5103] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:16:53.915571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:53.921104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:53.923629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.servers [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Removing options 'limit' from query {{(pid=127567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:16:53.924406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:53.934493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.935491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.936181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.937201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:53.937948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:53.938870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:53.980057 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15582638-a757-4ad6-a146-c4ba78346cbb tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.069425 Nov 02 12:16:53.983627 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2561/5104] 10.222.0.48 () {58 vars in 1140 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:53.995544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:54.000683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:54.001429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1596236187', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:16:54.008158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.008559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.009066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.011078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.011078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.011078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.125949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:16:54.197970 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78e2dfc0-1ea2-4511-8712-6bcc3772fc47 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1596236187" status: 200 len: 346 microversion: 2.1 time: 0.206694 Nov 02 12:16:54.198921 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2544/5105] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 12:16:53 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1596236187 => generated 346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:16:54.217196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:16:54.228548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.229051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.229777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.258299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:54.259304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:54.269366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:16:54.278379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.279846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.281387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.284007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.288150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.288845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.293287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:54.487282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:54.496175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d079888c-4cb5-4e7d-8327-1d1de3da41a5 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.244767 Nov 02 12:16:54.497298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2545/5106] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:54 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:54.568261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5310b9d-cf83-48e2-bfeb-f58817c043a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "POST /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae/action" status: 202 len: 0 microversion: 2.1 time: 0.359102 Nov 02 12:16:54.569327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2562/5107] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:16:54 2022] POST /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:16:54.578683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:54.579344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:54.596424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.599658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.599658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.601485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.602356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.603187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.768672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:54.768672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:54.776806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.777231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.777940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:54.778766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:54.779311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:54.779871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:55.117958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:55.132332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8c7c94d-3ff3-45e5-9759-82273ab17311 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.557451 Nov 02 12:16:55.136825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2546/5108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:54 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:55.211235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:55.221382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:55.222904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:55.224161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2af8d836-1141-4418-8747-2ed31fdbb6e1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.461452 Nov 02 12:16:55.224935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2563/5109] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:54 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:55.522015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:55.522632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:55.528798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:55.529279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:55.529731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:55.530460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:55.530889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:55.531335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:55.781410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:55.793008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a66669a-9ff3-4903-9920-7cd82b31ff48 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.275808 Nov 02 12:16:55.812492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2547/5110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:55 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:56.157048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:56.160258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:56.168214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.168964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.169408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:56.170117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.170577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.171088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:56.254178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:56.254806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:56.263134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.264185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.264646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:56.265609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.266067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.266502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:56.465491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:56.476035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f968c672-2461-4552-9120-66771a082abd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.321235 Nov 02 12:16:56.482584 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2564/5111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:56 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:56.539988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:56.548557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:56.553748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:56.555006 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad02bf8f-ff01-406f-9e9c-7ccae191a0f1 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.306185 Nov 02 12:16:56.555564 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2548/5112] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:56 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:16:56.821009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:56.821946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:56.828287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.828789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.829220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:56.832030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:56.832030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:56.832030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:57.060395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:57.070113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c6c809d-a340-4fc2-9d07-d98eddd173aa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.253594 Nov 02 12:16:57.077348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2565/5113] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:56 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:57.500199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:57.501553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:57.510081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:57.510821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:57.511509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:57.512422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:57.513118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:57.513931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:57.584155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:57.585466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:57.593703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:57.594588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:57.595064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:57.595991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:57.596695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:57.597294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:57.603426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:57.836047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:57.848833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a90757db-432e-4eb1-9ad1-cd11603db575 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.352843 Nov 02 12:16:57.850752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2549/5114] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:57 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:58.094322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:58.094948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:58.107310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.107423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.107875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:58.108615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.109085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.109525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:58.372635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:58.382908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:58.384604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:58.385767 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d43fd755-52b9-47e7-b8e6-05b8c6fbc894 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.806536 Nov 02 12:16:58.386332 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2566/5115] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:57 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:16:58.408149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:58.408670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:58.415291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.415787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.416227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:58.417182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.417804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.419038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:58.467757 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72700c7c-f0a2-4965-bae9-00305626d26d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/ips" status: 200 len: 151 microversion: 2.20 time: 0.067392 Nov 02 12:16:58.472072 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2567/5116] 10.222.0.48 () {60 vars in 1289 bytes} [Wed Nov 2 12:16:58 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/ips => generated 151 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:16:58.546549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:58.558353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e1eecc5-e130-4f7a-8c2f-16b5b945132b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1679 microversion: 2.1 time: 0.468489 Nov 02 12:16:58.563068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2550/5117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:58 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:16:58.873269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:58.874562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:58.909098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.909617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.910071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:58.910807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:58.912237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:58.912379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:59.374771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:16:59.379685 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d7c4bd3-fd76-438d-9e49-6aa8380b453a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.510796 Nov 02 12:16:59.380894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2568/5118] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:58 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:16:59.419120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:59.419893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:59.429086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:59.431593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:59.431593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:59.431593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:59.433474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:59.434483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:59.588671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:16:59.589298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:16:59.604636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:59.606774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:59.615670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:16:59.617761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:16:59.621330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:16:59.621330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.016526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.024434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.027264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.028780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.030090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c5f2d1c-ce08-496a-8d5b-0fedb3f3a0cd tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.617241 Nov 02 12:17:00.030747 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2551/5119] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:16:59 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:00.033578 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fab355a0-5844-4e73-8dc8-85f41df9374c tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1656 microversion: 2.1 time: 0.448337 Nov 02 12:17:00.033802 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2569/5120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:16:59 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1656 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:00.057093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:00.063906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:00.065348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:00.065793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.090851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:17:00.341806 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d95adb23-0a72-4765-a061-831138ccf5dc tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.288342 Nov 02 12:17:00.342576 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2552/5121] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:17:00 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:17:00.356763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:00.361257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:00.370892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:00.371606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:00.373692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.374552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:00.375159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:00.375690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.410707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:00.412638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:00.425852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:00.428050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:00.429174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.431401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:00.436871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:00.436871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:00.641167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.653151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9b9bede-d7a0-4637-8e53-6b1eeefbc5f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1665 microversion: 2.1 time: 0.305955 Nov 02 12:17:00.654909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2570/5122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:00 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1665 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:00.833955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:00.853260 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-843fba2b-d2cb-4404-9cb8-2a85f85099fd tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.443843 Nov 02 12:17:00.853260 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2553/5123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:00 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:01.073083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:01.073696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:01.089365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.091600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.093590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.095274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.095932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.097188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.608373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:01.621431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:01.623690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:01.635174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af05cdf4-e71c-48c0-95c9-2d662812a604 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.557683 Nov 02 12:17:01.643035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2571/5124] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:01 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:01.681892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:01.682458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:01.690609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.691472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.692198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.693364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.694195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.694746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.869658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:01.876033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:01.876959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:01.878811 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1805d4d6-aaf9-4b70-a6f4-0db716a7b4ab tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1665 microversion: 2.1 time: 0.201385 Nov 02 12:17:01.893156 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2554/5125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:01 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:01.893363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:02.052809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:02.070839 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-caaae139-5299-4325-9a3d-eb1a6575e6fe tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.194131 Nov 02 12:17:02.070839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2572/5126] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:01 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:02.238771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:02.239938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:02.245631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:02.252140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:02.253496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:02.254076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:02.255835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:02.256082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:02.256715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:02.301522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lazy-loading 'flavor' on Instance uuid 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:02.654229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:02.655817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:02.663514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:02.664390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:02.668980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:02.670015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:02.670832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:02.671527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.018105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ae141c7-9b72-4933-a3e6-fb5b09724caa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/action" status: 202 len: 0 microversion: 2.20 time: 0.787589 Nov 02 12:17:03.019810 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2555/5127] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:17:02 2022] POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:03.028137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.028983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.040363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.041205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.041979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.042935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.043576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.044229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.082479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:03.158147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.168958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.170747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.172000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da8338d9-a78b-4c22-97e0-bd59bd1b5f31 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.522011 Nov 02 12:17:03.172647 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2573/5128] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:02 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:03.206951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.208173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.224929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.225711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.226808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.227666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.228493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.229068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.266385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.281951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-598eb74f-60c4-4a66-81b1-0043312c5982 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.260545 Nov 02 12:17:03.291131 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2556/5129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:03.306430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.307428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.326488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.327326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.327957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.328854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.329426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.329865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.498505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.515953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.522737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.536625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b292303-3acc-4ed5-a864-60a3132971ad tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.339804 Nov 02 12:17:03.536625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2574/5130] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:03.544178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.544810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.569201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.569710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.570318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.571267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.571851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.572297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.640157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.651956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c952b0f-906e-4f7e-8558-1532823ba975 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.365201 Nov 02 12:17:03.653323 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2557/5131] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:03.812959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:03.825110 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5489b1c9-2830-4115-97e6-1c4c4599c518 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.292021 Nov 02 12:17:03.826127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2575/5132] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:03.854542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:03.865420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:03.865420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.865420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.865420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:03.866029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:03.866420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:03.866859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.034556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.037898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:04.038705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:04.050316 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e09c7455-3fcd-41bb-afb8-a631f31c5f87 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.198466 Nov 02 12:17:04.055600 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2558/5133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:03 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:04.077348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.078108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.081998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:04.087076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.089212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.089212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.090011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.090842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.091815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.204530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.206538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.225913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.227129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.227129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.232465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.234609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.235151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.405318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.419336 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67f372ab-995c-45d3-8ebf-4c8629359364 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.344673 Nov 02 12:17:04.420670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2576/5134] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:04.449153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.449837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.457456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.458712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.459219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.459945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.460409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.460842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.652767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.662924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.665216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.667100 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be4607d6-997b-41ac-92f7-03e1ba21cb32 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.467789 Nov 02 12:17:04.668624 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2559/5135] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:04.674815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.676149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.684184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.684998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.685630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.686728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.687491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.688115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.695414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.704628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b4677c5-a35e-4efb-87eb-5548ee1c4916 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.259560 Nov 02 12:17:04.705867 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2577/5136] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:04.711101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:04.711942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:04.718457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.719217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.719847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.720729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:04.721369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:04.721983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:04.973494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:04.989544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:05.011037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:05.011037 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94d93dea-b1af-40e3-b9cf-7722cdb58fb7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.322085 Nov 02 12:17:05.011037 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2560/5137] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:05.040480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:05.041140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:05.054577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:05.068918 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3007a594-544d-40d4-bc09-83c10be5ee54 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.360930 Nov 02 12:17:05.069514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2578/5138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:04 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:05.077281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.077907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.078362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.079277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.079804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.083235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.117951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lazy-loading 'flavor' on Instance uuid d8289f28-6ecb-49ba-8ff6-b2f4679a888f {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:05.532256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6faa316a-5c49-4720-8f9b-2dec652c447b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.500248 Nov 02 12:17:05.533229 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2561/5139] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:17:05 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:17:05.541748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:05.542361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:05.555308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.556154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.557058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.558963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.560024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.560770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.698168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:05.699085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:05.715836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.716347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.716804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.721772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:05.722580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:05.723234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:05.823217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:05.834080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce67c6cd-5e62-4032-93e5-c983efdc4db1 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1677 microversion: 2.1 time: 0.296121 Nov 02 12:17:05.851370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2579/5140] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:05 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1677 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:06.041262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:06.041262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:06.074476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.076067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.076555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:06.080351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.082350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.083602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:06.107051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.125072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.127869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.131667 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cbf0e05-2ce1-46b5-853d-5034f62a28aa tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.439425 Nov 02 12:17:06.132192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2562/5141] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:05 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:06.163433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:06.164070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:06.188568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.191822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.195208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:06.197373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.198543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.201028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:06.283958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.297329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.303481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.308267 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-953d4d51-2cf1-45c3-84e0-29a46dfa9c60 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.283743 Nov 02 12:17:06.308267 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2580/5142] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:06 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:06.438208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:06.448503 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f878270-dfdc-4727-986d-4d834fa78594 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.314386 Nov 02 12:17:06.463909 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2563/5143] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:06 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:06.859410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:06.860393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:06.877266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.880094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.881633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:06.884237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:06.885979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:06.887129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.133318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.142397 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a2e13aaa-bfe5-4871-8863-77757dbd6f7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1660 microversion: 2.1 time: 0.288080 Nov 02 12:17:07.143059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2581/5144] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:06 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1660 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:07.169994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:07.170271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:07.170710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:07.170828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:07.178701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.179089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.179223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.179543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.179978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.180421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.180686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.181135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.181744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.182293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.183089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.186167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.229108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:07.460123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.468383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.470411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.471925 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e494cedb-ea91-4bb2-a978-0f86b96575a8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.307934 Nov 02 12:17:07.472751 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2564/5145] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:07 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:07.477683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:07.478379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:07.484632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.485401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.486060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.486969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.487714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.488344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.516020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a826940-586f-4595-b5e7-711410ced872 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action" status: 202 len: 0 microversion: 2.1 time: 0.349644 Nov 02 12:17:07.516942 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2582/5146] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:17:07 2022] POST /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:17:07.525835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:07.527415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:07.535439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.536827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.537514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.538282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.538768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.539251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.769745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.783711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.787653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.796435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b4da5f1-5ba0-409d-b5ec-552e32e01ed2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.318065 Nov 02 12:17:07.800029 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2565/5147] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:07 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:07.805621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:07.806565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:07.832298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.833680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.833913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.835058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:07.835629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:07.836191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:07.900798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:07.911182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15019ebe-32c9-4190-9b52-356ecea4b8a1 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.390506 Nov 02 12:17:07.928270 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2583/5148] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:07 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:08.174488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:08.184907 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9162715-dfaf-48cc-8cd0-91f03371c0f6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1666 microversion: 2.1 time: 0.384827 Nov 02 12:17:08.206155 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2566/5149] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:07 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1666 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:08.501728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:08.504374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:08.525471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=98 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:08.537903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:08.540078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:08.542968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:08.548279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:08.548791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:08.549242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:08.570634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:08.612269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:08.615262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:08.616808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:08.646887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] Creating event network-vif-plugged:e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:08.653959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3b6e7e17-2964-4bcc-8a93-f7b3fb66bff7 req-8be9253b-3d97-4991-a775-62ca7054693b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087391 Nov 02 12:17:08.655813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2567/5150] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:08.832158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:08.833103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:08.845586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:08.846253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:08.846886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:08.847709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:08.848240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:08.848839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:09.218590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.241320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.252632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.254065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a35555c7-5d69-4784-8263-38efe6d93723 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.759053 Nov 02 12:17:09.258966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2584/5151] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:08 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:09.264227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:09.270633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:09.277109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:09.277958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:09.278703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:09.279820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:09.280483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:09.281140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:09.318120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.330092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.332455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.333141 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eba123ba-f73e-4b40-b3d5-9d61b7a3fcf4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.507285 Nov 02 12:17:09.350578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2568/5152] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:08 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:09.359185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:09.359185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:09.361396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:09.362762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:09.363281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:09.363720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:09.368584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:09.369229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:09.372504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:09.655119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.669960 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d62d80fb-eecd-435a-b230-8b274a0b802f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1666 microversion: 2.1 time: 0.326794 Nov 02 12:17:09.670679 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2569/5153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:09 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1666 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:09.719839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:09.729619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3babf34-bdf7-496f-b701-9b85a32030f3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.469262 Nov 02 12:17:09.730214 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2585/5154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:09 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:10.290685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:10.291610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:10.304694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.309136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.309849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.310765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.311417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.316074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.370286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:10.371214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:10.378183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.378653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.379120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.379817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.380297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.380744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.684134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.707750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.730292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.734043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.740057 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f4d1052-a4e7-4ff8-a868-1c06acaf6e96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.373986 Nov 02 12:17:10.763970 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2586/5155] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:10 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:10.765439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.770145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:10.773427 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eaa6fb8-fba1-4427-a3b5-4a914cc69626 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.488538 Nov 02 12:17:10.774071 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2570/5156] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:10 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:10.776188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:10.777215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:10.789349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.790741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.791768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.792830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.793436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:10.793692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.794566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.796307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:10.804661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.806555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.806555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:10.807011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:10.807663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:10.808301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:11.556187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:11.575144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:11.575323 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3577067f-2e79-4c47-970e-e6561a42af68 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.808300 Nov 02 12:17:11.575888 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2587/5157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:10 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:11.596334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab68804d-3868-4bb2-be3c-9e49790acc92 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.820395 Nov 02 12:17:11.596785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2571/5158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:10 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:11.598134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:11.598770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:11.609409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:11.769843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:11.770444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:11.777194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:11.777738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:11.778449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:11.779195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:11.779656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:11.780084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.017985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.026622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac25addf-5ddf-498e-807c-c147c61d393a tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1669 microversion: 2.1 time: 0.432320 Nov 02 12:17:12.027291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2588/5159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:11 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:12.049711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:12.050303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:12.060995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.061733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.062266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.063022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.064765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.065420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.104045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.113976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.115803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.117047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcb48556-ae09-4d04-8b38-db762e22e89c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.351327 Nov 02 12:17:12.127396 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2572/5160] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:11 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:12.127396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:12.127396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.138130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.173749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:12.181063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Working on deleting snapshot 24d040c8-a493-4aa4-be17-b9f63175036e from shelved instance... Nov 02 12:17:12.298871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.309822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.311558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.312756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4175266c-3da0-413e-8111-755248647f79 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.267500 Nov 02 12:17:12.313321 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2589/5161] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:12 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:12.633698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:12.635498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:12.652738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.653527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.657197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.657197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:12.657197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:12.657197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:12.845846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:12.856461 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e249fa3c-4eb0-408a-bd89-35c731205231 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.237679 Nov 02 12:17:12.874615 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2590/5162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:12 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:13.162431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:13.163196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:13.172508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.177048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.177048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.177048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.177048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.177048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.363405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.381554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.391471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.408078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8bee9e8e-9862-4675-bed7-01d8c629fac5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.247781 Nov 02 12:17:13.418197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2591/5163] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:13 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:13.435681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:13.436866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:13.452072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.454180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.455542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.456414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.457891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.458702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.719931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.735619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.737620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:13.739732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84ccf29b-a3c4-4b52-bbde-1dd4ae766f0e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.318509 Nov 02 12:17:13.742243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2592/5164] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:13 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:13.789286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:13.886027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:13.886508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.902037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.918249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Doing local delete in cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) {{(pid=127568) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 12:17:13.919090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:13.919890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:13.920964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:13.929995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 12:17:13.939303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] deallocate_for_instance() {{(pid=127568) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 12:17:14.175817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:14.194925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f0a25b3-aa0e-4136-9564-15a110a59651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.309061 Nov 02 12:17:14.194925 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2593/5165] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:13 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:14.437778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:14.439105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:14.452663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:14.453785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:14.454905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:14.456850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:14.464967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:14.466886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:14.921856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:14.945231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:14.947614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:14.953080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af81fd01-bf6a-46c1-9e80-2224ce0b6c88 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.520132 Nov 02 12:17:14.956176 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2594/5166] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:14 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:14.978796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:14.980633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:15.001759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:15.002752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:15.004236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:15.012010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:15.012010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:15.013763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:15.139620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Updating instance_info_cache with network_info: [] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:17:15.379087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:15.399677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:15.402803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:15.404374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2367d5b-17eb-4b7d-80de-ca8eae0fd091 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.446662 Nov 02 12:17:15.404946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2595/5167] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:14 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:15.671608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cef9b9-bace-47ff-908b-b162756c5dcd", "name": "network-vif-deleted", "tag": "912d05e1-e856-407b-936d-cf9568526fae"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:15.699504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:15.702172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:15.702800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:15.729292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_external_events [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] Unable to find a host for instance b8cef9b9-bace-47ff-908b-b162756c5dcd. Dropping event network-vif-deleted {{(pid=127567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:17:15.738793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d567e44a-153d-4e57-a1ec-8d1a0df3f5d5 req-63a11d37-bac5-4245-92a9-6363f4a06f31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.332565 Nov 02 12:17:15.741380 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2596/5168] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 336 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:17:15.754863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:15.755877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:15.764581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:15.765190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:15.765739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:15.766548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:15.767314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:15.768077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.090478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.103207 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a63c282-ee5a-4130-a573-4f0b978cac0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.359011 Nov 02 12:17:16.105274 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2597/5169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:15 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:16.118788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:16.119574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:16.132691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.133193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.133641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.134361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.134839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.139825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.309505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9904d1aa-107c-4ea1-b0ee-1a68dc762070 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 204 len: 0 microversion: 2.1 time: 4.190758 Nov 02 12:17:16.317268 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2573/5170] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:12 2022] DELETE /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 0 bytes in 4192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:16.326094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:16.326762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: b8cef9b9-bace-47ff-908b-b162756c5dcd] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:16.334667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.335191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.335652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.336366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.336822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.337263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.352547 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd HTTP/1.1 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'b8cef9b9-bace-47ff-908b-b162756c5dcd'} Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:16.354241 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 404 to user: Instance b8cef9b9-bace-47ff-908b-b162756c5dcd could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e662900c-2c0a-435a-8f41-00d6d4ab3cef tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd" status: 404 len: 111 microversion: 2.1 time: 0.034648 Nov 02 12:17:16.360652 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2574/5171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:16 2022] GET /compute/v2.1/servers/b8cef9b9-bace-47ff-908b-b162756c5dcd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:17:16.365405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:16.366008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:16.373389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.374108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.374580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.375915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.376340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.377133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.377747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.391111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.392848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.394032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91bf8adc-5975-4528-b6ad-38ea8128f82d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1744 microversion: 2.20 time: 0.286707 Nov 02 12:17:16.394610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2598/5172] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:16 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:16.421578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:16.437547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:16.438039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:16.448422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.449272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.449900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.450718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.451313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.451984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.471978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:16.809395 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff8fa8b4-72dc-4c84-9475-e171efb623b8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 204 len: 0 microversion: 2.1 time: 0.448387 Nov 02 12:17:16.810478 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2575/5173] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:16 2022] DELETE /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:17:16.821223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:16.822324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:16.829629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.830423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.831275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.832204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:16.832970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:16.833603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:16.859442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.869777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.872917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:16.875102 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06a51614-b9a2-4df7-b1c1-f726681d9c21 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.444339 Nov 02 12:17:16.876961 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2599/5174] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:16 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:17.134559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:17.135524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:17.147270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.151175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.152392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.154019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.155929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.160798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.196774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:17.205555 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69721e05-dc48-489b-9415-b2bdeaa32376 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1464 microversion: 2.1 time: 0.390058 Nov 02 12:17:17.215859 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2576/5175] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:16 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:17.423170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:17.424268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:17.441240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.448877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.448877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.448877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.448877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.448877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.582776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:17.596664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1be271fb-bcd9-465f-b7f0-9b11a1ac0ced tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.467846 Nov 02 12:17:17.612381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2600/5176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:17 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:17.612381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "9f57b110-70cf-4553-8955-22f352485443"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:17.645939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.646954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.653446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.675444 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] Creating event network-vif-plugged:9f57b110-70cf-4553-8955-22f352485443 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:17.682774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c9d10d1e-bc0b-4e11-9ec6-19d1a3cd69a9 req-96e9d7f9-319b-4d31-b2cd-c9a8b211f234 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083539 Nov 02 12:17:17.689005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2601/5177] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:17.913969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:17.922087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:17.933427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.935027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.935504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.936263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:17.936732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:17.937787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:17.939774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:17.953472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:17.956933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:17.960714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a2394e1-88d9-49b2-bcbd-c5505dc8cc4c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1744 microversion: 2.20 time: 0.542530 Nov 02 12:17:17.972020 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2577/5178] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:17 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1744 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:18.230824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:18.231487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:18.251082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:18.251672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:18.252563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:18.253112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:18.253770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:18.254446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:18.425331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:18.436209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34b38ac5-6594-4ee3-875e-a0e3ba24f783 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1464 microversion: 2.1 time: 0.209352 Nov 02 12:17:18.439937 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2578/5179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:18 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:18.461554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:18.478730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:18.480880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:18.484871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22cac743-04f3-4962-bd42-aaf84aa5e356 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.582639 Nov 02 12:17:18.487010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2602/5180] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:17 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:18.622815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:18.624771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:18.659223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:18.659889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:18.660455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:18.661447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:18.664740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:18.669785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:18.987447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:18.990278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:18.991632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:18.999031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:18.999888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-386fba4a-cc42-4e78-97e8-e580394e5288 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.380811 Nov 02 12:17:19.000332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:19.001183 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2579/5181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:18 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:19.015554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:19.016414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:19.016905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:19.027141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:19.463695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:19.465403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:19.483243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:19.483872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:19.484474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:19.485644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:19.486031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:19.487587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.024693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.034965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.036464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.038830 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bc2a9b0-301a-434f-adb1-9c3687e9dfcf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1744 microversion: 2.20 time: 1.052941 Nov 02 12:17:20.039473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2603/5182] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:18 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1744 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:20.060674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:20.061963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:20.071280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.071280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.071280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.071779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.072616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.072763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.073493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.090499 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-36be6f74-eddb-4e1b-95ea-8d9d319d4149 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1464 microversion: 2.1 time: 0.631659 Nov 02 12:17:20.094542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2580/5183] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:19 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1464 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:20.108916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "49cddf13-43ca-43b7-a525-e11d50847a9b"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "7589d967-ecb9-4345-901d-65564cbc7e37"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:20.129152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.130305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.131190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.150627 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Creating event network-vif-plugged:49cddf13-43ca-43b7-a525-e11d50847a9b for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:20.151253 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] Creating event network-vif-plugged:7589d967-ecb9-4345-901d-65564cbc7e37 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:20.158066 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-728d0bf1-d8cf-4dce-b6a0-1e5186f3d758 req-92bd13ae-356a-45aa-83cd-6a7f3a1ba308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061779 Nov 02 12:17:20.159258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2581/5184] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:20.166733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:20.167501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:20.175655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.176164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.176621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.177424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:20.178075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:20.178518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:20.743687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.760140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-290fa1d5-f705-47bd-9579-a84b2914971f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.599307 Nov 02 12:17:20.777875 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2582/5185] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:20 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:20.778127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.788261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.790116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:20.791630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97cbda54-0f12-44e8-bc8f-a5ab75c4011f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.751016 Nov 02 12:17:20.792552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2604/5186] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:20 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:21.072475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:21.073205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:21.090844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.097853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.098454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.100145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.103822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.107189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.122236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:21.122954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:21.143522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.149543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.150218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.151219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.151764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.152405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.540310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:21.563429 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15b238f5-de52-419a-8d1d-eabcd88d85ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1464 microversion: 2.1 time: 0.441907 Nov 02 12:17:21.564954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2605/5187] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:21 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1464 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:21.788804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:21.793862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:21.796281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:21.835387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.837482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.838139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.839810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.840541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:21.844007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.844732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.849473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:21.857006 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8e54c41-2fb1-47b7-866e-5609d61eb56b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1744 microversion: 2.20 time: 0.789319 Nov 02 12:17:21.857684 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2583/5188] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:21 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1744 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:21.875450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:21.875450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:21.875711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.891340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.910473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.910473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:21.910473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:21.910473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:21.990480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:22.518183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:22.534612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:22.541551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:22.544037 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d59afb00-6c7e-4819-8b5f-38950e5add1b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.682360 Nov 02 12:17:22.546410 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2584/5189] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:21 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:22.563453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6238c906-eb2c-48fb-9a6a-d0dc4996152b", "name": "network-vif-deleted", "tag": "f2984058-234b-4b36-98a1-5bff7c5f4546"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:22.583945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.587676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.588127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.620812 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] Creating event network-vif-deleted:f2984058-234b-4b36-98a1-5bff7c5f4546 for instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b on n-h2-855649-4 Nov 02 12:17:22.647324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:22.661307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-45173ece-1c47-408a-ac87-7ada25fbd276 req-efe79caa-89bc-4bad-82d4-4ef3deab0c9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109219 Nov 02 12:17:22.662681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2585/5190] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:22.668337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34b3b3e7-5ae3-460c-baa9-884359288484 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.885261 Nov 02 12:17:22.687972 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2606/5191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:21 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:22.698937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:22.699128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "7419a7c3-3bdf-4ff8-a405-c820499fee6c"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "386711e8-b84b-41b6-8852-b468bb24a704"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-plugged", "status": "completed", "tag": "0c74965c-575d-4fb0-a7e7-e737f0d386d4"}, {"server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "name": "network-vif-plugged", "status": "completed", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:22.710651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:22.723526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.730071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.730590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.731071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.731804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.732268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.732699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.736661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.737317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.779590 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Creating event network-vif-plugged:7419a7c3-3bdf-4ff8-a405-c820499fee6c for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:22.783768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Creating event network-vif-plugged:386711e8-b84b-41b6-8852-b468bb24a704 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:22.784465 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Creating event network-vif-plugged:0c74965c-575d-4fb0-a7e7-e737f0d386d4 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:22.785347 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] Creating event network-vif-plugged:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:17:22.831711 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4e06e9ff-f689-4549-a3de-9ebe819ab5c9 req-221e13ae-a188-4e9d-b6ff-2092b52857ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.167403 Nov 02 12:17:22.832508 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2586/5192] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:22.839235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.840955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.846942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.862806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lazy-loading 'fault' on Instance uuid 6238c906-eb2c-48fb-9a6a-d0dc4996152b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:22.894994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:22.895807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:22.909985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.915424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.915424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:22.915424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:22.915424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:22.915424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.008135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:23.023717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec2d5d1f-abec-4535-9740-df7e83663b44 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 200 len: 1304 microversion: 2.1 time: 0.333617 Nov 02 12:17:23.024352 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2607/5193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:22 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 1304 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:23.305995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:23.314659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:23.316600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:23.317935 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0676760-a17f-467f-a05d-cd9e73f047c4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.427501 Nov 02 12:17:23.318952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2587/5194] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:22 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:23.578577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:23.579425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:23.613048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.613958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.617696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.618635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.620733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.621477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.700977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:23.701732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:23.725323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.728189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.728952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:23.730014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:23.730648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:23.732651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.084163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.103793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.105499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.110622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.115864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe658d19-3520-4a90-8884-0fb18a8c9872 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.422722 Nov 02 12:17:24.118538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2588/5195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:23 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:24.122519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3437edf7-a0ae-4732-bfcc-d582f10f1644 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1878 microversion: 2.42 time: 0.548307 Nov 02 12:17:24.125748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.126693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 6238c906-eb2c-48fb-9a6a-d0dc4996152b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:24.137410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.138087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.138700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.139902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.141819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.143675 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2608/5196] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:23 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1878 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:24.149454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.208846 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b HTTP/1.1 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '6238c906-eb2c-48fb-9a6a-d0dc4996152b'} Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:24.217237 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 404 to user: Instance 6238c906-eb2c-48fb-9a6a-d0dc4996152b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de701608-b734-44b4-945b-f8771ebf34fa tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b" status: 404 len: 111 microversion: 2.1 time: 0.100341 Nov 02 12:17:24.228805 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2589/5197] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:24 2022] GET /compute/v2.1/servers/6238c906-eb2c-48fb-9a6a-d0dc4996152b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:24.238493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.240875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:24.253043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.253806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.254502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.259706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.259706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.259706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.301220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:24.364526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.365969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:24.378312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.381696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.382235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.383022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.386097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.386613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.606196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.621563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.623819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:24.625251 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d10d12d9-1cd0-41e8-98b8-19f7a0495807 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.269759 Nov 02 12:17:24.630338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2590/5198] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:24 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:24.856783 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1dd1e8ea-6a3f-4188-8076-bea9374f53c2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 204 len: 0 microversion: 2.1 time: 0.616611 Nov 02 12:17:24.868025 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2609/5199] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:24 2022] DELETE /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:24.876292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:24.876922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:24.902390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.902966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.903448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:24.910563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:24.911246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:24.916864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.143882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:25.145591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:25.164945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.169382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.171627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.174207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.175674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.183661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.267281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.294427 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2783ea7e-b983-4c29-8d3f-8976e2680850 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1507 microversion: 2.1 time: 0.417548 Nov 02 12:17:25.304580 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2591/5200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:24 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:25.311545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:25.312743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:25.327952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.334380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.335271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.336258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.336746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.337183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.632600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.652204 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3d763bd-f923-4a86-b332-ce8d50c0b53f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1521 microversion: 2.1 time: 0.512872 Nov 02 12:17:25.653482 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2610/5201] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:25 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:25.665557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:25.666804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:25.678296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.681739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.681739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.681739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.681739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.682933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.742858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.760599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.771960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:25.776457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-503851af-aaa9-4032-86ca-4c2315e688a0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2837 microversion: 2.42 time: 0.466959 Nov 02 12:17:25.778587 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2592/5202] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:25 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2837 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:25.819387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:25.820149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:25.835475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.838262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.839605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:25.840994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:25.851888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:25.855580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.223107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f95c5b7c-7be3-4b4b-ad0d-1068d2009bd0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.409475 Nov 02 12:17:26.226195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2593/5203] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:17:25 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9/os-interface => generated 1833 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:26.273270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:26.302412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:26.304463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:26.308449 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0519679d-3343-48c2-b412-0c84e791102e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.653562 Nov 02 12:17:26.309214 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2611/5204] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:25 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:26.344239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:26.346533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:26.358373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.374276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.377156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.382704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.383987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.384839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.681914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:26.682897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:26.697068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.709565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.713696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:26.717659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:26.721307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:26.724941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.323373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.340358 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07365620-3a07-4462-8ab8-f140868a22e3 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1507 microversion: 2.1 time: 1.010906 Nov 02 12:17:27.359523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2594/5205] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:26 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1507 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:27.372999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:27.373787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:27.386358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.388005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.391891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.392876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.393987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.397485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.812036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.826726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ccf9e40c-52f3-42c5-abd4-925425792d58 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1498 microversion: 2.1 time: 1.148675 Nov 02 12:17:27.827476 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2612/5206] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:26 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1498 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:27.859316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:27.864422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.871271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.872408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:27.876645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.882375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:27.887786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.888629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.890398 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81297d02-295c-40ba-bab5-03f545804232 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.521743 Nov 02 12:17:27.890562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:27.891468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:27.891922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:27.892274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2595/5207] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:27 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:27.897051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.081527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:28.167500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abdcf803-874c-4f38-b466-93dc30bd9387 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.312312 Nov 02 12:17:28.168725 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2613/5208] 10.222.0.48 () {58 vars in 1154 bytes} [Wed Nov 2 12:17:27 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:28.182094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:28.192141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.193753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.194469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.227404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:17:28.368348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:28.369113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:28.379663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.381731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.384088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.385687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.387595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.390698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.424268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:28.431010 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54ba149b-df72-4593-9d32-00fb22bf659e tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "POST /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae/action" status: 202 len: 0 microversion: 2.1 time: 0.253985 Nov 02 12:17:28.432792 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2596/5209] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:17:28 2022] POST /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:17:28.444391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:28.445398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:28.459607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.461271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.462516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:28.464108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:28.464776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:28.465390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:29.996247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:30.019118 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a01d9a75-b16c-449d-a01b-a49e0cd707ea tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1507 microversion: 2.1 time: 1.655454 Nov 02 12:17:30.222570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2614/5210] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:28 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1507 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:30.222570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:30.222570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:30.224311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:30.226154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:30.226154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:30.226154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:30.231681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f95047dc-734e-4dfd-a216-6a395628ddf2 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1507 microversion: 2.1 time: 1.642508 Nov 02 12:17:30.231681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2597/5211] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:28 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1507 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:30.232443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:30.232443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:30.232443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f67d36-cb5a-4803-9864-aab92876917b", "name": "network-vif-deleted", "tag": "00d99ae6-a067-4a12-a687-1d30c3914279"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] Creating event network-vif-deleted:00d99ae6-a067-4a12-a687-1d30c3914279 for instance a8f67d36-cb5a-4803-9864-aab92876917b on n-h2-855649-4 Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-59b7efc6-b3aa-4ab4-89f3-59ca361b44aa req-cb1831ed-bf43-4403-be6b-275630e08662 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069319 Nov 02 12:17:30.232843 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2598/5212] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:31.055799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:31.057425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:31.074771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:31.093261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.096477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.098498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.105057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:31.105338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.105466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:31.108015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-769cc171-ee26-4366-8280-13c9814ae3c5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 1.058444 Nov 02 12:17:31.108866 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2615/5213] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:30 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:31.111786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.112285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.116080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:31.116916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:31.126410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.127462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.128141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.129303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.133268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.133268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.238228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:31.238892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:31.246011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:31.247494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lazy-loading 'fault' on Instance uuid a8f67d36-cb5a-4803-9864-aab92876917b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:32.091622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:32.112697 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87299c1a-061d-4b8a-912b-f3b69a1bd7f8 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 200 len: 1305 microversion: 2.1 time: 1.063859 Nov 02 12:17:32.113670 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2599/5214] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:31 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 1305 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:32.131523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:32.154756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-deb754d7-b2d0-4e27-ad4e-19ca85d85d2c tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1507 microversion: 2.1 time: 1.043950 Nov 02 12:17:32.155460 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2616/5215] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:31 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1507 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:32.161814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:32.162758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:32.169756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:32.170440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:32.171046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:32.172757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:32.173484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:32.174594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.153639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:33.154213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: a8f67d36-cb5a-4803-9864-aab92876917b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:33.174351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.175669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.180435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.181430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.182436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.183079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.233970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b HTTP/1.1 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'a8f67d36-cb5a-4803-9864-aab92876917b'} Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:33.241654 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 404 to user: Instance a8f67d36-cb5a-4803-9864-aab92876917b could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:33.251977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2917296b-4b6f-489b-9100-dabf5e3d6089 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b" status: 404 len: 111 microversion: 2.1 time: 0.099083 Nov 02 12:17:33.260131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2617/5216] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:33 2022] GET /compute/v2.1/servers/a8f67d36-cb5a-4803-9864-aab92876917b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:33.274870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:33.283101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:33.311821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.315066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.315713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.325281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.326124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.326770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.420257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:33.448752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:33.450114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:33.451682 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb12987a-fd17-4e32-8b01-db8e77601f96 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 1.297431 Nov 02 12:17:33.452431 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2600/5217] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:32 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:33.485536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:33.489487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:33.541646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.548795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.554773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.554773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.554773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.554773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:33.613915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:33.742938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:33.891049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:33.916549 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ea9584c-c1d9-44b9-8383-91852d8d5651 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1507 microversion: 2.1 time: 0.649928 Nov 02 12:17:33.929770 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2618/5218] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:33 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1507 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:33.947700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "tag": "e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:33.982815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:33.984337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:33.985171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:34.012622 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] Creating event network-changed:e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:17:34.041315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-374c034e-7464-4b88-acfe-4b8db980bb40 req-48e8c7eb-bec6-4bab-9a8a-afd7110e388f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103292 Nov 02 12:17:34.044809 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2619/5219] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:34.184817 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e684c85e-54bf-423d-a8cc-207311c125d2 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 204 len: 0 microversion: 2.1 time: 0.709869 Nov 02 12:17:34.189945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2601/5220] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:33 2022] DELETE /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:34.219392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:34.227180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:34.257931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:34.259261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:34.260150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:34.265451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:34.267680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:34.275084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:34.490557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:34.491350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:34.516219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:34.521708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:34.524975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:34.526713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:34.529130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:34.531728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:35.411631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:35.441630 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f1ee4fc-cb54-4680-a4ab-e862e9160240 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1494 microversion: 2.1 time: 1.233047 Nov 02 12:17:35.441630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2620/5221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:34 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1494 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:35.444041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:35.444990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:35.461091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:35.462004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:35.462694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:35.467914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:35.468992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:35.469674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:35.634796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:35.647457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:35.649319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:35.651233 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61b1651c-943e-4a86-bb96-3076b0e0177c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 1.168613 Nov 02 12:17:35.667412 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2602/5222] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:34 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:36.397832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:36.412449 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73428b59-930e-4b02-8688-92a417847677 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1511 microversion: 2.1 time: 0.981680 Nov 02 12:17:36.427559 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2621/5223] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:35 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1511 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:36.449074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:36.455178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:36.455642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.servers [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Removing options 'limit' from query {{(pid=127568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 12:17:36.456581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:36.457818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.458372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.459472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:36.460482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.460957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.461707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:36.464546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90c52dcf-4b9e-4946-9b04-a8e3f549eb23 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025434 Nov 02 12:17:36.465902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2603/5224] 10.222.0.48 () {58 vars in 1140 bytes} [Wed Nov 2 12:17:36 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:17:36.479930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:36.481981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:36.491160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:36.491799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:36.498087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.498609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.499095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:36.500068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.500543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.500981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:36.508328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.508883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.510004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:36.510251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:36.510796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:36.511302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:37.289316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:37.342517 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b4e6496-129e-4c7b-9f06-6490b792e5a9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1511 microversion: 2.1 time: 0.865469 Nov 02 12:17:37.345302 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2622/5225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:36 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:37.365794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:37.370492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:37.394599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:37.402070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:37.404391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:37.405755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:37.407090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:37.408022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:37.458034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:37.472960 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5b7cdfa-7e28-4b41-9d9b-b9d67d11f487 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1494 microversion: 2.1 time: 0.988034 Nov 02 12:17:37.477802 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2604/5226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:36 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1494 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:37.491651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:37.492697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:37.515060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:37.516955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:37.520613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:37.523591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:37.525929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:37.529609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.005083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:38.097975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.113599 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a788b45c-001f-4c50-8b36-f2b5c5ecb2ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1511 microversion: 2.1 time: 0.633789 Nov 02 12:17:38.113858 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2605/5227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:37 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:38.144033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:38.144686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:38.190069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:38.191332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:38.195065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.197795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:38.200157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:38.201633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.285077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.312198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.319475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.322603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-130ec7ed-37a0-4c14-b7be-28bd97abde1e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.974764 Nov 02 12:17:38.328658 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2623/5228] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:37 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:38.336453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5436a9-0450-45b4-8a00-db0f6ff9f134", "name": "network-vif-deleted", "tag": "415972ad-4904-4f8b-bba9-60b574163136"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:38.361726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:38.365800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:38.366781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.397964 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] Creating event network-vif-deleted:415972ad-4904-4f8b-bba9-60b574163136 for instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 on n-h1-855649-4 Nov 02 12:17:38.409602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-850be09e-48ee-408a-b03b-b1dd2a2751fd req-0227a9a0-5fb0-4570-9841-cc613b9ef3c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079191 Nov 02 12:17:38.435631 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2624/5229] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:38.517747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:38.518488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:38.533536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:38.538822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:38.539623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.540758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:38.544100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:38.545004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:38.554589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.574895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50eca61c-fe38-46d8-944f-5de8764eb076 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1512 microversion: 2.1 time: 0.434946 Nov 02 12:17:38.576140 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2606/5230] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:38 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:38.598548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:38.607783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:38.608803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:39.312845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:39.326017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a2053c0-914b-4df3-b092-416ca379f6ec tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 200 len: 1287 microversion: 2.1 time: 0.818149 Nov 02 12:17:39.332649 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2625/5231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:38 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 1287 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:39.357131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:39.358158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:39.370899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.381797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.382816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:39.385224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.390230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.391081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:39.402661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.403573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.415744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:39.415744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.415744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.415744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:39.736092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:39.774708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:39.784156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:39.796299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:39.798103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7244819f-05f5-4b69-8b3a-4c0841e230e6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.445296 Nov 02 12:17:39.799224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2626/5232] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:39 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:39.883797 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43dc7b0e-80e2-4796-b6ec-1a306c91935a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 1.289531 Nov 02 12:17:39.892314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2607/5233] 10.222.0.48 () {58 vars in 1154 bytes} [Wed Nov 2 12:17:38 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:39.906647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:39.907306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:39.917483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:39.935195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.937243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.939543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:39.943333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:39.946144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:39.949892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.313356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:40.334210 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f0d2778-e0d7-4bea-b7ae-dd5b62a64251 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1511 microversion: 2.1 time: 0.431973 Nov 02 12:17:40.335188 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2627/5234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:39 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:40.356706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:40.357771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: 5a5436a9-0450-45b4-8a00-db0f6ff9f134] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:40.362140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:40.362763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:40.368305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:40.372440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.374488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.374953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.375706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.378328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.382461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.383135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.388271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.388582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.388679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.388679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.390723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.416335 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 HTTP/1.1 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '5a5436a9-0450-45b4-8a00-db0f6ff9f134'} Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:40.419747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. Nov 02 12:17:40.424363 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:40.426873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 404 to user: Instance 5a5436a9-0450-45b4-8a00-db0f6ff9f134 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:40.434328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-80042213-7933-4a91-bebc-972f656f229b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134" status: 404 len: 111 microversion: 2.1 time: 0.077303 Nov 02 12:17:40.434328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2608/5235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:40 2022] GET /compute/v2.1/servers/5a5436a9-0450-45b4-8a00-db0f6ff9f134 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:40.447372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:40.451787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:40.466288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.469385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.470209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.473153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.473654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.474661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.557714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:40.716143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:40.727831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31d5ac11-fd94-42ff-8f64-35d0e88c0a16 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1511 microversion: 2.1 time: 0.370260 Nov 02 12:17:40.728756 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2628/5236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:40 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:40.757474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:40.759227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:40.778081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.779599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.780288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:40.796391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:40.797363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:40.798014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.145335 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1d606e7-6471-4d6a-8b6a-b52dcce9160b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 204 len: 0 microversion: 2.1 time: 0.707876 Nov 02 12:17:41.150094 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2609/5237] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:40 2022] DELETE /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:41.160604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.176226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:41.178951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:41.180912 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf1cc556-cc79-4344-a47e-06f4360fafff tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1512 microversion: 2.1 time: 0.428164 Nov 02 12:17:41.193334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.204767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2629/5238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:40 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:41.204937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.204937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.205149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:41.205149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:41.205323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.205323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.205323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.235169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.235999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.236533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.237340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.246851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.248085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.746386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.761850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.768303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d2cc3b8-1518-4da0-91ac-41b9a935d2e6 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1675 microversion: 2.1 time: 0.572983 Nov 02 12:17:41.768916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2630/5239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:41 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1675 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:41.776824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:41.787610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.789635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.791183 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-702919cc-c1cc-48be-98c3-5e27d493644a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.637601 Nov 02 12:17:41.803474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2610/5240] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:41 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:41.815580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.817370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:41.826707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.827563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.831093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.831093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.831093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.831093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:41.876287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:41.966614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:41.984550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:41.986887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:41.988579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.243004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d822ca7-085a-45ec-9f59-b3f9e9393b50 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.469599 Nov 02 12:17:42.244803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2631/5241] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 12:17:41 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:42.275699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:42.311346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:42.315380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:42.453558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.454292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.462875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.464582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.469357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.469357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.525944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:42.607732 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d6ada8b-bd78-4658-af58-cb94bec21e0a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.336783 Nov 02 12:17:42.609335 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2611/5242] 10.222.0.48 () {58 vars in 1150 bytes} [Wed Nov 2 12:17:42 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:42.628894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:42.636522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:42.637685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:42.644444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.644444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.645167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.646022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.646546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.647534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.796928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:42.798017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:42.812342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.815221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.817357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.820561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:42.821072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:42.825306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:42.899051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:42.915224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:43.051141 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0d671b8-5feb-4fac-a911-e5d07ae24031 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.431369 Nov 02 12:17:43.052758 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2632/5243] 10.222.0.48 () {58 vars in 1212 bytes} [Wed Nov 2 12:17:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:43.059673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:43.061005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:43.073642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:43.074464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:43.075312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:43.078278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:43.079951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:43.080720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:43.539157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:43.556447 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ef939e2-d561-442f-ad13-058476d65c7b tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1675 microversion: 2.1 time: 0.763800 Nov 02 12:17:43.561360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2612/5244] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:42 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1675 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:43.580168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:43.585805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:43.597617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:43.600551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:43.601100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:43.606674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:43.612009 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bb2f517-6e27-49ab-8a06-d4d009262b4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.557053 Nov 02 12:17:43.614504 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2633/5245] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:43 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:43.622610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:43.623029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:43.623502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:43.625395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:43.625864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:43.628196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:43.834797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:44.022967 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ede663f-324e-4aaa-81a2-6ea2373324d9 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.458134 Nov 02 12:17:44.026253 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2613/5246] 10.222.0.48 () {58 vars in 1196 bytes} [Wed Nov 2 12:17:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:44.039517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:44.078260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:44.082587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': '1596236187', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:44.116888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.117388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.117831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.123607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.124134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.124579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.447543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:44.584178 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efc354a1-f3ec-47db-953c-81179dea9478 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=1596236187" status: 200 len: 346 microversion: 2.1 time: 0.548790 Nov 02 12:17:44.586293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2634/5247] 10.222.0.48 () {58 vars in 1156 bytes} [Wed Nov 2 12:17:44 2022] GET /compute/v2.1/servers?name=1596236187 => generated 346 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:44.589895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:44.590675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:44.601223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:44.608256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:44.609213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:44.616476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.617287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.620138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.620515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.622048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.622238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.622851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.624954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.625142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.626614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.627427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.628076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.783225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:44.877820 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e18b73b-1083-4935-8cd8-68eba5395265 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.282342 Nov 02 12:17:44.886702 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2635/5248] 10.222.0.48 () {58 vars in 1154 bytes} [Wed Nov 2 12:17:44 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:44.888073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:44.888888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:44.900309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.900977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.901587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:44.902434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:44.903375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:44.903923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:45.641476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:45.649541 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-804aa5cf-02ce-41f7-a1e5-1c7b17fb704f tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1675 microversion: 2.1 time: 1.065182 Nov 02 12:17:45.654136 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2614/5249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:44 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1675 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:45.678784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:45.710450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:45.711267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-159623618', 'deleted': False, 'project_id': '75e3d585afb5464ea97c154b7d84c586'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:17:45.737485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:45.737999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:45.738457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:45.746012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:45.746755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:45.747573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:45.934448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:17:46.102460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2b9f4fe-bc00-4e86-a46f-59b0d1018745 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-159623618" status: 200 len: 346 microversion: 2.1 time: 0.443348 Nov 02 12:17:46.103949 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2615/5250] 10.222.0.48 () {58 vars in 1228 bytes} [Wed Nov 2 12:17:45 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-159623618 => generated 346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:46.132708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:46.142807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:46.151189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:46.238072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:46.387826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:46.405382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:46.406968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:46.413104 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bad51763-f649-40b2-822c-ffaff779b432 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 1.532683 Nov 02 12:17:46.417014 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2636/5251] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:44 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:46.697072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:46.719859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:46.733632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:46.734128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:46.734927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:46.736381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:46.740638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:46.742005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.061381 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99bd2acf-f4a6-449d-9cfd-8b07c7907214 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 204 len: 0 microversion: 2.1 time: 0.944817 Nov 02 12:17:47.068297 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2616/5252] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:46 2022] DELETE /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:47.072612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:47.105695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:47.106443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:47.123171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b3e3ef6-a8c0-48dd-ba29-a361eb1d1797 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1607 microversion: 2.1 time: 0.436408 Nov 02 12:17:47.134725 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2637/5253] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:46 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1607 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:47.136813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:47.137300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:47.137763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.138470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:47.138931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:47.154838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.187544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8289f28-6ecb-49ba-8ff6-b2f4679a888f", "name": "network-vif-deleted", "tag": "9949859e-bcc6-40a5-a7ad-8120e713683d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:47.217567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:47.218060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:47.218488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.248165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] Creating event network-vif-deleted:9949859e-bcc6-40a5-a7ad-8120e713683d for instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f on n-h1-855649-4 Nov 02 12:17:47.257557 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b2b8f84-573a-461c-8c33-97f0d27da63d req-d3497a50-f8d5-4574-9ccd-9f9ba1f938cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074143 Nov 02 12:17:47.258516 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2638/5254] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:47.430397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:47.443843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1975d48e-fedc-4d33-a8f0-519ac5031334 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1518 microversion: 2.1 time: 0.363243 Nov 02 12:17:47.448271 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2617/5255] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:47 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1518 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:47.483251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:47.484116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:47.509648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:47.510825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:47.511529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.512477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:47.513150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:47.518003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:47.813198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:47.827445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:47.829824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:47.832846 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1db7e0c9-5dfa-4581-98a2-ebe927238519 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.390077 Nov 02 12:17:47.834537 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2639/5256] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:47 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:48.149915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:48.152032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:48.170914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.179276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.180270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:48.186572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.189469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.193099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:48.475111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:48.476072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:48.489417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.500105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.500555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:48.501337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.501815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.502253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:48.515003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:48.538535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a413a3a5-c62e-4c53-b9a9-cfe5ea79b341 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1607 microversion: 2.1 time: 0.391225 Nov 02 12:17:48.546113 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2618/5257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:48 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1607 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:48.876240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:48.876929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:48.887687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.888316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.888863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:48.890903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:48.891631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:48.892554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:49.376640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:49.393142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9011dcc-42da-4da5-a945-2e9f5dbe6958 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1518 microversion: 2.1 time: 0.920387 Nov 02 12:17:49.393809 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2640/5258] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:48 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1518 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:49.499828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:49.511910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:49.516233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:49.517919 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4de1eb4-2b91-45e4-8a8e-5186494d543f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1739 microversion: 2.20 time: 0.656635 Nov 02 12:17:49.523994 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2619/5259] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:48 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:49.569335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:49.570437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:49.577254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:49.577755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:49.578201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:49.578917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:49.579785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:49.580390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:49.639639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:49.639639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:49.639639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:49.639639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lazy-loading 'fault' on Instance uuid d8289f28-6ecb-49ba-8ff6-b2f4679a888f {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:49.717593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74d8003120246c4a99129c38d4d19ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5889d94676a430780b12bd9ad06a238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:49.719839 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-023210ae-aca8-4c45-a495-5f6e8dfada78 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 200 len: 1328 microversion: 2.1 time: 0.155875 Nov 02 12:17:49.721456 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2641/5260] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:49 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:50.418422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:50.419272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:50.431640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.435680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.436558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.438646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.438646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.438646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.550176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:50.551806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:50.560907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.564645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.585571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.586393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.586883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.594627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.747104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:50.763068 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68d13f83-6a4e-4ea5-a752-80389667e51b tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1476 microversion: 2.1 time: 0.349759 Nov 02 12:17:50.764310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2620/5261] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:50 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:50.770005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e462325-4ba0-45f5-afde-224648670b44", "name": "network-vif-deleted", "tag": "afbd0c4f-1364-40e8-8c06-76e5f3df517c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:50.786108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.788110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.792838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.810505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] Creating event network-vif-deleted:afbd0c4f-1364-40e8-8c06-76e5f3df517c for instance 1e462325-4ba0-45f5-afde-224648670b44 on n-h1-855649-4 Nov 02 12:17:50.816352 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-55d7b0ce-2d69-4a48-996f-716edd8bbae4 req-f5607acc-f635-4097-8a8a-44a8deeb4878 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050492 Nov 02 12:17:50.817280 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2621/5262] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:50.824887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:50.826058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] [instance: d8289f28-6ecb-49ba-8ff6-b2f4679a888f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:50.834266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.835097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.835804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.836728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:50.837364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:50.837967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:50.871424 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] HTTP exception thrown: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Request method failure captured: Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f HTTP/1.1 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl2tIM9IPD78v2cu8bia1PNT_CBjxOT55EaQOG_YW1YuXv0Qc3NmK2Ncxd7QKQHwaXBvKKxYFO0sSgZWQ3bLuyvVQMnaFVeC7T93b0mp69fhKSn8yCGWLxC9ASmHD_Q3cppThDl4kaX6GUhJtvi37UbPsZ91-FXmvZ0Yft8mkeYIuuQ Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5889d94676a430780b12bd9ad06a238", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5889d94676a430780b12bd9ad06a238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: f5889d94676a430780b12bd9ad06a238 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-468353312 Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: d74d8003120246c4a99129c38d4d19ed Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-468353312-project Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd8289f28-6ecb-49ba-8ff6-b2f4679a888f'} Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:50.873226 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Returning 404 to user: Instance d8289f28-6ecb-49ba-8ff6-b2f4679a888f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0203f897-172a-4083-bd84-fd0309aad301 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f" status: 404 len: 111 microversion: 2.1 time: 0.056002 Nov 02 12:17:50.884160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2622/5263] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:50 2022] GET /compute/v2.1/servers/d8289f28-6ecb-49ba-8ff6-b2f4679a888f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:50.899484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a57cd65b-b235-4a36-8bb9-9f9e112fcb41 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] Calling method '.version_select at 0x7ff1b292ce50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:51.071881 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a57cd65b-b235-4a36-8bb9-9f9e112fcb41 tempest-ServerActionsTestJSON-468353312 tempest-ServerActionsTestJSON-468353312-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808636974" status: 202 len: 0 microversion: 2.1 time: 0.179245 Nov 02 12:17:51.073215 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2623/5264] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:17:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808636974 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:17:51.116419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:51.139962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:51.142028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:51.143684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77795486-f725-442f-986a-4d6739436224 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1721 microversion: 2.20 time: 0.598887 Nov 02 12:17:51.144866 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2642/5265] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:50 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1721 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:17:51.793893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:51.795965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:51.814768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:51.817477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:51.818626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:51.820476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:51.821870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:51.822871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:51.884547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:51.885150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:51.886112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:51.886751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lazy-loading 'fault' on Instance uuid 1e462325-4ba0-45f5-afde-224648670b44 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:51.976850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:51.992261 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc50572e-31f4-446b-9a59-89123f42e11f tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 200 len: 1311 microversion: 2.1 time: 0.202129 Nov 02 12:17:51.993553 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2624/5266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:51 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:52.178587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:52.180924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:52.192399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:52.201671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:52.202793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:52.203654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:52.204904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:52.205855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:52.206781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:52.536857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:52.564224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:52.566838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:52.569520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f7f3847-3de2-40e3-b98f-562e3b5da023 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1721 microversion: 2.20 time: 0.401054 Nov 02 12:17:52.571253 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2643/5267] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:52 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:53.023912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:53.025113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 1e462325-4ba0-45f5-afde-224648670b44] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:53.034544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.035589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.036299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.038091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.040279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.041058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.088802 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] HTTP exception thrown: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Request method failure captured: Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 HTTP/1.1 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl-GZyMYbQZw913RQ1g37HTPJHyJMQ7qYz1FnqPsIecmjYLpCqH5WWm4UwLase5ScnvsxdqXDO9HhWraO2-qIaeuWwNlPm1fbMjPB3NtLBv0ML3hoCjVoMK_YrZrwuIyLGvNL72ZJdcGqqTyy50xAIT0s08zTmgU43Th3078aeY4OWo Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_75e3d585afb5464ea97c154b7d84c586", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ee616c7ef2a64977ba49b5302a88d0dd Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1e462325-4ba0-45f5-afde-224648670b44'} Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:53.093166 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. Nov 02 12:17:53.100348 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:17:53.105182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Returning 404 to user: Instance 1e462325-4ba0-45f5-afde-224648670b44 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:53.106341 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e32909ac-2446-4c93-94a5-1a22ce4dc707 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44" status: 404 len: 111 microversion: 2.1 time: 0.088347 Nov 02 12:17:53.112813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2625/5268] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:53 2022] GET /compute/v2.1/servers/1e462325-4ba0-45f5-afde-224648670b44 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:53.118050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:53.118556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:53.136171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.136957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.137672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.138656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.139439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.140087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.189023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:53.598405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:53.599424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:53.606691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.607640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.608343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.609959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.612184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.612881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.656064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bec943c8-189a-41b3-9719-d2cd529e27a8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 204 len: 0 microversion: 2.1 time: 0.538566 Nov 02 12:17:53.662653 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2644/5269] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:53 2022] DELETE /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:53.683692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:53.686901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:53.701397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.701814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.706087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.707646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:53.709430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:53.710870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:53.979285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:53.989249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:53.998836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:54.000410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b49a5bb8-361d-4635-b217-daaf04db405a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1721 microversion: 2.20 time: 0.406294 Nov 02 12:17:54.000967 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2626/5270] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:53 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:54.432438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:54.449660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7f9cb56-1140-4bd8-bed1-f3c3b93ee1c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1517 microversion: 2.1 time: 0.782281 Nov 02 12:17:54.451116 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2645/5271] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:53 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1517 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:55.033426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:55.033426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:55.042627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.043482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.044325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.047373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.048094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.049015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.050489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:55.056300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "name": "network-vif-unplugged", "status": "completed", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:55.079358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.085474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.086246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.106479 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] Creating event network-vif-unplugged:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:17:55.113081 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0318b468-32ae-4c14-8731-05cea384487b req-d34f4753-ca26-4886-b1e7-9fa45ea1cdde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062849 Nov 02 12:17:55.120296 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2646/5272] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:17:55.475252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:55.475959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:55.492620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.493122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.493566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.494290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.494749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.495252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.517993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:55.561020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:55.570953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:55.579738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:55.581275 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a7bcc43-50c1-4fd6-91fb-03ab691ff1be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1724 microversion: 2.20 time: 0.556171 Nov 02 12:17:55.603560 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2627/5273] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:55 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1724 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:55.610680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a310fcd-688d-4b31-9109-4ff3b90b15a0"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:55.613679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:55.621379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.622215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.622835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.624347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:55.625100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:55.625907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:55.822085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:55.996626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:56.012465 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-520bf81a-51e0-4498-a872-6ce9f823b3c8 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1517 microversion: 2.1 time: 0.542218 Nov 02 12:17:56.013994 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2647/5274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:55 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1517 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:17:57.039091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:57.040587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:57.052721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:57.055238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:57.056142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:57.057295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:57.058187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:57.058825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:57.226080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:57.236595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f4bf450-7b82-40ae-bb1a-c721e6727879 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1475 microversion: 2.1 time: 0.202413 Nov 02 12:17:57.237720 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2648/5275] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:57 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:57.242993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414e9d8e-a439-42be-aef7-19ffb6cc4689", "name": "network-vif-deleted", "tag": "75b5d561-b0ee-4ea0-aaab-9cd79ae6f965"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:57.256964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:57.257518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:57.258200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:57.278543 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] Creating event network-vif-deleted:75b5d561-b0ee-4ea0-aaab-9cd79ae6f965 for instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 on n-h2-855649-4 Nov 02 12:17:57.285766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-52c608eb-f302-4a89-9b87-d0f295525f32 req-9451c55a-a100-4e45-86f8-2919d980963d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046332 Nov 02 12:17:57.286963 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2649/5276] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:17:57.591282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4522e49e-7aca-49b1-8076-b38ed79ab0a5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.986355 Nov 02 12:17:57.592614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2628/5277] 10.222.0.48 () {62 vars in 1364 bytes} [Wed Nov 2 12:17:55 2022] POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 188 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:17:57.781642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:17:57.782597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:57.798856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:57.799488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:57.804689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:57.804689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:57.804689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:57.804689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:57.840336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:17:58.265373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:58.266383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:58.277003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:58.277893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:58.278617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:58.279631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:58.283509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:58.284684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:58.361727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:58.362744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:58.363635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:58.364346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lazy-loading 'fault' on Instance uuid 414e9d8e-a439-42be-aef7-19ffb6cc4689 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:17:58.435927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:58.460511 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1489f8e8-0344-43a2-9ef6-1ad7e0ec70b3 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 200 len: 1311 microversion: 2.1 time: 0.191253 Nov 02 12:17:58.460511 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2629/5278] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:58 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:17:58.511824 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-237c145e-1768-4fbd-9cb8-5eda440410d7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/action" status: 202 len: 0 microversion: 2.20 time: 0.734345 Nov 02 12:17:58.515968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2650/5279] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:17:57 2022] POST /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:17:58.522127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:58.523249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:58.530548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:58.531678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:58.532535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:58.533641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:58.534435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:58.535175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:58.934281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:58.952745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:58.954497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:17:58.960871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d0be9a3-f2ac-4f0a-92af-1a2e4e2230df tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1750 microversion: 2.20 time: 0.438048 Nov 02 12:17:58.962359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2630/5280] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:58 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1750 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:17:59.478535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:59.478770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 414e9d8e-a439-42be-aef7-19ffb6cc4689] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:59.497838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:59.498377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:59.498831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:59.499667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:59.500165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:59.500590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:59.528943 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] HTTP exception thrown: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Request method failure captured: Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 HTTP/1.1 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl-GZyMYbQZw913RQ1g37HTPJHyJMQ7qYz1FnqPsIecmjYLpCqH5WWm4UwLase5ScnvsxdqXDO9HhWraO2-qIaeuWwNlPm1fbMjPB3NtLBv0ML3hoCjVoMK_YrZrwuIyLGvNL72ZJdcGqqTyy50xAIT0s08zTmgU43Th3078aeY4OWo Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_75e3d585afb5464ea97c154b7d84c586", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ee616c7ef2a64977ba49b5302a88d0dd Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '414e9d8e-a439-42be-aef7-19ffb6cc4689'} Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:17:59.530833 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Returning 404 to user: Instance 414e9d8e-a439-42be-aef7-19ffb6cc4689 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a56876b8-ad03-40d1-8d2f-a0a7420c539a tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689" status: 404 len: 111 microversion: 2.1 time: 0.061111 Nov 02 12:17:59.541954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2651/5281] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:17:59 2022] GET /compute/v2.1/servers/414e9d8e-a439-42be-aef7-19ffb6cc4689 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:17:59.543529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:59.543529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:17:59.553402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:59.558718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:59.559400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:59.562624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:17:59.575596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:17:59.576538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:17:59.582169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:17:59.623474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:17:59.990891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:17:59.991569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:00.033303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:00.033936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:00.034410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:00.039298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:00.041299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:00.042376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:00.192510 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45c1b148-01ab-45d0-add5-ccb5fbda84ec tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 204 len: 0 microversion: 2.1 time: 0.654126 Nov 02 12:18:00.193808 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2631/5282] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:17:59 2022] DELETE /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:18:00.203009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:00.204602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:00.211769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:00.219418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:00.219418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:00.219418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:00.219418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:00.219418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:00.884076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:00.897872 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d59505b-2900-4cb2-8b2d-937fe5a317fa tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1517 microversion: 2.1 time: 0.699221 Nov 02 12:18:00.898950 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2632/5283] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:00 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1517 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:18:00.926348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:00.942662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:00.947253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:00.952406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-453cca1b-41d3-428f-9d9a-124b8e0c8dd1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1750 microversion: 2.20 time: 0.965714 Nov 02 12:18:00.953254 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2652/5284] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:17:59 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1750 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:01.923391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:01.924241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:01.933031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:01.934529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:01.935236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:01.936250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:01.936908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:01.937589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:01.981686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:01.982949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:02.008976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:02.009806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:02.010252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:02.011012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:02.011460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:02.016724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:02.468831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:02.487271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad9342b6-69fe-4276-997f-cf209f6fc362 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1517 microversion: 2.1 time: 0.568777 Nov 02 12:18:02.488640 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2633/5285] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:01 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1517 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:02.493391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:02.513584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:02.527220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:02.527220 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1f0b8e2-5518-40bb-be8a-bf42a5f47dbe tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.540578 Nov 02 12:18:02.542093 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2653/5286] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:01 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:03.357916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ec1b84-dd44-45f7-8df2-b125893849ae", "name": "network-vif-deleted", "tag": "5df0a538-3913-4fd6-bf1a-adc6f1591843"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:03.378317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:03.379252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:03.380092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:03.403341 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] Creating event network-vif-deleted:5df0a538-3913-4fd6-bf1a-adc6f1591843 for instance 30ec1b84-dd44-45f7-8df2-b125893849ae on n-h2-855649-4 Nov 02 12:18:03.414036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-57870156-031c-4bfe-b5b7-df5835243ef9 req-cd5d5a93-ce6a-43ad-9560-40458cdd0974 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059679 Nov 02 12:18:03.415312 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2634/5287] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:18:03.515184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:03.515998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:03.527989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:03.534664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:03.535732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:03.548842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:03.549677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:03.556038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:03.557062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:03.567068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:03.567376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:03.743658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:03.758129 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e6140c6-5638-458b-afc1-7084ba87be25 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1306 microversion: 2.1 time: 0.246682 Nov 02 12:18:03.759674 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2654/5288] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:03 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1306 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:03.896609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:03.908820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:03.910579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:03.912640 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7bf7c16b-75b2-4d86-8463-6ff4c67b9817 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.368767 Nov 02 12:18:03.913430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2635/5289] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:03 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:04.784392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:04.785781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:04.793982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:04.794778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:04.795425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:04.796444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:04.797081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:04.797686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:04.835707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:04.836404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:04.837014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:04.837646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lazy-loading 'fault' on Instance uuid 30ec1b84-dd44-45f7-8df2-b125893849ae {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:18:04.901248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee616c7ef2a64977ba49b5302a88d0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e3d585afb5464ea97c154b7d84c586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:04.910382 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-486fec22-4785-42e5-9341-38901ec8bf66 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 200 len: 1311 microversion: 2.1 time: 0.129977 Nov 02 12:18:04.912785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2655/5290] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:04 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 1311 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:04.944874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:04.947553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:04.962858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:04.962858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:04.962858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:04.962858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:04.962858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:04.970457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:05.364220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:05.385229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:05.415155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:05.415155 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adc4d4ed-d58d-4537-a7ed-e718d07c527f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.447157 Nov 02 12:18:05.415155 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2636/5291] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:04 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:05.938040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:05.940365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] [instance: 30ec1b84-dd44-45f7-8df2-b125893849ae] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:05.963566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:05.964210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:05.964693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:05.965537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:05.965993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:05.966474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:05.999036 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] HTTP exception thrown: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Request method failure captured: Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae HTTP/1.1 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl-GZyMYbQZw913RQ1g37HTPJHyJMQ7qYz1FnqPsIecmjYLpCqH5WWm4UwLase5ScnvsxdqXDO9HhWraO2-qIaeuWwNlPm1fbMjPB3NtLBv0ML3hoCjVoMK_YrZrwuIyLGvNL72ZJdcGqqTyy50xAIT0s08zTmgU43Th3078aeY4OWo Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_75e3d585afb5464ea97c154b7d84c586", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/75e3d585afb5464ea97c154b7d84c586"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 75e3d585afb5464ea97c154b7d84c586 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-850364243 Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ee616c7ef2a64977ba49b5302a88d0dd Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ListServerFiltersTestJSON-850364243-project Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '30ec1b84-dd44-45f7-8df2-b125893849ae'} Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:18:06.000615 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. Nov 02 12:18:06.006019 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:06.007696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] Returning 404 to user: Instance 30ec1b84-dd44-45f7-8df2-b125893849ae could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:18:06.008581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-613c4c96-34a4-4c5e-a62a-21efa3b86f95 tempest-ListServerFiltersTestJSON-850364243 tempest-ListServerFiltersTestJSON-850364243-project] 10.222.0.48 "GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae" status: 404 len: 111 microversion: 2.1 time: 0.074753 Nov 02 12:18:06.009489 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2656/5292] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:05 2022] GET /compute/v2.1/servers/30ec1b84-dd44-45f7-8df2-b125893849ae => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:18:06.430493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:06.431117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:06.462435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:06.464561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:06.465349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:06.470680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:06.470680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:06.470680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:06.994876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:07.004922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:07.026053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:07.029836 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6614b47-844a-443f-ab78-ac3e8aeeede0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.604189 Nov 02 12:18:07.039681 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2637/5293] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:06 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:08.069958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:08.070589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:08.097979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:08.103127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:08.103127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:08.103127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:08.103127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:08.103127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:08.492972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:08.509188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:08.515890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:08.515890 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4642b27-1839-4f1c-9622-d0ac88d6c39f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.448245 Nov 02 12:18:08.517634 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2657/5294] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:08 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:09.549742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:09.550860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:09.565840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:09.566994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:09.568027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:09.569459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:09.570273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:09.571151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:09.919657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:09.933534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:09.935262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:09.937222 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7f923c8-c59c-4983-9f70-ebcf53aadebc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.394158 Nov 02 12:18:09.938333 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2638/5295] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:09 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:10.981074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:10.984646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:11.007743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:11.009101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:11.010259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:11.012806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:11.013904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:11.014678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:11.422380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:11.476378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:11.479317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:11.494940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1afee767-b41f-4678-b4bf-6a5bb39a9e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1752 microversion: 2.20 time: 0.523820 Nov 02 12:18:11.494940 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2658/5296] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:10 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1752 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:12.521390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:12.523324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:12.526887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:12.544239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:12.545634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:12.546367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:12.549414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:12.552831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:12.554268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:12.917271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:12.928210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:12.934055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:12.936479 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-297669c5-b0db-4d1d-b39c-0c39736abd9f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.419719 Nov 02 12:18:12.937951 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2639/5297] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:12 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:13.047170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2012268673", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": "none"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:13.056405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:13.171979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:18:13.173307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:18:13.182452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:18:13.190870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:18:13.191908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:18:13.212434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:13.213944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:13.216052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:13.217164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:13.222289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:13.222289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:13.245896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Getting quotas for project 7056eff59f0a4103a230178d993f916e. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:18:13.262731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Getting quotas for user 419db93e8bbb4b81a7c99bd6611a1a9f and project 7056eff59f0a4103a230178d993f916e. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:18:13.279198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:18:13.286421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:18:13.470468 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-223bd075-4c9a-43a2-9977-7c4b874131ac tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.591828 Nov 02 12:18:13.471983 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2659/5298] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:18:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 12:18:13.487435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:13.488113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:13.622567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:13.631589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:13.633410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:13.635973 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-60458f96-d68c-40eb-b5b1-c7fb4c075219 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1281 microversion: 2.47 time: 0.152924 Nov 02 12:18:13.637348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2640/5299] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:13 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:13.967251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:13.967958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:13.986868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:13.987349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:13.987903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:13.988622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:13.989086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:13.989603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:14.306656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:14.323730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:14.325487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:14.327013 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c342e01-bbf1-4952-a0dc-7fe8717f157d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.364233 Nov 02 12:18:14.327641 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2660/5300] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:13 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:14.682392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:14.684304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:14.949675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:14.982441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:14.993026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:15.007427 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4336de4-c45b-4940-916c-681c463493e8 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1281 microversion: 2.47 time: 0.331871 Nov 02 12:18:15.008331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2641/5301] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:14 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1281 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:15.358604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:15.359473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:15.367813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:15.368820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:15.369327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:15.370282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:15.371090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:15.371555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:15.941119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:15.972493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:15.983039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:15.983039 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c5a787b-8fa9-4ae6-b20d-48f63debd869 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.623626 Nov 02 12:18:15.983039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2661/5302] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:15 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:16.052813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:16.053547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:16.071791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:16.074614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:16.074614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:16.074614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:16.074614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:16.074614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:16.264354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:16.283033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:16.295665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:16.296857 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cece081-b7ba-4f87-90a0-fd6f5c05a5c0 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1285 microversion: 2.47 time: 0.248245 Nov 02 12:18:16.298310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2642/5303] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:16 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:17.008994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:17.009595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:17.045225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:17.045726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:17.046235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:17.054614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:17.054614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:17.054614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:17.331919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:17.334157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:17.357298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:17.358192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:17.358926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:17.359785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:17.360251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:17.360681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:17.699787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.726964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.726964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.726964 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14aadb1b-4b85-46de-84dd-f7a70ee53f84 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.716808 Nov 02 12:18:17.726964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2662/5304] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:17 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:17.807244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.818745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.834111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:17.834111 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9a264c0-93c4-434a-9d99-c94f7821fc7a tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1333 microversion: 2.47 time: 0.495580 Nov 02 12:18:17.834111 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2643/5305] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:17 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1333 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:18.751286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:18.751939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:18.767995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:18.770545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:18.772794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:18.774435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:18.777799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:18.779685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:18.857568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:18.858191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:18.882502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:18.883872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:18.886018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:18.887224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:18.891330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:18.892463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:19.732002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.748926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.757127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.761278 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7632c4d5-5a7a-446d-81a7-25dd6ce20539 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1351 microversion: 2.47 time: 0.909529 Nov 02 12:18:19.764354 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2644/5306] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:18 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1351 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:19.863525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.876794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.879787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:19.881834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-159c9e60-8410-4ec0-9ce9-36e6925bac1c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 1.135561 Nov 02 12:18:19.897199 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2663/5307] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:18 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:20.802727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:20.805115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:20.838892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:20.843503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:20.847460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:20.848701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:20.851856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:20.853033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:20.914492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:20.919439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:20.930841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:20.930841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:20.930841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:20.931540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:20.932233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:20.932942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:21.080810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.120581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.130347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.131584 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb9c6d5a-c142-4e2b-9ba2-62b2344d89ef tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1339 microversion: 2.47 time: 0.339730 Nov 02 12:18:21.137737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2645/5308] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:20 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1339 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:21.216987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.246840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.251764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:21.253243 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af1db234-ca54-4803-9274-7f166a7ab425 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.346406 Nov 02 12:18:21.254580 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2664/5309] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:20 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:22.182726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:22.188586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:22.217887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.218538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.219008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.228030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.228521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.228974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.278404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:22.459400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-215872354", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:22.584259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:22.615934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:22.629748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:22.635678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7333aa67-7027-4172-9041-a2993c9e0401 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1339 microversion: 2.47 time: 0.457817 Nov 02 12:18:22.637434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2665/5310] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:22 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1339 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:22.668012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:22.670637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:22.677014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] validate_networks() for [('a6dac891-736c-42d9-9760-d64cd62a428f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:18:22.707359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.709510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.710897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:22.729665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:22.733342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:22.734698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:23.229551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:23.270102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:23.716219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.719736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.725687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.729432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cbe64491-7355-4478-8186-aa2699a22909 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 1.090167 Nov 02 12:18:23.734364 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2666/5311] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:22 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:23.750965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:23.756877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:23.775070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:23.775832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:23.777233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:23.779174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:23.785541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:23.786564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:23.932837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.945637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.956069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:23.957834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-00fc31af-840f-4e4d-9e37-84d0e5af8efb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1339 microversion: 2.47 time: 0.222197 Nov 02 12:18:23.959284 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2667/5312] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:23 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:24.556397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:18:24.557024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:18:24.557336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:18:24.566294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:18:24.566294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:18:24.573830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:24.574508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:24.574966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:24.575736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:24.576196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:24.576629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:24.612309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Getting quotas for project 3b4864ef151f415ebc0fb2fddc4cf62d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:18:24.620472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Getting quotas for user 16373f609d2d4e14856b6df33ff5f16f and project 3b4864ef151f415ebc0fb2fddc4cf62d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:18:24.637493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:18:24.640982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:18:24.767311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:24.768118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:24.813695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:24.815596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:24.980259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:24.980259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:24.980259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:24.980259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:25.197829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.210639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.218751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.218751 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91a9d1df-e24f-4dd0-b6e7-6e31792d03d5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.453166 Nov 02 12:18:25.218751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2668/5313] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:24 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:25.220008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:25.220847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:25.228505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:25.230050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:25.230719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:25.231752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:25.232632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:25.233297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:25.361148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.390218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.392434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:25.394064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61a9c3ba-b9a3-43d8-b722-50ffc5c6066d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1360 microversion: 2.47 time: 0.178854 Nov 02 12:18:25.396938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2669/5314] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:25 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:25.419942 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:18:25.440841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-933714831"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:25.445805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:25.459188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:25.462552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:25.462552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:25.462552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:25.462552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:25.462552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:26.236459 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1658aae-58ba-4e5f-b4bd-eca9905a927e tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "POST /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4/action" status: 202 len: 52 microversion: 2.47 time: 0.808865 Nov 02 12:18:26.245814 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2670/5315] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:18:25 2022] POST /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4/action => generated 52 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 02 12:18:26.259670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:26.269448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:26.291952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:26.292469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:26.292916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:26.293652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:26.294114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:26.306069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:26.412709 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45272. Nov 02 12:18:26.421564 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f263f710-f92c-48d4-b22e-caa1f782064d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.456698 Nov 02 12:18:26.427540 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2646/5316] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:18:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 4464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:18:26.435623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:26.441474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:26.464893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:26.468565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:26.469855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:26.477007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:26.478071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:26.480573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:26.551291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:18:26.738570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:26.747507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:26.762510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:26.765775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:26.768380 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e4c08f9-0a3f-4539-a2d6-ff16744f3239 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.526628 Nov 02 12:18:26.772108 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2671/5317] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:26 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:26.785342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1abdf6c8-7242-4c4e-b65b-58c8eb8bd70c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:26.786149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1abdf6c8-7242-4c4e-b65b-58c8eb8bd70c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:26.919716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1abdf6c8-7242-4c4e-b65b-58c8eb8bd70c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:26.933793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1abdf6c8-7242-4c4e-b65b-58c8eb8bd70c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1222 microversion: 2.1 time: 0.158916 Nov 02 12:18:26.935276 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2672/5318] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:26 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:27.028784 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53facd39-2d2b-4224-95e0-58f07be151f4 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 204 len: 0 microversion: 2.47 time: 0.596333 Nov 02 12:18:27.028784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2647/5319] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:18:26 2022] DELETE /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:18:27.036769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:27.037410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:27.050885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:27.052805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:27.052805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:27.065011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:27.065614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:27.066162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:27.264703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:27.276412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:27.287548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:27.289077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04d299d0-188e-4471-bfd1-1ee06ae6076d tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.258456 Nov 02 12:18:27.306421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2673/5320] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:27 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:27.801496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:27.801496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:27.810160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:27.811403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:27.812216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:27.813697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:27.814801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:27.816414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:27.957901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70122063-3a2c-4223-80e5-c6ad6030c0cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:27.958687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70122063-3a2c-4223-80e5-c6ad6030c0cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:28.095336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70122063-3a2c-4223-80e5-c6ad6030c0cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.102933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70122063-3a2c-4223-80e5-c6ad6030c0cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1222 microversion: 2.1 time: 0.149339 Nov 02 12:18:28.105017 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2674/5321] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:27 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:28.175720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.198551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.201308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.202833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-813345a2-fde8-44db-8440-0afc374f5008 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.407691 Nov 02 12:18:28.203713 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2648/5322] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:27 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:28.318331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:28.319756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:28.327296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:28.327739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:28.328181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:28.328890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:28.329349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:28.329840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:28.411037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.419438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.420887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:28.422054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4ddbf7a-055c-4384-b911-5030fa3f31dc tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.108198 Nov 02 12:18:28.422618 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2675/5323] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:28 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:29.133346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:29.134024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:29.147219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.150573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.150573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.151139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.151624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.152199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.230241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:29.230860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:29.243232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.243743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.244171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.247174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.247870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.251297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.297912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.315830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f11f3f6-1ff5-414a-b85b-7ed5e1a328fa tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1274 microversion: 2.1 time: 0.186295 Nov 02 12:18:29.326920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2649/5324] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:29 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:29.450163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:29.450795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:29.466639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.467252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.467625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.472156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:29.472156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:29.472156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:29.593280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.603464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.604932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.610384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.619143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3764df4-9001-4306-8d3d-c1b93bb72d2b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.173889 Nov 02 12:18:29.622907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.624408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:29.625701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ca7bec4-83fd-4a59-8061-ad028bb3ad4d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.399699 Nov 02 12:18:29.626556 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2650/5325] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:29 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:29.633084 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2676/5326] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:29 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:30.354807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:30.355469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:30.362852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.363445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.363955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.365253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.365715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.366142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.654371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:30.655193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:30.662924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.663446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.663894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.664616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.665077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.665658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.811554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:30.816927 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ede56156-9576-49d7-909b-4f81067715fc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1274 microversion: 2.1 time: 0.466299 Nov 02 12:18:30.829165 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2651/5327] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:30 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1274 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:30.839887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:30.840516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:30.846835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.847364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.847959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.848678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:30.849721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:30.850171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:30.867772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:30.878951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:30.882130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:30.883469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edc68509-7cc4-47e0-b630-0ed19a7e4ebb tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.233218 Nov 02 12:18:30.885146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2677/5328] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:30 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:31.215336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:31.248318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:31.256453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:31.257953 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-528efcd0-5e42-4dc8-88c4-d48c1eb1c549 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.429050 Nov 02 12:18:31.272802 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2652/5329] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:30 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:31.843736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:31.845757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:31.862946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:31.865745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:31.866665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:31.870745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:31.872114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:31.872899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:31.924395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:31.928420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:31.945678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:31.946696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:31.947544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:31.948532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:31.949238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:31.949975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:32.096416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.115901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd25edee-4a44-4cdd-9a94-b626bf46118a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1280 microversion: 2.1 time: 0.267266 Nov 02 12:18:32.120141 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2678/5330] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:31 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:32.207790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.218569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.220447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.221873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22091f1d-c2f0-452b-9259-b264cdafb7c1 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.310563 Nov 02 12:18:32.240562 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2653/5331] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:31 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:32.293132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:32.293132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:32.306074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:32.310525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:32.311996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:32.312974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:32.313440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:32.316925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:32.651838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.665475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.670117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:32.671715 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7a48888-535a-4000-bacf-d806a2ef95ca tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.388678 Nov 02 12:18:32.693423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2679/5332] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:32 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:33.140104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:33.141219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:33.153944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.155552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.156271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:33.159401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.160065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.164180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:33.251113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:33.251737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:33.264756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.265564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.266177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:33.281246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.282513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.283623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:33.476079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:33.511796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:33.513601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:33.515100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2f1cc01-f500-4aa3-ab85-680139b53da9 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.267940 Nov 02 12:18:33.518904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2680/5333] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:33 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:33.699596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:33.700293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:33.713591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.716580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.716580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:33.716580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:33.716580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:33.716580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:34.015266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.027241 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0ecb830-f3c6-4dcd-af02-5aaa1f15e074 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.891941 Nov 02 12:18:34.042332 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2654/5334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:33 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:34.146453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.158554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.159921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.161325 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14c79021-409a-4cff-a8ab-3f3a1dbd4939 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.465737 Nov 02 12:18:34.163264 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2681/5335] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:33 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:34.544917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:34.546387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:34.560508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:34.562390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:34.565007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:34.567886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:34.568721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:34.569874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:34.605244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:34.652940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:34.746708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.756310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.763535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:34.764807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-107e5efb-fa89-41d3-a447-51b8d2f35d7b tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1366 microversion: 2.47 time: 0.225038 Nov 02 12:18:34.765401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2655/5336] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:34 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:35.056526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:35.057942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:35.069734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.070225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.070664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.076223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.076727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.077172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.177950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:35.199084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.200150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.204243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.255677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] Creating event network-changed:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:18:35.262203 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c8d32f00-8572-476a-bf48-973f021420ed req-cbb7cd3a-df7b-4dce-88ef-bcba42b465da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089173 Nov 02 12:18:35.265730 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2656/5337] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:18:35.281341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:35.282060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:35.297861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.298735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.301192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.302782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.308339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.309005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.803662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:35.813204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:35.815208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:35.816652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b21b2c16-05f7-4bbb-bc50-ea3ba748ed76 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.549344 Nov 02 12:18:35.831205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2657/5338] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:35 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:35.840920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:35.841553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:35.847897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.848379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.849636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.850369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.851038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.851645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.853026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:35.857526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:35.864917 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-638fd5cc-0a2f-4a33-9562-b7ef54796d93 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.812837 Nov 02 12:18:35.866230 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2682/5339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:35 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:35.923952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:35.925025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:35.926047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:35.926704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lazy-loading 'fault' on Instance uuid 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:18:36.030364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:36.049987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:36.053248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:36.055071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1425d973-d000-4081-97e0-356a3fed73da tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1371 microversion: 2.47 time: 0.222471 Nov 02 12:18:36.068302 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2658/5340] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:35 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:36.847079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:36.847706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:36.855204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:36.855693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:36.856172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:36.856887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:36.857349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:36.857802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:36.888861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:36.889702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:36.897662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:36.898476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:36.898904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:36.899638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:36.900098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:36.900552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:37.355125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.358541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.364177 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d185d969-ef0a-4b76-b2e2-045391f9670f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.480291 Nov 02 12:18:37.365454 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2659/5341] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:36 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:18:37.368394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.369857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.371333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:37.373134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1395f756-b856-4888-8259-4ef10cbdb7be tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.530608 Nov 02 12:18:37.374546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:37.382896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:37.383848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:37.383982 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2683/5342] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:36 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:37.384661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:37.385633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:37.386308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:37.387037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:37.425441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:37.425938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:37.426391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:37.426854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lazy-loading 'fault' on Instance uuid 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:18:37.473685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.490233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.491326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '419db93e8bbb4b81a7c99bd6611a1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7056eff59f0a4103a230178d993f916e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:37.492650 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40f4e811-eafe-4035-a89f-022eaa330f97 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 200 len: 1371 microversion: 2.47 time: 0.125949 Nov 02 12:18:37.493563 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2660/5343] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:37 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:38.389228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:38.389835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:38.393249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:38.398709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.399216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.399651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.399808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:38.400637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.400764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:38.401099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.401522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.407887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.408375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.408810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.409509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.409962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.410399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.715409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:38.723154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b42ad31b-47b4-4b78-b7b3-f84f85c5e696 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.338204 Nov 02 12:18:38.723731 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2684/5344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:38 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:38.729020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:38.729626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] [instance: 9c69efc3-c031-4d2c-81ae-8c15d67fccc4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:38.735578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.736057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.736489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.737313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:38.737798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:38.738281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:38.748106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:38.753697 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] HTTP exception thrown: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Request method failure captured: Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 HTTP/1.1 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmAEX5HmCDeFUeOTey-tD7tfs_0_XP26GT-PpaplBkKOgR_Hrc2YkOSVZYnZ0vbOVAARoJy6_2AKZmyLUIW5aJxWmnaTisjUDZfRweqsiQbAm0FCAAMX--pQ9h0wWHwieT81kiHOjaD6jbr8sBJWAq8b1fh2DKijj9X-_kta_WKtn5o Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 7056eff59f0a4103a230178d993f916e Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAaction247Test-677634891 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7056eff59f0a4103a230178d993f916e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7056eff59f0a4103a230178d993f916e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7056eff59f0a4103a230178d993f916e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7056eff59f0a4103a230178d993f916e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAaction247Test-677634891 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 7056eff59f0a4103a230178d993f916e Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAaction247Test-677634891 Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAaction247Test-677634891-project Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 419db93e8bbb4b81a7c99bd6611a1a9f Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAaction247Test-677634891-project Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '9c69efc3-c031-4d2c-81ae-8c15d67fccc4'} Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:18:38.755390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] Returning 404 to user: Instance 9c69efc3-c031-4d2c-81ae-8c15d67fccc4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fdb28fe-1fc6-413c-9b73-e4ab1e2fd9f7 tempest-ServersAaction247Test-677634891 tempest-ServersAaction247Test-677634891-project] 10.222.0.48 "GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4" status: 404 len: 111 microversion: 2.47 time: 0.031427 Nov 02 12:18:38.764392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2685/5345] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:38 2022] GET /compute/v2.1/servers/9c69efc3-c031-4d2c-81ae-8c15d67fccc4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:18:38.766324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:38.766324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:38.766324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12b38cc6-32c2-452a-b879-40279f58ee2a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.369079 Nov 02 12:18:38.766324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2661/5346] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:38 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:39.748476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:39.749135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:39.756930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:39.758056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:39.758056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:39.758538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:39.759015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:39.759665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:39.796257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:39.796963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:39.811451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:39.812391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:39.813019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:39.813741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:39.814644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:39.815106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:39.987037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:39.995497 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-403e6698-6f4d-48b1-80f1-6bf77d9fc52d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.250709 Nov 02 12:18:40.001494 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2686/5347] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:39 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:40.053306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:40.068919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:40.072122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:40.081573 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68547ee6-25e8-454d-837c-281375f6af08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.284989 Nov 02 12:18:40.082736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2662/5348] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:39 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:41.026775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:41.027689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:41.036215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:41.046485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:41.046485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:41.046485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:41.046485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:41.046485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:41.113486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:41.114219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:41.121888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:41.122454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:41.122898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:41.123856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:41.124342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:41.127513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:41.246342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:41.256121 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d10157f2-5795-4fa3-ae69-31c38ad8552e tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.233922 Nov 02 12:18:41.256794 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2687/5349] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:41 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:41.332466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:41.347439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:41.348887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:41.350713 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbd4954a-bda5-4eb6-b0cc-7c3dd3e60a1a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.241378 Nov 02 12:18:41.365517 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2663/5350] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:41 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:41.598314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "name": "network-vif-plugged", "status": "completed", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:41.617403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:41.617892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:41.618390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:41.633982 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] Creating event network-vif-plugged:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:18:41.639320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-324fa52d-2b15-4c45-909e-943922443864 req-63d766c6-47ee-4d65-8797-b5a36d5dba3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048165 Nov 02 12:18:41.640057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2688/5351] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:18:42.285769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:42.287715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:42.298723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:42.299675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:42.300597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:42.301552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:42.302289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:42.303329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:42.323198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:42.385993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:42.385993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:42.395074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:42.395627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:42.399717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:42.399717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:42.399717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:42.399717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:42.534406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:42.545211 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-099d979a-6c9a-4123-a3ce-2d492eb1e8da tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1322 microversion: 2.1 time: 0.261978 Nov 02 12:18:42.545848 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2664/5352] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:42 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:42.636148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:42.647501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:42.649435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:42.651053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44ae87d5-cc9f-45e3-a012-4c5afdcca2a9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.277766 Nov 02 12:18:42.652272 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2689/5353] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:42 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:43.570726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:43.571375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:43.578418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.578968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.579649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.580560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.581191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.581624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.678431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:43.679305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:43.687248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.687743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.688186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.688903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.689620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.690243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.727687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:43.736282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97c45198-c2a8-44b5-b430-d91024a60f68 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1518 microversion: 2.1 time: 0.170166 Nov 02 12:18:43.740866 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2665/5354] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:43 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:43.760246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:43.762545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:43.769459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.771838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.771838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.771838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:43.771838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:43.772261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:43.799022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lazy-loading 'flavor' on Instance uuid 617dde1f-d400-4ec7-87f6-c17646b16d10 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:18:43.851894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:43.861542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:43.863046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:43.864239 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6caaf485-0511-4433-a6e8-e9ab1474e883 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.190321 Nov 02 12:18:43.865557 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2690/5355] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:43 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:18:44.454008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f4e0f67-5a68-41ee-8591-24c98266960f tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action" status: 200 len: 32 microversion: 2.1 time: 0.697828 Nov 02 12:18:44.454627 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2666/5356] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:18:43 2022] POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action => generated 32 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:18:44.464456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:44.465076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:44.472310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:44.472807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:44.473250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:44.474629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:44.474951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:44.475737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:44.734159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:44.744450 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-026acd49-15d0-4c6f-9e8b-09ffcab72de2 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.283820 Nov 02 12:18:44.745050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2691/5357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:44 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:44.894303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:44.895130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:44.901957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:44.902817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:44.903035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:44.903944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:44.904397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:44.904874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:45.208506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:45.221790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:45.223792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:45.225954 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bde912e8-d290-4af7-9374-efa92a741031 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.338040 Nov 02 12:18:45.227737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2667/5358] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:44 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:45.768330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:45.768959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:45.772494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:45.799181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:45.800494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:45.803877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:45.806448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:45.807517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:45.808164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:46.253821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:46.254574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:46.261597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:46.280082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:46.282535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:46.290128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:46.291218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:46.291935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:46.294452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:46.328968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:46.346828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-46dd2d7a-4e59-431d-a7ce-c5f95be56def tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.580243 Nov 02 12:18:46.347826 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2692/5359] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:45 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:18:46.619088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:46.628258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:46.629696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:46.631656 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afc5799b-2816-480b-81fa-2cc580c82ad4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.382425 Nov 02 12:18:46.632223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2668/5360] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:46 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:47.309443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "name": "network-vif-plugged", "status": "completed", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:47.327887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:47.328370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:47.338293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:47.351167 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] Creating event network-vif-plugged:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:18:47.368481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f268a855-6ea0-424c-8f20-ccc4c55dc90d req-6d3c3439-9e26-4ad3-82d2-b7cd3db4670d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064162 Nov 02 12:18:47.369644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2693/5361] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:18:47.374268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:47.378448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:47.387245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:47.389596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:47.390097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:47.391858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:47.392341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:47.397611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:47.658298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:47.659044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:47.679766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:47.680883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:47.683523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:47.691827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:47.691827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:47.691827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:47.964635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:47.973602 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ad0dd38-4ec1-4474-8476-6c158f1e1f14 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.604061 Nov 02 12:18:47.974312 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2669/5362] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:47 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:48.353331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:48.366026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:48.367580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:48.373484 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81fe9ae0-cd5a-4c13-945c-96e46665eaaf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.718135 Nov 02 12:18:48.374699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2694/5363] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:47 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:49.017384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:49.018132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:49.039577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.043105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.044487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.047556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.048130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.050432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.379076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.389340 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3775d8f-d1f2-4837-a9f1-63ac5f052dc1 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.380468 Nov 02 12:18:49.395705 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2670/5364] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:49 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:49.406548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:49.407826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:49.419076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.419672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.420179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.420950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:49.421471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:49.421964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:49.697572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.711552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.712970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:49.716693 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08f57917-6ac2-4fb0-b034-98312b5731e1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.315316 Nov 02 12:18:49.718629 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2695/5365] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:49 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:50.421193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:50.421193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:50.426497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:50.427813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:50.428467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:50.429550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:50.429815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:50.430326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:50.606476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:50.614217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3aa2863-b35c-4bc5-b90f-7fdf4c324f28 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.203028 Nov 02 12:18:50.615425 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2671/5366] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:50 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:50.748452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:50.749960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:50.773848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:50.774584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:50.775131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:50.775876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:50.776520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:50.777314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:51.026164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:51.038151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:51.041154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:51.043808 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0ecdce1-e0bd-4cd6-8b2b-a17b4aeacc24 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1808 microversion: 2.20 time: 0.302199 Nov 02 12:18:51.045514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2696/5367] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:50 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:51.644204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:51.644204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:51.656949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:51.658904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:51.659686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:51.661497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:51.662796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:51.664046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:51.941539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:51.953441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dba8326-8f73-44f3-b253-6ca3ed1b2997 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.318892 Nov 02 12:18:51.953999 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2672/5368] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:51 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:52.079225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:52.079866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:52.100065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.104852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.110831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:52.112348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.113211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.113977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:52.414767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:52.431424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:52.434264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:52.435927 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-724c335b-7e6a-43de-8848-08bc5f6a8e65 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1795 microversion: 2.20 time: 0.361944 Nov 02 12:18:52.436949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2697/5369] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:18:52 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1795 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:18:52.757630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-777165741", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "25729cce-34c0-4b89-9c87-f702e1f3880a"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:18:52.840184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] validate_networks() for [('25729cce-34c0-4b89-9c87-f702e1f3880a', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:18:52.979307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:52.980296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:52.986951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.987401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.987815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:52.988896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:52.989356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:52.990413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:53.357372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:53.370998 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc91e6c7-2b87-4911-b4d0-03bca7c8d045 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.396200 Nov 02 12:18:53.389287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2698/5370] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:52 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:18:53.624655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:18:53.625243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:18:53.625906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:18:53.626320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:18:53.626777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:18:53.636836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:53.637257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:53.637696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:53.638427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:53.638881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:53.639338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:53.659258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Getting quotas for project dbae56d3dd4744899854a1ad04bfabee. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:18:53.665186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Getting quotas for user 7e798fda768e4152b1c85e855bcf6574 and project dbae56d3dd4744899854a1ad04bfabee. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:18:53.682204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:18:53.685162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:18:53.885018 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd7032bf-a2b5-4153-8435-6cc115ef0a8f tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.301586 Nov 02 12:18:53.903188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a0c1135-25f6-49a9-8f80-df1c4772dbd0 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:53.904127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a0c1135-25f6-49a9-8f80-df1c4772dbd0 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:53.907340 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2673/5371] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:18:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:18:53.978055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a0c1135-25f6-49a9-8f80-df1c4772dbd0 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:53.986732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a0c1135-25f6-49a9-8f80-df1c4772dbd0 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1216 microversion: 2.1 time: 0.088903 Nov 02 12:18:53.998701 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2699/5372] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:53 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:54.397549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:54.398740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:54.409268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:54.409268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:54.409268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:54.409705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:54.410384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:54.410885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:54.593898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:54.603575 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d305245-d301-4ede-b860-73bdb763d850 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.210445 Nov 02 12:18:54.615187 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2674/5373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:54 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:55.037735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3acc4fa4-706a-41f7-84f9-37ce35657ce5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:55.039472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3acc4fa4-706a-41f7-84f9-37ce35657ce5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:55.177144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3acc4fa4-706a-41f7-84f9-37ce35657ce5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:55.187751 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3acc4fa4-706a-41f7-84f9-37ce35657ce5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1216 microversion: 2.1 time: 0.155952 Nov 02 12:18:55.190324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2700/5374] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:55 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:55.629268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:55.631157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:55.639188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:55.640030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:55.641388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:55.642593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:55.643262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:55.644356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:55.882394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:55.891140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0254720e-81d1-4ba6-8a5e-0e63b02559cc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.265839 Nov 02 12:18:55.892522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2675/5375] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:55 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:56.214241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:56.215244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:56.226602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.231749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.233368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:56.234448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.240903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.243608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:56.350173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:56.361453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-881daf8f-b8bf-4c92-9adf-4cf3fce6a354 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1212 microversion: 2.1 time: 0.151153 Nov 02 12:18:56.362759 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2701/5376] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:56 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:56.918089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:56.918714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:56.926527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.927982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.928625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:56.929699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:56.930345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:56.930963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:57.145056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:57.159056 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd8a43c2-a676-4120-9079-43617397b2e8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.242883 Nov 02 12:18:57.159786 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2676/5377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:56 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:57.393519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:57.394498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:57.410769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:57.412046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:57.412512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:57.413268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:57.413732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:57.418553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:57.642766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:57.663054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeb3cc8c-2b61-44c3-b896-de558c53ac9b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1276 microversion: 2.1 time: 0.275893 Nov 02 12:18:57.680151 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2702/5378] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:57 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1276 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:58.186282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:58.187220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:58.203585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.204195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.205471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.206264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.218687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.218687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.435382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:58.446777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e013c54a-9e3b-425d-b486-a2e6caedfc4d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.264779 Nov 02 12:18:58.447438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2677/5379] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:58 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:58.701231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:58.701860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:58.709636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.710128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.711681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.716461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:58.716461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:58.716461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:58.739205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:18:58.897656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:58.907563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba6f120d-e428-4e5b-a02e-de94542b96fc tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.209030 Nov 02 12:18:58.908415 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2703/5380] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:58 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:59.472873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:59.474175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:59.486027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.486805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.489253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:59.490050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.490527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.490969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:59.706091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:18:59.719513 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ef9e5c60-d791-46ba-bec0-f9fed6b8f219 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.251096 Nov 02 12:18:59.720555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2678/5381] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:59 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:18:59.934242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:18:59.934888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:18:59.942381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.943461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.943911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:18:59.944618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:18:59.945071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:18:59.945500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:00.504500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:00.518680 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-324e31dc-e486-4525-b19c-7cd0a6a84827 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.588702 Nov 02 12:19:00.519733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2704/5382] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:18:59 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:00.744178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:00.744901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:00.752228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:00.752645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:00.753088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:00.753793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:00.754447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:00.754889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:00.847120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3158096-a429-48b6-8e3f-bda7c4a97e22", "tag": "bc92c494-4eed-4e37-a3dd-678ecb7952d3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:00.859055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:00.859590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:00.860805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:00.874306 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] Creating event network-changed:bc92c494-4eed-4e37-a3dd-678ecb7952d3 for instance e3158096-a429-48b6-8e3f-bda7c4a97e22 on n-h2-855649-4 Nov 02 12:19:00.880131 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-eaf90c1c-6d35-41f8-9fce-bf92d00849be req-b77dc5e7-be44-46cd-9ada-09fef2a6651c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036802 Nov 02 12:19:00.881683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2705/5383] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:01.069182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:01.072599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:01.104236 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d4ff1a6-a621-49bd-9048-af3f4f7001b0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.364447 Nov 02 12:19:01.119503 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2679/5384] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:00 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:01.544631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:01.550876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:01.555110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:01.555878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:01.556561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:01.557494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:01.558197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:01.560335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:01.782782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:01.800939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ed06a7b-f922-471d-b30b-544318af638b tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.262368 Nov 02 12:19:01.810332 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2706/5385] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:01 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:02.134087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:02.134577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:02.144595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.145453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.146131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:02.147150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.148649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.149377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:02.396688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:02.405093 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cc05762-f07a-4d03-be31-249ffd18257b tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.276895 Nov 02 12:19:02.418535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2680/5386] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:02 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:02.825357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:02.826002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:02.833819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.841875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.841875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:02.841875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:02.841875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:02.841875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:03.051378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:03.060931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f26db78-f315-4e62-b252-ddbf932eacc2 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.237809 Nov 02 12:19:03.060931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2707/5387] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:02 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:03.430563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:03.431233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:03.438715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:03.439494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:03.439953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:03.440664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:03.441132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:03.441564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:03.648041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:03.674456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:03.715593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:03.723296 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e32ac60e-591a-40af-b68b-d85219944bc7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.297206 Nov 02 12:19:03.723874 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2681/5388] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:03 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:04.082336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:04.083065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:04.090669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.091353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.091859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.092751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.093309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.093796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.411414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:04.418161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23c20889-733e-4e70-a799-f1cd422bf5d1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.340254 Nov 02 12:19:04.418738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2708/5389] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:04 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:04.752133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:04.753071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:04.761250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.761824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.762339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.763183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:04.763708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:04.764205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:04.993927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:05.001756 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42bb2b16-9aeb-4a04-a6da-973aae12b928 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.260365 Nov 02 12:19:05.002345 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2682/5390] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:04 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:05.442811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:05.443488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:05.449327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:05.458504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:05.460671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:05.460671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:05.464535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:05.465226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:05.465860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:05.701871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:05.710051 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa047081-6a66-4b17-af15-20b13f26522c tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.272124 Nov 02 12:19:05.710739 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2709/5391] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:05 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:06.038194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:06.038194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:06.042256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.043003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.043716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.044721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.045499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.046113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.311884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:06.320612 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0363d96-103e-4de2-8ae2-0ee60c18f2de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.297871 Nov 02 12:19:06.326044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2683/5392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:06 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:06.734131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:06.734769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:06.746908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.747983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.748632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.749699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:06.750360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:06.751044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:06.979634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:06.987554 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f226fe5c-7414-4f2a-b7c1-1aade6c44cdf tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.257646 Nov 02 12:19:06.988140 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2710/5393] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:06 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:07.350454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:07.351226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:07.358779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.359396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.359916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.360780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.361316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.361824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.632606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3158096-a429-48b6-8e3f-bda7c4a97e22", "name": "network-vif-plugged", "status": "completed", "tag": "bc92c494-4eed-4e37-a3dd-678ecb7952d3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:07.655340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:07.656634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:07.657069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:07.678592 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] Creating event network-vif-plugged:bc92c494-4eed-4e37-a3dd-678ecb7952d3 for instance e3158096-a429-48b6-8e3f-bda7c4a97e22 on n-h2-855649-4 Nov 02 12:19:07.684290 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e00b5e23-c1ce-4037-b7b3-f6194864589d req-ef0f65e6-25d3-421a-8fab-d2754dab2519 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056095 Nov 02 12:19:07.689954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2711/5394] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:08.015590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:08.016304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:08.026907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.028596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.028596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.029483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:08.030223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:08.030871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:08.156844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:08.166457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94c2dbca-9c03-433d-a601-01666834b937 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.820415 Nov 02 12:19:08.167394 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2684/5395] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:07 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:08.486129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:08.497241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eaa501b2-2332-4184-b770-7cb22ae8871d tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.485820 Nov 02 12:19:08.499133 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2712/5396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:08 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:09.194903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:09.195619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:09.202443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.203247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.203923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.205039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.205669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.206486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.482277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:09.491788 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8d2984e-b392-4c91-a1a3-a239782eaa58 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.303267 Nov 02 12:19:09.492817 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2685/5397] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:09 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:09.523670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:09.525770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:09.535015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.535637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.536281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.537542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:09.538253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:09.538900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:09.754207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:09.766517 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0b3db74b-eb37-4a62-9080-57a127ba63b1 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1316 microversion: 2.1 time: 0.248383 Nov 02 12:19:09.769914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2713/5398] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:09 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:10.516950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.517578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:10.525966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.526464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.527194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.529172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.529172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.529172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.690850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:10.699290 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81d9755f-2bb2-4b0a-b805-fa4e1dca0b2d tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.186291 Nov 02 12:19:10.700035 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2686/5399] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:10.794019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:10.794636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:10.801485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.801970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.803044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:10.803736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:10.804225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:10.804649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.018635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:11.029283 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73b0b815-2387-486d-9ed9-acc544992c22 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1504 microversion: 2.1 time: 0.238982 Nov 02 12:19:11.030325 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2714/5400] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:10 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:11.054638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.055168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.061606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.062135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.062707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.063565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.064076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.064819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.090888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0ddad2d-7167-4a1d-8054-a862e239e50a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips" status: 200 len: 108 microversion: 2.1 time: 0.040756 Nov 02 12:19:11.091505 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2687/5401] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:11.104352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.104852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.111551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.112241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.113071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.114441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.115332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.118486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.147768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e21a476e-47b2-432e-b4b3-4b335c555459 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips" status: 200 len: 108 microversion: 2.1 time: 0.047242 Nov 02 12:19:11.148541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2715/5402] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:11.160923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.162135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.168833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.170192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.170192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.170457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.171181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.171833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.200716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b3d0e36-0074-4979-a295-5d88f066647a tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips/tempest-ServerAddressesTestJSON-827576320-network" status: 200 len: 93 microversion: 2.1 time: 0.044470 Nov 02 12:19:11.211206 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2688/5403] 10.222.0.48 () {58 vars in 1398 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22/ips/tempest-ServerAddressesTestJSON-827576320-network => generated 93 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:19:11.220789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.221298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.229590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.230080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.230514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.231257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.231711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.232561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.271834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:19:11.722638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.723895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.749524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.749524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.749524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.749981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.751553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.751929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.791576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac2f105e-d490-4ee2-9832-dba7052af4c9 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 204 len: 0 microversion: 2.1 time: 0.579837 Nov 02 12:19:11.793408 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2716/5404] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:19:11 2022] DELETE /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:11.802674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:11.804222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:11.811812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.812458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.812997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:11.813944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:11.814904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:11.815705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:12.117359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:12.125831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d29bbe3-ee20-4c01-8469-c45d4497cbc8 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.407189 Nov 02 12:19:12.126501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2689/5405] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:12.127215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:12.143491 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc1cb15b-c2ee-4428-9da2-b3645db8e254 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1510 microversion: 2.1 time: 0.345633 Nov 02 12:19:12.144611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2717/5406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:11 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:13.151383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:13.152008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:13.169493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:13.172651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:13.184928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:13.192457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:13.195232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:13.196354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:13.199027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:13.199918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:13.201051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:13.201353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:13.202140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:13.203095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:13.213006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:13.222511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:13.479364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:13.488356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d85c3e01-f520-4458-a8ae-44bb061ccd81 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1524 microversion: 2.1 time: 0.342172 Nov 02 12:19:13.489228 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2690/5407] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:13 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1524 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:13.550169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:13.559570 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f251c784-33a7-43cb-807a-bebf437aa0dd tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1510 microversion: 2.1 time: 0.395577 Nov 02 12:19:13.560167 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2718/5408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:13 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.232213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3158096-a429-48b6-8e3f-bda7c4a97e22", "name": "network-vif-deleted", "tag": "bc92c494-4eed-4e37-a3dd-678ecb7952d3"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:14.252640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.253139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.253588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.280198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] Creating event network-vif-deleted:bc92c494-4eed-4e37-a3dd-678ecb7952d3 for instance e3158096-a429-48b6-8e3f-bda7c4a97e22 on n-h2-855649-4 Nov 02 12:19:14.315368 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c95a243a-b8fd-42c4-848d-9a9d403b5b22 req-bc40b813-e6c5-41dc-965c-b92694207186 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086100 Nov 02 12:19:14.315730 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2691/5409] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:14.512006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:14.513486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.521331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.522109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.522647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.523504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.524082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.524740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.584380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:14.585093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:14.591938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.592438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.592882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.593594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:14.594054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:14.594486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:14.766122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e798fda768e4152b1c85e855bcf6574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbae56d3dd4744899854a1ad04bfabee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:14.777982 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f1db4be-ecb1-4891-bef4-ae1fc14457ba tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 200 len: 1301 microversion: 2.1 time: 0.197788 Nov 02 12:19:14.781392 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2692/5410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:14 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 1301 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.847983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:14.869859 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fd888b5-0dcd-4569-a695-90561af9894c tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1504 microversion: 2.1 time: 0.354338 Nov 02 12:19:14.869859 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2719/5411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:14 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:14.886033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6a101f4-543e-4c9a-b10a-1ec3658fc6a0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'create', calling method: .version_select at 0x7ff1b2fac4c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500023801", "description": "tempest-description-1455439753"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:15.423199 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6a101f4-543e-4c9a-b10a-1ec3658fc6a0 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.541102 Nov 02 12:19:15.424161 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2693/5412] 10.222.0.48 () {60 vars in 1180 bytes} [Wed Nov 2 12:19:14 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:15.437572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500023801"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:15.438194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:15.445114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:15.445606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:15.446045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:15.446745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:15.447229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:15.447668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:15.452348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:15.666535 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Adding security group a2792ac8-396a-4a9e-af70-7f0a71620f2e to port 32afd5cc-8565-48aa-b66e-6cf0005702a7 Nov 02 12:19:15.806814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:15.807388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] [instance: e3158096-a429-48b6-8e3f-bda7c4a97e22] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:15.817748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:15.818381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:15.818835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:15.819594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:15.820137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:15.820481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:15.854536 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] HTTP exception thrown: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Request method failure captured: Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 HTTP/1.1 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmAsNdG-U4mHSpW1c4mRnVG5Bk2pNTYysGOr5e56y-_bY-XNrCHiLXEuct3uQN4Y7faxBoFSZTeONS_VabcM-1Wr06PDEhQoyPEa9m2i4TAiFAE98HBAQsiXbhf6GbJnZiiOrTYoXxlIAeZ2eBq83ZG7TFuF_u2XId8B01uZEBc_ba8 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dbae56d3dd4744899854a1ad04bfabee Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerAddressesTestJSON-1235810184 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dbae56d3dd4744899854a1ad04bfabee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dbae56d3dd4744899854a1ad04bfabee", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dbae56d3dd4744899854a1ad04bfabee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dbae56d3dd4744899854a1ad04bfabee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerAddressesTestJSON-1235810184 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dbae56d3dd4744899854a1ad04bfabee Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1235810184 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerAddressesTestJSON-1235810184-project Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7e798fda768e4152b1c85e855bcf6574 Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerAddressesTestJSON-1235810184-project Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e3158096-a429-48b6-8e3f-bda7c4a97e22'} Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:15.857539 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. Nov 02 12:19:15.863747 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:15.865590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] Returning 404 to user: Instance e3158096-a429-48b6-8e3f-bda7c4a97e22 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:15.868047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b00707b1-d9db-4371-96fa-1496b438f5b5 tempest-ServerAddressesTestJSON-1235810184 tempest-ServerAddressesTestJSON-1235810184-project] 10.222.0.48 "GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22" status: 404 len: 111 microversion: 2.1 time: 0.065588 Nov 02 12:19:15.874659 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2694/5413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:15 2022] GET /compute/v2.1/servers/e3158096-a429-48b6-8e3f-bda7c4a97e22 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:19:16.432911 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2691ceb-7963-4785-8715-6f9c81b67e03 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action" status: 202 len: 0 microversion: 2.1 time: 0.997435 Nov 02 12:19:16.433574 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2720/5414] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:15 2022] POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:16.436345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:16.443738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-500023801"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:16.448572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:16.453742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.461271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.461863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.473464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.475022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.479136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.486043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:16.486043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:16.486043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:16.508943 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] Creating event network-changed:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:19:16.518926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a80dcf03-3cc7-4da8-b5a5-8501e4c57205 req-5857c00b-2f0d-46f4-84ae-d435db1bff79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086286 Nov 02 12:19:16.524043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2695/5415] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:16.938254 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Removing security group a2792ac8-396a-4a9e-af70-7f0a71620f2e from port 32afd5cc-8565-48aa-b66e-6cf0005702a7 Nov 02 12:19:17.178832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:17.180075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:17.188706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:17.189787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:17.190593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:17.191997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:17.192884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:17.193793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.019276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:18.037023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:18.043271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:18.049183 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f54a31e9-04b2-4b94-aa8e-cde817d48c74 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2955 microversion: 2.42 time: 1.129331 Nov 02 12:19:18.052882 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2696/5416] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:16 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2955 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:18.081310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:18.082073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:18.089716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:18.092107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:18.092107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.092107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:18.092642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:18.093447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.304380 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb79a398-cd01-4b83-b3b8-df84c1d80226 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.229451 Nov 02 12:19:18.306050 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2697/5417] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:19:18 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9/os-interface => generated 1833 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:18.419542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9db444bb-4b35-42ed-9335-82fa42fd1ce3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action" status: 202 len: 0 microversion: 2.1 time: 1.980990 Nov 02 12:19:18.420278 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2721/5418] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:16 2022] POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action => generated 0 bytes in 1983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:18.430970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6772ae23-bb56-4255-8e04-3d95840e71ad tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'create', calling method: .version_select at 0x7ff1b3246790>, body: {"pool": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:18.617246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:18.648793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:18.648793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:18.648793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:18.678336 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] Creating event network-changed:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:19:18.687237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-dfb13c79-b0c1-4595-8f90-490cd8fdf7cc req-7023454c-7d7f-4a84-b5b8-7b2fbe3ca426 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074094 Nov 02 12:19:18.688438 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2722/5419] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:21.671024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6772ae23-bb56-4255-8e04-3d95840e71ad tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.244153 Nov 02 12:19:21.673764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2698/5420] 10.222.0.48 () {60 vars in 1170 bytes} [Wed Nov 2 12:19:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:21.687730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.67"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:21.691221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:21.694332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:21.699582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:21.700139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:21.700658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:21.701416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:21.701930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:21.702472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:21.730397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:19:21.734638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquired lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:19:23.731092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Building network info cache for instance {{(pid=127567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:19:23.748266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:23.791221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:23.797167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:23.798876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:23.800431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:23.834790 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] Creating event network-changed:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:19:23.850160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5b9a6b79-ba29-4ec5-9411-54fb04933afe req-61a8e900-4d25-4d5b-84b4-cdf0c4a109c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107726 Nov 02 12:19:23.851006 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2699/5421] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:25.941942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Updating instance_info_cache with network_info: [{"id": "32afd5cc-8565-48aa-b66e-6cf0005702a7", "address": "fa:16:3e:91:51:96", "network": {"id": "a6dac891-736c-42d9-9760-d64cd62a428f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1429427603-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3b4864ef151f415ebc0fb2fddc4cf62d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32afd5cc-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:19:26.124505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Releasing lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:19:26.124505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e84f99d8-d119-4bcc-b217-9a38a050483a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action" status: 202 len: 0 microversion: 2.1 time: 4.437555 Nov 02 12:19:26.124505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2723/5422] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:21 2022] POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action => generated 0 bytes in 4440 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 02 12:19:26.131858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.67"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:26.517698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:26.526101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:26.526934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:26.527713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:26.528776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:26.530441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:26.532652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:26.943524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:19:26.943524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquired lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:19:28.722217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Building network info cache for instance {{(pid=127568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 12:19:28.788096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:28.807008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:28.808043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:28.808688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:28.830441 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] Creating event network-changed:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:19:28.842940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-de970b56-3865-4449-a5bb-2be4610144f5 req-a940d300-e319-4660-96c5-c32db1228e82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063106 Nov 02 12:19:28.844127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2724/5423] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:19:30.141097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Updating instance_info_cache with network_info: [{"id": "32afd5cc-8565-48aa-b66e-6cf0005702a7", "address": "fa:16:3e:91:51:96", "network": {"id": "a6dac891-736c-42d9-9760-d64cd62a428f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1429427603-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3b4864ef151f415ebc0fb2fddc4cf62d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32afd5cc-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:19:30.323529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Releasing lock "refresh_cache-617dde1f-d400-4ec7-87f6-c17646b16d10" {{(pid=127568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:19:30.324498 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b5b59f3-3e1e-47d1-a11c-3b376595d2bc tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action" status: 202 len: 0 microversion: 2.1 time: 4.198081 Nov 02 12:19:30.325123 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2700/5424] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:19:26 2022] POST /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10/action => generated 0 bytes in 4200 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 12:19:30.342215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2e08952-c7be-4195-b31c-9eb67a4c8148 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '.version_select at 0x7ff1bba46b80>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:32.734494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2e08952-c7be-4195-b31c-9eb67a4c8148 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/8cc29ce8-2501-45d5-bee1-c44e11304927" status: 202 len: 0 microversion: 2.1 time: 2.401173 Nov 02 12:19:32.754849 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2725/5425] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:19:30 2022] DELETE /compute/v2.1/os-floating-ips/8cc29ce8-2501-45d5-bee1-c44e11304927 => generated 0 bytes in 2423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:32.768431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c461baa-2e4b-4a48-bd75-20520290bdd9 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '.version_select at 0x7ff1b39cfdc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:33.658333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c461baa-2e4b-4a48-bd75-20520290bdd9 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/a2792ac8-396a-4a9e-af70-7f0a71620f2e" status: 202 len: 0 microversion: 2.1 time: 0.909074 Nov 02 12:19:33.658333 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2701/5426] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 12:19:32 2022] DELETE /compute/v2.1/os-security-groups/a2792ac8-396a-4a9e-af70-7f0a71620f2e => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:19:33.666860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:33.667866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:33.677429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:33.678066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:33.678853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:33.679880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:33.680341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:33.680772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:33.742889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:19:34.182176 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-055a8181-8161-4300-8f30-74975305304a tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 204 len: 0 microversion: 2.1 time: 0.521187 Nov 02 12:19:34.183530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2726/5427] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:19:33 2022] DELETE /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:19:34.196787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:34.197540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:34.217030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.219240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.221723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.225054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:34.225576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:34.226172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:34.236386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:34.464763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:34.473318 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3c5de4c-ecff-4702-a116-712d8e0610d5 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1510 microversion: 2.1 time: 0.285126 Nov 02 12:19:34.482314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2702/5428] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:34 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:35.501408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:35.502395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:35.526455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:35.527015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:35.527477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:35.528284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:35.528757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:35.529170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:36.278171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:36.312935 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff7454ea-5a9c-4c18-9286-cfda5ce564a7 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1510 microversion: 2.1 time: 0.815439 Nov 02 12:19:36.332808 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2727/5429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:35 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:37.346787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:37.346787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:37.369076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.371762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.371762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.371762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:37.371762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:37.375437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:37.827486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:37.841743 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83828c1b-f688-4e2f-9fd3-c13c5d184de3 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1510 microversion: 2.1 time: 0.506266 Nov 02 12:19:37.848335 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2703/5430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:37 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1510 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:37.985044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "617dde1f-d400-4ec7-87f6-c17646b16d10", "name": "network-vif-deleted", "tag": "32afd5cc-8565-48aa-b66e-6cf0005702a7"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:38.040530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.042037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.042841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.088716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] Creating event network-vif-deleted:32afd5cc-8565-48aa-b66e-6cf0005702a7 for instance 617dde1f-d400-4ec7-87f6-c17646b16d10 on n-h1-855649-4 Nov 02 12:19:38.097988 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-22ca2811-beae-4300-b8c8-253ed61af2d2 req-6f2e3606-7f1a-47ca-a855-13ebc1129ba6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118024 Nov 02 12:19:38.099613 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2728/5431] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:38.880210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:38.880210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:38.925776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.932870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.935406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:38.979389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:38.990168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:38.995794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.142579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:39.143465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:39.144159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:39.144898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lazy-loading 'fault' on Instance uuid 617dde1f-d400-4ec7-87f6-c17646b16d10 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:39.279877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16373f609d2d4e14856b6df33ff5f16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b4864ef151f415ebc0fb2fddc4cf62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:39.300799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6362308-aa15-4f97-b7c4-bd8593d073de tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 200 len: 1312 microversion: 2.1 time: 0.435969 Nov 02 12:19:39.311943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2704/5432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:38 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:40.308204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-23730364", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "e8e201cd-5709-4578-9255-0ccd131ba6a9"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:40.349401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:40.350031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] [instance: 617dde1f-d400-4ec7-87f6-c17646b16d10] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:40.383523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.384145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.384610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.385376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:40.385844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:40.386320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:40.429902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] validate_networks() for [('e8e201cd-5709-4578-9255-0ccd131ba6a9', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:19:40.439334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] HTTP exception thrown: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Request method failure captured: Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 HTTP/1.1 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmANWcgEVyofk1n5sAIseNaR2HmvM073fIVmTsiRpdfeSN6ZuY9g9EJgdwTwa02cZh6fH05tWi30J-RAoaAIDkpjI8X5UKc2vZWhNotzqtCBonn_W9WDGbgw1MdZZRWK0uj4RMhco4RXWq32RG_BOnUor2nQzQtQvkCjLcA_nHXMYcg Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 3b4864ef151f415ebc0fb2fddc4cf62d Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-572741701 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b4864ef151f415ebc0fb2fddc4cf62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b4864ef151f415ebc0fb2fddc4cf62d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b4864ef151f415ebc0fb2fddc4cf62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b4864ef151f415ebc0fb2fddc4cf62d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-572741701 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 3b4864ef151f415ebc0fb2fddc4cf62d Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-572741701 Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerRescueTestJSONUnderV235-572741701-project Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 16373f609d2d4e14856b6df33ff5f16f Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-572741701-project Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '617dde1f-d400-4ec7-87f6-c17646b16d10'} Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:40.442213 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. Nov 02 12:19:40.448985 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:19:40.451179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] Returning 404 to user: Instance 617dde1f-d400-4ec7-87f6-c17646b16d10 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:19:40.452294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-125c1608-239f-4dee-b7a6-37c7136e4766 tempest-ServerRescueTestJSONUnderV235-572741701 tempest-ServerRescueTestJSONUnderV235-572741701-project] 10.222.0.48 "GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10" status: 404 len: 111 microversion: 2.1 time: 0.108043 Nov 02 12:19:40.453058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2705/5433] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:19:40 2022] GET /compute/v2.1/servers/617dde1f-d400-4ec7-87f6-c17646b16d10 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:19:41.422470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:19:41.423184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:19:41.423454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:19:41.423794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:19:41.424211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:19:41.443403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.443980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.444672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.445450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:41.446191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:41.446826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:41.488911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Getting quotas for project fb1b3a9dc1a24cbc86fe2104f10b8ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:19:41.501574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Getting quotas for user 96f4e893b6444443a746ae119f409629 and project fb1b3a9dc1a24cbc86fe2104f10b8ca3. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:19:41.530170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:19:41.534073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:19:41.667663 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1df866f6-7a0a-4b6e-b2ad-94dd56b566c8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.711881 Nov 02 12:19:41.675226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2729/5434] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:19:41.686905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:41.688323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:41.798234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:41.811133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:41.813088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:41.815009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f22a2ee9-0348-4410-89cc-7cdd0b46224a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1260 microversion: 2.26 time: 0.138327 Nov 02 12:19:41.816251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2706/5435] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:41 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1260 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:42.843176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:42.843745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:42.954126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.962675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.964074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:42.965247 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5c5e84b-a949-4fda-a4f1-5c7f12459937 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1260 microversion: 2.26 time: 0.127277 Nov 02 12:19:42.965885 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2730/5436] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:42 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1260 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:43.997970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:43.998818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:44.013421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.013922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.014369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.028858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:44.028858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:44.028858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:44.320086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:44.331944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:44.333717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:44.351920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cc98815-65fa-4ce1-aef7-8e34e8a22d4a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1256 microversion: 2.26 time: 0.341202 Nov 02 12:19:44.351920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2707/5437] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:43 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1256 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:45.366153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:45.368948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:45.406338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.410734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.412899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.424487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:45.425096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:45.425559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:45.579734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:45.593066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:45.595195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:45.596807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7c53870-a11f-4c47-8d7f-e4563a693da4 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1320 microversion: 2.26 time: 0.235192 Nov 02 12:19:45.611043 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2731/5438] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:45 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:46.634890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:46.640446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:46.649202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.653709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.653709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:46.653709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:46.653709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:46.653709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:47.011039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:47.034255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:47.038191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:47.040338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d964a738-f80d-4415-afcb-0551ee23071d tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.413822 Nov 02 12:19:47.056615 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2708/5439] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:46 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:48.078425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:48.081456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:48.094272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.095047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.095689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.096760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.097777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.105570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.288457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92c15a2-0adb-42b7-bf61-4d75d8c0371b", "tag": "ce204832-126b-494f-af81-de79bf3b9d07"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:48.317100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.320698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=54,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:48.327096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:48.329169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:48.331045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:48.334654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.340611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:48.345157 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3eb143e9-6098-4924-8131-b4e75c87610e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.268811 Nov 02 12:19:48.345157 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2732/5440] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:48 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:48.350662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] Creating event network-changed:ce204832-126b-494f-af81-de79bf3b9d07 for instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b on n-h1-855649-4 Nov 02 12:19:48.357123 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-360e937a-58b9-4c5d-8f19-535b59ba58cd req-50311ca0-18c4-4ad2-9bb6-9dd3fd90dbda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072889 Nov 02 12:19:48.358214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2709/5441] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:49.369639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:49.370252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:49.379174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.379675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.380842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.382122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:49.383584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:49.384355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:49.555369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.586798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.586798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:49.586798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78e701b3-3438-4d2c-a786-e577fee09a79 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.215777 Nov 02 12:19:49.586798 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2733/5442] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:49 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:50.621841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:50.623169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:50.636103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.637273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.637914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.638819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:50.639510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:50.640532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:50.816849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:50.829521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:50.831100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:50.832289 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf995dad-3600-41c2-a9b6-695fb7930450 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.223971 Nov 02 12:19:50.833765 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2710/5443] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:50 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:51.859886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:51.860553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:51.872535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:51.875552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:51.876587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:51.877176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:51.878235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:51.879289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:51.880169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:52.054685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:52.065477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:52.067142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:52.068985 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4ca57b8-36c2-40b6-a639-99273ec4e66a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.213443 Nov 02 12:19:52.069750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2734/5444] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:51 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:53.104395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:53.105030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:53.109039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:53.115762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.116273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.125858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.125858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.125858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.125858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.296044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:53.305444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:53.309458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:53.310676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b4d5017-2087-42b9-be8c-54bf796aab2e tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.213896 Nov 02 12:19:53.323235 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2711/5445] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:53 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:53.777930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92c15a2-0adb-42b7-bf61-4d75d8c0371b", "name": "network-vif-plugged", "status": "completed", "tag": "ce204832-126b-494f-af81-de79bf3b9d07"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:53.789334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:53.791703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:53.792341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:53.792926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:53.806501 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] Creating event network-vif-plugged:ce204832-126b-494f-af81-de79bf3b9d07 for instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b on n-h1-855649-4 Nov 02 12:19:53.812412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3615dd61-080f-4512-bad7-790b24fb8990 req-d04128ce-cd75-4c89-bd69-1abc59de97ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038192 Nov 02 12:19:53.813546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2735/5446] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:19:54.349817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:54.351851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:54.363781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.365381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.366871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:54.368432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:54.369670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:54.370517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:54.556029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.580783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.580971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:54.583612 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8b7c474-8d03-4d89-a60d-1a42ff98bc85 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1360 microversion: 2.26 time: 0.247275 Nov 02 12:19:54.584530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2712/5447] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:54 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:19:55.611111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:55.611880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:55.623380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:55.629836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.640166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.640166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.640875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.641495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.642067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.871987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:55.883976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:55.886602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:19:55.890381 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c92f8f7-2c2b-4d9f-a83e-c21d5a723e69 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1544 microversion: 2.26 time: 0.283320 Nov 02 12:19:55.891116 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2736/5448] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:19:55 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1544 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:19:55.918629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b3a16f70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:55.929861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.930358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.930803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.931329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:55.936913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.937443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.938046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.938765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.939243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.939947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.968345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.969055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.969542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:55.984510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:55.984993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:55.985435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.118548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:56.137338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58913659-5192-4a2c-b8bc-f210d462ad23 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1219935529" status: 201 len: 0 microversion: 2.26 time: 0.222932 Nov 02 12:19:56.138182 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2713/5449] 10.222.0.48 () {62 vars in 1380 bytes} [Wed Nov 2 12:19:55 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1219935529 => generated 0 bytes in 225 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:19:56.148712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6bea131e-715d-4d7a-9883-a79bc21a08d2 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2d93700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.157294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bea131e-715d-4d7a-9883-a79bc21a08d2 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.157818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bea131e-715d-4d7a-9883-a79bc21a08d2 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.158227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6bea131e-715d-4d7a-9883-a79bc21a08d2 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.178561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6bea131e-715d-4d7a-9883-a79bc21a08d2 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1219935529" status: 204 len: 0 microversion: 2.26 time: 0.034131 Nov 02 12:19:56.179407 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2737/5450] 10.222.0.48 () {60 vars in 1361 bytes} [Wed Nov 2 12:19:56 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1219935529 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:56.188963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b3a16ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.197096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.197586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.198029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.198514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:56.203735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.204213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.204656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.205339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.205800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.206282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.229741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.230231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.230713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.358548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:56.379904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f081f44-2276-4853-95b2-a91db7c38293 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 204 len: 0 microversion: 2.26 time: 0.194801 Nov 02 12:19:56.386368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2714/5451] 10.222.0.48 () {60 vars in 1295 bytes} [Wed Nov 2 12:19:56 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:56.392711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2b3f715-34f2-4fb7-9563-57fa57e1293b tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2d93d30>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.401619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b3f715-34f2-4fb7-9563-57fa57e1293b tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.402457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b3f715-34f2-4fb7-9563-57fa57e1293b tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.405858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2b3f715-34f2-4fb7-9563-57fa57e1293b tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.418617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2b3f715-34f2-4fb7-9563-57fa57e1293b tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 12 microversion: 2.26 time: 0.029146 Nov 02 12:19:56.426079 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2738/5452] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 12:19:56 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:56.430633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b30dd820>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.441332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.442186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.443502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.444221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:56.450809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.451472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.452011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.452843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.453554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.454086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.500471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.502021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.502534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.513736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.514357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.514949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.653886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:56.670449 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f2cb8c2-3857-4a77-9e93-6ff2c06ef0f3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1278080017" status: 201 len: 0 microversion: 2.26 time: 0.244038 Nov 02 12:19:56.671245 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2715/5453] 10.222.0.48 () {62 vars in 1380 bytes} [Wed Nov 2 12:19:56 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1278080017 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 12:19:56.684911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-866f3d0f-760f-4fec-94cc-8e6965eb38b8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2d93280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.695547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866f3d0f-760f-4fec-94cc-8e6965eb38b8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.696291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866f3d0f-760f-4fec-94cc-8e6965eb38b8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.697305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866f3d0f-760f-4fec-94cc-8e6965eb38b8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.709726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-866f3d0f-760f-4fec-94cc-8e6965eb38b8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 36 microversion: 2.26 time: 0.032606 Nov 02 12:19:56.710916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2739/5454] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 12:19:56 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 36 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:56.735628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b32f7e50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.743416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.743930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.744421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.745054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:56.752346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.752840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.753487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.754476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.755646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.756084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.783145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.783791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.784242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.787563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:56.908965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:56.929246 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-996f2016-993b-4e59-96fe-1f58d245e70f tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1278080017" status: 204 len: 0 microversion: 2.26 time: 0.211886 Nov 02 12:19:56.931548 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2716/5455] 10.222.0.48 () {60 vars in 1364 bytes} [Wed Nov 2 12:19:56 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1278080017 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:56.940555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2890ee41-5b8f-4782-aef2-44fa0d7c20e8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b35cdaf0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.951563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2890ee41-5b8f-4782-aef2-44fa0d7c20e8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.952248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2890ee41-5b8f-4782-aef2-44fa0d7c20e8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.952896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2890ee41-5b8f-4782-aef2-44fa0d7c20e8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.964927 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2890ee41-5b8f-4782-aef2-44fa0d7c20e8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 12 microversion: 2.26 time: 0.028772 Nov 02 12:19:56.966272 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2740/5456] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 12:19:56 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:56.976634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b326ce50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:56.985702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.986200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.986644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.987268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:56.994488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.995049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:56.995443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:56.996165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:56.996623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.005771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.023977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.024463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.024899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.037043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:57.053546 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f785f41-616a-42b2-9c9f-21993774a436 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 204 len: 0 microversion: 2.26 time: 0.081109 Nov 02 12:19:57.054181 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2717/5457] 10.222.0.48 () {60 vars in 1295 bytes} [Wed Nov 2 12:19:56 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:57.067021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2d939d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:57.083927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.084697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.085204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.085748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:57.093042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.093865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.094337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.095062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.095669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.096093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.126141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.126638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.127106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.139481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:57.148816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:57.148816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:57.256546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:57.279564 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:19:58.287303 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47408. Nov 02 12:19:58.292964 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c3db4bc-6789-4669-8e1c-1e6bc933539c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1502943451" status: 201 len: 0 microversion: 2.26 time: 1.231420 Nov 02 12:19:58.293826 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2741/5458] 10.222.0.48 () {62 vars in 1380 bytes} [Wed Nov 2 12:19:57 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1502943451 => generated 0 bytes in 1233 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 12:19:58.305506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b326c8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.309610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=50 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:19:58.316646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.317122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.318169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.318647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:58.324384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.324853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.325289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.325999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.326505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.326832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.353276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.353769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.354217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.363795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.364823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.365277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.508770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:58.529524 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-934e3ed5-9511-44c4-8fa6-1c458acb6989 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-547691825" status: 201 len: 0 microversion: 2.26 time: 0.229716 Nov 02 12:19:58.535995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2718/5459] 10.222.0.48 () {62 vars in 1377 bytes} [Wed Nov 2 12:19:58 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-547691825 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Nov 02 12:19:58.540618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2b53940>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.560706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.561189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.561638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.562156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:58.570035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.570593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.571052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.571803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.577884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.577884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.600553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.601218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.601663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.747013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:58.764478 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f8fd720-085a-4c77-84db-e529c1ad45cd tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 204 len: 0 microversion: 2.26 time: 0.228183 Nov 02 12:19:58.765261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2742/5460] 10.222.0.48 () {60 vars in 1295 bytes} [Wed Nov 2 12:19:58 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:19:58.774622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e153fad-a58f-4035-be35-ac72e953d217 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1bbaad5e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.783768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e153fad-a58f-4035-be35-ac72e953d217 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.784664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e153fad-a58f-4035-be35-ac72e953d217 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.785283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e153fad-a58f-4035-be35-ac72e953d217 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.796701 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e153fad-a58f-4035-be35-ac72e953d217 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 12 microversion: 2.26 time: 0.027248 Nov 02 12:19:58.802219 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2719/5461] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 12:19:58 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:19:58.807974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b2e1b9d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.817177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.818684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.819417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.820079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:58.826349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.826837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.827316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.828016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.828471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.829037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.852108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.852595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.853034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.863983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:58.878341 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-467ba9dc-5fe7-4eaf-947b-a47745f73a63 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 204 len: 0 microversion: 2.26 time: 0.074614 Nov 02 12:19:58.879363 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2743/5462] 10.222.0.48 () {60 vars in 1295 bytes} [Wed Nov 2 12:19:58 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:19:58.893007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b32a55e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:58.903572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.904132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.904607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.905151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:58.910735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.911301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.911740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.912440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.912894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.913318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.940905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.941428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.941861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:58.951407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:58.951889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:58.952326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.119238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:59.135614 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3a87da65-5987-42ee-bd92-b44dfa5079c3 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-716775156" status: 201 len: 0 microversion: 2.26 time: 0.250057 Nov 02 12:19:59.136395 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2720/5463] 10.222.0.48 () {62 vars in 1377 bytes} [Wed Nov 2 12:19:58 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-716775156 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 02 12:19:59.150090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b3950a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.160394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.160952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.161419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.161895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.167818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.168329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.168768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.173454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.173454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.173454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.202118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.202608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.203099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.213532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.214017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.214451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.394163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:59.429780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1dbe2989-6549-4357-a327-66f5f0796643 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1135276341" status: 201 len: 0 microversion: 2.26 time: 0.283187 Nov 02 12:19:59.431549 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2744/5464] 10.222.0.48 () {62 vars in 1380 bytes} [Wed Nov 2 12:19:59 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags/tempest-tag-1135276341 => generated 0 bytes in 286 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 12:19:59.451213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Action: 'update_all', calling method: .version_select at 0x7ff1bba2ce50>, body: {"tags": ["tempest-tag-1616618046", "tempest-tag-659119067"]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:19:59.463631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.464406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.465067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.466028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.475039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.475528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.475967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.476665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.477127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.477553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.501261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.501825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.502360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.627654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:59.649979 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aaf83cf3-818f-49cd-9330-b3a175f42c30 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 61 microversion: 2.26 time: 0.213192 Nov 02 12:19:59.656430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2721/5465] 10.222.0.48 () {62 vars in 1312 bytes} [Wed Nov 2 12:19:59 2022] PUT /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 61 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:59.663037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed7a7efc-8cd9-44e6-bb45-a02473c789d6 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1bbafa550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.673185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed7a7efc-8cd9-44e6-bb45-a02473c789d6 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.673749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed7a7efc-8cd9-44e6-bb45-a02473c789d6 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.674265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed7a7efc-8cd9-44e6-bb45-a02473c789d6 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.684531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed7a7efc-8cd9-44e6-bb45-a02473c789d6 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 200 len: 61 microversion: 2.26 time: 0.026924 Nov 02 12:19:59.685203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2745/5466] 10.222.0.48 () {60 vars in 1292 bytes} [Wed Nov 2 12:19:59 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 61 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:19:59.696520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '.version_select at 0x7ff1b32b0670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.709173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.710021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.710782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.711643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.719070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.719922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.720598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.721696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.722451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.723098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.757737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.758349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.759051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.860841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lazy-loading 'flavor' on Instance uuid a92c15a2-0adb-42b7-bf61-4d75d8c0371b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:19:59.877312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95438453-d2ea-4c41-8e8c-cd32485c1ffc tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags" status: 204 len: 0 microversion: 2.26 time: 0.185420 Nov 02 12:19:59.878392 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2722/5467] 10.222.0.48 () {60 vars in 1295 bytes} [Wed Nov 2 12:19:59 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:19:59.888297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:19:59.888900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:19:59.896472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.896472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.896656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.897344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:19:59.897797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:19:59.898227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:19:59.924379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:20:00.206145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.206714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.217839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.251939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ced36798-f0e9-4c69-9acc-cd71a876e05c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments/7a310fcd-688d-4b31-9109-4ff3b90b15a0" status: 200 len: 194 microversion: 2.20 time: 0.397739 Nov 02 12:20:00.258610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2746/5468] 10.222.0.48 () {60 vars in 1454 bytes} [Wed Nov 2 12:19:59 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments/7a310fcd-688d-4b31-9109-4ff3b90b15a0 => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:20:00.367842 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28ebbcb0-b25c-4e10-a096-ad666888692a tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 204 len: 0 microversion: 2.26 time: 0.483898 Nov 02 12:20:00.368635 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2723/5469] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:19:59 2022] DELETE /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:20:00.370932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.375099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.380422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.381025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.381469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.382179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.382633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.383101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.384774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.385700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.394782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.395462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.396063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.397001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.398086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.398686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.512776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:00.518053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lazy-loading 'services' on Instance uuid 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:00.619186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.627409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.628877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:00.630150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1aaa865c-6fff-480c-b3c0-1e843284f8b5 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1550 microversion: 2.26 time: 0.252182 Nov 02 12:20:00.630726 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2724/5470] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:00 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1550 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:00.786374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e01cc468-7944-4a5f-aaf0-95c1f2f7443d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments/7a310fcd-688d-4b31-9109-4ff3b90b15a0" status: 202 len: 0 microversion: 2.20 time: 0.419428 Nov 02 12:20:00.787206 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2747/5471] 10.222.0.48 () {60 vars in 1457 bytes} [Wed Nov 2 12:20:00 2022] DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments/7a310fcd-688d-4b31-9109-4ff3b90b15a0 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:20:00.799486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:00.804204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:00.815400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.816263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.817278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.818558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:00.819511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:00.820533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:00.869425 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0458aa95-7a0c-431b-b927-27e350da18ee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075488 Nov 02 12:20:00.870197 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2725/5472] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:00 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:01.658000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:01.658807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:01.666145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.666742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.667458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.668622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.669363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.669840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.888587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:01.894119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:01.908366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.909224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.910172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.913261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:01.921278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:01.922497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:01.982274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0741ce50-4374-4da0-8c1e-1886807075e5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099837 Nov 02 12:20:01.983560 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2726/5473] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:01 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:20:02.011169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:02.025042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:02.026858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:02.028302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8a46f56-f19e-44b9-b15a-2d5e83dce5d8 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1550 microversion: 2.26 time: 0.375532 Nov 02 12:20:02.029411 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2748/5474] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:01 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1550 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:02.695673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92c15a2-0adb-42b7-bf61-4d75d8c0371b", "name": "network-vif-deleted", "tag": "ce204832-126b-494f-af81-de79bf3b9d07"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:02.709018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:02.710532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:02.711301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:02.732648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] Creating event network-vif-deleted:ce204832-126b-494f-af81-de79bf3b9d07 for instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b on n-h1-855649-4 Nov 02 12:20:02.743837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2c89f560-2c6b-4f65-be58-e3bed7026f70 req-9a3868e1-7260-4a28-bda7-28fc13fad2a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055807 Nov 02 12:20:02.745621 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2727/5475] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:03.001684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.005391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:03.018131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.018865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.019338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.020077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.021062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.021669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.057234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:03.058012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:03.061323 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60e39651-c4b2-458b-a507-ed35fe7c321e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068411 Nov 02 12:20:03.061916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2749/5476] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:02 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:03.069918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:03.071717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.072216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.072692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.073596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:03.074060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:03.074494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:03.205231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:03.223080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:03.225738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96f4e893b6444443a746ae119f409629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1b3a9dc1a24cbc86fe2104f10b8ca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:03.227937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2090ec74-0743-45a0-83d8-b1693b84583c tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 200 len: 1345 microversion: 2.26 time: 0.176208 Nov 02 12:20:03.229018 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2728/5477] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:03 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 1345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:04.075636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.078786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.087620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.088331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.093343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.093343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.093343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.093343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.136531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-799b0888-3081-49a9-b2a9-be806d43c82c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065379 Nov 02 12:20:04.137862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2750/5478] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:04 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:04.254537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:04.255877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] [instance: a92c15a2-0adb-42b7-bf61-4d75d8c0371b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:04.265440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.265948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.266386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.267300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:04.267771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:04.268209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:04.283744 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] HTTP exception thrown: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Request method failure captured: Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b HTTP/1.1 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmBbF2Jz5Jt0uxpf0E3u1RILeRIR_qYH8totbBjtLQqKOnXiYSedUivHtuSjAodTpg61F1ioQlIEr0VQ0R8wWSeVB_IzWNncwLTXLaErYM1FzidWCw0n_3gW8muoFDHuzw4kJBmNzaqmPECoGMjVXCXlNYTAMzpdpNO2oMCYqbcugLA Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fb1b3a9dc1a24cbc86fe2104f10b8ca3 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerTagsTestJSON-2001712666 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb1b3a9dc1a24cbc86fe2104f10b8ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb1b3a9dc1a24cbc86fe2104f10b8ca3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb1b3a9dc1a24cbc86fe2104f10b8ca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb1b3a9dc1a24cbc86fe2104f10b8ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerTagsTestJSON-2001712666 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fb1b3a9dc1a24cbc86fe2104f10b8ca3 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerTagsTestJSON-2001712666 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerTagsTestJSON-2001712666-project Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 96f4e893b6444443a746ae119f409629 Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerTagsTestJSON-2001712666-project Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a92c15a2-0adb-42b7-bf61-4d75d8c0371b'} Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:04.285936 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. Nov 02 12:20:04.293990 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:04.297928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] Returning 404 to user: Instance a92c15a2-0adb-42b7-bf61-4d75d8c0371b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:04.299220 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64daac5f-51b0-468c-825b-c659f760f312 tempest-ServerTagsTestJSON-2001712666 tempest-ServerTagsTestJSON-2001712666-project] 10.222.0.48 "GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b" status: 404 len: 111 microversion: 2.26 time: 0.049093 Nov 02 12:20:04.300351 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2729/5479] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:04 2022] GET /compute/v2.1/servers/a92c15a2-0adb-42b7-bf61-4d75d8c0371b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:05.150141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:05.155471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:05.168060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:05.210245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-efd64a40-3c34-487c-8658-291b7c1f579d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064488 Nov 02 12:20:05.210839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2751/5480] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:05 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:06.224272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:06.227250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:06.261908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.267788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.268345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.269124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:06.269605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:06.270045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:06.391267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59943647-a6f7-48c3-8420-079196e778cf tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167947 Nov 02 12:20:06.391915 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2730/5481] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:06 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:20:07.405272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.408361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.418138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.418850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.419496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.420553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.421204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.422004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.491768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b54a18bb-946e-4208-9258-bbc877c1bb7b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.090652 Nov 02 12:20:07.494711 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2752/5482] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:20:07 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:07.631009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:07.631549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:07.648428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.649113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.649447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.650216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:07.653748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:07.654267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:07.709191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:20:08.371603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3438f1e4-bef6-45a0-8e1a-7dbdcb300034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 204 len: 0 microversion: 2.20 time: 0.737067 Nov 02 12:20:08.371603 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2731/5483] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:20:07 2022] DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:20:08.378261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:08.378892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:08.390883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.391415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.391862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.393004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:08.393647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:08.394474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:08.609731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:08.656492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:08.656492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:08.656492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff6d7803-6dc2-410e-bccc-6fb72ed1609a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.267049 Nov 02 12:20:08.672025 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2753/5484] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:08 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:09.685618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:09.686896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:09.699028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.700556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.712809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:09.718241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:09.719655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:09.720421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:10.127933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.146241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.147751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:10.149179 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f820e963-d18f-49e7-832b-84249812b0a4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.469773 Nov 02 12:20:10.149753 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2732/5485] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:09 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:11.177995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:11.179264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:11.187137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.187674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.193580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.194519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:11.195034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:11.195481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:11.573733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.587515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.591661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:11.593784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-278b1cdc-a357-46e2-b767-80731cb5adf9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1723 microversion: 2.20 time: 0.419623 Nov 02 12:20:11.618206 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2754/5486] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:11 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:12.242541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d623ac7-dedb-4198-a23f-3b8b8eeed2e1", "name": "network-vif-deleted", "tag": "8bed0b35-f956-4cbc-b13f-17be40b436a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:12.282437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.289915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.290839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.333510 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] Creating event network-vif-deleted:8bed0b35-f956-4cbc-b13f-17be40b436a5 for instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 on n-h2-855649-4 Nov 02 12:20:12.358196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6d4bf01c-b4ac-4afc-b800-8f8112870447 req-66af1a4b-13f1-4662-b131-c36f11e98482 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120319 Nov 02 12:20:12.366490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2733/5487] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:12.625654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:12.626892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:12.636069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.636572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.638004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.638960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.639884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.641189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.705197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.706157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.706776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.707606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lazy-loading 'fault' on Instance uuid 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:20:12.810781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:12.827805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:12.829356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:12.836494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a659860b-05d3-4eeb-8d2f-c5266cb9967e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 200 len: 1371 microversion: 2.20 time: 0.215189 Nov 02 12:20:12.837100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2755/5488] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:12 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:13.866598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:13.867582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:13.894354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.895882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.908491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.908491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:13.908491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:13.908491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:13.959038 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 HTTP/1.1 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '7d623ac7-dedb-4198-a23f-3b8b8eeed2e1'} Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.960787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:20:13.964772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:20:13.981791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c449895c-b3df-47f6-8e7e-30cb96372e08 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 404 len: 111 microversion: 2.20 time: 0.101281 Nov 02 12:20:13.982608 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2734/5489] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:13 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:20:13.992154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d96db2a-c3c7-40b0-8f91-abd31e033187 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '.version_select at 0x7ff1b2d93700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:14.127315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d96db2a-c3c7-40b0-8f91-abd31e033187 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702542058" status: 204 len: 0 microversion: 2.20 time: 0.139954 Nov 02 12:20:14.132172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2756/5490] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 12:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702542058 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:20:15.939112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dec625e4-d965-4dd0-a2b9-a834fedde4c0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: .version_select at 0x7ff1b32ea4c0>, body: {"keypair": {"name": "tempest-keypair-1480188749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYSP4CxPDx8DMcVjhoILZ8CiSlEIcgyuUNWklY0AvbTIUyKg7UVECDCHzdCgCC76RDuLAjmUFH9LGEanmSODYIqpAylXPxBF/WzHPycCih8O23jhcmcfq1XaPRheO+j4g=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:15.975116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dec625e4-d965-4dd0-a2b9-a834fedde4c0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for project 35cd9f7745c7496ab54140b648471e6a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:15.995277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-dec625e4-d965-4dd0-a2b9-a834fedde4c0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for user c1e0f9913abf4ea7b14677dea2dd9012 and project 35cd9f7745c7496ab54140b648471e6a. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:16.217324 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dec625e4-d965-4dd0-a2b9-a834fedde4c0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.277678 Nov 02 12:20:16.217324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2735/5491] 10.222.0.48 () {62 vars in 1200 bytes} [Wed Nov 2 12:20:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:20:20.987994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1209499713", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9dc1f885-3670-491b-9450-5326900f025d"}], "security_groups": [{"name": "tempest-securitygroup--131374753"}], "key_name": "tempest-keypair-1480188749", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:21.298929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] validate_networks() for [('9dc1f885-3670-491b-9450-5326900f025d', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:22.446954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:22.447653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:22.447935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:22.448346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:22.448755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:22.458564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.459076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.459510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.460279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:22.460729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:22.461150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:22.479114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for project 35cd9f7745c7496ab54140b648471e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:22.484325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Getting quotas for user c1e0f9913abf4ea7b14677dea2dd9012 and project 35cd9f7745c7496ab54140b648471e6a. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:22.496802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:22.499198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:22.651323 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df184f64-3cf7-4d15-8e64-27e798d2e397 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.667893 Nov 02 12:20:22.658665 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2757/5492] 10.222.0.48 () {62 vars in 1188 bytes} [Wed Nov 2 12:20:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:20:22.677783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:22.682126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:23.296533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:23.318705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:23.322831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:23.328413 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55939078-c1d0-409b-83ae-5f78ed2e6f40 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1282 microversion: 2.20 time: 0.668557 Nov 02 12:20:23.329488 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2736/5493] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:22 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1282 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:24.358205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:24.363239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:24.981509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:24.997049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:25.001525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:25.002727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4ef0fda-c3ad-4fd7-98cd-3c1509138797 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1282 microversion: 2.20 time: 0.648869 Nov 02 12:20:25.003339 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2758/5494] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:24 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1282 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:26.032830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:26.034361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:26.046207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:26.049153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.050161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.050834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.053222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:26.054112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:26.057655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:26.180459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:26.197768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:26.199853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:26.201922 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea0ec3cb-414c-4255-9bcb-ab7eefa6e3f1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1334 microversion: 2.20 time: 0.174703 Nov 02 12:20:26.203262 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2737/5495] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:26 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1334 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:20:27.233502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:27.235795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:27.257611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:27.258565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:27.259331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:27.260207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:27.263968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:27.265210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:27.617751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:27.663796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:27.672645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:27.685817 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f37079a-1212-4fba-93ac-ad586cc5cdec tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1340 microversion: 2.20 time: 0.451207 Nov 02 12:20:27.691392 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2759/5496] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:27 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1340 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:28.737325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:28.737916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:28.784736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.784736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.784736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.789815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:28.796949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:28.803178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:28.961808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:29.000517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:29.003302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:29.007961 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e8a3b38-8e2c-40fc-b3cf-036b16b196b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1340 microversion: 2.20 time: 0.291384 Nov 02 12:20:29.019066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2738/5497] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:28 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1340 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:30.040987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:30.042748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:30.044292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:30.063607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.064114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.065013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.066289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:30.066919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:30.068091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:30.506536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:30.533925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:30.535496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:30.536763 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-278422b7-112f-4f7b-a8c6-5e8fc49bec5e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.500754 Nov 02 12:20:30.543092 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2760/5498] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:30 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:31.570622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:31.571279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:31.578962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:31.581104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.581798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.584003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.585181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.585807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.586396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.745784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:31.781207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:31.783145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:31.783145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:31.798012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] Creating event network-changed:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h2-855649-4 Nov 02 12:20:31.810449 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5ee16f39-6b1b-4a43-bb80-3645813f8fa5 req-25af1255-ad87-4278-bdaf-6bc0817d7e89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070869 Nov 02 12:20:31.811355 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2761/5499] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:31.887344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.901994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.904252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:31.906896 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f2092c2-a0b3-4e07-94ad-41a76bb49df8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.342654 Nov 02 12:20:31.909835 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2739/5500] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:31 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:32.943481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:32.943481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:32.943481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:32.971015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:33.169802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.179102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.180551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:33.181876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19b84345-459d-43ee-9002-4e2f1763efd7 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.247995 Nov 02 12:20:33.200961 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2762/5501] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:32 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:34.211566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:34.212300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:34.224699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:34.228895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.233131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.233802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.234794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:34.235422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:34.239383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:34.426558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.435680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.437139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:34.438288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f40ac3db-76c7-4027-bae3-d4a0fc88a1ed tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.233983 Nov 02 12:20:34.438863 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2740/5502] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:34 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:35.467888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:35.469183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:35.474910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:35.494421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.495580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.496372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.502686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:35.504135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:35.505319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:35.719181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:35.733766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:35.738547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:35.739008 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-548db8a3-2600-4a65-9694-2232876b29ce tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.276656 Nov 02 12:20:35.739860 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2763/5503] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:35 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:36.766520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:36.767280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:36.776359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:36.777087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:36.781115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:36.781115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:36.781115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:36.781115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:37.147893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.187088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.188937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:37.190857 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4e695c9-1a08-40f5-abe4-8001466b4e85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.429024 Nov 02 12:20:37.192861 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2741/5504] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:36 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:38.224259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:38.225458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:38.243863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.244861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.245457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.246426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.247236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.247886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:38.306306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:38.604374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:38.622657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:38.624416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:38.633005 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70d24af6-75f1-4473-87e5-8ecb5281870c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.415142 Nov 02 12:20:38.640169 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2764/5505] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:38 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:20:38.975718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "name": "network-vif-plugged", "status": "completed", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:38.998051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:38.998599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:38.999028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.039712 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] Creating event network-vif-plugged:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h2-855649-4 Nov 02 12:20:39.046959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0fa64be4-11ae-4b60-8cd4-036ce2f6de07 req-b214bd5d-b178-41b8-b360-b35d81b71d46 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075082 Nov 02 12:20:39.048232 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2742/5506] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:39.666225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:39.668187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:39.676993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.677487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.678119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.679372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:39.679984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:39.680564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:39.871710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.882456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.884315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:39.885805 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-925ec1c4-5576-4d3b-8de0-028d566c240a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.230290 Nov 02 12:20:39.886365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2765/5507] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:39 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:40.503966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1780716493", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:40.625981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:40.916978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:40.917613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:40.998495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.011443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.013877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.017490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.019039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.021518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.230339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:41.230893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:41.231505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:41.231994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:41.232648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:41.252355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.253072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.253526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.254269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:41.255434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:41.255893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:41.277676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Getting quotas for project 92b45c6113604a4fb19e56176740da93. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:41.285014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Getting quotas for user 62337836015b4f0a80eef6bba22d8046 and project 92b45c6113604a4fb19e56176740da93. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:41.308680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:41.312580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:41.344582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.366228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.369029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.370801 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e424c222-34d2-4627-b1ec-bd6eb091ed18 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1407 microversion: 2.20 time: 0.461606 Nov 02 12:20:41.372109 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2766/5508] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:40 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:41.596656 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d380335-b0f0-48b5-aeae-af95f2aa6c45 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100820 Nov 02 12:20:41.597856 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2743/5509] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:20:41.694389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ca059f0-92f2-44b7-aae7-b5b646d2170b tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:41.695656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ca059f0-92f2-44b7-aae7-b5b646d2170b tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:41.785636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1016761835", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "5eb714b2-4008-47c9-bfb6-bd6496e36454"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:41.934695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] validate_networks() for [('5eb714b2-4008-47c9-bfb6-bd6496e36454', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:20:41.983870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ca059f0-92f2-44b7-aae7-b5b646d2170b tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:41.999816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ca059f0-92f2-44b7-aae7-b5b646d2170b tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1215 microversion: 2.1 time: 0.382549 Nov 02 12:20:42.008770 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2744/5510] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:41 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:42.402473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.403515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.411379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.420861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.423715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.426557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.430084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.430673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:42.936690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.954090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.955626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:42.956989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e27c2a5b-70ea-48b4-9db3-28b4b53f759a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1599 microversion: 2.20 time: 0.558485 Nov 02 12:20:42.957573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2745/5511] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1599 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:20:42.982418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:20:42.983454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:20:42.984114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:20:42.984732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:20:42.985296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:20:42.988106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:42.988880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:42.997833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.998421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:42.998748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:42.999279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.002147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.002147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.002147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.002147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.002719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.004074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:43.004578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:43.005895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:43.036619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Getting quotas for project a4bce0005cc247bf86311ee8fa7e54b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:20:43.048252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Getting quotas for user 97b9a0d8a9534288a648cc768a6729ec and project a4bce0005cc247bf86311ee8fa7e54b2. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:20:43.128767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:20:43.138464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:20:43.164273 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1846686-afc3-41e5-8398-da85aa4f17eb tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.181831 Nov 02 12:20:43.176477 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2746/5512] 10.222.0.48 () {60 vars in 1316 bytes} [Wed Nov 2 12:20:42 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:20:43.180870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8309d48c-3537-4401-9ee2-75ce671e5da7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.181502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8309d48c-3537-4401-9ee2-75ce671e5da7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.362147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8309d48c-3537-4401-9ee2-75ce671e5da7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:43.374005 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bceab45-e5b2-4d2c-bfc2-7cc4eb32f52f tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000434 Nov 02 12:20:43.375248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2767/5513] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:20:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:20:43.386866 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8309d48c-3537-4401-9ee2-75ce671e5da7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1215 microversion: 2.1 time: 0.210798 Nov 02 12:20:43.389528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd05b4d1-1ace-4516-9bcc-799c6dea2011 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:43.390415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd05b4d1-1ace-4516-9bcc-799c6dea2011 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:43.399394 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2747/5514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:43.665312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd05b4d1-1ace-4516-9bcc-799c6dea2011 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:43.682689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd05b4d1-1ace-4516-9bcc-799c6dea2011 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1228 microversion: 2.1 time: 0.292958 Nov 02 12:20:43.700560 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2768/5515] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:43 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1228 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:44.413650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:44.414277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:44.448196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:44.582559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:44.594697 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7074cd4f-22c9-4a1b-91ee-79544f7c4f67 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1211 microversion: 2.1 time: 0.185205 Nov 02 12:20:44.599192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2748/5516] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:44 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:44.716662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5706243d-bc62-422c-8f80-d69bb954084a tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:44.717619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5706243d-bc62-422c-8f80-d69bb954084a tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:44.972255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5706243d-bc62-422c-8f80-d69bb954084a tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:44.990228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5706243d-bc62-422c-8f80-d69bb954084a tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1228 microversion: 2.1 time: 0.278190 Nov 02 12:20:44.992498 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2769/5517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:44 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1228 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:45.634069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:45.635785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:45.662031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:45.662891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:45.663635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.664763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:45.665581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:45.666463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.960033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:45.960033 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23f82291-ea75-494d-8f09-25eb1d9b32f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1267 microversion: 2.1 time: 0.288697 Nov 02 12:20:45.961975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:45.972118 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2749/5518] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:45 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] Creating event network-changed:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h2-855649-4 Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ff71ae01-4e5c-4331-b625-71df03a762e7 req-36746b39-739e-4671-a1f9-8f3efff85946 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037979 Nov 02 12:20:45.972320 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2770/5519] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:46.015240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.044588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:46.127908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:46.136619 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f77778f2-8984-4ddc-aad7-3b25583e0d52 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1232 microversion: 2.1 time: 0.125514 Nov 02 12:20:46.137331 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2750/5520] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:46 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1232 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:46.984663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:46.985393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:46.998725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:46.999329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:46.999825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.000567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.001045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.001481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.155927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:47.164475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:47.165644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:47.170391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df1dba21-0d68-4eeb-a2db-4316091a4e53 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1285 microversion: 2.1 time: 0.189995 Nov 02 12:20:47.173935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.174126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2771/5521] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:46 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:47.174779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.175425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.176325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:47.176999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:47.179893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:47.391829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:47.403775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d095189d-055f-432d-abbf-bf55ed563fb2 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1224 microversion: 2.1 time: 0.244377 Nov 02 12:20:47.409241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2751/5522] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:47 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1224 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:48.199548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:48.201914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:48.220041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.223136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.224347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.225324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.226391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.226836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.368192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.383513 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c480139a-0e98-40af-a8e2-f24d5f478199 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1273 microversion: 2.1 time: 0.192104 Nov 02 12:20:48.383513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2772/5523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:48 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:48.450971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:48.452467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:48.468332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.470633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.471238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.472004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:48.472477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:48.472919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:48.604722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:48.614638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39a79b0a-a63c-45dc-9321-9e1391e9ceef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1288 microversion: 2.1 time: 0.181286 Nov 02 12:20:48.615269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2752/5524] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:48 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:49.422344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:49.422966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:49.431172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.431658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.432091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.432899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.435868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.437882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.649680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:49.650334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:49.665670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.666176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.666828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.667613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:49.668085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:49.668523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:49.809122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:49.819344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb382748-f1c1-431c-baa7-0e037bfda097 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.400711 Nov 02 12:20:49.820112 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2773/5525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:49 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:49.976619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:49.990746 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e11ce324-5de1-4d8a-8eed-b0acfbbbb0c1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.355258 Nov 02 12:20:49.992174 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2753/5526] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:49 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:50.844109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:50.848365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:50.854170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:50.854710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:50.855182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:50.856005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:50.856610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:50.857550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.022173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:51.023685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:51.031002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.032004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.033471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.034634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.035497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.036027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.264378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:51.320243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:51.328117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1bfd3ee3-6116-4197-b37a-dbe1d3f1ce6c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.490074 Nov 02 12:20:51.328784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2774/5527] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:50 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:51.408684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:51.418338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75d0ca7b-a3a9-4f2f-82c9-250b5f68a9e1 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.400436 Nov 02 12:20:51.421631 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2754/5528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:51 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:51.737432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a390d10-b5fa-4936-986c-2d49ee49e434", "tag": "e13b97fd-e7da-48e4-aa77-49116821a630"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:51.748980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:51.749771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:51.750414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:51.766698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] Creating event network-changed:e13b97fd-e7da-48e4-aa77-49116821a630 for instance 2a390d10-b5fa-4936-986c-2d49ee49e434 on n-h1-855649-4 Nov 02 12:20:51.774310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-02c9ab4c-87fc-4fce-a92f-13d2a54f63fb req-fe15d6e2-1ad0-4883-882a-0536fe6c9982 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040735 Nov 02 12:20:51.776545 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2775/5529] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:52.351686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:52.352297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:52.359411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.359901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.360351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.361065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.361628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.362097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.447251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:52.448650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:52.462748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.464171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.465120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.466244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:52.471693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:52.471693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:52.721855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:52.745966 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-077656d2-9478-4163-bbb7-1a720c5d61a4 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.394023 Nov 02 12:20:52.748815 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2755/5530] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:52 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:52.813085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:52.824929 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b47e1172-0883-4750-bf09-8936582819f5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.382246 Nov 02 12:20:52.827223 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2776/5531] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:52 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:53.772072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:53.780698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:53.780698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:53.781265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.781843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.782358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:53.783355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.783914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.784636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:53.807571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e0127b-be42-48b2-b80d-bf8e7f908f09", "tag": "e7341594-785c-4eca-85d7-b950c888cdec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:53.823810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:53.827079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.828866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.830739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:53.851898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] Creating event network-changed:e7341594-785c-4eca-85d7-b950c888cdec for instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 on n-h1-855649-4 Nov 02 12:20:53.859142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-45e59c66-9d1f-45e4-919d-eb95196dc289 req-2246acaa-fe96-4c2d-a965-7909e0b95618 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059831 Nov 02 12:20:53.860547 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2777/5532] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:53.867445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:53.868736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:53.884402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:54.054138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:54.063828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c4d8a4ec-7d05-41f2-8e66-94a20b27ed21 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.296369 Nov 02 12:20:54.065402 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2756/5533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:53 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:54.094844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:54.102954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0120a61-9e10-499b-8fc7-9bf0f99f37e6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.240735 Nov 02 12:20:54.109138 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2778/5534] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:53 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:55.089344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:55.090561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:55.098658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.099444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.100077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.100810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.101333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.101779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.106184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:55.131408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:55.132334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:55.135181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:20:55.142608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.143389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.143840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.144555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:55.145020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:55.146015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:55.348637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:55.355975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:55.357562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ea2930c-1ea8-42a3-9b4a-fff2637de485 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.272773 Nov 02 12:20:55.358809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2757/5535] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:55 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:55.365182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59aa9047-5f56-49a7-af81-7e75c9c39255 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.241966 Nov 02 12:20:55.366377 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2779/5536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:55 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:56.382905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:56.383749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:56.390709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:56.391932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.392092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:56.392423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.393210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.394080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.394755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.395813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.402595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.403494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.404154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.405209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:56.405875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:56.406373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:56.615901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:56.628097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:56.630872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88cf7aea-ebe4-4425-8955-66a7f7abe2ef tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.245168 Nov 02 12:20:56.631513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2780/5537] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:56 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:20:56.637555 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00d6dbb5-e985-4cc6-9629-25e4ceefa6e2 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.259818 Nov 02 12:20:56.638387 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2758/5538] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:56 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:57.659782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:57.662428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:57.663953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:57.665046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:57.672935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.673909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.674697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:57.675613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.676358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.676541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.677125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:57.677483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.678637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:57.680907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:57.684383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:57.685281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:57.944149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:57.952393 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d367126b-24b6-498f-858e-0cb38204778f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.293770 Nov 02 12:20:57.959115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2759/5539] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:57 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:57.990511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:57.999581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-24083cee-4131-48a0-870a-31a2722b2e42 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.349173 Nov 02 12:20:58.012498 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2781/5540] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:57 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:58.745779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e0127b-be42-48b2-b80d-bf8e7f908f09", "name": "network-vif-plugged", "status": "completed", "tag": "e7341594-785c-4eca-85d7-b950c888cdec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:20:58.759747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:58.760227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:58.760656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:58.772581 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] Creating event network-vif-plugged:e7341594-785c-4eca-85d7-b950c888cdec for instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 on n-h1-855649-4 Nov 02 12:20:58.777872 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6b35a323-8727-4beb-b338-a0607baddbe5 req-95519014-5e63-42d3-815e-bf9c2ded6fdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036866 Nov 02 12:20:58.778465 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2760/5541] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:58.978525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:58.979240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:58.986792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:58.987335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:58.987822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:58.988533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:58.989541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:58.989983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:59.028655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:59.029619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:20:59.037204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:59.037713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:59.038148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:59.043802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:59.043802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:59.043802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:59.237781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:59.246255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd6be217-b8db-4161-ad39-bc1098243dbc tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.272663 Nov 02 12:20:59.246906 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2782/5542] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:58 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:20:59.298964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:20:59.310299 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cdf97e1-21bf-4440-acab-d1083d0e083b tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1328 microversion: 2.1 time: 0.286261 Nov 02 12:20:59.315379 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2761/5543] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:20:59 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:00.269182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:00.269803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:00.277127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.277620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.278060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.278769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.279252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.284886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.338019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:00.338786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:00.350289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.351277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.351798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.352737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.353573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.354225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.482295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:00.504082 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-134a8a5d-d3e2-4e39-8842-30ac0866dcb7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.238934 Nov 02 12:21:00.508417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2783/5544] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:00 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:00.557062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:00.574957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3706d771-4929-4465-bcfe-c34ed6118c70 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1528 microversion: 2.1 time: 0.236537 Nov 02 12:21:00.574957 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2762/5545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:00 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1528 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:00.591249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:00.592123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:00.604352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.604855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.605300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.606015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.606470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.606899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.751383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:00.760577 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d6a3f23-f24d-4f40-9e38-744be8753cd6 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1528 microversion: 2.1 time: 0.173362 Nov 02 12:21:00.761136 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2784/5546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:00 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1528 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:00.799560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a390d10-b5fa-4936-986c-2d49ee49e434", "name": "network-vif-plugged", "status": "completed", "tag": "e13b97fd-e7da-48e4-aa77-49116821a630"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:00.812949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:00.813727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:00.814371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:00.831431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] Creating event network-vif-plugged:e13b97fd-e7da-48e4-aa77-49116821a630 for instance 2a390d10-b5fa-4936-986c-2d49ee49e434 on n-h1-855649-4 Nov 02 12:21:00.838762 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-fcc5191d-dccb-4cf2-acaa-fef4a0e798fe req-7e6f182d-3c60-45ba-b68d-61114bd3e9bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042937 Nov 02 12:21:00.844781 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2785/5547] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:01.240584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.240584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.247362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.247362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.247362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.247362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.247819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.248183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.262617 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] HTTP exception thrown: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Request method failure captured: Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 HTTP/1.1 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmCYqfbR1-QCuiTYInyV41xRyaGkJPyMfAaQoaZSbFTQqxbv3z3paqaDLdTQrYtOhM9EDRgWqBDbB2flmZKNLdC28yaBMdDhESi-3UPWkZRliOvj1-wmNh-PF_ITnSProENRTIM2fkFky5E21BoOVEHqMP7d9Fnc0XukBKKtP6qIPuU Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ca4d337881444ebd8e5da50c004b91e7 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca4d337881444ebd8e5da50c004b91e7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ca4d337881444ebd8e5da50c004b91e7 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1171611082-project Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 08270c42ace94dffb035bd376f1e2306 Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082-project Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '88e0127b-be42-48b2-b80d-bf8e7f908f09'} Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:21:01.264425 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Returning 404 to user: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0499dd13-bdc4-4514-991f-a8707e791de2 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] 10.222.0.48 "DELETE /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 404 len: 111 microversion: 2.1 time: 0.487063 Nov 02 12:21:01.268515 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2763/5548] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:21:00 2022] DELETE /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 111 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:01.282657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.283789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.307914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.308408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.309653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.312462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.312950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.313390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.338566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:01.458866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:01.466763 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94556fa3-b4f2-4868-a73f-00316df231b9 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1528 microversion: 2.1 time: 0.194003 Nov 02 12:21:01.467393 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2786/5549] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1528 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:01.496322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Action: 'update', calling method: >, body: {"server": {"name": "88e0127b-be42-48b2-b80d-bf8e7f908f09_new"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:01.499276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.506639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.507188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.507654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.508378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.508949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.509376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.524201 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] HTTP exception thrown: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Request method failure captured: Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: request: PUT /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 HTTP/1.1 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 64 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmCYqfbR1-QCuiTYInyV41xRyaGkJPyMfAaQoaZSbFTQqxbv3z3paqaDLdTQrYtOhM9EDRgWqBDbB2flmZKNLdC28yaBMdDhESi-3UPWkZRliOvj1-wmNh-PF_ITnSProENRTIM2fkFky5E21BoOVEHqMP7d9Fnc0XukBKKtP6qIPuU Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ca4d337881444ebd8e5da50c004b91e7 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca4d337881444ebd8e5da50c004b91e7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca4d337881444ebd8e5da50c004b91e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ca4d337881444ebd8e5da50c004b91e7 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1171611082-project Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 08270c42ace94dffb035bd376f1e2306 Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1171611082-project Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "88e0127b-be42-48b2-b80d-bf8e7f908f09_new"}} Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '88e0127b-be42-48b2-b80d-bf8e7f908f09', 'body': {'server': {'name': '88e0127b-be42-48b2-b80d-bf8e7f908f09_new'}}} Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:21:01.529151 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] Returning 404 to user: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cf28868-6067-43cf-94f3-11960e570590 tempest-ServersNegativeTestMultiTenantJSON-1171611082 tempest-ServersNegativeTestMultiTenantJSON-1171611082-project] 10.222.0.48 "PUT /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 404 len: 111 microversion: 2.1 time: 0.035736 Nov 02 12:21:01.532777 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2764/5550] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 12:21:01 2022] PUT /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:21:01.538132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.538764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.541173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:01.541819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:01.545060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.545491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.546185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.547019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.547600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.548110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.548231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.548918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.549434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.550179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:01.550667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:01.551248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:01.580357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:21:01.713042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:01.721953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8ef31c3-c6cd-4371-9a40-f548605ba60f tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1315 microversion: 2.1 time: 0.188785 Nov 02 12:21:01.722547 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2787/5551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:01.991873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7416b72-05b3-4ce2-b150-2435868dc952 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "DELETE /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 204 len: 0 microversion: 2.1 time: 0.455322 Nov 02 12:21:01.992747 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2765/5552] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:21:01 2022] DELETE /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:21:02.001451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:02.002071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:02.008800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:02.009287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:02.009764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:02.010500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:02.010948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:02.011399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:02.461217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:02.469231 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-864e724f-1bf6-4012-9fb6-a99ce968cf36 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1534 microversion: 2.1 time: 0.472164 Nov 02 12:21:02.469804 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2788/5553] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:01 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1534 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:02.751485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:02.752296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:02.761478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:02.762129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:02.762740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:02.764062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:02.764566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:02.765275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:02.952475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:02.961055 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-736738f0-5f6f-4c67-a25e-1ca3be2fd469 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1465 microversion: 2.1 time: 0.215098 Nov 02 12:21:02.961578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2766/5554] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:02 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:03.009654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:03.010160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:03.017312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.017796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.018430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:03.019455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.020839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.021149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:03.054606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:21:03.494307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:03.494797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:03.501012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.501497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.501934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:03.502631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.503105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.503533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:03.599115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89d730c0-91f9-44ab-9ef4-a63c2806c899 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 204 len: 0 microversion: 2.1 time: 0.591927 Nov 02 12:21:03.607695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2789/5555] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:21:03 2022] DELETE /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:21:03.618255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:03.619780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:03.628048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.628858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.629549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:03.635395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:03.635395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:03.635395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.101380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:04.111916 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79fc877d-b14f-4b6e-96f7-f2bc381c53ea tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1534 microversion: 2.1 time: 0.621546 Nov 02 12:21:04.114311 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2767/5556] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:03 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1534 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:04.148508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:04.178001 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-86c6ada6-e095-46da-912c-f5498777029c tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1471 microversion: 2.1 time: 0.559937 Nov 02 12:21:04.178001 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2790/5557] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:03 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:04.437960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e0127b-be42-48b2-b80d-bf8e7f908f09", "name": "network-vif-deleted", "tag": "e7341594-785c-4eca-85d7-b950c888cdec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:04.452821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:04.453570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:04.454167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:04.468029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] Creating event network-vif-deleted:e7341594-785c-4eca-85d7-b950c888cdec for instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 on n-h1-855649-4 Nov 02 12:21:04.473974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-60162e41-d9d6-410c-b9c3-f716fadf0316 req-c64ef509-5a44-43ff-9df2-92c5432e9487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040003 Nov 02 12:21:04.475171 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2768/5558] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:05.139946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:05.140968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:05.150307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.150966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.155063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.155063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.155063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.155063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.193147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.193945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.194654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.195340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lazy-loading 'fault' on Instance uuid 88e0127b-be42-48b2-b80d-bf8e7f908f09 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:05.210488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:05.211711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:05.226676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.227823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.228678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.229863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:05.231153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:05.231973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:05.318930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b9a0d8a9534288a648cc768a6729ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bce0005cc247bf86311ee8fa7e54b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:05.332463 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f31ef3a-bb4b-4d3e-b1ae-1d118753bcaf tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 200 len: 1318 microversion: 2.1 time: 0.197524 Nov 02 12:21:05.333628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2791/5559] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:05 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:05.481660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:05.490959 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67f01ca7-151f-46e5-b9f5-b362bdea54a7 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1471 microversion: 2.1 time: 0.289402 Nov 02 12:21:05.491605 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2769/5560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:05 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:06.362618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:06.363358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] [instance: 88e0127b-be42-48b2-b80d-bf8e7f908f09] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:06.366936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:06.372400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.373170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.373620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.374339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.374800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.375459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.390396 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] HTTP exception thrown: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Request method failure captured: Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 HTTP/1.1 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmCL9GrbstcbY-7WHwigrYSvPyN87RuFfdvxswUv-PqYwD1BDxsZDcJeCZkBJKQTKdIsdC58ndP3Ks_SCGgKiOUDJqYhBR6S5btwd6wPv63umSvPkvgKN7JxiSBmwXCMd7x_G9bqvYjl475rk5hqAVVfJWmvBIeFjYef7tqmOK_-5VY Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a4bce0005cc247bf86311ee8fa7e54b2 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1557100488 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4bce0005cc247bf86311ee8fa7e54b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4bce0005cc247bf86311ee8fa7e54b2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4bce0005cc247bf86311ee8fa7e54b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4bce0005cc247bf86311ee8fa7e54b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1557100488 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a4bce0005cc247bf86311ee8fa7e54b2 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1557100488 Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1557100488-project Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 97b9a0d8a9534288a648cc768a6729ec Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1557100488-project Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '88e0127b-be42-48b2-b80d-bf8e7f908f09'} Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:06.392108 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. Nov 02 12:21:06.395581 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:06.397513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] Returning 404 to user: Instance 88e0127b-be42-48b2-b80d-bf8e7f908f09 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:06.398597 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31f11962-68be-44e4-8e2a-42f2043743d5 tempest-ServersNegativeTestMultiTenantJSON-1557100488 tempest-ServersNegativeTestMultiTenantJSON-1557100488-project] 10.222.0.48 "GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09" status: 404 len: 111 microversion: 2.1 time: 0.040054 Nov 02 12:21:06.399202 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2792/5561] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:06 2022] GET /compute/v2.1/servers/88e0127b-be42-48b2-b80d-bf8e7f908f09 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:06.518812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:06.522805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a390d10-b5fa-4936-986c-2d49ee49e434", "name": "network-vif-deleted", "tag": "e13b97fd-e7da-48e4-aa77-49116821a630"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:06.524658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:06.534492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.535442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.536653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.538310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.539010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.539601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.541116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.542121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.542685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.556617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] Creating event network-vif-deleted:e13b97fd-e7da-48e4-aa77-49116821a630 for instance 2a390d10-b5fa-4936-986c-2d49ee49e434 on n-h1-855649-4 Nov 02 12:21:06.576593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a12ab5df-aecd-4342-896f-8d7daaf6be88 req-b6b8b65d-9cae-4dac-94b4-09e5ecdbf045 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061222 Nov 02 12:21:06.577857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2793/5562] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:06.609711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:06.610477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:06.611183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:06.612141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lazy-loading 'fault' on Instance uuid 2a390d10-b5fa-4936-986c-2d49ee49e434 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:06.687276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62337836015b4f0a80eef6bba22d8046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b45c6113604a4fb19e56176740da93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:06.696252 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-220a3724-b454-418a-96df-bbb1e6ae9d63 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 200 len: 1305 microversion: 2.1 time: 0.184518 Nov 02 12:21:06.696954 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2770/5563] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:06 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 1305 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:07.723348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:07.724079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] [instance: 2a390d10-b5fa-4936-986c-2d49ee49e434] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:07.737701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.738269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.739057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:07.742066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:07.743373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:07.748367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:07.790772 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] HTTP exception thrown: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Request method failure captured: Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 HTTP/1.1 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmCTBOgWAi9nYyIqJ0WSCpwyuN40fIwqT6qCVvdhqBKoTm0V1wZiSe8NUCvFCKgy1kZpv-Qd0QbPYyPr4ci_gMneDDRi5GU-iJ9I-dcbN4xThLSg2IIHs_sMTRdJiuRchexhMAVYbna53dtC9n1J1X4K5Zr5LO4tEiWWZSDo4G5enfE Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 92b45c6113604a4fb19e56176740da93 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesNegativeTest-1533731115 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92b45c6113604a4fb19e56176740da93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92b45c6113604a4fb19e56176740da93", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92b45c6113604a4fb19e56176740da93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92b45c6113604a4fb19e56176740da93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesNegativeTest-1533731115 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 92b45c6113604a4fb19e56176740da93 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesNegativeTest-1533731115 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesNegativeTest-1533731115-project Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 62337836015b4f0a80eef6bba22d8046 Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesNegativeTest-1533731115-project Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '2a390d10-b5fa-4936-986c-2d49ee49e434'} Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:07.792942 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. Nov 02 12:21:07.796349 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:21:07.798225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] Returning 404 to user: Instance 2a390d10-b5fa-4936-986c-2d49ee49e434 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:07.799347 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6beb1c45-46c0-4bdd-8cc6-24998075c3f1 tempest-VolumesNegativeTest-1533731115 tempest-VolumesNegativeTest-1533731115-project] 10.222.0.48 "GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434" status: 404 len: 111 microversion: 2.1 time: 0.082180 Nov 02 12:21:07.802438 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2794/5564] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:07 2022] GET /compute/v2.1/servers/2a390d10-b5fa-4936-986c-2d49ee49e434 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:19.171638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:19.175327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:19.333567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-615707946", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "4bbee995-4ba3-4137-826f-4bbbbdafeb91"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:19.390761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] validate_networks() for [('4bbee995-4ba3-4137-826f-4bbbbdafeb91', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:20.037566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:20.038269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:20.039004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:20.039527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:20.040547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:20.054151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.054930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.055636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.056621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:20.057927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:20.058455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:20.087094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Getting quotas for project 8a5c0181318849aea32c37f768dc66fa. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:20.097154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Getting quotas for user 8d5233b7aa9a49fa9680106e582f5ea8 and project 8a5c0181318849aea32c37f768dc66fa. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:20.113694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:20.116655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:20.256190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-159170df-1933-459c-b2c1-0e9cfef1ab6d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092878 Nov 02 12:21:20.257124 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2771/5565] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:20.269813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36dedd14-a299-4c83-8976-8419a1871578 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:20.271819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36dedd14-a299-4c83-8976-8419a1871578 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:20.302470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:20.364670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36dedd14-a299-4c83-8976-8419a1871578 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:20.373536 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36dedd14-a299-4c83-8976-8419a1871578 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1213 microversion: 2.1 time: 0.107213 Nov 02 12:21:20.374542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2795/5566] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:20 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:21.401493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6794fa7d-0e9e-4b2d-8234-95a72ce18e86 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:21.402184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6794fa7d-0e9e-4b2d-8234-95a72ce18e86 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:21.503695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6794fa7d-0e9e-4b2d-8234-95a72ce18e86 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:21.521210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6794fa7d-0e9e-4b2d-8234-95a72ce18e86 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1213 microversion: 2.1 time: 0.124535 Nov 02 12:21:21.522228 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2772/5567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:21 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:22.545328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:22.545982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:22.557745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.558308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.558756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.559560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.560004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.560431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.633427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:22.642639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61c408ef-70bf-428d-a768-4233517c9f25 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1217 microversion: 2.1 time: 0.101556 Nov 02 12:21:22.643272 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2796/5568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:22 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:22.665958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:22.666569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:22.676984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.677575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.678312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.679221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:22.679967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:22.680496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:22.710673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:21:23.239918 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a0b2d1d-3938-4581-b28f-5b8aaad1eab5 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 204 len: 0 microversion: 2.42 time: 0.582932 Nov 02 12:21:23.240828 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2773/5569] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:21:22 2022] DELETE /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:21:23.251635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:23.252767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:23.260650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:23.261147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:23.261581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:23.262318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:23.262772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:23.263226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:23.490072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:23.504717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:23.506611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:23.508020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6350cd89-2a4c-481b-856e-371f653bf6e7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2961 microversion: 2.42 time: 0.260392 Nov 02 12:21:23.508803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2797/5570] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:23 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2961 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:23.672605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:23.673372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:23.694348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:23.694926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:23.695403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:23.696135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:23.696603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:23.697227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:23.784360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:23.794185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c03745f-6f7a-4ce5-8f39-4af721b45199 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1265 microversion: 2.1 time: 0.126012 Nov 02 12:21:23.796165 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2774/5571] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:23 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:24.542876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:24.543891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:24.557996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.560631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.561165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.561965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.562592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.563265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.809778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.820426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.823590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.833076 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9b5acac-b6d9-444c-9581-1a8d6763dc61 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2961 microversion: 2.42 time: 0.291633 Nov 02 12:21:24.833076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2798/5572] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:24 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2961 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:24.833384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:24.833384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:24.842328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.843181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.843865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.844880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:24.845702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:24.846347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:24.917705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:24.928023 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf20f4d3-e045-476b-b7af-17e540f55d4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1265 microversion: 2.1 time: 0.103570 Nov 02 12:21:24.942852 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2775/5573] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:24 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:25.862666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:25.866880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:25.877352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.881918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.882578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.883685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.884306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.884890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.965303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:25.967243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:25.980705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.982041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:25.982963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:25.998401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:25.999592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:26.000642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:26.244487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.256696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c4e98af-5c15-4597-9a53-2db85ee73ce8 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1265 microversion: 2.1 time: 0.302634 Nov 02 12:21:26.257351 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2776/5574] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:25 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:26.551583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.574188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.581228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:26.582447 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a830ab8-99fc-4b09-b19c-3defa8f49836 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2961 microversion: 2.42 time: 0.725339 Nov 02 12:21:26.587110 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2799/5575] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:25 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2961 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:27.281957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.282848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.309562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.310091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.318646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.322357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.324120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.324786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.486233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:27.495228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae076f5a-4b60-40f1-9978-0938e1a15904 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1271 microversion: 2.1 time: 0.217999 Nov 02 12:21:27.512373 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2777/5576] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:27.622547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:27.625485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:27.645914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.646439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.646886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:27.647643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:27.654450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:27.659264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.348637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.364372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.368683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:28.370099 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1077f260-177b-4b34-bbf8-361ac8219f00 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2961 microversion: 2.42 time: 0.758337 Nov 02 12:21:28.372916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2800/5577] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:27 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2961 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:28.521770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:28.522417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:28.547722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.548239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.548695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.549655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.552128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.555843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.715145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "9f57b110-70cf-4553-8955-22f352485443"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:28.737602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:28.738430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:28.739737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:28.765379 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] Creating event network-vif-unplugged:9f57b110-70cf-4553-8955-22f352485443 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:28.779773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-62848fc7-6a04-42fc-a9a5-2b4e570ad95f req-326205f8-c9b5-4d0a-a0f5-724013d1fffa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068349 Nov 02 12:21:28.783123 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2801/5578] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:29.251769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:29.267641 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fe0cdf7-efc3-470e-aa7f-87bc9417c9ea tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.749138 Nov 02 12:21:29.269832 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2778/5579] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:28 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:29.406760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:29.409367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:29.425896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.427421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.428614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:29.432441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:29.433124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:29.434283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.292025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:30.293313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:30.299499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:30.306780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.307581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.308036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.311528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:30.311528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:30.311528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:30.371515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:30.873927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.905823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.916955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.918858 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9641fff-dbfd-4f73-b98e-44c78d8c88ee tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2940 microversion: 2.42 time: 1.516567 Nov 02 12:21:30.920544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2802/5580] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:29 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2940 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:30.939075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:30.953919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "49cddf13-43ca-43b7-a525-e11d50847a9b"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:30.956481 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5aa5bbb-669f-43a2-b9d9-d5ae6f230858 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.668400 Nov 02 12:21:30.967293 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2779/5581] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:30 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:31.017216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.020483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.023021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.050788 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Creating event network-vif-unplugged:49cddf13-43ca-43b7-a525-e11d50847a9b for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:31.052508 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] Creating event network-vif-unplugged:e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:31.060824 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-41314869-4cf0-4ab1-abf1-be0390a4d1f2 req-8de1b923-42e3-47e0-818a-fc88fd59688b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.114911 Nov 02 12:21:31.062659 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2803/5582] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:31.953568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:31.954380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:31.963338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:31.983570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.986439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:31.987198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:31.987729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.990395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:31.991376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:31.998903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:31.999961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.016306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:32.022557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:32.023273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.024202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:32.026275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:32.027457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.849239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:32.862392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15eb21bf-c780-4a4e-bfb0-bb6b3a1969aa tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.881632 Nov 02 12:21:32.863352 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2804/5583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:31 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:32.880538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cc57d6-9894-4f99-9f30-a6f725bfd6cb", "tag": "bf48a9d0-fab5-479c-ba7a-f79a0ea0106d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:32.914865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:32.915382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:32.915815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:32.949035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] Creating event network-changed:bf48a9d0-fab5-479c-ba7a-f79a0ea0106d for instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb on n-h1-855649-4 Nov 02 12:21:32.954438 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d8e8054c-4332-4cda-9120-3983e13a4894 req-1e0ce5bd-958e-4f99-b60b-4e367d56e05f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084119 Nov 02 12:21:32.960910 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2805/5584] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:33.008041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.034461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.036586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:33.038194 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6064cf38-4e6c-4610-b2b0-b2896bb22c0d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2919 microversion: 2.42 time: 1.091091 Nov 02 12:21:33.039322 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2780/5585] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:31 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2919 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:33.130700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "7589d967-ecb9-4345-901d-65564cbc7e37"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "386711e8-b84b-41b6-8852-b468bb24a704"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-unplugged", "status": "completed", "tag": "0c74965c-575d-4fb0-a7e7-e737f0d386d4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:33.170400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.171450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.172172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.207133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Creating event network-vif-unplugged:7589d967-ecb9-4345-901d-65564cbc7e37 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:33.207954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Creating event network-vif-unplugged:386711e8-b84b-41b6-8852-b468bb24a704 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:33.211297 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] Creating event network-vif-unplugged:0c74965c-575d-4fb0-a7e7-e737f0d386d4 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:33.255249 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ead149ad-7fdb-4c40-8014-2d166399b764 req-22f5a940-f64e-4772-89d1-7d5ab2984573 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.126356 Nov 02 12:21:33.259035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2806/5586] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:33.892498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:33.892498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:33.927004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.927004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.928246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:33.929187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:33.929812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:33.931912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.073283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:34.074659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:34.106455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.111786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.114529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.121202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:34.122004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:34.125631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:34.707080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.718656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.723893 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a8f91eb-9282-4625-afcd-05343231142d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.839259 Nov 02 12:21:34.737269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2781/5587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:33 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:34.754163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.761366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:34.765728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33ae9373-d7c7-4f69-b4af-522d1229eb73 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2872 microversion: 2.42 time: 0.697378 Nov 02 12:21:34.766789 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2807/5588] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:34 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2872 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:35.100314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-deleted", "tag": "0c74965c-575d-4fb0-a7e7-e737f0d386d4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:35.130423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.133334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.134540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.164813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7706908-b89f-45a9-8961-6d779d34556e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: .version_select at 0x7ff1b357fb80>, body: {"keypair": {"name": "tempest-keypair-1813411128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc13XthVpTs63mMq/h1w6Obt1aOj1TrnVYdJOfKoExS4QOK4SvZd1mF9O5RB8tWD6Y6wMLvPmzwjkmdrBnOpLBPhHWRWBFuCpYpF0V6cDpgcXjpEqB/Gz3I2AdCUQADOQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:35.170922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] Creating event network-vif-deleted:0c74965c-575d-4fb0-a7e7-e737f0d386d4 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:35.193635 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4597113a-fcee-4620-a77f-8edbaafe6a40 req-68e0400d-87f8-4b99-908d-619e2ed12a0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096581 Nov 02 12:21:35.195668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2808/5589] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:35.226200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c7706908-b89f-45a9-8961-6d779d34556e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:35.248432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c7706908-b89f-45a9-8961-6d779d34556e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for user 866e943ff5b94fbebec3c8974ee053dc and project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:35.428271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7706908-b89f-45a9-8961-6d779d34556e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.689409 Nov 02 12:21:35.429626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2782/5590] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:21:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:35.765387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:35.766774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.780921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.781707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.782352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.783304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.784947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.788123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.798354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:35.799696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:35.833095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.834732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.843693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:35.850209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:35.850209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:35.850209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:36.365245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.374603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f990373-6860-4d34-a8e7-ae0a91ad27dc tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.614191 Nov 02 12:21:36.379012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2809/5591] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:35 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:36.550495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.565455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.567572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:36.574727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49f48ae4-ac1e-4845-8b9e-2b3a3a8b4055 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2711 microversion: 2.42 time: 0.777393 Nov 02 12:21:36.598169 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2783/5592] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:35 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2711 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:37.246083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-deleted", "tag": "e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:37.279440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.281360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.282256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.329973 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] Creating event network-vif-deleted:e8ee3a6f-9183-47e1-8ce6-3fa438dd27c1 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:37.341682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c015efb-7ad9-4933-90a6-0383c1b99201 req-34c8347f-d53d-4f20-8713-0420605bc4f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096144 Nov 02 12:21:37.341682 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2810/5593] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:37.421538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:37.422832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:37.435917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.436719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.437362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.438280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.439010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.440845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.620020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:37.621308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:37.636567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.639684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.640418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:37.649499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:37.650270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:37.650881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:38.260131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.288422 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5b895944-2820-4c29-a20e-64577570bc1d tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.882425 Nov 02 12:21:38.318221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2784/5594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:37 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:38.359089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.390066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.391585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:38.413350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7813eaa-6316-4c77-88c8-40bfb8bc14a2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2420 microversion: 2.42 time: 0.786520 Nov 02 12:21:38.416101 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2811/5595] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:37 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2420 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:39.324608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:39.326652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:39.375987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.377962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.379119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.382401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.383792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.387437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.413135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-deleted", "tag": "49cddf13-43ca-43b7-a525-e11d50847a9b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:39.442320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.442746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.446402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.507029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] Creating event network-vif-deleted:49cddf13-43ca-43b7-a525-e11d50847a9b for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:39.514477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-de963868-ac62-4bb0-beb7-3a5d6b15f5c1 req-da153d00-ad97-4495-8865-ca0afa4000ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105824 Nov 02 12:21:39.523633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2812/5596] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:39.538495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:39.542695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:39.564092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.565875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.566496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:39.567492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:39.568109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:39.573959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:40.543498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.556598 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-369ddeb9-9777-4914-b6e3-96270ab7ffbd tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 1.242754 Nov 02 12:21:40.560416 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2785/5597] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:39 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:40.566954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.592122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.593623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:40.597705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-866e5374-a7dd-448f-92b8-6e9db7bab0b8 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 2326 microversion: 2.42 time: 1.068018 Nov 02 12:21:40.603456 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2813/5598] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:39 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 2326 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:40.969710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cc57d6-9894-4f99-9f30-a6f725bfd6cb", "name": "network-vif-plugged", "status": "completed", "tag": "bf48a9d0-fab5-479c-ba7a-f79a0ea0106d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:40.996737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:40.998194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.005008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.029228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] Creating event network-vif-plugged:bf48a9d0-fab5-479c-ba7a-f79a0ea0106d for instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb on n-h1-855649-4 Nov 02 12:21:41.044275 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-71c682f6-783b-47f1-baf3-79ea58e9ebda req-6a20e2e1-cc52-44bf-aa03-ad425d81e058 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080393 Nov 02 12:21:41.045034 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2786/5599] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:41.072289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-981134275", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7bd10d9-80e3-4e5a-adaa-b0ad946c70df"}], "security_groups": [{"name": "tempest-securitygroup--703365895"}], "key_name": "tempest-keypair-1813411128", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:41.424641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] validate_networks() for [('c7bd10d9-80e3-4e5a-adaa-b0ad946c70df', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:21:41.590464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:41.591512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:41.615799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.616352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.621900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:41.622752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:41.623346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:41.623782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.060098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.077560 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86938f7f-be7a-4b48-8cd0-15d2497be001 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1313 microversion: 2.1 time: 0.500863 Nov 02 12:21:42.093455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2787/5600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:41 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:42.099647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:42.100604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:42.107977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.108830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.109490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.110410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.111125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.111754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.209601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.223859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.225521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.227051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d0b3d83-0f0d-4884-9642-520be52576bf tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.132181 Nov 02 12:21:42.251489 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2788/5601] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:42 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:42.263571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-deleted", "tag": "386711e8-b84b-41b6-8852-b468bb24a704"}, {"server_uuid": "7a104fc8-deba-4907-91f0-506d9d7867c9", "name": "network-vif-deleted", "tag": "7589d967-ecb9-4345-901d-65564cbc7e37"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:42.267790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.268326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.268876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.274227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:42.282664 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Creating event network-vif-deleted:386711e8-b84b-41b6-8852-b468bb24a704 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:42.283474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] Creating event network-vif-deleted:7589d967-ecb9-4345-901d-65564cbc7e37 for instance 7a104fc8-deba-4907-91f0-506d9d7867c9 on n-h1-855649-4 Nov 02 12:21:42.298662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6a321167-b730-4bc9-92d5-047a6d9fa1b2 req-91570bee-e1c1-4462-8113-2c8ca3ecf4c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045674 Nov 02 12:21:42.300816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2789/5602] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:42.380484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:21:42.381587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:21:42.382388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:21:42.383067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:21:42.383745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:21:42.395763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.396645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.397335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.398363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:42.399152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:42.399941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:42.469810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:42.479664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for user 866e943ff5b94fbebec3c8974ee053dc and project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:42.507484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:21:42.510900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:21:42.677117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6592d880-bdb6-4ca4-bcb8-4c53865e9e3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.611003 Nov 02 12:21:42.678452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2814/5603] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:21:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:21:42.690260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4faaccf-e2ad-4bf0-8e29-e4e262e21d4f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:42.691728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4faaccf-e2ad-4bf0-8e29-e4e262e21d4f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:42.855901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4faaccf-e2ad-4bf0-8e29-e4e262e21d4f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:42.877808 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4faaccf-e2ad-4bf0-8e29-e4e262e21d4f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1237 microversion: 2.1 time: 0.191986 Nov 02 12:21:42.880684 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2790/5604] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:42 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:43.102476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.103388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.111518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.112327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.112981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.114080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.114854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.116135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.261244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.262279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.275985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.276983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.277757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.278405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.278909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:43.279659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:43.280488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:43.294408 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c4e85e8-76f1-4acb-8c1a-13ca744caf90 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1497 microversion: 2.1 time: 0.197446 Nov 02 12:21:43.299496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2815/5605] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.467031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.495972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.503440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.510778 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ae556e7-2c5e-40b2-bc74-0842ca6cbf8f tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.254827 Nov 02 12:21:43.531963 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2791/5606] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:43.908873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59cf5695-01a1-489f-a325-61230ee7809c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.909581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59cf5695-01a1-489f-a325-61230ee7809c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:43.987045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59cf5695-01a1-489f-a325-61230ee7809c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:43.995961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59cf5695-01a1-489f-a325-61230ee7809c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1237 microversion: 2.1 time: 0.093653 Nov 02 12:21:43.996764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2816/5607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:44.542295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:44.547977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:44.566190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:44.567467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:44.568090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:44.569038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:44.575698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:44.576379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:44.704015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:44.723515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:44.725113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:44.726348 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85e8d9ba-8f8e-46a1-86b2-264b69ed90b7 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.188278 Nov 02 12:21:44.727260 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2792/5608] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:44 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:45.019652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:45.020986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:45.034955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.038420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.038420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.038420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.038420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.038420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.138768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:45.147762 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-baeed411-be5e-4d50-b2c8-fe3d26a0e7c4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1233 microversion: 2.1 time: 0.131963 Nov 02 12:21:45.150711 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2817/5609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:45 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1233 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:45.756817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:45.758294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:45.772706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.777032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.777753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.778659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:45.779295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:45.787193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:45.899592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:45.912362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:45.914196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:45.915447 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a36c382-8035-4ef8-894c-d5644afc9402 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.163301 Nov 02 12:21:45.916013 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2793/5610] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:45 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:46.177893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:46.178744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:46.191412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.192962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.195479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.200344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.201490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.202158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.456255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:46.495932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:46.506448 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dadfabdd-3d43-49ef-8b3a-ae78fdbc30d8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1297 microversion: 2.1 time: 0.332302 Nov 02 12:21:46.507441 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2818/5611] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:46 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1297 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:46.943081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:46.943985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:46.950789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.951535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.952255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:46.953111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:46.953712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:46.954290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.135578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.142559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.144076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.145841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0c5a75a-9c1b-4c2e-aa22-38d2bf42f643 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.207522 Nov 02 12:21:47.146401 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2819/5612] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:46 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:47.308637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3a71be0-0c7a-4893-9c81-6db486c96d73 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Action: 'create', calling method: .version_select at 0x7ff1b3fc65e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-886427130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfHXfFo3kIU7+zDxTr/k9FriIF6ct5Sj71IdoU1bTOvrkBPT7za5odqL9ZahK9ukEj0ht7+LPr7woRcRYMmuDn1/V0jzY41w4naxZqpvMrIciJ2A8+1z7E9RfJ+I6pbUw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:47.329160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b3a71be0-0c7a-4893-9c81-6db486c96d73 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:21:47.337179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b3a71be0-0c7a-4893-9c81-6db486c96d73 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for user b4defa4511744796b36f9b539f2f590f and project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:21:47.529737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:47.530308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:47.538248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.539158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.539844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.540659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:47.541369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:47.541885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:47.574716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3a71be0-0c7a-4893-9c81-6db486c96d73 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.656969 Nov 02 12:21:47.575686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2794/5613] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:21:46 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:47.648242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:47.659232 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13e93960-536e-46b4-a2e5-73bdb08db03a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1295 microversion: 2.1 time: 0.132956 Nov 02 12:21:47.675775 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2820/5614] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:47 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:48.178003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.178943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.190355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.192584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.192961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.193722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.197149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.197534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.341315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.351098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.352972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:48.354473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed6f1d2-8386-449a-8940-6f770b44b319 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.180484 Nov 02 12:21:48.355277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2795/5615] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:48.687008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.687008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.698692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.699705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.700853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.721389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.721389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.721389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.937966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:48.938479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:48.946792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.947581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.948182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.949667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:48.950296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:48.950903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:48.983306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:21:49.251836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.275062 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f270f07-7275-4c6e-8fec-d156c105229a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.592752 Nov 02 12:21:49.280118 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2821/5616] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:48 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:49.383535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:49.384362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:49.403426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.407167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.407587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:49.408604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.412430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.413340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.418858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.518121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2824d645-ad8f-4fda-8c1d-2b640217c883 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 204 len: 0 microversion: 2.1 time: 0.583725 Nov 02 12:21:49.519573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2796/5617] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:21:48 2022] DELETE /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:21:49.532418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:49.533587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:49.542309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.544726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.545740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.547656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:49.548786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:49.549591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:49.699824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.712978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.715404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.717542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd10e6f8-3bc3-49e3-8820-2052ae5d193e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.338865 Nov 02 12:21:49.719538 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2822/5618] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:49 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:49.956988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:49.974062 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e819461f-1f8f-4bac-bb8f-5fcacda099da tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1503 microversion: 2.1 time: 0.446349 Nov 02 12:21:49.975214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2797/5619] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:49 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.318910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.319411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:50.334105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.345391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.345391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.345391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.345391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.345391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.646520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029a6a4d-879d-424c-83ab-23ecdc9f54f1", "tag": "a1fe1337-bc12-4b25-a812-e05ed36e4262"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:50.667276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.670735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.671261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.671710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.677054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-099dea7d-2ca7-4456-ac07-90e5eeff293e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.364520 Nov 02 12:21:50.693974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] Creating event network-changed:a1fe1337-bc12-4b25-a812-e05ed36e4262 for instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 on n-h2-855649-4 Nov 02 12:21:50.696296 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2823/5620] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:50.701669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cbe26f1a-def7-4fc9-9bf0-d1226bc7b624 req-b0419fdf-961f-4a86-a5fc-6413e476323e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060433 Nov 02 12:21:50.705817 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2798/5621] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:50.749268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.754652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:50.765945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.766477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.767240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.768159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:50.768701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:50.769202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:50.945545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.956473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.958329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:50.959773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-344cb90d-8063-4129-9bd4-be485aebbfe0 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.216400 Nov 02 12:21:50.960880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2824/5622] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:50.999317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.000312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.008877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.009703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.010707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.013159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.013819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.014617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.408613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:51.423461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64aa3cf9-1c1b-4ded-92be-8be52134ca4a tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1503 microversion: 2.1 time: 0.429168 Nov 02 12:21:51.424461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2799/5623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1503 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:51.710309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.711196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:51.726179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.729235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.730029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.732268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:51.734786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:51.735459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:51.991014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:51.991641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.010167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.015497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.015497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.015497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.017683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.018757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.440991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:52.864337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.878230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.884524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.889265 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8097707b-aa21-46f5-9202-4546065c1f4d tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.903215 Nov 02 12:21:52.890197 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2800/5624] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:52.897708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:52.898365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:52.925787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.926350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.926800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.927733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:52.928208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:52.928658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:52.940397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:52.961604 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-766b0bbb-ad74-4937-8378-0aa28137c8b8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 1.255093 Nov 02 12:21:52.966304 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2825/5625] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:51 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:53.468948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cc57d6-9894-4f99-9f30-a6f725bfd6cb", "name": "network-vif-deleted", "tag": "bf48a9d0-fab5-479c-ba7a-f79a0ea0106d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:53.479637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:53.482073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.482811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.483437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.497840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] Creating event network-vif-deleted:bf48a9d0-fab5-479c-ba7a-f79a0ea0106d for instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb on n-h1-855649-4 Nov 02 12:21:53.504586 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7e79b0a1-ef78-4cb9-90c6-d191837fae12 req-55b316b0-df27-4ed1-8427-0f65915617b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039323 Nov 02 12:21:53.505853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2826/5626] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:53.581830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:53.592799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09011d8d-348a-42ba-9ac5-036bbcb925a2 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1503 microversion: 2.1 time: 0.701221 Nov 02 12:21:53.593682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2801/5627] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:52 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1503 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:53.924150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:53.924150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:53.936803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.938687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.939354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.940547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:53.941664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:53.942662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:53.998912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.001957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:54.002120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.024008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.024008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.024008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.024272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.024663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.025112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.066533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.084643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.086914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.088775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe669d10-362c-444b-9c5f-fe476c56b8ea tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.172457 Nov 02 12:21:54.089499 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2827/5628] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:21:54.309730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.323875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9934f7cc-e27b-4d20-9144-a537d0bbbab1 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.332553 Nov 02 12:21:54.339493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2802/5629] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:53 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:54.621032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.622215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:54.631687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.632457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.633065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.634102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.635667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.636320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.731104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:54.731884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:54.732893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:54.734811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lazy-loading 'fault' on Instance uuid 05cc57d6-9894-4f99-9f30-a6f725bfd6cb {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:21:54.809613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d5233b7aa9a49fa9680106e582f5ea8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5c0181318849aea32c37f768dc66fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:54.822464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f825602-592d-4c34-a622-c82d266c2500 tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 200 len: 1303 microversion: 2.1 time: 0.205722 Nov 02 12:21:54.823459 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2828/5630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:55.134658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:55.134658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.135983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.140440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.141093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.143938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.144542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.145172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.334707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.353490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:55.354282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.368693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.372298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.373655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.375967 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6458a781-af34-46d3-963d-652c50711860 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.263223 Nov 02 12:21:55.377287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.377869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.383917 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2803/5631] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:55 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:55.384699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.385428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.386141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.631402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:55.642318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3af5e145-89e2-46c6-ba8a-e6a6924a6f7d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.294934 Nov 02 12:21:55.644242 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2829/5632] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:55 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:55.847495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:55.849610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] [instance: 05cc57d6-9894-4f99-9f30-a6f725bfd6cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:55.874909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.877815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.878431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.881069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:55.883043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:55.884956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:55.903277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] HTTP exception thrown: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Request method failure captured: Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb HTTP/1.1 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmC5L7fqy_YbancLAIYGeKnO56nF90mh0tOyowxXla8qeTBdESffevKIXrzxoZab5wZNtKY3FD03Pbq4JZChRKtBpw7zGrXeNSODSV2-9q_OLMAFsW6kVLgwNhpZ0bAXUDcnSqu4dI7t8kXjS9CnG6PJjxq7ZSRBnA-eOaUUhVlNLUc Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 8a5c0181318849aea32c37f768dc66fa Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesActionsTest-1214275541 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a5c0181318849aea32c37f768dc66fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8a5c0181318849aea32c37f768dc66fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8a5c0181318849aea32c37f768dc66fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a5c0181318849aea32c37f768dc66fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesActionsTest-1214275541 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 8a5c0181318849aea32c37f768dc66fa Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesActionsTest-1214275541 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesActionsTest-1214275541-project Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 8d5233b7aa9a49fa9680106e582f5ea8 Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesActionsTest-1214275541-project Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '05cc57d6-9894-4f99-9f30-a6f725bfd6cb'} Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:21:55.905421 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] Returning 404 to user: Instance 05cc57d6-9894-4f99-9f30-a6f725bfd6cb could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-681bf34f-b4fb-4e53-978e-f4e5b1cf811f tempest-VolumesActionsTest-1214275541 tempest-VolumesActionsTest-1214275541-project] 10.222.0.48 "GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb" status: 404 len: 111 microversion: 2.1 time: 0.068099 Nov 02 12:21:55.923887 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2804/5633] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:55 2022] GET /compute/v2.1/servers/05cc57d6-9894-4f99-9f30-a6f725bfd6cb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:21:56.420846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.420846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.430011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.430796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.431559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.432538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.433384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.434301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.536609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.546947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.549792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.551593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7314ebb7-6acf-4809-ac1c-b2c132cf580b tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.138570 Nov 02 12:21:56.552353 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2830/5634] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:56.670814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:56.671552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:56.680178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.691470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.691470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.691470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:56.691470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:56.691470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:56.874302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:56.898843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9726fd30-7097-4519-ade3-050aa2c7296d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.236341 Nov 02 12:21:56.901451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2805/5635] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:56 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:57.578704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.579442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.595751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.596023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.596460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.597189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.597651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.598739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.730346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.750363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.752248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:57.756762 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61845417-87fa-4cd0-aedf-3fe6628890bc tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.181997 Nov 02 12:21:57.761711 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2831/5636] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:57.927984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.929182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:57.932502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:57.944899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.945404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.945861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:57.946597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:57.953630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:57.954306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.241266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.250276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eddae795-fb15-4e74-b15c-2c3603b007b9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.326855 Nov 02 12:21:58.257755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2806/5637] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:58.785159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:58.786287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:58.793394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.794165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.794788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.795730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:58.796254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:58.796867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:58.951909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.970665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.972309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:58.978003 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02d30e61-bdcc-45f2-9d16-db307f8b9525 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.193019 Nov 02 12:21:58.990380 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2832/5638] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:21:58 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:21:59.278762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:59.279477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:21:59.321705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.322239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.326605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.334677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:21:59.335230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:21:59.335720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:21:59.651200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:21:59.670543 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5485f1f1-86ee-4313-a6f1-0ebe9657f89e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.395975 Nov 02 12:21:59.677288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2807/5639] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:21:59 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:00.011088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.012253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.025781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.030377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.031233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.032623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.033405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.034231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.162271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.193162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.194712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:00.196015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae777373-7d73-43d7-b548-5ac0d6a591a9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1603 microversion: 2.42 time: 0.190381 Nov 02 12:22:00.218764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2833/5640] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1603 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:00.702552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.703373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:00.719474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.723799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.725340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.729724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:00.730702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:00.732318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:00.803679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:00.971442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.000926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8191229e-4d39-4657-8392-7e7ebdc4ab8c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.302745 Nov 02 12:22:01.024929 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2808/5641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:01.041036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029a6a4d-879d-424c-83ab-23ecdc9f54f1", "name": "network-vif-plugged", "status": "completed", "tag": "a1fe1337-bc12-4b25-a812-e05ed36e4262"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:01.058268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.060034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.060736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.083461 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] Creating event network-vif-plugged:a1fe1337-bc12-4b25-a812-e05ed36e4262 for instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 on n-h2-855649-4 Nov 02 12:22:01.094032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d8acc126-421f-4988-9327-b65c40466b6a req-94920455-595a-49e4-a0a1-11c5a06364e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351959 Nov 02 12:22:01.094844 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2834/5642] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:01.226704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:01.227359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:01.238782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.239691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.242298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.243200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.244316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.247516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.336444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:01.337150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:01.337763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:01.338391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lazy-loading 'fault' on Instance uuid 7a104fc8-deba-4907-91f0-506d9d7867c9 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:01.439092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.453801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.455920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9323f6adf51b4577b7a5d9931744af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daece1ed0dd48f2827d3f51319b0a66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:01.458586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6bc11b68-19ae-49db-ae9e-57245abaedeb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 200 len: 1608 microversion: 2.42 time: 0.235421 Nov 02 12:22:01.459567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2809/5643] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:01 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 1608 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:02.059800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:02.061447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:02.069998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.070852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.071430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.078421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.079310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.079977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.345674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1598106753-access_point-1943922213", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "141dbde7-7202-4ad2-bd89-84b31bef1486"}], "key_name": "tempest-TestSecurityGroupsBasicOps-886427130", "security_groups": [{"name": "tempest-secgroup_access--773266064"}, {"name": "tempest-secgroup_general--1373067496"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:02.836641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:02.847962 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f23fa1a1-9dd2-4b70-9c41-c73eb715f60c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1362 microversion: 2.1 time: 0.792185 Nov 02 12:22:02.859238 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2835/5644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:02 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1362 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:02.859238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:02.862970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:02.883357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.884226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.884870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.885801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:02.895353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:02.896215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:02.947722 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] HTTP exception thrown: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Request method failure captured: Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 HTTP/1.1 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl8E39p4Z6J5hHxQ4knf-6ksqUW8djitDei6n5tX56bVC-vika0tVVE0q50Pw8SbrLbV7hvtS-cchDGUkaBlP5o0t2oLIDP-JYlvMAfvTfU49ve_inP0KoRgL1V_FaoEtUOOzIsqpEj3j3PUMzAfbG-qRelFa_bbAIo9k0u5oUXrVW4 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6daece1ed0dd48f2827d3f51319b0a66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9323f6adf51b4577b7a5d9931744af8c Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '7a104fc8-deba-4907-91f0-506d9d7867c9'} Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:02.956762 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Returning 404 to user: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:02.963300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cef40a0b-93ac-442f-b08a-527af2c66ac2 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 404 len: 111 microversion: 2.42 time: 0.108425 Nov 02 12:22:02.966485 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2836/5645] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:02 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:22:02.976797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b8fa2e6-ed77-48d0-abef-2a82a14a9bcb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '.version_select at 0x7ff1b2de53a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.085829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] validate_networks() for [('141dbde7-7202-4ad2-bd89-84b31bef1486', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:22:03.112396 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b8fa2e6-ed77-48d0-abef-2a82a14a9bcb tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-440497936" status: 204 len: 0 microversion: 2.42 time: 0.147677 Nov 02 12:22:03.112998 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2837/5646] 10.222.0.48 () {60 vars in 1259 bytes} [Wed Nov 2 12:22:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-440497936 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:22:03.877683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:03.881021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:03.897361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.901651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.903615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.907628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:03.914268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:03.918267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:03.929461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:04.104374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:22:04.114704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:22:04.116668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:22:04.118514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:22:04.119132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:22:04.145603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.147697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.148165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.153713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.154479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.155112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.197923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:22:04.209620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for user b4defa4511744796b36f9b539f2f590f and project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:22:04.229561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:22:04.232141 n-d-855649-4 devstack@n-api.service[127568]: WARNING nova.utils [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1598106753-access_point-1943922213 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1598106753-ac Nov 02 12:22:04.232912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:22:04.240061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:04.253119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28aadadf-559f-4e76-81cf-d50621f79b68 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1549 microversion: 2.1 time: 0.379535 Nov 02 12:22:04.268663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2838/5647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:03 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1549 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:04.280243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.281209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.288448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.290073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.290752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.291840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:04.292539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:04.293211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:04.453602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c485346-f85e-4ff3-8521-a50480a8aed9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177447 Nov 02 12:22:04.454425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2839/5648] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:04.535843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe9e238c-2dd1-4560-9fa8-7403ddaef43c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.183995 Nov 02 12:22:04.536525 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2810/5649] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:02 2022] POST /compute/v2.1/servers => generated 457 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:22:04.554808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdffaf48-263e-486c-96b4-ab29656a1931 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.555610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdffaf48-263e-486c-96b4-ab29656a1931 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:04.716175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdffaf48-263e-486c-96b4-ab29656a1931 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:04.726090 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdffaf48-263e-486c-96b4-ab29656a1931 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1294 microversion: 2.1 time: 0.178140 Nov 02 12:22:04.727662 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2840/5650] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1294 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:05.754818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-baccd160-7fa5-4981-a9b2-5cfd5646bc34 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:05.755514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-baccd160-7fa5-4981-a9b2-5cfd5646bc34 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:05.945111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-baccd160-7fa5-4981-a9b2-5cfd5646bc34 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:05.953707 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-baccd160-7fa5-4981-a9b2-5cfd5646bc34 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1294 microversion: 2.1 time: 0.204305 Nov 02 12:22:05.956054 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2811/5651] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:05 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1294 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:06.605661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029a6a4d-879d-424c-83ab-23ecdc9f54f1", "tag": "a1fe1337-bc12-4b25-a812-e05ed36e4262"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:06.655051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:06.656678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:06.658498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:06.707996 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] Creating event network-changed:a1fe1337-bc12-4b25-a812-e05ed36e4262 for instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 on n-h2-855649-4 Nov 02 12:22:06.722239 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-413fd254-09e5-4014-9af6-84c1923da688 req-d96a1858-786e-4319-9fd4-e2b22ac44118 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120325 Nov 02 12:22:06.734040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2841/5652] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:06.980566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:06.982172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:07.007483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.012067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.013825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.023733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:07.025255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:07.027295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:07.186909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:07.200556 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ef8c69f-523f-4c15-b99c-8d517e5f1cd1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1290 microversion: 2.1 time: 0.227399 Nov 02 12:22:07.207496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2812/5653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:06 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1290 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:08.241567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:08.242435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:08.265079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.265574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.266017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.266728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:08.268991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:08.269465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:08.413255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:08.431794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4729e54-b7ce-46ef-8578-3ea12a4d0a95 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1354 microversion: 2.1 time: 0.202941 Nov 02 12:22:08.456845 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2842/5654] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:08 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:09.474639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:09.476036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:09.484600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.485571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.486263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.487233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:09.487917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:09.488614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:09.584883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:09.600086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e04377ab-66a1-4e33-ae55-1cf80b2b8c4b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1352 microversion: 2.1 time: 0.129951 Nov 02 12:22:09.601052 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2813/5655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:09 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:10.625006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:10.625621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:10.644113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.647153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.649353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:10.652609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:10.653573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:10.654235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:11.172783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:11.185018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3906dc5a-5686-4e81-bc14-20e77f581e63 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.564342 Nov 02 12:22:11.187623 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2843/5656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:10 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:12.214295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:12.214926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:12.234222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.240464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.241178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.242419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.243082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.243699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.674360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4033d38-dd86-4e0b-945a-41014178ddd4", "tag": "f37a965d-4bd6-40b1-9208-eec870a08066"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:12.687924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:12.688448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:12.689205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:12.716271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] Creating event network-changed:f37a965d-4bd6-40b1-9208-eec870a08066 for instance c4033d38-dd86-4e0b-945a-41014178ddd4 on n-h1-855649-4 Nov 02 12:22:12.727888 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a2620f1b-38df-4d7e-879e-5f640bf5eb53 req-095e6ce4-2091-41be-b325-a67f77af534f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057254 Nov 02 12:22:12.731473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2844/5657] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:12.733879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:12.751549 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23a4e5ae-f696-4330-a8e4-a0d13d325a6b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.541148 Nov 02 12:22:12.752782 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2814/5658] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:12 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:13.286281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.288838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.309723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.310226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.312928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.318686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.319295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.319666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.390362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c10a42c-6a65-4e19-a590-6ed6a1bcd5b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/ips" status: 200 len: 152 microversion: 2.20 time: 0.116397 Nov 02 12:22:13.392521 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2845/5659] 10.222.0.48 () {60 vars in 1289 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/ips => generated 152 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:13.526495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.532945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.553419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.554752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.555867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.557424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.558574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.559872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.589320 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] HTTP exception thrown: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Request method failure captured: Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 HTTP/1.1 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl8E39p4Z6J5hHxQ4knf-6ksqUW8djitDei6n5tX56bVC-vika0tVVE0q50Pw8SbrLbV7hvtS-cchDGUkaBlP5o0t2oLIDP-JYlvMAfvTfU49ve_inP0KoRgL1V_FaoEtUOOzIsqpEj3j3PUMzAfbG-qRelFa_bbAIo9k0u5oUXrVW4 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6daece1ed0dd48f2827d3f51319b0a66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9323f6adf51b4577b7a5d9931744af8c Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '7a104fc8-deba-4907-91f0-506d9d7867c9'} Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:13.593408 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.602599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Returning 404 to user: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:13.608554 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-070cfbc5-fd9d-4d97-8e9b-df583f05a75e tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 404 len: 111 microversion: 2.42 time: 0.099296 Nov 02 12:22:13.608981 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2815/5660] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:22:13 2022] DELETE /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:22:13.629989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.632610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] [instance: 7a104fc8-deba-4907-91f0-506d9d7867c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.647023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.648159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.649416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.652098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.652098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.653095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.684047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] HTTP exception thrown: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Request method failure captured: Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 HTTP/1.1 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl8E39p4Z6J5hHxQ4knf-6ksqUW8djitDei6n5tX56bVC-vika0tVVE0q50Pw8SbrLbV7hvtS-cchDGUkaBlP5o0t2oLIDP-JYlvMAfvTfU49ve_inP0KoRgL1V_FaoEtUOOzIsqpEj3j3PUMzAfbG-qRelFa_bbAIo9k0u5oUXrVW4 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6daece1ed0dd48f2827d3f51319b0a66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6daece1ed0dd48f2827d3f51319b0a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6daece1ed0dd48f2827d3f51319b0a66 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638462796 Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9323f6adf51b4577b7a5d9931744af8c Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638462796-project Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '7a104fc8-deba-4907-91f0-506d9d7867c9'} Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.686806 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. Nov 02 12:22:13.695467 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:13.699223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] Returning 404 to user: Instance 7a104fc8-deba-4907-91f0-506d9d7867c9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:13.701262 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c524b48-339a-41a2-8a13-598bb46d7da9 tempest-TaggedBootDevicesTest_v242-1638462796 tempest-TaggedBootDevicesTest_v242-1638462796-project] 10.222.0.48 "GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9" status: 404 len: 111 microversion: 2.42 time: 0.085487 Nov 02 12:22:13.702970 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2846/5661] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/7a104fc8-deba-4907-91f0-506d9d7867c9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:22:13.776904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:13.777988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:13.799923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.801384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.803760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:13.804733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:13.806712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:13.809319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:14.152838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:14.163264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5b630a9-f154-436c-b474-76b663d13da9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.392356 Nov 02 12:22:14.164480 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2816/5662] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:13 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:15.193272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:15.193927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:15.216010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:15.220925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.221669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.225058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.227441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:15.230234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:15.232770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:15.713981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:15.724589 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4461dc57-98a1-45cc-b3c0-ce665cef18f6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.535697 Nov 02 12:22:15.725181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2847/5663] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:15 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:16.752484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:16.753915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:16.760580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:16.762932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:16.764913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.765621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.766303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.767515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:16.768236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:16.768875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:16.987371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:16.988757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:17.000767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.001273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.001734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.010725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.011640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.012260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.072558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lazy-loading 'flavor' on Instance uuid 78b4d082-3dad-438f-b788-ccbdfe23a6ee {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:22:17.098737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:17.108185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53eda153-bf68-43d8-b655-ca0ced05bbb7 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.360162 Nov 02 12:22:17.109562 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2817/5664] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:16 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:17.800524 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dd28f79-594c-4e41-a86b-d6c69467135e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/action" status: 202 len: 0 microversion: 2.20 time: 0.816988 Nov 02 12:22:17.802742 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2848/5665] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:22:16 2022] POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:22:17.811325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:17.811957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:17.837851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.840480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.840480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:17.842316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:17.846351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:17.846933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.065876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.078708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.080769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.082506 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d83b7b60-a29c-46be-bad3-70c8e618d90e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.274751 Nov 02 12:22:18.083091 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2818/5666] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:17 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:18.137978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:18.139409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:18.154581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.155950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.156661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.157585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:18.158481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:18.159494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:18.338927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:18.347161 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6429344-2d87-4db2-94ed-5b808ba4fd24 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.215067 Nov 02 12:22:18.347795 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2849/5667] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:18 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:19.112551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4033d38-dd86-4e0b-945a-41014178ddd4", "name": "network-vif-plugged", "status": "completed", "tag": "f37a965d-4bd6-40b1-9208-eec870a08066"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:19.116972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:19.118294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:19.125798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.126873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.127619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.128146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.130211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.130939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.131747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.132436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.133095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.145931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] Creating event network-vif-plugged:f37a965d-4bd6-40b1-9208-eec870a08066 for instance c4033d38-dd86-4e0b-945a-41014178ddd4 on n-h1-855649-4 Nov 02 12:22:19.151449 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cf103ecd-22d4-4dcd-9053-cf94a2aea641 req-2c64f109-f6ee-4d44-bc93-2875674d4156 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045504 Nov 02 12:22:19.155958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2819/5668] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:19.371059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:19.371995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:19.379165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.379751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.380489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.381240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:19.381722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:19.382237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:19.458484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:19.494374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:19.507419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:19.552985 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc8c9e7a-99bd-415c-8823-9a3c3d4dcc1d tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.432321 Nov 02 12:22:19.553347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2850/5669] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:19 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:19.749150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:19.765374 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e3e69ae-5eee-4135-9be0-e0d6ba751dff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.399021 Nov 02 12:22:19.780291 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2820/5670] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:19 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:20.570251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:20.572792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:20.600368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.601105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.606127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.606127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.606127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.606127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.806735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:20.812711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:20.843530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.844377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.844850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.845616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:20.846253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:20.846716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:20.864549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.877366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.879101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:20.880497 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba3d9504-6e5e-460c-9635-a965c18edacd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.314382 Nov 02 12:22:20.881592 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2851/5671] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:20 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:21.091965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:21.101504 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c772ef52-e713-44e0-8cab-f4106d29dfe4 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1471 microversion: 2.1 time: 0.313207 Nov 02 12:22:21.103527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2821/5672] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:20 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:21.907401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:21.908951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:21.918405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.919290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.920797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:21.922472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:21.923309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:21.924603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.130411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:22.132594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.149968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.154319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.155040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.156248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.159711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.160801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.163074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.163452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.165221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.168682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0560086-3ec4-4745-bb51-90f4ac1fe6b3 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.265608 Nov 02 12:22:22.172908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2852/5673] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:21 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:22.454518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.467037 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82dd9d83-f089-4bbf-b950-a8ef378c417e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1642 microversion: 2.1 time: 0.340792 Nov 02 12:22:22.467651 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2822/5674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:22 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1642 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:22.495836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:22.498382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.505260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.506071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.506846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.508212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.508946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.509644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.764848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:22.778116 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d2baa53-a542-4a2b-b11a-aec92215a9d1 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1642 microversion: 2.1 time: 0.286793 Nov 02 12:22:22.782006 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2853/5675] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:22 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1642 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:22.804938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:22.805628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:22.809823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:22.820168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.203013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:23.204316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:23.213296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.214764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.216162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.217807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:23.219168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:23.220436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:23.527101 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4dfc7163-f092-4ebc-a158-e3eb017e8498 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1793 microversion: 2.1 time: 0.723033 Nov 02 12:22:23.531347 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2823/5676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:22:22 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1793 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:23.717167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.727033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.728691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:23.734691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c91e18d-e824-4150-9c99-f248e8a6efee tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.535673 Nov 02 12:22:23.768768 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2854/5677] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:23 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:24.761966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:24.762589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:24.788665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.791564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.794641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:24.796367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:24.797147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:24.801370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:25.187417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.207905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.213320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:25.214629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ec0941e-8c88-477b-b921-a528396a2369 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.457093 Nov 02 12:22:25.219548 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2824/5678] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:24 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:26.258213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:26.262782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:26.304228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.305109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.305883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.307278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:26.308263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:26.309196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:26.924998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:26.951498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:26.954206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:26.956438 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-334eb120-e5ff-43d2-8ec9-5281b707004f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.706332 Nov 02 12:22:26.973376 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2855/5679] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:26 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:28.007499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:28.009048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:28.027913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:28.038551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.041332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.041820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.047458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.048037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.048497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.128155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:28.228499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4033d38-dd86-4e0b-945a-41014178ddd4", "tag": "f37a965d-4bd6-40b1-9208-eec870a08066"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:28.254262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:28.257780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:28.261617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:28.294162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] Creating event network-changed:f37a965d-4bd6-40b1-9208-eec870a08066 for instance c4033d38-dd86-4e0b-945a-41014178ddd4 on n-h1-855649-4 Nov 02 12:22:28.295688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a5b36643-cc7f-4c36-84ae-d03762a95dd4 req-54d57ab4-73c3-4ad7-991e-8bae23360112 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479281 Nov 02 12:22:28.303520 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2825/5680] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:28.772768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.781625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.787262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:28.795502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0c85bd4-9d25-4510-86b4-208ba72c149f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.786965 Nov 02 12:22:28.801988 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2856/5681] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:28 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:29.832172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:29.833912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:29.866021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.866697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.873418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:29.876027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:29.876543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:29.877004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:30.211973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:30.224538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:30.227220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:30.231607 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6d41b8d-1a16-43a8-849c-01a088bce48e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.406091 Nov 02 12:22:30.234475 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2826/5682] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:29 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:31.264844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:31.265880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:31.283793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:31.284296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:31.293928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:31.295076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:31.298423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:31.299176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:31.749492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.762371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.764866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:31.766212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a065b1a-d435-4e61-9759-a60c7a6d36f0 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1745 microversion: 2.20 time: 0.506206 Nov 02 12:22:31.767210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2857/5683] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:31 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1745 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:32.799270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:32.801345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:32.812589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.813340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.813955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:32.815666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:32.817004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:32.817769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.108767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "name": "network-vif-plugged", "status": "completed", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:33.137556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:33.141080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:33.143614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:33.172440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] Creating event network-vif-plugged:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h2-855649-4 Nov 02 12:22:33.185777 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-08cea0f9-d422-42a1-811f-b9a9a129170b req-58a84aac-bb1f-4f8d-80f8-6e8106899bbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081086 Nov 02 12:22:33.188554 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2858/5684] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:33.263323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.288357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.292856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:33.299884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0f71be7-81e8-4878-837a-c0281fc77488 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1745 microversion: 2.20 time: 0.506063 Nov 02 12:22:33.325095 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2827/5685] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:32 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1745 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:34.363601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.364548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:34.373774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:34.374583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:34.375269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:34.376335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:34.376976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:34.377679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:34.926689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:34.944685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:34.946611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:34.949754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-790cb63d-83f6-430b-9559-121ead7cc058 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1745 microversion: 2.20 time: 0.591944 Nov 02 12:22:34.951516 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2859/5686] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1745 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:36.000564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.002845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:36.014395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:36.015599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:36.016301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:36.017276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:36.019127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:36.020690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:36.026547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:36.463535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:36.507302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:36.509229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:36.512307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-340b2a10-4787-46b3-ad3f-d34cfa3a93d6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1745 microversion: 2.20 time: 0.517287 Nov 02 12:22:36.517237 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2828/5687] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:35 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1745 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:37.551507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:37.557411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:37.567212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:37.568057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:37.569711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:37.572630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:37.573430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:37.575469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:37.915310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.926938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.928414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:37.929607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d919c67e-4574-4fdc-b382-cd0b1e9502cc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1745 microversion: 2.20 time: 0.390385 Nov 02 12:22:37.930671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2860/5688] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:37 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1745 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:38.965009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.965009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:38.980346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.986553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.987269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:38.988710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:38.989305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:38.989856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:39.428233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:39.455031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:39.459818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:39.461665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1976d084-b977-41a0-a6cf-805db7bf6a7c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.507372 Nov 02 12:22:39.463224 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2829/5689] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:40.492167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:40.493669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:40.502638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:40.504359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:40.505047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:40.506010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:40.506667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:40.507327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:40.872063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:40.886005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:40.892022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:40.897476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a0276a1-50c6-4f2a-a7d9-6638f5bc221a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.406394 Nov 02 12:22:40.899865 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2861/5690] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:40 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:41.926961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:41.928199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:41.942087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:41.942859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:41.943489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:41.944406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:41.952286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:41.953138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:42.473712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:42.493175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:42.505549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:42.514523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a1973ee2-c55b-46b4-92bc-900e3ff12d16 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.585689 Nov 02 12:22:42.525162 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2830/5691] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:41 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:43.541854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:43.543336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:43.563361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:43.584373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:43.585665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:43.590838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:43.591382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:43.594957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:44.184926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:44.203576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:44.210461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:44.211136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fa5d918-e542-401b-a6c9-d89f67f7d505 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.671353 Nov 02 12:22:44.212148 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2862/5692] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:43 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:45.245659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:45.246313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:45.258891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:45.259906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:45.260601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:45.261623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:45.262569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:45.263269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:45.648178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:45.664008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:45.701592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:45.702881 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a2f94392-fe97-493c-b7fa-892aee37efa6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.466506 Nov 02 12:22:45.711602 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2831/5693] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:45 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:46.739973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:46.740593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:46.758780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:46.764920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:46.767904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:46.769008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:46.770240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:46.772662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:47.315979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:47.334530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:47.347669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:47.355181 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1df1807-01fb-4f36-a9b3-6f2156b62264 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.614286 Nov 02 12:22:47.357645 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2863/5694] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:46 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:48.384051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:48.384676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:48.401909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:48.402414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:48.405839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.405839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:48.405839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:48.405839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:48.759214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:48.772660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:48.774120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:48.786494 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-485aef06-087c-4cea-a9e1-ed05ddc93fc9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.406265 Nov 02 12:22:48.788146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2832/5695] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:48 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:49.818685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:49.819943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:49.845867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:49.846367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:49.846811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:49.848102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:49.848568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:49.849023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:50.199093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:50.209769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:50.213887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:50.213887 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5593155-dc21-486a-9262-346a02b1e1b6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.399873 Nov 02 12:22:50.228638 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2864/5696] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:49 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:51.256461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:51.257093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:51.276621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:51.279560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:51.279560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:51.279560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:51.279560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:51.280152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:52.027675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:52.044914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:52.049757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:52.053684 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29763644-02d1-487d-b936-6efe8bee784e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.802088 Nov 02 12:22:52.057430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2833/5697] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:51 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:53.086864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:53.087684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:53.102762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.103511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.111648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.113467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:53.116110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:53.116693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:53.473096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.482036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.491105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:53.494365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7107cd2b-8c73-4b34-ba22-d98c833d4cb4 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.410781 Nov 02 12:22:53.518502 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2865/5698] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:53 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:54.527505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:54.528113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:54.546033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:54.546776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:54.548176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:54.549908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:54.553006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:54.555009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:54.819772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:54.838358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:54.839888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:54.844624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f08e902e-e0e7-454f-b50a-a63ee8374cbd tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.320051 Nov 02 12:22:54.874724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2834/5699] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:54 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:55.665870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-121d2795-ff9b-40f7-a777-6735c417f047 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-256600941", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:55.669610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-121d2795-ff9b-40f7-a777-6735c417f047 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] HTTP exception thrown: min_count must be <= max_count Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-121d2795-ff9b-40f7-a777-6735c417f047 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Request method failure captured: Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 183 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmEezDVcvG4Zq8nTI_FZVLdBNsL0bmtUtpvZBXXMZDnBHJOMYBXfK6tvDDwUQl4rU9GIueNargRZFCTXGYblDYAergC3wa3uZ-UlH2wFkSytDiI6GaiHh2CDr7_unTYk7rCb3uqttJhZ2AljfQbr2GKgOXK6_6XOJNFnxFJxkHkRcX0 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5892b37b1e58463fb2a7a34d31b4f1d2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 07051b6c722f4774a8246915cf267f15 Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-256600941", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: exception: min_count must be <= max_count Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-256600941', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 12:22:55.671223 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.680957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-121d2795-ff9b-40f7-a777-6735c417f047 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Returning 400 to user: min_count must be <= max_count {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:55.681867 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-121d2795-ff9b-40f7-a777-6735c417f047 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.526930 Nov 02 12:22:55.682473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2866/5700] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:55 2022] POST /compute/v2.1/servers => generated 74 bytes in 528 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:55.756409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e40e164-ff1b-4469-9e64-75c892f1ab31 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1597409175", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "max_count": 0}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e40e164-ff1b-4469-9e64-75c892f1ab31 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Request method failure captured: Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 168 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmEezDVcvG4Zq8nTI_FZVLdBNsL0bmtUtpvZBXXMZDnBHJOMYBXfK6tvDDwUQl4rU9GIueNargRZFCTXGYblDYAergC3wa3uZ-UlH2wFkSytDiI6GaiHh2CDr7_unTYk7rCb3uqttJhZ2AljfQbr2GKgOXK6_6XOJNFnxFJxkHkRcX0 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5892b37b1e58463fb2a7a34d31b4f1d2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 07051b6c722f4774a8246915cf267f15 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1597409175", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "max_count": 0}} Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1597409175', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'max_count': 0}}} Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:22:55.768480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e40e164-ff1b-4469-9e64-75c892f1ab31 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e40e164-ff1b-4469-9e64-75c892f1ab31 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017744 Nov 02 12:22:55.772745 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2835/5701] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:22:55.846760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c1396cb-294a-47f2-85d7-e28a2e0c8ad5 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1009969377", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "max_count": 2.5}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c1396cb-294a-47f2-85d7-e28a2e0c8ad5 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Request method failure captured: Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 170 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmEezDVcvG4Zq8nTI_FZVLdBNsL0bmtUtpvZBXXMZDnBHJOMYBXfK6tvDDwUQl4rU9GIueNargRZFCTXGYblDYAergC3wa3uZ-UlH2wFkSytDiI6GaiHh2CDr7_unTYk7rCb3uqttJhZ2AljfQbr2GKgOXK6_6XOJNFnxFJxkHkRcX0 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5892b37b1e58463fb2a7a34d31b4f1d2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 07051b6c722f4774a8246915cf267f15 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1009969377", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "max_count": 2.5}} Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1009969377', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:22:55.854591 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:55.860876 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.864142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c1396cb-294a-47f2-85d7-e28a2e0c8ad5 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:55.865192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c1396cb-294a-47f2-85d7-e28a2e0c8ad5 tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022758 Nov 02 12:22:55.866254 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2867/5702] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:22:55.880568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:55.883504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:55.891936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.892900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.893632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:55.894619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:55.895355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:55.896031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:55.939840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbfde62a-da1f-48cb-acc1-ec4a4f54b91a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1456417781", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 0}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbfde62a-da1f-48cb-acc1-ec4a4f54b91a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Request method failure captured: Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 168 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmEezDVcvG4Zq8nTI_FZVLdBNsL0bmtUtpvZBXXMZDnBHJOMYBXfK6tvDDwUQl4rU9GIueNargRZFCTXGYblDYAergC3wa3uZ-UlH2wFkSytDiI6GaiHh2CDr7_unTYk7rCb3uqttJhZ2AljfQbr2GKgOXK6_6XOJNFnxFJxkHkRcX0 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5892b37b1e58463fb2a7a34d31b4f1d2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 07051b6c722f4774a8246915cf267f15 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1456417781", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 0}} Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1456417781', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'min_count': 0}}} Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:22:55.945415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:22:55.949773 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:55.951769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbfde62a-da1f-48cb-acc1-ec4a4f54b91a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:55.953031 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbfde62a-da1f-48cb-acc1-ec4a4f54b91a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018991 Nov 02 12:22:55.953771 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2868/5703] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:22:56.058962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c90694e6-13a1-4dee-8d91-533ca8662a4a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1094680672", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 2.5}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c90694e6-13a1-4dee-8d91-533ca8662a4a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Request method failure captured: Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 170 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmEezDVcvG4Zq8nTI_FZVLdBNsL0bmtUtpvZBXXMZDnBHJOMYBXfK6tvDDwUQl4rU9GIueNargRZFCTXGYblDYAergC3wa3uZ-UlH2wFkSytDiI6GaiHh2CDr7_unTYk7rCb3uqttJhZ2AljfQbr2GKgOXK6_6XOJNFnxFJxkHkRcX0 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5892b37b1e58463fb2a7a34d31b4f1d2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5892b37b1e58463fb2a7a34d31b4f1d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 5892b37b1e58463fb2a7a34d31b4f1d2 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1157805428 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 07051b6c722f4774a8246915cf267f15 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1157805428-project Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1094680672", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "min_count": 2.5}} Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1094680672', 'imageRef': '2f72b382-4911-4efc-9bb2-e22b0b29c043', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:22:56.076590 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:22:56.083741 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:22:56.086548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c90694e6-13a1-4dee-8d91-533ca8662a4a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:56.087698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c90694e6-13a1-4dee-8d91-533ca8662a4a tempest-MultipleCreateNegativeTestJSON-1157805428 tempest-MultipleCreateNegativeTestJSON-1157805428-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033593 Nov 02 12:22:56.093248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2869/5704] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:22:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:22:56.118127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.130485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.140867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:56.150682 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb7819b2-f7ed-49ea-af42-838755505e80 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.277527 Nov 02 12:22:56.155764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2836/5705] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:55 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:57.180435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:57.181966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:57.217241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.219057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.219886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.224128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:57.225611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:57.226564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:57.680531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:57.696757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:57.724850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:57.733378 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61880c21-4216-43f4-aa78-09561ea45a1b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.556573 Nov 02 12:22:57.736060 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2870/5706] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:57 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:58.763715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:58.764400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:22:58.768072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=26 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:58.774028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.774747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.775424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:58.776419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:22:58.776890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:22:58.777328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:22:59.161324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:59.170769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:59.175087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:22:59.178549 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9669153-d05b-46a5-b4cb-45a8e9a34e98 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.420690 Nov 02 12:22:59.182513 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2837/5707] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:22:58 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:00.209661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:00.210728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:00.218097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:00.218944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:00.219601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:00.220807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:00.221429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:00.222018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:00.468711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.481388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.483874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:00.486106 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-452e4845-512b-43d1-a884-8e2a737d758e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1740 microversion: 2.20 time: 0.281594 Nov 02 12:23:00.487241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2871/5708] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:00 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:01.514337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:01.515758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:01.532984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.533480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.533931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:01.534703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:01.535722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:01.536156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:02.003119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.026431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.027940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:02.029195 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e65f9fa1-6fe0-4260-a175-2930d8ab7c72 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1722 microversion: 2.20 time: 0.519990 Nov 02 12:23:02.029773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2838/5709] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:01 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:03.068490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:03.069116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:03.074818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:03.088020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.088585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.089040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:03.092277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:03.092731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:03.097336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:03.104141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=65 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:03.271320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:03.287543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:03.289765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:03.292012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7527709e-7b40-44eb-a874-f303c7abcf48 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1722 microversion: 2.20 time: 0.228825 Nov 02 12:23:03.307711 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2872/5710] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:03 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:04.322493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:04.323855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:04.342903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:04.356411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:04.360637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:04.361867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:04.363953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:04.365906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:04.666064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.685714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.690968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:04.692281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-daa0f734-1367-4838-a820-6da9ccebcc11 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1722 microversion: 2.20 time: 0.374257 Nov 02 12:23:04.695419 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2839/5711] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:04 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:04.991364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "name": "network-vif-unplugged", "status": "completed", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:04.998088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:04.999097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:04.999727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.013799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] Creating event network-vif-unplugged:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h2-855649-4 Nov 02 12:23:05.020064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5f1f4d54-8046-456c-88c9-ccf0d5edbed7 req-c66a6e24-242c-4b28-96e3-89753ef723ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044208 Nov 02 12:23:05.020741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2873/5712] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:05.721348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:05.722505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:05.789585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.791867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.792387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:05.793203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:05.799084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:05.803097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.332531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.360882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.366823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:06.372162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27bff2ee-36c5-447c-94d4-7de989932095 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1665 microversion: 2.20 time: 0.657784 Nov 02 12:23:06.378335 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2840/5713] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:05 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1665 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:06.408653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c26c980-cf2c-4830-9c1c-a501f1a2692e"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:06.415623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:06.435286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.436045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.439889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:06.441036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:06.441689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:06.442970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:07.927403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2014789460", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "b1f75927-aec0-49ac-8be5-3be724e28e40"}], "key_name": "tempest-TestSecurityGroupsBasicOps-886427130", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c4033d38-dd86-4e0b-945a-41014178ddd4"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:08.020758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-554f30eb-2b8e-4d45-9398-59fc611a6253 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.617030 Nov 02 12:23:08.022399 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2874/5714] 10.222.0.48 () {62 vars in 1364 bytes} [Wed Nov 2 12:23:06 2022] POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments => generated 188 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:23:08.090717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] validate_networks() for [('b1f75927-aec0-49ac-8be5-3be724e28e40', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:08.298263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:08.301236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:08.317317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:08.317819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:08.318267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:08.319004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:08.326525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:08.330177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.481397 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fe7e7d6c-d50b-4251-a59e-0c4eea384f85 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments/1c26c980-cf2c-4830-9c1c-a501f1a2692e" status: 202 len: 0 microversion: 2.20 time: 1.187137 Nov 02 12:23:09.482591 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2875/5715] 10.222.0.48 () {60 vars in 1457 bytes} [Wed Nov 2 12:23:08 2022] DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments/1c26c980-cf2c-4830-9c1c-a501f1a2692e => generated 0 bytes in 1189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:09.585085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:09.585702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:09.596415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.596917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.597463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.598191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.598651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.601436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.702538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:23:09.900204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:09.901846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:09.902513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:09.903119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:09.903683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:09.930736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.931631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.932517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.934492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:09.935256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:09.935850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:09.949990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=72 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:09.966869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:09.974336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Getting quotas for user b4defa4511744796b36f9b539f2f590f and project b6fbf3dce4874d46baa72a5ffad76ef3. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:10.000777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:10.004908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:10.127250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02ffde84-831b-4973-befa-53b395be820b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/action" status: 202 len: 0 microversion: 2.20 time: 0.546778 Nov 02 12:23:10.130944 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2876/5716] 10.222.0.48 () {62 vars in 1319 bytes} [Wed Nov 2 12:23:09 2022] POST /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:23:10.167811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:10.172758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:10.221764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.225921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.229684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.234586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:10.239284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:10.241717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:10.388247 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a96f68ab-9e26-4be0-9967-5021a62c6d1a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.466588 Nov 02 12:23:10.393044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2841/5717] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:07 2022] POST /compute/v2.1/servers => generated 361 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:10.410748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6283e371-53c9-4609-868a-83a9e42ad38e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:10.411967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6283e371-53c9-4609-868a-83a9e42ad38e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:11.029603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6283e371-53c9-4609-868a-83a9e42ad38e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.068033 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6283e371-53c9-4609-868a-83a9e42ad38e tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1241 microversion: 2.1 time: 0.660635 Nov 02 12:23:11.075824 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2842/5718] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:10 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1241 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:11.370951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.411593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.421520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:11.427167 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-970b94d9-dad9-43ab-8c0a-0b517b9bad9c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1673 microversion: 2.20 time: 1.289186 Nov 02 12:23:11.429198 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2877/5719] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:10 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1673 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:12.102161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.102161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.118272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.129618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.130765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.131615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.132642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.133368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.349466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.368858 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51334221-62f1-4f48-82e7-1b02ce7cfd90 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1245 microversion: 2.1 time: 0.273341 Nov 02 12:23:12.387599 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2843/5720] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1245 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:12.453935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:12.454549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:12.468818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.472814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.473646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.475256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:12.475927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:12.480935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:12.886717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.903775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.904371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:12.905600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-085595a7-21ed-4160-beb2-8eb28e34dcc1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1673 microversion: 2.20 time: 0.455793 Nov 02 12:23:12.912607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2878/5721] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:12 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1673 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:13.397351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.399652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:13.436144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.439650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.440185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.441558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.442236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.442750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.696246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:13.718615 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3ec3f51-4f33-4551-8f2d-b917f7d0df23 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1293 microversion: 2.1 time: 0.322475 Nov 02 12:23:13.719336 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2844/5722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1293 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:13.933659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:13.934302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:13.947128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.951188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.951925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:13.954138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:13.956737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:13.958052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.750729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:14.751401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:14.773746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.774243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.781514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:14.785184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:14.788108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:14.789711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:15.348376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.369032 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-709b4aba-2c43-4c9e-9844-81c89fb92e0c tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.626662 Nov 02 12:23:15.370954 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2845/5723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:14 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:15.479424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Action: 'create', calling method: .version_select at 0x7ff1b2f24e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:15.539238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Getting quotas for project 204415394af749208c97a9c8d93c06d0. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:15.571001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Getting quotas for user 5c45821748574e4eade1c4d9052225b6 and project 204415394af749208c97a9c8d93c06d0. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:15.589813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.624160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.631854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:15.634415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f25017a0-3bf0-4480-927d-0fb895144ce2 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1675 microversion: 2.20 time: 1.705875 Nov 02 12:23:15.641602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2879/5724] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:13 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1675 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:15.882275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Getting quotas for project 204415394af749208c97a9c8d93c06d0. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:15.894511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Getting quotas for user 5c45821748574e4eade1c4d9052225b6 and project 204415394af749208c97a9c8d93c06d0. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:15.929727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cac1ec4f-efbf-4dcc-ae8b-e3f79b29debd tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.553597 Nov 02 12:23:15.930581 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2846/5725] 10.222.0.48 () {62 vars in 1214 bytes} [Wed Nov 2 12:23:15 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:23:15.942264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-819ba9bf-d86f-4aac-9b95-2d4c34b94a21 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:15.972766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-819ba9bf-d86f-4aac-9b95-2d4c34b94a21 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031613 Nov 02 12:23:15.973385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2880/5726] 10.222.0.48 () {60 vars in 1193 bytes} [Wed Nov 2 12:23:15 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:23:15.984601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ac2d46d-860b-4f4a-855f-33b5e2bb9e9b tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.002448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ac2d46d-860b-4f4a-855f-33b5e2bb9e9b tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de" status: 200 len: 235 microversion: 2.64 time: 0.022197 Nov 02 12:23:16.003688 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2847/5727] 10.222.0.48 () {60 vars in 1304 bytes} [Wed Nov 2 12:23:15 2022] GET /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de => generated 235 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:23:16.016252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995cd088-a1da-4f87-9e53-e0bfe657f898 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.261295 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-995cd088-a1da-4f87-9e53-e0bfe657f898 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de" status: 204 len: 0 microversion: 2.64 time: 0.250474 Nov 02 12:23:16.262489 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2881/5728] 10.222.0.48 () {60 vars in 1307 bytes} [Wed Nov 2 12:23:16 2022] DELETE /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:23:16.271861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8b243c4-3f3b-4667-91a4-765049b9d767 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.280540 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c8b243c4-3f3b-4667-91a4-765049b9d767 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] HTTP exception thrown: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8b243c4-3f3b-4667-91a4-765049b9d767 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Request method failure captured: Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de HTTP/1.1 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmEyVS5TEccfkPcLWat1ptRQ_pUvA73lYDQUB-wXa_JGYs2UItM8V9UXSei8lp77pZaUEOyONfTTCXCjt8fVKayNyveH_kQ0YUSSMMpBY9XrRhYrmd2zlMVHWl7x-rP-3EtUiQ6x-6HE9XST6fzdYnAOJ-C4kf9LyGnTd9Lkn_CwoPQ Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 204415394af749208c97a9c8d93c06d0 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroup264TestJSON-724036690 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/204415394af749208c97a9c8d93c06d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_204415394af749208c97a9c8d93c06d0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/204415394af749208c97a9c8d93c06d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/204415394af749208c97a9c8d93c06d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroup264TestJSON-724036690 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 204415394af749208c97a9c8d93c06d0 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroup264TestJSON-724036690 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroup264TestJSON-724036690-project Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 5c45821748574e4eade1c4d9052225b6 Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroup264TestJSON-724036690-project Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '2a3c6be0-445c-4490-99f7-3eeec012a9de'} Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:23:16.313893 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. Nov 02 12:23:16.320312 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:23:16.324099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c8b243c4-3f3b-4667-91a4-765049b9d767 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] Returning 404 to user: Instance group 2a3c6be0-445c-4490-99f7-3eeec012a9de could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:16.325406 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c8b243c4-3f3b-4667-91a4-765049b9d767 tempest-ServerGroup264TestJSON-724036690 tempest-ServerGroup264TestJSON-724036690-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de" status: 404 len: 117 microversion: 2.64 time: 0.058088 Nov 02 12:23:16.326644 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2848/5729] 10.222.0.48 () {60 vars in 1307 bytes} [Wed Nov 2 12:23:16 2022] DELETE /compute/v2.1/os-server-groups/2a3c6be0-445c-4490-99f7-3eeec012a9de => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:23:16.420861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.421501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:16.435722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.436235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.436690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.437431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.442145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.442735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.635285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:16.647266 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-36cb7b5d-53a6-43b3-940b-28bea97dfc02 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.232985 Nov 02 12:23:16.663749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2882/5730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:16 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:16.716655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:16.717304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:16.746401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.747264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.747408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:16.763648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:16.767687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:16.768358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.672919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:17.680071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:17.691647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.692604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.693366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:17.694456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:17.695083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:17.697843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:18.467580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.483347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.485378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.486648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2189ce4-9018-4438-9729-3a8ebc773da6 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 1.786431 Nov 02 12:23:18.487286 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2849/5731] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:16 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:18.520465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:18.535692 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc165432-b981-4d50-8aec-354b312776b3 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.865480 Nov 02 12:23:18.536330 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2883/5732] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:17 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:19.515539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.516336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:19.533487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.539177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.539757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.542663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.543652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.546835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.560932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:19.561747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:19.578565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.580211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.580665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.586946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:19.588111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:19.588736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:19.952166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:20.222287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.235006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49b6bfbb-efac-411c-a83d-d407d75a7d85 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.675287 Nov 02 12:23:20.255724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2884/5733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:20.319259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.332129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.333690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:20.334887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-207fb0c1-ca35-4e54-838a-5d7aaa24099a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.824183 Nov 02 12:23:20.335524 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2850/5734] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:19 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:20.486608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:20.516385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:20.516894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:20.517333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:20.556800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:20.559269 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] Creating event network-changed:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h1-855649-4 Nov 02 12:23:20.578675 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c1c3fed2-31a0-4c0f-8339-a026f9150621 req-d5236190-25e5-4e29-a0c1-3f16c6dff056 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095565 Nov 02 12:23:20.584145 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2885/5735] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:21.264549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.266177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:21.276209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.276961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.277567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.278453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.279592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.280866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.366544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:21.370218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:21.385739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.390089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.390797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.391748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.393900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.394564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.733707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:21.746821 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b831a3c2-9610-4544-aae5-d82cb359becf tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.482778 Nov 02 12:23:21.747862 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2851/5736] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:21 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:21.991347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:22.030703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:22.037004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:22.043652 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1a81a22-bdb7-4900-b73d-b5a2cfcef06c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.681818 Nov 02 12:23:22.046258 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2886/5737] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:21 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:22.709868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca605de-b809-4747-847d-0e85582eb235", "tag": "7ad4d318-6a14-4bc7-ad01-3512f0b5384d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:22.723447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.724228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.724971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:22.762475 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] Creating event network-changed:7ad4d318-6a14-4bc7-ad01-3512f0b5384d for instance eca605de-b809-4747-847d-0e85582eb235 on n-h2-855649-4 Nov 02 12:23:22.773011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:22.773653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:22.775776 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3905b631-31cd-41bc-a54c-a8527f0968e2 req-7f12f865-3aad-4183-ad9c-5de99df252e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071191 Nov 02 12:23:22.777053 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2852/5738] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:22.787757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.794664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.795667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:22.796657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:22.797460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:22.799884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.077574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:23.079655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:23.097624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.100151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.100887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.101832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:23.107627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:23.108341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:23.176523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:23.194169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfd3fd08-dbaf-4f4f-bf43-7eb6d2548aac tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.426366 Nov 02 12:23:23.199396 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2887/5739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:22 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:24.224610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:24.226264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:24.249269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.250849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.255888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:24.257043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:24.265454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:24.266199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:25.457572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:25.473886 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-504d9e0c-823d-496c-9e97-72f9f0b67c5b tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 1.254076 Nov 02 12:23:25.474513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2888/5740] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:24 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:25.559958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:25.582063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:25.584953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:25.591567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62cda156-3e22-484e-9e43-7472edf5fa44 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 2.522122 Nov 02 12:23:25.619589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2853/5741] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:23 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:26.506043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:26.507578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:26.530416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.532606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.533252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.540790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.544445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.546562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.656208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:26.658025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:26.699816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:26.702382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.710293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.712242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.713234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:26.716758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:26.718628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:26.735892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:26.749228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72a27b88-18af-4b7e-aec8-16d5a92aa3f9 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.252906 Nov 02 12:23:26.751073 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2889/5742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:26 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:27.415776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:27.415776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:27.415776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:27.415776 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed59ee37-8a81-48b5-9bb6-5d9782b66d03 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.757447 Nov 02 12:23:27.415776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2854/5743] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:26 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:27.784066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:27.787276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:27.803062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.804045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.804853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:27.807371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:27.808111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:27.809009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.181634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:28.195892 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9aef50c-46c0-4661-8eba-8e5fa5a26639 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.419793 Nov 02 12:23:28.199628 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2890/5744] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:27 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:28.445107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:28.445806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:28.472058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.474785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.476662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:28.479957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:28.481063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:28.490091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.228127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:29.235033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:29.259216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:29.260171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:29.263478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:29.265643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:29.267336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:29.268487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:30.126155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.167230 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-542ecff1-5576-4b82-87a3-f4d65b40f3ff tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.945370 Nov 02 12:23:30.170133 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2891/5745] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:29 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:30.189058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.219580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.221429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:30.222754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04eaf91f-a3d6-4efb-b1b8-c48228eb1129 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 1.784863 Nov 02 12:23:30.223379 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2855/5746] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:28 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:31.194594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:31.195780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:31.229933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.230423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.234930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.243945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.244463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.244917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.254351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:31.258290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:31.278376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.278376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.278376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.287645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.289283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.291058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.559068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:31.587749 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aec183d9-e6e7-4a78-bdd8-72be741bb57a tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.384258 Nov 02 12:23:31.587749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2892/5747] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:31 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:31.597826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca605de-b809-4747-847d-0e85582eb235", "name": "network-vif-plugged", "status": "completed", "tag": "7ad4d318-6a14-4bc7-ad01-3512f0b5384d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:31.648428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:31.655831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:31.673895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:31.732729 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] Creating event network-vif-plugged:7ad4d318-6a14-4bc7-ad01-3512f0b5384d for instance eca605de-b809-4747-847d-0e85582eb235 on n-h2-855649-4 Nov 02 12:23:31.759082 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d0591197-6528-4bc1-b3a3-79f68a597ee1 req-94be5007-6ec6-4a1b-8ccd-d1c98290072e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180131 Nov 02 12:23:31.762033 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2893/5748] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:31.789988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:31.828608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:31.847919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:31.847919 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a966ad4a-4abe-40e8-a4cb-b3cae1dfb1f8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.596024 Nov 02 12:23:31.853337 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2856/5749] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:31 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:32.610353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.611325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:32.632039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.636534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.637295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.638299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.639640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.640400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.797244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:32.815480 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2443ee73-264b-49cb-9455-3c4120612b8f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.213825 Nov 02 12:23:32.817914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2894/5750] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:32.875586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:32.877165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:32.883080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:32.892123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.893110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.894469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:32.895474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:32.896201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:32.897142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.490942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.512481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.529414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:33.530926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3510b4cc-cd90-4efc-ae66-854e8cc1f9b9 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.659538 Nov 02 12:23:33.540343 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2857/5751] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:32 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:33.842598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:33.843385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:33.857234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.864045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.865017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:33.865946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:33.866425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:33.866869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.202221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.202221 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5dcb559-2173-4c07-a91e-4c7e38b26ccc tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1299 microversion: 2.1 time: 0.353748 Nov 02 12:23:34.204142 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2895/5752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:33 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:34.561935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.563459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:34.580910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.587094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.587094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.587094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.587094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.596812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.899438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.912057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:34.912620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:34.937032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.937032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.946465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.947868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:34.948584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:34.950570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:34.952179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.954272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:34.971465 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d73cf91-282e-449f-9d9f-cba1bbc06e38 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.404898 Nov 02 12:23:34.974017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2858/5753] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:35.073977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-805dca92-114f-40b5-b04d-8402c68fd46b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/ips" status: 200 len: 147 microversion: 2.1 time: 0.167423 Nov 02 12:23:35.084896 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2896/5754] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:23:34 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/ips => generated 147 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:35.220280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.221134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.232297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.234205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.235565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.240990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.241922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.246830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.496289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:35.513544 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a844aabe-f489-42ae-a593-a3f9a6743697 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1472 microversion: 2.1 time: 0.297487 Nov 02 12:23:35.516057 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2859/5755] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:35.544281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.544899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.547256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:35.558284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.559232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.559678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.563869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.564891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.566053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.842617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:35.855644 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fe84d5f-97a7-49a4-9da3-ac7e1939aa68 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1472 microversion: 2.1 time: 0.315291 Nov 02 12:23:35.873668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2897/5756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:35.900316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:35.900906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:35.915095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.916902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.919934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:35.921405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:35.922558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:35.929152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.017531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:36.019038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:36.029814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.036555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.041040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.058000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.061880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.064883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.215288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38e2954e-0b62-4e98-9416-123d1ad905f6 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1623 microversion: 2.1 time: 0.319523 Nov 02 12:23:36.226773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2860/5757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:35 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1623 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:36.254237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:36.267882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:36.281557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.288374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.293244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:36.294422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:36.295180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:36.295872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.020163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:37.050830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:37.062772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:37.071011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eab6fa97-b3b8-40ba-ae04-2def556e7851 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 1.056744 Nov 02 12:23:37.089213 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2898/5758] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:36 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:37.245421 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9f150bf-735f-4c39-800b-cecc6fd337a4 tempest-TestSecurityGroupsBasicOps-1638986040 tempest-TestSecurityGroupsBasicOps-1638986040-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1911 microversion: 2.1 time: 0.992182 Nov 02 12:23:37.245421 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2861/5759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:36 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1911 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:37.380019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:37.382233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:37.401918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.413675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.414321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.415274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:37.415867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:37.418730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:37.494118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:23:38.116009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:38.117110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:38.126618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.127501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.128157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:38.129328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.130407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.131084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:38.498558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:38.519946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:38.522439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:38.524340 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8de929d-0808-4969-88ba-2d4c12c376aa tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.413042 Nov 02 12:23:38.525548 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2862/5760] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:38 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:38.967485 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a41b66c6-a602-4f8f-983a-507eeddbb004 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 204 len: 0 microversion: 2.1 time: 1.593077 Nov 02 12:23:38.968247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2899/5761] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:37 2022] DELETE /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 0 bytes in 1595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:38.977373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:38.978099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:38.984244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.984928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.985371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:38.985950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:38.986409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:38.986843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:38.991306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:39.080005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.088371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89db1e41-afe7-4665-aaaf-67b7abb1c41d tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1478 microversion: 2.1 time: 0.115227 Nov 02 12:23:39.088953 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2863/5762] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:38 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1478 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:39.555004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:39.555776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:39.563575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.564064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.564776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.566093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:39.566554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:39.567000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:39.699576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.710844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.712183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:39.719168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8aaf4c3e-7fe1-4bad-8ba9-7e768f45f859 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.163455 Nov 02 12:23:39.729467 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2900/5763] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:39 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:40.113397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.114650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:40.131328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.132184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.132870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.133869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.134536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.135292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.332929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:40.353138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b530d634-ac9c-4fc7-874a-20c9b8a7c381 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1478 microversion: 2.1 time: 0.241684 Nov 02 12:23:40.360955 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2864/5764] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1478 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:40.743469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.744136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:40.760199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.760199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.760199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:40.760976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:40.761438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:40.761908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.147186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:41.153377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:41.162279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:41.165237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:41.167705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7ad2680-e1e8-48a2-8264-87353ffa2e8b tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.429180 Nov 02 12:23:41.191597 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2901/5765] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:41.381873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.382604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:41.399118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.401500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.402083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.402922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.406427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.408963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.568040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:41.583836 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2239b77c-a6d5-4ecb-8b0e-8602406ccf56 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1478 microversion: 2.1 time: 0.205598 Nov 02 12:23:41.604883 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2865/5766] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:41 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1478 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:41.673351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7adeb3-562a-4b3d-a8cb-05eb948028c6"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:41.679407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:41.704629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.705677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.706867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.711219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.714580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.718158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.721740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca605de-b809-4747-847d-0e85582eb235", "name": "network-vif-deleted", "tag": "7ad4d318-6a14-4bc7-ad01-3512f0b5384d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:41.734212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:41.734759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:41.735293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:41.760736 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] Creating event network-vif-deleted:7ad4d318-6a14-4bc7-ad01-3512f0b5384d for instance eca605de-b809-4747-847d-0e85582eb235 on n-h2-855649-4 Nov 02 12:23:41.769512 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-75646f53-de68-461b-a3fb-cae6f8309382 req-722456c3-f69f-4c13-8388-367a7c8ac09b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052753 Nov 02 12:23:41.774913 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2866/5767] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:42.200612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:42.201591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:42.208582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.209479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.210165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.211482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.212269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.212929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.710432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.730045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.730045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.730342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1701b06a-9303-4228-a90a-90d5593a672c tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.534089 Nov 02 12:23:42.731106 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2867/5768] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:42 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:23:42.736356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:42.737236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:42.762842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.763411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.763853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.764582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.765050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.765495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.829074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:42.829501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:42.830006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:42.830478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lazy-loading 'fault' on Instance uuid eca605de-b809-4747-847d-0e85582eb235 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:23:42.907327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:42.919820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a250cbe0-9ee3-4b9b-8728-55b46ad6e020 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 200 len: 1331 microversion: 2.1 time: 0.187484 Nov 02 12:23:42.921589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2868/5769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:42 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 1331 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:43.164078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53167863-c49c-43e3-af2b-bdd5f854b0bf tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.501271 Nov 02 12:23:43.165251 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2902/5770] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:23:41 2022] POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments => generated 194 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:43.760901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:43.761533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:43.778386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.778826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.784604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.788893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.791744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.792280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.947887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:43.948993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: eca605de-b809-4747-847d-0e85582eb235] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:43.980027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.983343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.985413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:43.986551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:43.989187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:43.990647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:44.044451 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] HTTP exception thrown: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Request method failure captured: Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 HTTP/1.1 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDYitil9ND4Qp-eP9Uefytx-fzDX2jFyJWpVE2nNR7FqcCAKjzfWDLTpxVfp0qu4WxF9rrW1EPtkqy5pnuvvDTR4sNUJ_dAmdy_79dRBSAi38jrIeuG9jwFrcNzxg0_NZL19rCCzZk42BjuIZrcN0wFoOAR8G_A2pJIC4JN1wPcGQI Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b6fbf3dce4874d46baa72a5ffad76ef3 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6fbf3dce4874d46baa72a5ffad76ef3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b6fbf3dce4874d46baa72a5ffad76ef3 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestSecurityGroupsBasicOps-1598106753-project Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b4defa4511744796b36f9b539f2f590f Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1598106753-project Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'eca605de-b809-4747-847d-0e85582eb235'} Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.063443 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. Nov 02 12:23:44.068649 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:23:44.073589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Returning 404 to user: Instance eca605de-b809-4747-847d-0e85582eb235 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:23:44.075610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70cb2a49-17ae-4bf5-9d89-dac4f1ca03f5 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235" status: 404 len: 111 microversion: 2.1 time: 0.132621 Nov 02 12:23:44.079052 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2903/5771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:43 2022] GET /compute/v2.1/servers/eca605de-b809-4747-847d-0e85582eb235 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:23:44.388436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:44.401949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:44.404113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:44.404920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c2631ad-f303-4672-b77d-4032edb04fa5 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.648452 Nov 02 12:23:44.405496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2869/5772] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:43 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:45.470226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:45.474427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:45.508542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.509053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.510503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:45.510503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:45.511204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:45.511390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:46.008545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "name": "network-vif-plugged", "status": "completed", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:46.063726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:46.065084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:46.066914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:46.190416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] Creating event network-vif-plugged:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h1-855649-4 Nov 02 12:23:46.205665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3a15cd18-11b3-4c59-b0fb-9da089b39296 req-419828b3-ae7b-410d-99b1-76a5778f093d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203928 Nov 02 12:23:46.206549 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2870/5773] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:23:46.444758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:46.464208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:46.468493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:46.484136 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2325393a-9ebc-422f-aaf7-3de0c24befac tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 1.029791 Nov 02 12:23:46.489480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2904/5774] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:45 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:47.570083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:47.572271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:47.649273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.656321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.659958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:47.663671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:47.669128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:47.673666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:49.216667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:49.254355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:49.261382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:49.267426 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06ceab24-f1ae-447a-a5b9-49682163ddcc tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 1.746202 Nov 02 12:23:49.273521 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2871/5775] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:47 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:50.328636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:50.337521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:50.370438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.378264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.379398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:50.384478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:50.385727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:50.386788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:51.020352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:51.033202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:51.036036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:51.044968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26f0b7ce-1a69-4aa2-a0ac-b8465718dc02 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1731 microversion: 2.20 time: 0.717443 Nov 02 12:23:51.044968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2905/5776] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:50 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1731 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:52.067025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:52.067746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:52.084483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.084981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.085422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.086127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:52.086755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:52.087215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:52.995995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1237713342", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:53.012443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:53.030396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:53.045789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:53.047154 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c708f87d-d9c0-4c6c-97b6-6eef92fe4a6f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1718 microversion: 2.20 time: 0.985197 Nov 02 12:23:53.052796 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2872/5777] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:23:52 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1718 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:53.166827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] validate_networks() for None {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:53.980599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: .version_select at 0x7ff1b284d430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-405015717", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:54.008405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.021756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.080643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:54.081991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:54.082704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:54.083388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:54.083960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:54.099199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:54.100030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:54.100678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:54.102521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:54.103314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:54.103955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:54.157787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Getting quotas for project d75a38f213e6485cb89c75873df1d650. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.195385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.197013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Getting quotas for user 09e8c803c87a48e895ad9fb4ba885517 and project d75a38f213e6485cb89c75873df1d650. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.219392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.240743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:54.243086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:54.260770 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66b9a8dd-f934-40fc-ba1a-2de5e3cf3e75 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.572970 Nov 02 12:23:54.271753 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2873/5778] 10.222.0.48 () {60 vars in 1174 bytes} [Wed Nov 2 12:23:53 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:23:54.282647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: .version_select at 0x7ff1bbb55820>, body: {"server_group": {"name": "tempest-server-group-487980742", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:54.328372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.343332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.446008 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-239e661f-2fff-4912-98e6-7c60520afefd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.455693 Nov 02 12:23:54.452666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2906/5779] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:54.465509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b605dd81-2a1d-4af1-9c3c-3586981349a8 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:54.469014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b605dd81-2a1d-4af1-9c3c-3586981349a8 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:54.579460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.589754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.634217 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-992fa56b-eec2-4a27-b22f-4136a7f31713 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.357717 Nov 02 12:23:54.635488 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2874/5780] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 12:23:54 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:54.647137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: .version_select at 0x7ff1b26cc550>, body: {"server_group": {"name": "tempest-server-group-487980742", "policies": ["affinity"]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:54.708954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b605dd81-2a1d-4af1-9c3c-3586981349a8 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:54.715865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:54.720018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b605dd81-2a1d-4af1-9c3c-3586981349a8 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1214 microversion: 2.1 time: 0.257177 Nov 02 12:23:54.729910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:54.748988 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2907/5781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:54 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:54.775915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:55.035408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:55.047562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:55.089009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d8f4259-5b8b-458f-ab55-3bf03699de0b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.446540 Nov 02 12:23:55.102992 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2875/5782] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 12:23:54 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:55.115421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb2eadf5-650b-47b2-863b-7e3e4473a473 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:55.330042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb2eadf5-650b-47b2-863b-7e3e4473a473 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2e083aed-db86-4bee-b7c3-341ffd88b703" status: 204 len: 0 microversion: 2.1 time: 0.221043 Nov 02 12:23:55.330656 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2908/5783] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:23:55 2022] DELETE /compute/v2.1/os-server-groups/2e083aed-db86-4bee-b7c3-341ffd88b703 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:55.339437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-422f44bb-ed0a-4237-a31b-64fe522773ae tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:55.382487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-422f44bb-ed0a-4237-a31b-64fe522773ae tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.047394 Nov 02 12:23:55.383382 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2876/5784] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:23:55 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:55.397579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50bf5dd4-bc38-4002-b6bb-55fcdb40960a tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:55.544859 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50bf5dd4-bc38-4002-b6bb-55fcdb40960a tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/7649788b-a9b3-46c7-b9f1-1735b0610798" status: 204 len: 0 microversion: 2.1 time: 0.153092 Nov 02 12:23:55.548624 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2909/5785] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:23:55 2022] DELETE /compute/v2.1/os-server-groups/7649788b-a9b3-46c7-b9f1-1735b0610798 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:55.558591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43032321-8228-4cdd-867c-e480e37cbca2 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:55.595385 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43032321-8228-4cdd-867c-e480e37cbca2 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040528 Nov 02 12:23:55.605612 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2877/5786] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:23:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:55.619829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: .version_select at 0x7ff1b824eee0>, body: {"server_group": {"name": "tempest-server-group-2032671782", "policies": ["affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:55.694848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:55.706541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:55.756690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44d40eb5-9b6e-48ce-aec5-398a596f7214 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:55.757404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44d40eb5-9b6e-48ce-aec5-398a596f7214 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:55.855313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:55.866187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:55.885205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf6976f6-d57f-43f9-a532-4e95082d5426 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.279120 Nov 02 12:23:55.886239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2910/5787] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 12:23:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:55.927514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9b301efe-44a5-4bd6-8197-34302e4c24ed tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.035074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44d40eb5-9b6e-48ce-aec5-398a596f7214 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:56.047191 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44d40eb5-9b6e-48ce-aec5-398a596f7214 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1214 microversion: 2.1 time: 0.294968 Nov 02 12:23:56.049829 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2878/5788] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:55 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:23:56.151442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9b301efe-44a5-4bd6-8197-34302e4c24ed tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/89d30c49-a221-47b5-b01c-3e8f99514292" status: 204 len: 0 microversion: 2.1 time: 0.253822 Nov 02 12:23:56.152660 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2911/5789] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:23:55 2022] DELETE /compute/v2.1/os-server-groups/89d30c49-a221-47b5-b01c-3e8f99514292 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:23:56.162892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93d04844-46b4-4c81-9d50-b3eb25bbe9af tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.189142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93d04844-46b4-4c81-9d50-b3eb25bbe9af tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031844 Nov 02 12:23:56.190017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2879/5790] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:56.203645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: .version_select at 0x7ff1b3e37a60>, body: {"server_group": {"name": "tempest-server-group-91078597", "policies": ["anti-affinity"]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:56.253886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:56.257441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:56.269519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:56.481992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:56.489347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_groups'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:56.508443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d705166-0e70-4aa9-a64a-86d2e1a5bd82 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.309109 Nov 02 12:23:56.509050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2912/5791] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:56.526162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e4b667d-274f-42a2-b3e6-93eb2c7dc614 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.728664 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e4b667d-274f-42a2-b3e6-93eb2c7dc614 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/221625c5-e80d-4381-b64d-1640aff2f96d" status: 204 len: 0 microversion: 2.1 time: 0.210378 Nov 02 12:23:56.729274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2880/5792] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:23:56 2022] DELETE /compute/v2.1/os-server-groups/221625c5-e80d-4381-b64d-1640aff2f96d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:56.737912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d65072b8-fde8-420b-9330-18d97c1fb082 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:56.752069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d65072b8-fde8-420b-9330-18d97c1fb082 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018457 Nov 02 12:23:56.753186 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2913/5793] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:23:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:56.933831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-830059257", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6c156e5f-6ee9-44ea-b921-a6f186258a08"}]}, "os:scheduler_hints": {"group": "9ae9e943-d3a9-4fb0-8738-69a2c2a401ef"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:57.027941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] validate_networks() for [('6c156e5f-6ee9-44ea-b921-a6f186258a08', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:23:57.076566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:57.077627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:57.094503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:57.102790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:57.103523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:57.105410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:57.108172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:57.111425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:57.295141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:57.312021 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a43451c9-3c2d-49e1-9914-ae2fab4d5f65 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1218 microversion: 2.1 time: 0.239865 Nov 02 12:23:57.312625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2914/5794] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:57 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:58.207025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:58.212229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:58.236972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:58.239459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:58.245592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:58.247855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:58.248645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:58.249993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:23:58.250597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:23:58.250900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:23:58.251359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:23:58.251682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:58.251816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:23:58.327229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:58.330435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:58.330568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:23:58.333012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:58.334611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:58.335410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:58.337688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:58.390740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:58.407617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:58.433779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:23:58.437334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:23:58.634229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127568) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 12:23:58.655701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:58.665936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:59.225373 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-890612ae-a29d-4901-b539-5c82cecec6c6 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 204 len: 0 microversion: 2.1 time: 1.023847 Nov 02 12:23:59.230732 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2915/5795] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:23:58 2022] DELETE /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:23:59.235170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4033d38-dd86-4e0b-945a-41014178ddd4", "tag": "f37a965d-4bd6-40b1-9208-eec870a08066"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:23:59.249172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.249943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.250546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.250724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:23:59.260471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Getting quotas for user 685d7df0dfb744bc890be2ecf3e47b4e and project 0de712f0dee6401aa5c5267a82facc71. Resources: {'server_group_members'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:23:59.279936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] Creating event network-changed:f37a965d-4bd6-40b1-9208-eec870a08066 for instance c4033d38-dd86-4e0b-945a-41014178ddd4 on n-h1-855649-4 Nov 02 12:23:59.282708 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-36b17fe9-82fa-47ba-be48-f24e92207355 req-a156e9a3-55f3-4af4-b9af-633a0131101b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054590 Nov 02 12:23:59.283813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2916/5796] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:59.296989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9a142a9-c076-4c7e-a376-1e35375ecf07 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374592 Nov 02 12:23:59.306076 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2881/5797] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:23:59.312900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:59.322185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:59.332438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.332945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.335148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.336327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.336984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.337636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.338830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:59.341167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:59.356530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.357767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.358505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.359464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:59.360082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:59.360686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:59.545318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:59.556006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5bd7904a-55ef-4920-bf56-7cc65a95f24a tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1266 microversion: 2.1 time: 0.269306 Nov 02 12:23:59.557156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2917/5798] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:59 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:59.563113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd374fcd-5d72-4627-a980-2799a1b50c48 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:59.564478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd374fcd-5d72-4627-a980-2799a1b50c48 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:23:59.692543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd374fcd-5d72-4627-a980-2799a1b50c48 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:59.705276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd374fcd-5d72-4627-a980-2799a1b50c48 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1212 microversion: 2.1 time: 0.146324 Nov 02 12:23:59.707242 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2918/5799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:59 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:59.800283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:23:59.808239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87ad8031-980c-48b6-a29d-90207d741318 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1766 microversion: 2.1 time: 0.500751 Nov 02 12:23:59.808816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2882/5800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:23:59 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1766 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:00.584004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:00.584677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:00.603035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.603556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.604129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.604851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:00.605318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:00.605754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:00.732918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2596c2f5-f097-44e1-8594-3fe079ba6bde tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:00.742339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2596c2f5-f097-44e1-8594-3fe079ba6bde tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:01.160817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:01.177758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7eaec86b-13d4-436e-9eeb-4a160cea5856 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1274 microversion: 2.1 time: 0.597749 Nov 02 12:24:01.188963 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2919/5801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:00 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1274 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:01.202181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2596c2f5-f097-44e1-8594-3fe079ba6bde tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:01.205345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:01.206402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:01.215497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2596c2f5-f097-44e1-8594-3fe079ba6bde tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1212 microversion: 2.1 time: 0.489116 Nov 02 12:24:01.217567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2883/5802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:00 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1212 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:01.231395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.232314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.233020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:01.234489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:01.235262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:01.235840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.016185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4033d38-dd86-4e0b-945a-41014178ddd4", "name": "network-vif-deleted", "tag": "f37a965d-4bd6-40b1-9208-eec870a08066"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:02.036107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.037095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.037753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.053277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] Creating event network-vif-deleted:f37a965d-4bd6-40b1-9208-eec870a08066 for instance c4033d38-dd86-4e0b-945a-41014178ddd4 on n-h1-855649-4 Nov 02 12:24:02.058871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-aaaafaf3-61bb-4d17-9ccb-6ccd6ea235ed req-c1882932-b453-4f27-8c63-323cc3f746d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281695 Nov 02 12:24:02.059619 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2884/5803] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:02.066130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:02.072971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.073566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.074081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.100038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:24:02.118032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.135090 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e47e4c64-e486-4b78-a7f2-55a10cbef994 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1766 microversion: 2.1 time: 0.944501 Nov 02 12:24:02.142308 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2920/5804] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:01 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1766 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:02.204874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:02.205963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.222638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.347628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.358348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cd0eeec-2b62-4c88-96f4-7c4bcd0427ee tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1272 microversion: 2.1 time: 0.157571 Nov 02 12:24:02.359132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2921/5805] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:02 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:02.377433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:02.377433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:02.383245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.383783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.384224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.385238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.385752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.386215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.498143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e804272b-42f0-404f-974e-706641fdd8f4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action" status: 202 len: 0 microversion: 2.1 time: 0.436513 Nov 02 12:24:02.499493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2885/5806] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:02 2022] POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:02.522105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:02.523261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.527772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:02.535822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.536719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.537812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.538773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:02.539505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:02.540130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:02.543579 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-08c5940a-b483-434c-8672-b531d43708f0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1264 microversion: 2.1 time: 0.183255 Nov 02 12:24:02.545132 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2922/5807] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:02 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:02.791690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:02.818557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42384613-e0a1-4db5-959b-2d7fafd93d43 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.305299 Nov 02 12:24:02.819778 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2886/5808] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:02 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:03.159663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.160271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.167666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.171009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.171009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.171009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.171009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.171009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.209737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.210499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.211130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.211775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lazy-loading 'fault' on Instance uuid c4033d38-dd86-4e0b-945a-41014178ddd4 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:03.322224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4defa4511744796b36f9b539f2f590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fbf3dce4874d46baa72a5ffad76ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:03.336293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71b00174-98ee-40e6-b113-bb0f8e81da0f tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 200 len: 1534 microversion: 2.1 time: 0.180451 Nov 02 12:24:03.336978 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2923/5809] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 1534 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:03.389327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.391244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.399981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.401533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.402345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.403506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.404408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.405139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.559894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:03.571879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.572722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.591860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.594011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.595204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.597061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.598121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3dbc4f21-4397-495a-9cda-e1e2b6c937af tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1272 microversion: 2.1 time: 0.211733 Nov 02 12:24:03.612967 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2887/5810] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:03.613382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.620677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.759181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:03.768108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3427aa6-2dc2-402f-a2ea-1f5c60d873c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1270 microversion: 2.1 time: 0.201365 Nov 02 12:24:03.769488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2924/5811] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:03.844004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:03.845041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:03.853362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.853934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.854467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:03.855335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:03.855961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:03.856498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.207425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.216941 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d5d1f92-bab7-4c0f-8ba3-6e662c55932f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.377155 Nov 02 12:24:04.221719 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2888/5812] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:03 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:04.367029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.367812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] [instance: c4033d38-dd86-4e0b-945a-41014178ddd4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:04.370175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:04.376399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.376885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.377321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.378894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.379462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.379930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.385257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:04.396905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] HTTP exception thrown: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Request method failure captured: Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 HTTP/1.1 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDYitil9ND4Qp-eP9Uefytx-fzDX2jFyJWpVE2nNR7FqcCAKjzfWDLTpxVfp0qu4WxF9rrW1EPtkqy5pnuvvDTR4sNUJ_dAmdy_79dRBSAi38jrIeuG9jwFrcNzxg0_NZL19rCCzZk42BjuIZrcN0wFoOAR8G_A2pJIC4JN1wPcGQI Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b6fbf3dce4874d46baa72a5ffad76ef3 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b6fbf3dce4874d46baa72a5ffad76ef3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b6fbf3dce4874d46baa72a5ffad76ef3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b6fbf3dce4874d46baa72a5ffad76ef3 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1598106753 Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestSecurityGroupsBasicOps-1598106753-project Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b4defa4511744796b36f9b539f2f590f Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1598106753-project Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c4033d38-dd86-4e0b-945a-41014178ddd4'} Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:04.398698 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Returning 404 to user: Instance c4033d38-dd86-4e0b-945a-41014178ddd4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d16b2fa-649b-445f-ac5a-4d01a1adc9be tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4" status: 404 len: 111 microversion: 2.1 time: 0.037244 Nov 02 12:24:04.403150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2925/5813] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/c4033d38-dd86-4e0b-945a-41014178ddd4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:04.630209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.631803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:04.639498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.640185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.640803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.641865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.642523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.643845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.800503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:04.801285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:04.807582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.808090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.808534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.809574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:04.810201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:04.810809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:04.967426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:04.976473 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a87a1626-e997-498f-b855-3c98b161685f tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1270 microversion: 2.1 time: 0.180154 Nov 02 12:24:04.977422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2926/5814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.054562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:05.064767 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8af2d438-cfab-463a-a393-3f69e78fc4b9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.439511 Nov 02 12:24:05.066579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2889/5815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:04 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:05.240883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:05.241974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:05.249152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.249736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.250247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.251074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:05.251671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:05.252176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:05.528854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:05.539794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fc82b21-9f30-4ef7-b058-6090a7f5b5f9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.303077 Nov 02 12:24:05.540374 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2927/5816] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:05 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:06.013718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.015470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:06.040596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.041997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.043051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.044410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.045285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.046082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.055448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:06.093658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.094334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:06.112765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.119368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.119368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.119368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.119368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.119368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.458933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:06.477957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76635225-30c0-4a8d-b9cc-f679e98299da tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.471751 Nov 02 12:24:06.478531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2890/5817] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:06 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:06.484567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540f5f20-acdf-4975-ae5b-6ed0f0894e9d", "tag": "51bf0a11-77fb-4382-a299-e38890b4e4e2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:06.520173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.520717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.521221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.548891 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] Creating event network-changed:51bf0a11-77fb-4382-a299-e38890b4e4e2 for instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d on n-h1-855649-4 Nov 02 12:24:06.558149 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-137689f7-83bf-4615-b4e6-40f35413c29e req-fc836c05-72da-470b-83b4-0af63b1368a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078061 Nov 02 12:24:06.559267 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2891/5818] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:06.569515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:06.570299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:06.589498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:06.591586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.592222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.592718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.593513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:06.594073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:06.595228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:06.651149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:06.684778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3787b473-7a71-4c9e-8020-bc650d7c7fe4 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.594210 Nov 02 12:24:06.695058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2928/5819] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:06 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:07.006567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:07.029935 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c359908a-0719-48bc-bdd8-5cd395b2c6b0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.465528 Nov 02 12:24:07.043167 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2892/5820] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:06 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:07.508386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:07.509517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:07.529114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.529942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.530566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.533053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.540895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.541613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.711290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:07.716358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:07.723034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.723788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.724449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.725509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:07.726247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:07.727494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:07.869764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:07.883587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5da6c8d6-79dd-4383-a558-b51bb5ee83ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.381616 Nov 02 12:24:07.884971 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2929/5821] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:07 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:07.995133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:08.009714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07b964c3-2d8c-4f5e-a42d-9fecabb707b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.299954 Nov 02 12:24:08.009714 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2893/5822] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:07 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:08.060103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:08.061220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:08.068528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.069330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.070004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.071138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.071792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.072506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.640900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b", "tag": "3d004556-1042-41e6-a1fb-2e27eedb9c41"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:08.649928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:08.659163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:08.673485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.682857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.682857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.683134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ad8fff8-b5d5-4652-845e-866ce8f3de2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.619098 Nov 02 12:24:08.683134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2930/5823] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:08 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:08.692870 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] Creating event network-changed:3d004556-1042-41e6-a1fb-2e27eedb9c41 for instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b on n-h2-855649-4 Nov 02 12:24:08.708015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-183f7882-d9b4-4aff-b74e-30deacfbfb5b req-221eaec8-a4c9-4934-aed2-65b4f8b4fc9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073599 Nov 02 12:24:08.708717 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2894/5824] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:08.911707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:08.913338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:08.926769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.929407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.930181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:08.931958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:08.932949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:08.934000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.046377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:09.050091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:09.068663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:09.070542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:09.071201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.072200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:09.072839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:09.073441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.313926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:09.355182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:09.364375 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c177fd2-8f94-46f9-a323-ea6b9162beaa tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.449735 Nov 02 12:24:09.365140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64a6c6b4-3c79-4431-9981-fccac0aae414 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.329417 Nov 02 12:24:09.381945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2895/5825] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:09 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:09.383019 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2931/5826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:08 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:09.715217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:09.716632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:09.738571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:09.908301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:09.918203 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-107dbf87-eec5-489c-8ce2-bb99ea9f6663 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.209273 Nov 02 12:24:09.918797 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2896/5827] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:09 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:10.390605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.391996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:10.394368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.396433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:10.399805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.400448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.401173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.402285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.402923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.403537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.411373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=26 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:10.414583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.417176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.418260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.420525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.422319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.423364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.677001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:10.686547 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4f13641f-7615-442c-a727-5a54d92759a0 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.299947 Nov 02 12:24:10.687495 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2897/5828] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:10 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:10.761940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:10.772275 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8411a1e1-20a1-4527-af19-d5d9f9417d22 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.385326 Nov 02 12:24:10.788210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2932/5829] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:10 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:10.942085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:10.943839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:10.953339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.953848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.954287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:10.957701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:10.959823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:10.961188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.180039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:11.188998 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b0e473f-1f56-4284-ad16-a17845b6efbe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.251232 Nov 02 12:24:11.190033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2898/5830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:10 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:11.513125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62f872ce-5569-4468-a83c-abe2ad82ca52 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] Calling method '.version_select at 0x7ff1b37053a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:11.625017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62f872ce-5569-4468-a83c-abe2ad82ca52 tempest-TestSecurityGroupsBasicOps-1598106753 tempest-TestSecurityGroupsBasicOps-1598106753-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-886427130" status: 202 len: 0 microversion: 2.1 time: 0.120687 Nov 02 12:24:11.626317 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2933/5831] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-886427130 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:11.661021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540f5f20-acdf-4975-ae5b-6ed0f0894e9d", "name": "network-vif-plugged", "status": "completed", "tag": "51bf0a11-77fb-4382-a299-e38890b4e4e2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:11.666503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=42 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:11.672269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.672751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.673187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.685026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] Creating event network-vif-plugged:51bf0a11-77fb-4382-a299-e38890b4e4e2 for instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d on n-h1-855649-4 Nov 02 12:24:11.691539 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8c4a42dd-a054-4e53-abad-d2c3dc19f5d6 req-c695b247-078e-4584-bc01-7cab943774c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033156 Nov 02 12:24:11.692068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2899/5832] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:11.712682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:11.713404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:11.723551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.724564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.725162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.726193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.726943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.728067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.795943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:11.796660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:11.803291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.803821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.804639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:11.805348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:11.805962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:11.806536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.134638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.149791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1938a5a-d668-445d-b4be-05d8b70b80cd tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.442439 Nov 02 12:24:12.156731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.165824 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de7db803-ca43-4c1a-b5fb-0b1dc51db13d tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.374312 Nov 02 12:24:12.166702 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2900/5833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:11 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:12.170228 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2934/5834] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:11 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:12.213439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:12.214296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:12.221033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.221766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.222395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.223148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:12.223857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:12.224482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:12.465605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:12.478073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e5dde53-b94f-4bd3-8fd5-454470f024b2 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1724 microversion: 2.1 time: 0.268028 Nov 02 12:24:12.479862 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2901/5835] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:12 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.179692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.180957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.189027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.189781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.190698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.191173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.191442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.191752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.191894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.192368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.210380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.219502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.220216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.221719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.222719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.223542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.435330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.445012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c1909d5-6743-4c95-bbf0-5a686cf4c368 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1314 microversion: 2.1 time: 0.269549 Nov 02 12:24:13.445703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2935/5836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:13 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.467720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.475557 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48dd23cb-d157-461f-a0d2-e86b97438065 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.289770 Nov 02 12:24:13.476128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2902/5837] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:13 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.509042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:13.509813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:13.517029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.517526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.518181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.518910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.519403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.519993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.660804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:13.669389 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef14a885-2d22-4355-bcf2-bb964941759d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1701 microversion: 2.1 time: 0.167350 Nov 02 12:24:13.670174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2936/5838] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:13 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:13.709439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:13.715832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:13.716388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:13.716841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:13.743292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:24:14.010142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e9f420b2-3f4a-4809-aab3-ee9e9a5fd8fe tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action" status: 202 len: 0 microversion: 2.1 time: 0.305263 Nov 02 12:24:14.010968 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2903/5839] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:24:13 2022] POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:24:14.020555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.021335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.029306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.029955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.030492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.031349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.031926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.032435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.199829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.209549 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7eca353-3934-4fdf-99de-44e6f37bf450 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1710 microversion: 2.1 time: 0.194195 Nov 02 12:24:14.210477 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2937/5840] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1710 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.468972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.469953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.477898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.478574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.479357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.480230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.480806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.481342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.501687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:14.504142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.513821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.514695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.516443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.518206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.519637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.520412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.774819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.800274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-389a44c4-c429-46b2-a58b-6d7050e258ac tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1464 microversion: 2.1 time: 0.334370 Nov 02 12:24:14.814367 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2904/5841] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:14.829358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b148b8af-93d5-4d3c-85d4-6ec88db5c4eb", "device": "/dev/sdb"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:14.833081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:14.836738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:14.842621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.843417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.844734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.845767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:14.846523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:14.847182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:14.847866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21124b2f-543a-450a-ad4f-54fdfaa3097b tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.352350 Nov 02 12:24:14.848914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2938/5842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:14 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:15.241857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.244417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.268322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.269221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.269995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.271204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.271843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.272884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.608499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:15.617267 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4e1847c-b97e-4056-aff1-e9d524b1cd35 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1710 microversion: 2.1 time: 0.387665 Nov 02 12:24:15.617850 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2939/5843] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1710 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:15.639702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b", "name": "network-vif-plugged", "status": "completed", "tag": "3d004556-1042-41e6-a1fb-2e27eedb9c41"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:15.650893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.652516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.652976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.668399 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] Creating event network-vif-plugged:3d004556-1042-41e6-a1fb-2e27eedb9c41 for instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b on n-h2-855649-4 Nov 02 12:24:15.673732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-475d8a00-4db9-4aa6-a188-ecb609046359 req-8b378d5c-f5f7-4e7c-ade1-0503bb299c93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042149 Nov 02 12:24:15.674219 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2940/5844] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:15.874146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:15.875226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:15.882842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.883769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.884430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.885410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:15.885932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:15.886548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:15.947953 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cfdae2c-a6e2-477a-bd03-c87964ad5647 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "POST /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124674 Nov 02 12:24:15.964355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2905/5845] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:24:14 2022] POST /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:16.119802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:16.129045 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-704fd94c-b98d-4176-8676-928e2e3fa338 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.258944 Nov 02 12:24:16.129624 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2941/5846] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:15 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:16.646353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:16.647277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:16.660598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.661102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.661841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.662802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:16.663433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:16.663890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:16.687954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:16.821806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:16.835386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f13c839-4ec5-4af4-b70c-d887f5957e06 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1714 microversion: 2.1 time: 0.195700 Nov 02 12:24:16.836736 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2906/5847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:16 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1714 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:17.153253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:17.154007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:17.161868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.162478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.163063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.164002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:17.164686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:17.165338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:17.469633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:17.484837 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20e512d9-1233-4df8-b47d-54da891e7de3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1312 microversion: 2.1 time: 0.335262 Nov 02 12:24:17.486663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2942/5848] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:17 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:18.510348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.511196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:18.521039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.521636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.522784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.523642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.524277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.524933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.744423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:18.754089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-de713a91-5186-4be5-8b65-23dbba86c7d3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1498 microversion: 2.1 time: 0.248836 Nov 02 12:24:18.755085 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2907/5849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:18 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:18.785725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.808733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Querying cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) for 1 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:24:18.810209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.811396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.812097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.839546 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bede1324-5ad0-40df-9316-cacadeb51ec1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef" status: 200 len: 221 microversion: 2.1 time: 0.065859 Nov 02 12:24:18.840634 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2943/5850] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:18 2022] GET /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef => generated 221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:18.851937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:18.852686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:18.864474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.871146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.871146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.871146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:18.871146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:18.871146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:18.904987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:19.012701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.015432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.022461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.023229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.023964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.024950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.025606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.026293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.045545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:19.059658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5c607fe-0784-4e4e-acab-379ac0d73971 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051435 Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2944/5851] 10.222.0.48 () {60 vars in 1343 bytes} [Wed Nov 2 12:24:19 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.380303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:24:19.723108 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-83ab5201-a221-4dac-ab88-b3fdb1df4dd0 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 204 len: 0 microversion: 2.1 time: 0.874016 Nov 02 12:24:19.723972 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2908/5852] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:18 2022] DELETE /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 0 bytes in 877 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:19.732363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.733170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.740698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.741501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.742021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.742814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.743458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.743892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.749605 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c9d9661-30f9-4afe-b942-20b91b5ff275 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 204 len: 0 microversion: 2.20 time: 0.609882 Nov 02 12:24:19.750253 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2945/5853] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:24:19 2022] DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:24:19.762172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:19.770234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:19.770721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.771425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.772184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.773298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:19.773917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:19.775649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:19.979999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.010865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.012615 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e563af4-4abc-4d00-b1a7-0ed88de5eaa7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1504 microversion: 2.1 time: 0.282645 Nov 02 12:24:20.015641 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2909/5854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:19 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:20.030368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.040100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:20.040100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15c3f78a-949d-44ca-a8da-da72d9f652d8 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.278310 Nov 02 12:24:20.040100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2946/5855] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:19 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:24:21.062097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:21.067488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:21.070949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:21.074051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:21.082843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.083564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.087082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.088143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.088266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.088266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.091157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.093151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.095022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.099421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:21.103834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:21.104680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:21.655549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:21.669395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:21.671731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:21.678123 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-470a5b89-8a5d-4b91-9b35-16c556df08d1 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.611772 Nov 02 12:24:21.683967 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2947/5856] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:21 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:24:21.781624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:21.798750 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e00b2c93-ea2b-43c5-b97a-e45871dfacf1 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1504 microversion: 2.1 time: 0.741744 Nov 02 12:24:21.798750 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2910/5857] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:21 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1504 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:22.710514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:22.711321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:22.719539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.720450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.721607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.722640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.723289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.723882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.822966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:22.823881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:22.837145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.838216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.838821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.839723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:22.840389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:22.842220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:22.969425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:22.979208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2871429-1f56-467e-82e8-f7ba132497ad tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1462 microversion: 2.1 time: 0.161453 Nov 02 12:24:22.983914 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2911/5858] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:22 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1462 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:23.050733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b", "name": "network-vif-deleted", "tag": "3d004556-1042-41e6-a1fb-2e27eedb9c41"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:23.068182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:23.068665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:23.069287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:23.099895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] Creating event network-vif-deleted:3d004556-1042-41e6-a1fb-2e27eedb9c41 for instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b on n-h2-855649-4 Nov 02 12:24:23.114084 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-0fdb4944-3909-45b8-a4da-c82d0699baa7 req-eb627d4d-2d59-4e11-ba14-a488d20d3427 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065394 Nov 02 12:24:23.114872 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2912/5859] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:23.139872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:23.156529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:23.158018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:23.159374 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19de1481-0c46-4ae6-9eb5-898c6eea3a56 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1724 microversion: 2.20 time: 0.454415 Nov 02 12:24:23.159969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2948/5860] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:22 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:24:24.012235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:24.013072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:24.028627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.029150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.029603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.030340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.030805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.033049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.104109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.104611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.109881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.110623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lazy-loading 'fault' on Instance uuid 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:24.184443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685d7df0dfb744bc890be2ecf3e47b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de712f0dee6401aa5c5267a82facc71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.191020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:24.192690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:24.196411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd52b905-31ed-49de-8ff5-fcde7c86dde8 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 200 len: 1302 microversion: 2.1 time: 0.189325 Nov 02 12:24:24.201480 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2913/5861] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:24 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 1302 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:24.214644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.215266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.220152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.221846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.222387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.222789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.283687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:24.284635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:24.285242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:24.285869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lazy-loading 'fault' on Instance uuid 78b4d082-3dad-438f-b788-ccbdfe23a6ee {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:24:24.381595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.395328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.397105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1e0f9913abf4ea7b14677dea2dd9012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cd9f7745c7496ab54140b648471e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:24.398351 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89264b19-0ceb-4d82-924c-946964904f0a tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 200 len: 1372 microversion: 2.20 time: 0.215800 Nov 02 12:24:24.419178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2949/5862] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:24 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:24:25.138346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b4d082-3dad-438f-b788-ccbdfe23a6ee", "name": "network-vif-deleted", "tag": "c5089c16-a6b7-46ce-b97b-8a59e3609268"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:25.149377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.149859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.150295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.164990 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] Creating event network-vif-deleted:c5089c16-a6b7-46ce-b97b-8a59e3609268 for instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee on n-h1-855649-4 Nov 02 12:24:25.171312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b2aa7778-7802-4685-9852-e659a024351d req-bd794560-569c-4f80-be40-bd6040445290 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036032 Nov 02 12:24:25.172935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2914/5863] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:25.235381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.236113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.245218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.245865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.246379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.247296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.247870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.248443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.269882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b HTTP/1.1 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b'} Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.273240 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76d8a010-39bf-4f84-80c6-a529fad3a3c7 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 404 len: 111 microversion: 2.1 time: 0.044727 Nov 02 12:24:25.278040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2950/5864] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.289722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.309402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_groups [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Querying cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) for 1 instances {{(pid=127568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:24:25.310331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.310946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.311498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.327387 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b277cc8-6a77-4a50-83b2-6ba08eb56940 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043826 Nov 02 12:24:25.328474 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2915/5865] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:25.342871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.359543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.compute.server_groups [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Querying cell 6188fd48-dbf5-4478-9768-9058e0ca7da6(cell1) for 1 instances {{(pid=127567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:24:25.360685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.361190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.361636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.375294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fc6773e-595c-47f7-8f34-2e402f90d1a5 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef" status: 200 len: 183 microversion: 2.1 time: 0.037552 Nov 02 12:24:25.376389 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2951/5866] 10.222.0.48 () {58 vars in 1263 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:25.400249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.401242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.411187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.412263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.413185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.414283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.415097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.415857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.429573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.430934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.447633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.448840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.449726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.450852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.451630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.452349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.454840 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b HTTP/1.1 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b'} Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:25.457547 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db9743c1-9877-4fd9-8afd-419e7513b1b3 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 404 len: 111 microversion: 2.1 time: 0.069887 Nov 02 12:24:25.472238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2916/5867] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.474658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.474658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] [instance: 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:25.484382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.485041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.485613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.486388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:25.488150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:25.488597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:25.492883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee HTTP/1.1 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '78b4d082-3dad-438f-b788-ccbdfe23a6ee'} Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.497718 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3559762a-7954-46f1-b375-994d7bcc2cab tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 404 len: 111 microversion: 2.20 time: 0.082588 Nov 02 12:24:25.509390 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2952/5868] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:25.523921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.524516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-238fdb57-474a-44b9-86d4-bcd2c15ed44e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '.version_select at 0x7ff1b3db49d0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b HTTP/1.1 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b'} Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.529290 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance 632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.535458 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b94a4c08-d823-46e0-b0fb-5bc82b5c08e6 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b" status: 404 len: 111 microversion: 2.1 time: 0.065084 Nov 02 12:24:25.537544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2917/5869] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:25 2022] GET /compute/v2.1/servers/632a5fc0-a9d9-4b8e-98e9-d202ca3dc07b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:24:25.566887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cafb527f-e487-409c-a976-d09c51f89df9 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.579276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cafb527f-e487-409c-a976-d09c51f89df9 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cafb527f-e487-409c-a976-d09c51f89df9 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/221625c5-e80d-4381-b64d-1640aff2f96d HTTP/1.1 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '221625c5-e80d-4381-b64d-1640aff2f96d'} Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.582499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. Nov 02 12:24:25.586721 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.588983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cafb527f-e487-409c-a976-d09c51f89df9 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance group 221625c5-e80d-4381-b64d-1640aff2f96d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.590191 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cafb527f-e487-409c-a976-d09c51f89df9 tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/221625c5-e80d-4381-b64d-1640aff2f96d" status: 404 len: 117 microversion: 2.1 time: 0.036249 Nov 02 12:24:25.594622 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2918/5870] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-server-groups/221625c5-e80d-4381-b64d-1640aff2f96d => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.604130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cc22601-5509-473d-bb0e-6301abcafeab tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.618326 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3cc22601-5509-473d-bb0e-6301abcafeab tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cc22601-5509-473d-bb0e-6301abcafeab tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/89d30c49-a221-47b5-b01c-3e8f99514292 HTTP/1.1 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '89d30c49-a221-47b5-b01c-3e8f99514292'} Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.620062 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cc22601-5509-473d-bb0e-6301abcafeab tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance group 89d30c49-a221-47b5-b01c-3e8f99514292 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cc22601-5509-473d-bb0e-6301abcafeab tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/89d30c49-a221-47b5-b01c-3e8f99514292" status: 404 len: 117 microversion: 2.1 time: 0.026241 Nov 02 12:24:25.627060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2919/5871] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-server-groups/89d30c49-a221-47b5-b01c-3e8f99514292 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.632518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f913e862-93a6-4a5f-a64b-b4d2c3c4acec tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.636460 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-238fdb57-474a-44b9-86d4-bcd2c15ed44e tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480188749" status: 204 len: 0 microversion: 2.20 time: 0.118366 Nov 02 12:24:25.637589 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2953/5872] 10.222.0.48 () {60 vars in 1262 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480188749 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:24:25.640454 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f913e862-93a6-4a5f-a64b-b4d2c3c4acec tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f913e862-93a6-4a5f-a64b-b4d2c3c4acec tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-server-groups/7649788b-a9b3-46c7-b9f1-1735b0610798 HTTP/1.1 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '7649788b-a9b3-46c7-b9f1-1735b0610798'} Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.642309 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f913e862-93a6-4a5f-a64b-b4d2c3c4acec tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance group 7649788b-a9b3-46c7-b9f1-1735b0610798 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.646352 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f913e862-93a6-4a5f-a64b-b4d2c3c4acec tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/7649788b-a9b3-46c7-b9f1-1735b0610798" status: 404 len: 117 microversion: 2.1 time: 0.015913 Nov 02 12:24:25.653390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d364baf-4401-41db-b734-1305ce93ab1c tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.661011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2920/5873] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-server-groups/7649788b-a9b3-46c7-b9f1-1735b0610798 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.662504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6d364baf-4401-41db-b734-1305ce93ab1c tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] HTTP exception thrown: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d364baf-4401-41db-b734-1305ce93ab1c tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Request method failure captured: Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/os-server-groups/2e083aed-db86-4bee-b7c3-341ffd88b703 HTTP/1.1 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmFZO127vFn6E0QfDyYMDYKpAbBBi_7HDd4AsMOhetd7D2fiVVClpw8u9Ec1eO2uKG165oh0VXXwEn-fULh5JJgA4bL6YVak-TvU7lvZR5FbW9ynrHj0cAlK7oOpC_wqkS8da-_xiNXcFWp6LOEvm_Th61ivvOZR57c7klAuhFigKuY Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0de712f0dee6401aa5c5267a82facc71", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0de712f0dee6401aa5c5267a82facc71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0de712f0dee6401aa5c5267a82facc71 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1450698550 Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 685d7df0dfb744bc890be2ecf3e47b4e Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerGroupTestJSON-1450698550-project Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '2e083aed-db86-4bee-b7c3-341ffd88b703'} Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.664757 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. Nov 02 12:24:25.670157 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:25.671845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d364baf-4401-41db-b734-1305ce93ab1c tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Returning 404 to user: Instance group 2e083aed-db86-4bee-b7c3-341ffd88b703 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:25.672949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d364baf-4401-41db-b734-1305ce93ab1c tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2e083aed-db86-4bee-b7c3-341ffd88b703" status: 404 len: 117 microversion: 2.1 time: 0.024260 Nov 02 12:24:25.677260 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2954/5874] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-server-groups/2e083aed-db86-4bee-b7c3-341ffd88b703 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:24:25.683296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9586bd4b-8f51-4e98-8445-2dc2478f81fb tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:25.796662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9586bd4b-8f51-4e98-8445-2dc2478f81fb tempest-ServerGroupTestJSON-1450698550 tempest-ServerGroupTestJSON-1450698550-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef" status: 204 len: 0 microversion: 2.1 time: 0.116998 Nov 02 12:24:25.796852 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2921/5875] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:24:25 2022] DELETE /compute/v2.1/os-server-groups/9ae9e943-d3a9-4fb0-8738-69a2c2a401ef => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:24:32.897867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:32.897867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:32.904791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.905491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.906168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.907123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.907745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.908361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.946871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee HTTP/1.1 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '78b4d082-3dad-438f-b788-ccbdfe23a6ee'} Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:32.951544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:32.956897 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:32.959968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:32.963789 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83904ef8-73b9-4640-8433-1c9d5784781f tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 404 len: 111 microversion: 2.20 time: 0.070801 Nov 02 12:24:32.964855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2955/5876] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:24:32 2022] DELETE /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:32.974866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:32.975743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 78b4d082-3dad-438f-b788-ccbdfe23a6ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:32.987534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.990812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.991393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:32.993190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:32.994321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:32.994889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:33.016104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee HTTP/1.1 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '78b4d082-3dad-438f-b788-ccbdfe23a6ee'} Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:33.019546 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. Nov 02 12:24:33.024924 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:33.036252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 78b4d082-3dad-438f-b788-ccbdfe23a6ee could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:33.037454 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-280dbc74-694e-4ff1-858f-50b71fed8034 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee" status: 404 len: 111 microversion: 2.20 time: 0.068130 Nov 02 12:24:33.038697 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2922/5877] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:32 2022] GET /compute/v2.1/servers/78b4d082-3dad-438f-b788-ccbdfe23a6ee => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:40.237997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:40.238528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:40.252412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.252918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.253368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.254924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.255474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.255929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.308674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 HTTP/1.1 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '7d623ac7-dedb-4198-a23f-3b8b8eeed2e1'} Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:40.314221 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b15cbc0-ed01-4546-9ba4-72ea3d7f64af tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 404 len: 111 microversion: 2.20 time: 0.083357 Nov 02 12:24:40.325181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2956/5878] 10.222.0.48 () {60 vars in 1280 bytes} [Wed Nov 2 12:24:40 2022] DELETE /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:40.331938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:40.332693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] [instance: 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:40.345142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:40.355145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.355734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.356479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.357399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:40.357869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:40.358303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:40.398042 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] HTTP exception thrown: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Request method failure captured: Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 HTTP/1.1 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYl9DnuUTT-8cZnEgIUZnK1VdMhjPfQlBQtPb62nthGynEsExQ9GI8U8KrRz8eEJAF8B7_Dj6DL0SNMY4Lhmsm4ct0rw7_5qKaIHeVsVB36J7iT_CfeCdNxo3l62_ROjNPcIXI3JCn37ICxPVa3ltpHva8nphupRvDnDnZ6faBpHiSKY Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35cd9f7745c7496ab54140b648471e6a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35cd9f7745c7496ab54140b648471e6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 35cd9f7745c7496ab54140b648471e6a Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-763353489 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: c1e0f9913abf4ea7b14677dea2dd9012 Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-763353489-project Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '7d623ac7-dedb-4198-a23f-3b8b8eeed2e1'} Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.401072 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. Nov 02 12:24:40.405133 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:24:40.411899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] Returning 404 to user: Instance 7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:24:40.412900 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c140af3-16a4-4b60-97f3-a3912025ad53 tempest-AttachVolumeShelveTestJSON-763353489 tempest-AttachVolumeShelveTestJSON-763353489-project] 10.222.0.48 "GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1" status: 404 len: 111 microversion: 2.20 time: 0.088821 Nov 02 12:24:40.418004 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2923/5879] 10.222.0.48 () {60 vars in 1277 bytes} [Wed Nov 2 12:24:40 2022] GET /compute/v2.1/servers/7d623ac7-dedb-4198-a23f-3b8b8eeed2e1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:24:41.021940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39aa4402-b08c-4dd9-b81f-841fcaf2f52b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Action: 'create', calling method: .version_select at 0x7ff1b37cb280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-959966774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlmSCOis3b3v4HFKt3zT514S9Iu5YiL6pNwJ4CYUARnk7e/D0RB3woTRK/WlM/pdBDgrty/XI0I83aoWSvWeFKlaGwKQQi1Aofemj5ZhBoSKRt0JkFtn9QcqtRz1wr+Xg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:41.047402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-39aa4402-b08c-4dd9-b81f-841fcaf2f52b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for project fa53c0fab318497fadd6a36ae5dd1479. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:41.055266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-39aa4402-b08c-4dd9-b81f-841fcaf2f52b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for user 24e2c93c5dbc48479bbd24b4a2ecd959 and project fa53c0fab318497fadd6a36ae5dd1479. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:41.230128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39aa4402-b08c-4dd9-b81f-841fcaf2f52b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.527254 Nov 02 12:24:41.231849 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2957/5880] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:24:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:47.357322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1703445228", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-959966774", "security_groups": [{"name": "tempest-secgroup-smoke-436640547"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "1b448939-a46d-4cf4-9a9a-d95c036136c9"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:47.916019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] validate_networks() for [('1b448939-a46d-4cf4-9a9a-d95c036136c9', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:24:48.937382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for project fa53c0fab318497fadd6a36ae5dd1479. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:48.943810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for user 24e2c93c5dbc48479bbd24b4a2ecd959 and project fa53c0fab318497fadd6a36ae5dd1479. Resources: dict_keys(['metadata_items']) {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:48.959495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:24:48.960256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:24:48.960807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:24:48.961292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:24:48.961767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:24:48.973367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.973951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.974463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:48.975378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:48.975888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:48.976393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:49.004549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for project fa53c0fab318497fadd6a36ae5dd1479. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:24:49.016996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Getting quotas for user 24e2c93c5dbc48479bbd24b4a2ecd959 and project fa53c0fab318497fadd6a36ae5dd1479. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:24:49.036641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:24:49.040583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:24:49.446662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b38adb4-51c0-4153-a407-bed8988a6648 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.098198 Nov 02 12:24:49.447960 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2924/5881] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:24:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:24:49.468093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc9dc4c6-8310-4125-a1d1-5959727ba68b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:49.468857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc9dc4c6-8310-4125-a1d1-5959727ba68b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:49.595074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc9dc4c6-8310-4125-a1d1-5959727ba68b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:49.622391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc9dc4c6-8310-4125-a1d1-5959727ba68b tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1302 microversion: 2.1 time: 0.156171 Nov 02 12:24:49.624675 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2958/5882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:49 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:24:50.658555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.659253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:50.852658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:50.882626 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1302 microversion: 2.1 time: 0.224633 Nov 02 12:24:50.882626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2925/5883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1302 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:51.901329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c984f3b-14cf-441e-8583-ddecfac81252 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:51.901931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c984f3b-14cf-441e-8583-ddecfac81252 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:51.905268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:52.219547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c984f3b-14cf-441e-8583-ddecfac81252 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:52.227328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c984f3b-14cf-441e-8583-ddecfac81252 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1302 microversion: 2.1 time: 0.330028 Nov 02 12:24:52.240338 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2959/5884] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:51 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1302 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:52.831976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:52.833143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-975e2dce-c0f9-4c0b-87db-62a9c6199f1c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002718 Nov 02 12:24:52.834406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2926/5885] 10.222.0.48 () {56 vars in 886 bytes} [Wed Nov 2 12:24:52 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:24:53.260466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.261321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:53.290015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.291675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.294576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.295585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:53.296479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:53.298298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:53.468793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:53.484324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4d34dbd-9c19-458a-bb13-82cf239e46db tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1298 microversion: 2.1 time: 0.230362 Nov 02 12:24:53.488178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2960/5886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:54.514369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:54.514904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:54.522782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.523690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.524364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.525280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:54.525957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:54.526560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:54.553213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:55.068723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:55.081737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e5c74929-894e-4f1c-b21d-91629103ef92 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1362 microversion: 2.1 time: 0.567754 Nov 02 12:24:55.081737 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2927/5887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:54 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:56.107231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:56.108029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:56.124494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:56.129168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.130398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.130860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.131951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:56.132893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:56.133639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:56.343971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:56.354439 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-77b7aae4-f04b-4b07-beec-6c89fb567ab2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1360 microversion: 2.1 time: 0.254139 Nov 02 12:24:56.355324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2961/5888] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:56 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:57.381782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:57.382455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:57.393544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.393544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.393544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:57.394019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:57.394475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:57.395294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:58.222375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:58.233969 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4591aae6-25f6-4c85-9e23-963e0e84de10 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.856642 Nov 02 12:24:58.237233 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2928/5889] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:57 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:59.266562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:59.267228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:24:59.276823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.277431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.286282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.286282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:24:59.286282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:24:59.286282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:24:59.793175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:24:59.809617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e6c89ec-e8a7-49c5-8af2-388609453262 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.547849 Nov 02 12:24:59.816986 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2962/5890] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:24:59 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:00.845461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:00.847059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:00.855428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:00.869137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.869901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.872092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.873031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:00.875515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:00.876717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:00.879286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:01.101548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:01.115570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33c39fd6-52ed-48e1-b838-38e8ee678e8e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.275682 Nov 02 12:25:01.133186 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2929/5891] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:00 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:01.232269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9", "tag": "56a902d8-3135-4f4b-94cb-d1b237ac7fd3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:01.252745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:01.253481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:01.254092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:01.272453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] Creating event network-changed:56a902d8-3135-4f4b-94cb-d1b237ac7fd3 for instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 on n-h1-855649-4 Nov 02 12:25:01.278901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-92132228-2c4e-46aa-b260-69dbe04bd594 req-eae27b7b-b6b0-49cb-8d24-0a797e9075e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052242 Nov 02 12:25:01.279800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2963/5892] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:02.143205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:02.144131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:02.154043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.154560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.155013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.155920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:02.156376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:02.156801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:02.463270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:02.478725 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f88c0892-1635-47b0-9ca6-7b59ec0e206e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.341250 Nov 02 12:25:02.479545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2930/5893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:02 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:03.499015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:03.506058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:03.506776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:03.523081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.529424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.529424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.529424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:03.529424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:03.529424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:03.721817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:03.733560 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-285b6cad-c07c-4ac2-addf-a9bf6a61b863 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.235471 Nov 02 12:25:03.739018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2964/5894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:03 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:04.757294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:04.757924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:04.765740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.766150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.766595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:04.767420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:04.767860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:04.782783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:05.170539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:05.181082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-703ba65c-990f-4b6b-b7d1-9c1d8ed7aaec tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.427412 Nov 02 12:25:05.183248 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2931/5895] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:04 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:06.208085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:06.216359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:06.233479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:06.234359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:06.235117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:06.236056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:06.237749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:06.238364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:06.726244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:06.739843 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0f843e0-2710-4c46-962d-b9f616abcfcd tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.535814 Nov 02 12:25:06.749620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2965/5896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:06 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:07.775169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:07.775829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:07.805679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.812157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.813578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.817189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:07.817960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:07.818986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:07.996086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3c5b01b-64c9-499b-a71a-ed657a4fd672 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: .version_select at 0x7ff1b2703b80>, body: {"keypair": {"name": "tempest-keypair-1378627975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhE0Dmm+FAlTRELjLHn/0QCVJNgArM2mZF+rx4+C8dYixlz1kqBPH1x+Yb8WfG8swJd1OoYOui+il2xgnxWW9gCEaj/w9KF6/ONPHqIIFcqGDRZmEgwFYyKs+/4MvppEQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:08.024251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b3c5b01b-64c9-499b-a71a-ed657a4fd672 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:08.031127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b3c5b01b-64c9-499b-a71a-ed657a4fd672 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:08.141269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:08.154186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65c5f1c2-d061-4bfd-b82d-a045ab52bf2c tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.383192 Nov 02 12:25:08.171877 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2966/5897] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:07 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:08.278909 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3c5b01b-64c9-499b-a71a-ed657a4fd672 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.806400 Nov 02 12:25:08.279791 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2932/5898] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:25:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:09.178530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:09.179234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:09.197476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.197476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.197476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.197476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:09.197476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:09.211190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:09.415502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:09.426065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db278108-0922-4298-9bca-bae2270f3405 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.251827 Nov 02 12:25:09.427365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2967/5899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:09 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:10.456418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:10.457205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:10.471466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.472040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.472797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.473608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:10.474178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:10.474722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:10.919481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:10.932411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23efa843-cd2b-476c-a6fd-98841dee0301 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.479855 Nov 02 12:25:10.936017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2933/5900] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:10 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:11.020255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9", "name": "network-vif-plugged", "status": "completed", "tag": "56a902d8-3135-4f4b-94cb-d1b237ac7fd3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:11.032921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:11.035867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:11.038343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:11.064256 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] Creating event network-vif-plugged:56a902d8-3135-4f4b-94cb-d1b237ac7fd3 for instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 on n-h1-855649-4 Nov 02 12:25:11.082156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ade7f61f-28e7-4f7c-8f27-f137b5868599 req-2313bcae-4107-4786-b15c-6658d92422d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063259 Nov 02 12:25:11.083192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2968/5901] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:11.961437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:11.962070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:11.979253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:11.982612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:11.993741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:11.994772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:11.995443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:11.996086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:12.354052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:12.365560 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9637574-c475-4be8-b344-ac71105299ea tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1427 microversion: 2.1 time: 0.409173 Nov 02 12:25:12.366833 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2934/5902] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:11 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1427 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:12.983371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1078870229", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba6c2373-9a81-452f-a522-659a15bb02e6"}], "security_groups": [{"name": "tempest-securitygroup--1857794916"}], "key_name": "tempest-keypair-1378627975", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:13.150131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] validate_networks() for [('ba6c2373-9a81-452f-a522-659a15bb02e6', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:25:13.391154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:13.391674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:13.420057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.420057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.420057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.421189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.421724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.422402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.733437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:13.777185 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88bc53b0-9229-45aa-a392-4b9e868af6ac tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1606 microversion: 2.1 time: 0.389983 Nov 02 12:25:13.778276 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2935/5903] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1606 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:13.802536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:13.803207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:13.820679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.822303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.823281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:13.825104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:13.827322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:13.827823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.633464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:14.642853 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30d045d5-93ec-4279-8ef3-4cd5316effa4 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1606 microversion: 2.1 time: 0.844433 Nov 02 12:25:14.644276 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2936/5904] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:13 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1606 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:14.666742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:14.667215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:14.675001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.675500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.675945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.676669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.677314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.678076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.822956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:25:14.824208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:25:14.825454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:25:14.826172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:25:14.826819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:25:14.847182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.849166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.849662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.850471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:14.850945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:14.851400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:14.881523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:25:14.889608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:25:14.916272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:25:14.919987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:25:14.998990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:15.015850 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c76fefb5-ad33-4c90-bd9d-21c932f7a690 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1606 microversion: 2.1 time: 0.352342 Nov 02 12:25:15.037751 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2937/5905] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:14 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1606 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:15.055228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5cbec27a-9e51-429a-88ca-a45dddc48e00 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.079076 Nov 02 12:25:15.057169 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2969/5906] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:25:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:25:15.077422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e167d966-4705-478c-b51d-59f3fae52773 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:15.078060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e167d966-4705-478c-b51d-59f3fae52773 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:15.192135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e167d966-4705-478c-b51d-59f3fae52773 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:15.195386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e167d966-4705-478c-b51d-59f3fae52773 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1242 microversion: 2.1 time: 0.129131 Nov 02 12:25:15.195991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2938/5907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:15 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:16.220409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a6ecd4e-b96b-4138-8fe8-f8d813e7c857 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.221496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a6ecd4e-b96b-4138-8fe8-f8d813e7c857 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:16.324462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a6ecd4e-b96b-4138-8fe8-f8d813e7c857 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:16.335155 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a6ecd4e-b96b-4138-8fe8-f8d813e7c857 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1242 microversion: 2.1 time: 0.120575 Nov 02 12:25:16.335695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2970/5908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:17.359211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:17.360187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:17.369536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.370333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.370901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.371872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:17.372437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:17.372987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:17.500330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:17.516703 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4208259-13e2-4b0d-bfbb-3fe3d256bc08 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1246 microversion: 2.1 time: 0.160645 Nov 02 12:25:17.519381 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2939/5909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:17 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:18.218681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9", "tag": "56a902d8-3135-4f4b-94cb-d1b237ac7fd3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:18.245964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.246461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.246929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.276705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] Creating event network-changed:56a902d8-3135-4f4b-94cb-d1b237ac7fd3 for instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 on n-h1-855649-4 Nov 02 12:25:18.290559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-50aa3133-e08b-4709-aee5-31b4260f9663 req-58288a8a-5aad-46f7-b0a1-bad952878647 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076590 Nov 02 12:25:18.294787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2971/5910] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:18.549238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:18.557227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:18.580764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:18.725769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:18.747509 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b6d3535a-a4a7-4d7a-b85f-31ea6b20fec0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1294 microversion: 2.1 time: 0.207211 Nov 02 12:25:18.751621 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2940/5911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:18 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:19.792807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.794313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:19.805540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.806077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.807031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:19.809718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:19.812586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:19.813363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:20.082470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:20.093565 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-528e1a59-e68e-4660-b3ea-2112585c142e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1300 microversion: 2.1 time: 0.312432 Nov 02 12:25:20.094131 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2972/5912] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1300 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:21.120297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:21.121650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:21.132621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:21.134590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.136491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.139449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.140568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:21.141283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:21.142082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:21.539332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:21.551938 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf7e1e9a-764a-4496-8621-abbf24bc038c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.435421 Nov 02 12:25:21.564145 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2941/5913] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:21 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:22.318068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e6c38c-73d6-406d-9da6-5c7759b786e2", "tag": "b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:22.329937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.330429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.330874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.344635 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] Creating event network-changed:b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c for instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 on n-h2-855649-4 Nov 02 12:25:22.350858 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-20169652-4aee-4cb2-9692-6d7f6bb52cda req-656be0de-71e7-4e82-9927-3424e809c97b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037920 Nov 02 12:25:22.351815 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2973/5914] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:22.578227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:22.579559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:22.588038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.588534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.589052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.589769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:22.590230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:22.590661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:22.810650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:22.827543 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9344c847-b48a-4bad-be13-24f9a61d7b72 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.248422 Nov 02 12:25:22.841807 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2942/5915] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:22 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:23.850820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:23.852057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:23.862560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.863094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.864811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:23.866465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:23.867189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:23.867909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.004386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:24.006771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:24.012233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.012730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.013175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.014051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:24.014511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:24.014942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:24.022286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:24.031615 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95aa9992-32a0-442e-a2b8-56e1065f8dcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.186619 Nov 02 12:25:24.033176 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2974/5916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:23 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:24.371917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lazy-loading 'services' on Instance uuid 029a6a4d-879d-424c-83ab-23ecdc9f54f1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:25:24.811918 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a23a370-17d7-4990-8dc0-0b75a617b4be tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments/2d7adeb3-562a-4b3d-a8cb-05eb948028c6" status: 202 len: 0 microversion: 2.1 time: 0.813560 Nov 02 12:25:24.826884 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2943/5917] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:25:23 2022] DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments/2d7adeb3-562a-4b3d-a8cb-05eb948028c6 => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:25.056365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:25.060298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:25.060635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:25.067738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:25.068232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:25.068664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:25.069731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:25.070193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:25.070618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:25.496666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:25.505115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3891f0da-e9ea-4f5d-9b8a-b5d621e8e014 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.451535 Nov 02 12:25:25.505764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2975/5918] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:25 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:26.530917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:26.532590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:26.546410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:26.549028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.549828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.550498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.557278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:26.560208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:26.561722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:26.752326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:26.765047 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ef40d09-f77a-44d8-9b7b-19332d332cf5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.239510 Nov 02 12:25:26.781019 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2944/5919] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:26 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:27.792940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:27.800511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:27.811367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:27.814953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.815739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.816389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:27.817530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:27.818154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:27.819181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:28.851679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:28.877213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e422412-b6a5-4caa-9331-b8138abd9f0c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 1.087655 Nov 02 12:25:28.877830 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2976/5920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:27 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:29.908053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e6c38c-73d6-406d-9da6-5c7759b786e2", "name": "network-vif-plugged", "status": "completed", "tag": "b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:29.908707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:29.909313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:29.919478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:29.922404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:29.924092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:29.925101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:29.926078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:29.926766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:29.931881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:29.932873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:29.933572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:29.934180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:29.955841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=77 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:29.960202 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] Creating event network-vif-plugged:b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c for instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 on n-h2-855649-4 Nov 02 12:25:29.981322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-231168d3-f774-4990-9070-0c4afad8ce34 req-393a97a8-b931-4a5a-bd20-0524911bc1a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078443 Nov 02 12:25:29.982576 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2977/5921] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:30.344091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:30.355169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-793405f9-9549-42a5-8b07-8ca5bf4be911 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.454861 Nov 02 12:25:30.356461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2945/5922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:29 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:31.385541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:31.386265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:31.398925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.401225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.409439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.410422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:31.411142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:31.411594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:31.859094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:31.877565 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b64dabed-1e53-435b-bb27-a34da092656c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1368 microversion: 2.1 time: 0.497430 Nov 02 12:25:31.878771 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2978/5923] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:31 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1368 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:32.902122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:32.902748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:32.910947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.922038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.922038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:32.922038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:32.922038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:32.922038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.114839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:33.124317 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54dca8f4-45b5-4a7f-acac-f709fdc49c3c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1558 microversion: 2.1 time: 0.226674 Nov 02 12:25:33.139577 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2946/5924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:32 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:33.148027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:33.149245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:33.157457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.158746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.159377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.160287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:33.160910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:33.161499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:33.255864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eff4e4de-3fdc-4f23-948c-5567ec516caf tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111635 Nov 02 12:25:33.271393 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2979/5925] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:25:33 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:34.837204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:34.846820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:34.847348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:34.847793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:34.874834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:25:35.002063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e6c38c-73d6-406d-9da6-5c7759b786e2", "tag": "b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:35.012674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.013043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.013468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.027953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] Creating event network-changed:b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c for instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 on n-h2-855649-4 Nov 02 12:25:35.031873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7f6fcb05-959d-4aea-876c-6143adccda84 req-a649e6a8-1cfe-4933-aba9-fdcb3bf7f937 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Nov 02 12:25:35.033526 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2980/5926] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:35.344783 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b2d7554b-2bdc-4a56-939b-a620df1cf164 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action" status: 202 len: 0 microversion: 2.1 time: 0.512962 Nov 02 12:25:35.346128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2947/5927] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:25:34 2022] POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:35.356460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:35.357636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:35.368719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.369280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.369682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.374143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:35.374143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:35.374143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:35.775956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:35.786536 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-897af3c6-5e65-4545-8014-19a7692368d0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.433576 Nov 02 12:25:35.787173 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2981/5928] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:35 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:36.814231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:36.816135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:36.823653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.827969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.827969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:36.827969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:36.827969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:36.827969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:37.241530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:37.253754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e984aa5-b48e-402d-b044-f7c374b657c5 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.445313 Nov 02 12:25:37.261105 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2948/5929] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:36 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:38.278325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:38.278835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:38.298127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:38.300112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.300827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.301440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.302355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:38.303026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:38.303624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:38.691369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:38.698537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9780dc20-d159-4514-be49-92f8af2b1ed8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.423869 Nov 02 12:25:38.704320 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2982/5930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:38 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:39.729739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:39.729739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:39.735221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.735753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.736202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.736918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:39.737383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:39.737822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:39.962334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:39.980533 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0d88c9ba-6b20-4aa8-bb97-dc322839c644 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.249452 Nov 02 12:25:39.980533 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2949/5931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:39 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:25:40.994298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:40.994928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:41.002413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.002913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.003401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.004117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:41.004577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:41.005008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:41.206008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:41.216190 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0549836e-ddf4-4113-844e-a01ec8c5990c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.226174 Nov 02 12:25:41.223674 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2983/5932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:40 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:42.254047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:42.255364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:42.263280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.264243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.267647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.267647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:42.267647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:42.267647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:42.453689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:42.463239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e6ffb64-3ae8-4c89-bd75-4ff4c7019962 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.223471 Nov 02 12:25:42.463983 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2950/5933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:42 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:43.490703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:43.491447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:43.498419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.498925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.499633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.500548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:43.501248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:43.502222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:43.766506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:43.780275 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e7876d55-68cd-46f3-9580-a503c25df5c6 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.296419 Nov 02 12:25:43.780720 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2984/5934] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:43 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:44.818278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:44.818278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:44.829099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.829634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.830278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:44.831011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:44.831547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:44.831991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:45.137253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:45.152490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4ca1b67-0113-46b1-84b2-497702450385 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.350221 Nov 02 12:25:45.153262 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2951/5935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:44 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:46.189762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:46.190472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:46.198763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.199285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.199728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.200507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:46.201223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:46.201913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:46.390997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:46.399313 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-708f94bd-ca87-40db-b65e-ac0ead68a434 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.214307 Nov 02 12:25:46.399900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2985/5936] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:46 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:47.424116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:47.424762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:47.433240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.434009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.434619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.436427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:47.436930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:47.437435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:47.631220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:47.640997 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02189aa3-b91a-4dd2-b560-97a2a111b185 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.220906 Nov 02 12:25:47.642609 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2952/5937] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:47 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:48.666050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:48.666948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:48.676529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.677061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.677607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.678441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.679101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.679645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.838661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:48.839235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:48.865697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.866209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.866661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.869207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:48.869657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:48.870112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:48.935142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:48.941674 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-683199db-e199-4461-8d75-ad27582eb8ad tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.107956 Nov 02 12:25:48.943274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2953/5938] 10.222.0.48 () {58 vars in 1293 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9/os-server-password => generated 116 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:48.953866 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d28892c5-59d2-46f5-b364-cccb23d064a0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.291317 Nov 02 12:25:48.955765 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2986/5939] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:48 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:49.987684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:49.988969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:49.997133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:49.998022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.003725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.003725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:50.003725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:50.003725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:50.252839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:50.263156 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-213ac293-3fe6-4c3a-9d4b-191f7e6c6667 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1678 microversion: 2.1 time: 0.279854 Nov 02 12:25:50.263956 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2954/5940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:49 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.326703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.490462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:51.503765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-786517bc-7284-468d-965a-ef54dec851ba tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1655 microversion: 2.1 time: 0.217695 Nov 02 12:25:51.504382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2987/5941] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1655 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:51.527396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:51.535950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.536442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.536888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.572142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Going to try to start instance {{(pid=127568) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:25:51.811301 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7cb66aa6-c72e-4ea6-8600-6b637e38e134 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action" status: 202 len: 0 microversion: 2.1 time: 0.285113 Nov 02 12:25:51.815871 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2955/5942] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:25:51 2022] POST /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:25:51.825578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:51.826813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:51.836652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.840139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.840139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:51.840139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:51.841532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:51.842398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:52.164077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:52.173973 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66a707d0-3222-4ecf-9a39-8a8b435106ae tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1664 microversion: 2.1 time: 0.353855 Nov 02 12:25:52.178455 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2988/5943] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:51 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1664 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:53.211241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:53.212625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:53.235660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.237221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.240410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:53.242000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:53.243206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:53.244276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:54.104943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:54.122942 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-481ae286-6892-4487-9dac-3abbf577452d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1664 microversion: 2.1 time: 0.921777 Nov 02 12:25:54.136666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2956/5944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:53 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1664 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:55.150095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:55.150834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:25:55.168680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.176106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.176778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.177801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:25:55.178637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:25:55.179278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:25:55.355947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:25:55.366536 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-12e65b5c-4442-4b3f-a79e-8d06746a63a7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1668 microversion: 2.1 time: 0.221143 Nov 02 12:25:55.367415 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2989/5945] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:25:55 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:26.732616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:26.734213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:26.743442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=31 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:26.744996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:26.747392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:26.748018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:26.748576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:26.749768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:26.751298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:26.752220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:26.891060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lazy-loading 'services' on Instance uuid 540f5f20-acdf-4975-ae5b-6ed0f0894e9d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:26:27.219128 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05cb4be5-7be7-4896-b678-1c763139770f tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "DELETE /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d/os-volume_attachments/b148b8af-93d5-4d3c-85d4-6ec88db5c4eb" status: 202 len: 0 microversion: 2.1 time: 0.491310 Nov 02 12:26:27.221215 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2957/5946] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:26:26 2022] DELETE /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d/os-volume_attachments/b148b8af-93d5-4d3c-85d4-6ec88db5c4eb => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:26:35.242322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:35.243192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:35.247317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=15 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:35.248937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=67 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:35.254560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.259900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.259900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.259900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.259900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.259900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.301651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:26:35.753061 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7caa3566-34fb-4a41-b333-2c68c7f01b29 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "DELETE /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 204 len: 0 microversion: 2.1 time: 0.514640 Nov 02 12:26:35.757712 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2990/5947] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:26:35 2022] DELETE /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:26:35.769962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:35.770723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:35.785812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.786351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.786740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:35.787508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:35.787959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:35.788391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:36.017437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:36.027623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1b7877c-5ad4-4af2-beb7-5acd3473495e tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1470 microversion: 2.1 time: 0.264993 Nov 02 12:26:36.028451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2958/5948] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:35 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:37.059892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:37.059892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:37.064193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:37.064761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:37.065208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:37.065945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:37.066400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:37.066827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:38.126289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:38.134932 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc155e22-4bde-4983-a019-0191a39f5ee9 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1470 microversion: 2.1 time: 1.086610 Nov 02 12:26:38.139804 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2991/5949] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:37 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1470 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:26:38.786107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540f5f20-acdf-4975-ae5b-6ed0f0894e9d", "name": "network-vif-deleted", "tag": "51bf0a11-77fb-4382-a299-e38890b4e4e2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:38.795288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:38.795771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:38.796293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:38.810071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] Creating event network-vif-deleted:51bf0a11-77fb-4382-a299-e38890b4e4e2 for instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d on n-h1-855649-4 Nov 02 12:26:38.816162 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e0f012bf-8d68-49c3-b9f9-699a4c2d07c4 req-c19eebbb-fd42-4605-bbf6-32d8d105456d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037047 Nov 02 12:26:38.816779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2959/5950] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:39.164427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:39.165040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:39.176435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:39.177191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:39.177817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:39.178715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:39.179372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:39.179994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:39.321276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8c803c87a48e895ad9fb4ba885517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75a38f213e6485cb89c75873df1d650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:26:39.337060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1bc6176-9945-4c03-b9ae-9a0e04a265b5 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 200 len: 1299 microversion: 2.1 time: 0.176590 Nov 02 12:26:39.347424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2992/5951] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:39 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:40.364675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:40.372550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] [instance: 540f5f20-acdf-4975-ae5b-6ed0f0894e9d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:26:40.381258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.381759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.382412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.383326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:40.383966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:40.384568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:40.402540 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] HTTP exception thrown: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Request method failure captured: Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d HTTP/1.1 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmFTv5Xu3wVrj5hqt8LRErEGfnhakbFBdrhrAEwJWYsqdz7asHBitrax2DdTrMBhvWeg-5JpNrFtjfmKQLdCK-6gIKtW2JW2VWTQ_TpcT24exibUtjC1lYl1jzYMer3niuBalM2cgJkbOhQaBsYW3UziYuLx78MkIIJHY7RgoLRZefk Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: d75a38f213e6485cb89c75873df1d650 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesBackupsTest-512195345 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d75a38f213e6485cb89c75873df1d650"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d75a38f213e6485cb89c75873df1d650", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d75a38f213e6485cb89c75873df1d650"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d75a38f213e6485cb89c75873df1d650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesBackupsTest-512195345 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: d75a38f213e6485cb89c75873df1d650 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesBackupsTest-512195345 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesBackupsTest-512195345-project Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 09e8c803c87a48e895ad9fb4ba885517 Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesBackupsTest-512195345-project Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '540f5f20-acdf-4975-ae5b-6ed0f0894e9d'} Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:26:40.404275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] Returning 404 to user: Instance 540f5f20-acdf-4975-ae5b-6ed0f0894e9d could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a734cc10-62dd-453b-835e-78a1097d0fc7 tempest-VolumesBackupsTest-512195345 tempest-VolumesBackupsTest-512195345-project] 10.222.0.48 "GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d" status: 404 len: 111 microversion: 2.1 time: 0.048111 Nov 02 12:26:40.409071 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2960/5952] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:26:40 2022] GET /compute/v2.1/servers/540f5f20-acdf-4975-ae5b-6ed0f0894e9d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:27:02.732508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:02.737921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:02.754359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:02.755999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:02.761433 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:27:02.761664 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments (ip 10.222.0.48) !!! Nov 02 12:27:02.773451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.775180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.776343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:02.778076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.779489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.780302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:02.855417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf96afb4-bb6f-40f2-b1cd-5c4c7cd71001 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142135 Nov 02 12:27:02.866725 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2993/5953] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:27:02 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:27:02.984984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:02.986171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:02.993223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:02.996189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:02.997120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.997630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.998082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:02.998858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:02.999366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:02.999806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.034394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:27:03.547888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01d0144e-80c9-460e-b295-dbacc37d0c47 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 204 len: 0 microversion: 2.1 time: 0.566329 Nov 02 12:27:03.548534 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2961/5954] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:27:02 2022] DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:27:03.557486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:03.558320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:03.565869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.566359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.566795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.567543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:03.568140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:03.568573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:03.748435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:03.769804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf175d66-fc5d-4f75-9808-ce6019bb8be8 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1674 microversion: 2.1 time: 0.216528 Nov 02 12:27:03.770409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2994/5955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:03 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:04.769979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.771559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:04.784212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.788879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.795297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.795297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.795297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.795297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.796897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.798045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:04.818868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.819932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.820615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.821531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.822237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.822852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.847832 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46c0d9c1-ed20-43a9-a3a5-2070f8d40823 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.087492 Nov 02 12:27:04.849283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2962/5956] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:27:05.248513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:05.264547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06836bdb-46a9-4d6b-b577-73d546888323 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1674 microversion: 2.1 time: 0.472062 Nov 02 12:27:05.268025 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2995/5957] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1674 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:06.302508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.305101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:06.333970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.336586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.337220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.338060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.341801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.342361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.432710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:06.448855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7d22d798-6a09-4c21-b3e2-b672d9dbcef3 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1607 microversion: 2.1 time: 0.157861 Nov 02 12:27:06.451590 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2963/5958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1607 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:06.651812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029a6a4d-879d-424c-83ab-23ecdc9f54f1", "name": "network-vif-deleted", "tag": "a1fe1337-bc12-4b25-a812-e05ed36e4262"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:06.691729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:06.693037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:06.694074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:06.721344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] Creating event network-vif-deleted:a1fe1337-bc12-4b25-a812-e05ed36e4262 for instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 on n-h2-855649-4 Nov 02 12:27:06.736451 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c58b798-23c5-4306-9890-68f31b64a6bd req-c4e6f270-6b8d-4723-a552-6c72456b51e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092457 Nov 02 12:27:06.757773 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2996/5959] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:27:07.478722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:07.480022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:07.491267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:07.492659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:07.493403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.494406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:07.495227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:07.496158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.560264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:07.560769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:07.561222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:07.561688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lazy-loading 'fault' on Instance uuid 029a6a4d-879d-424c-83ab-23ecdc9f54f1 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:27:07.615354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:07.627392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f351de12-3a9b-45c0-a1fa-11c8fd79f1f7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 200 len: 1327 microversion: 2.1 time: 0.151698 Nov 02 12:27:07.629989 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2964/5960] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:07 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:08.654817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:08.655569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:08.672517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:08.685609 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 HTTP/1.1 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '029a6a4d-879d-424c-83ab-23ecdc9f54f1'} Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:27:08.688202 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:27:08.694174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:27:08.699641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bca7bab-94cc-4ec2-99ee-005740acdac0 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 404 len: 111 microversion: 2.1 time: 0.049496 Nov 02 12:27:08.712964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2997/5961] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:08 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:27:08.713779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-837f7a06-7339-4fd0-abc5-749c2c6f2bbc tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '.version_select at 0x7ff1b28c6430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:08.886449 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-837f7a06-7339-4fd0-abc5-749c2c6f2bbc tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813411128" status: 202 len: 0 microversion: 2.1 time: 0.180758 Nov 02 12:27:08.891168 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2965/5962] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813411128 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:27:09.183179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98e9151c-a9c1-40f3-97bf-edfa46d2269e"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:09.186488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:09.194229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.194720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.195290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:09.195920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:09.196382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:09.196843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:10.103934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-803494dd-c7ca-49a5-b9a2-024d882bc523 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: .version_select at 0x7ff1b227b0d0>, body: {"keypair": {"name": "tempest-keypair-1479677581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPROYtffPG5oqdJovLRdHNc/jC7g4OkJEIsZGf01HEq2+EMJFlWFFRLaVknKJB7yJSPDjTUcAUwkAJYKUAoF8ZWcvEjvjSxThR0T+5nG3jFdTNEzUXHyDkzMPXgVW2gg3A=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:10.128890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-803494dd-c7ca-49a5-b9a2-024d882bc523 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:10.136623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-803494dd-c7ca-49a5-b9a2-024d882bc523 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for user 866e943ff5b94fbebec3c8974ee053dc and project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:10.315333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-803494dd-c7ca-49a5-b9a2-024d882bc523 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.215368 Nov 02 12:27:10.316285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2966/5963] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:27:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:10.690684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-203cadf0-e038-40ab-ade6-2ae1dd5d197f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.512209 Nov 02 12:27:10.691569 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2998/5964] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:27:09 2022] POST /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 194 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:15.302446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1202413033", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7bd10d9-80e3-4e5a-adaa-b0ad946c70df"}], "security_groups": [{"name": "tempest-securitygroup--783778954"}], "key_name": "tempest-keypair-1479677581", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:15.474009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] validate_networks() for [('c7bd10d9-80e3-4e5a-adaa-b0ad946c70df', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:16.124355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:16.125473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:16.126755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:16.130686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:16.130686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:16.145258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.146873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.148127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.149835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:16.151027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:16.152141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:16.194059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:16.205860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Getting quotas for user 866e943ff5b94fbebec3c8974ee053dc and project 214c458d28ab4aecbbf38ba8d4f2dbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:16.238891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:16.244546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:16.545076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14901de8-f038-48d4-9a2c-340d24fb4034 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.249704 Nov 02 12:27:16.547852 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2967/5965] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:27:16.588495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fe9772c-5930-4e83-ba86-e52b835b58aa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:16.589853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2fe9772c-5930-4e83-ba86-e52b835b58aa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:16.715692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2fe9772c-5930-4e83-ba86-e52b835b58aa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:16.727185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fe9772c-5930-4e83-ba86-e52b835b58aa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1238 microversion: 2.1 time: 0.157447 Nov 02 12:27:16.728787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 2999/5966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:16 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:17.760141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-258208b7-7793-470d-bb17-707e05270469 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:17.761607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-258208b7-7793-470d-bb17-707e05270469 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:17.910160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-258208b7-7793-470d-bb17-707e05270469 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:17.928044 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-258208b7-7793-470d-bb17-707e05270469 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1238 microversion: 2.1 time: 0.177742 Nov 02 12:27:17.928044 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2968/5967] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:17 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1238 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:18.954606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:18.959663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:18.968141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:18.969158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:18.969842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:18.970876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:18.971643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:18.972454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:19.085433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:19.099121 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04a03a32-7bef-4851-9cc7-4c838c65dc8f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1234 microversion: 2.1 time: 0.151612 Nov 02 12:27:19.099744 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3000/5968] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:18 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1234 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:20.130315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:20.136705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:20.178821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.179521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.180263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.181291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:20.182028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:20.182551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:20.344916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:20.357377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3641d9fa-ef49-416c-ac5b-1bd11a821a93 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1298 microversion: 2.1 time: 0.237375 Nov 02 12:27:20.358275 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2969/5969] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:20 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1298 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:21.402237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:21.403943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:21.422995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.424454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.438265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.441904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:21.442587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:21.446737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:21.935163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:21.952872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8393a630-207b-4f87-83e5-69ff7b6ea88b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.554116 Nov 02 12:27:21.955673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3001/5970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:21 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:22.983426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:22.984838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:23.005309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.006152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.007694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.009542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:23.010233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:23.010875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:23.825414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:23.842584 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a184f541-cc72-4c31-8bc0-cb0d3131ce95 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.863953 Nov 02 12:27:23.844288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2970/5971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:22 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:24.181282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa00049-b24a-44bf-91c3-d837e0acfce0", "tag": "7895972b-58ec-421e-aee9-1f80f8744540"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:24.207167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:24.211428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:24.212227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:24.233717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] Creating event network-changed:7895972b-58ec-421e-aee9-1f80f8744540 for instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 on n-h1-855649-4 Nov 02 12:27:24.247926 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cded758f-0e41-4582-8ff3-3c355f272289 req-e9383c0b-9ffb-487f-9bec-2614e05e8526 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070513 Nov 02 12:27:24.254320 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3002/5972] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:24.869618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:24.870448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:24.882626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:24.883377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:24.883717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:24.884365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:24.884829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:24.885476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:24.930593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e62a85b-e964-4f74-9029-787121d2e39e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: .version_select at 0x7ff1b37053a0>, body: {"keypair": {"name": "tempest-keypair-1483489476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWsEOTiUSLedPPv2/4zYxExZANXIQ+We0bfeUE33qJ3z9K7EqExlxAOSbZRzR7O+EdkneKN9m2OLAjE9nrQ9BuepLj7TRLDNHt4w9eUJOm43biLC24X+iAXkBQpVjVgtg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:24.959388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1e62a85b-e964-4f74-9029-787121d2e39e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:24.966249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1e62a85b-e964-4f74-9029-787121d2e39e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:25.104124 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e62a85b-e964-4f74-9029-787121d2e39e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180647 Nov 02 12:27:25.114176 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3003/5973] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:27:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:25.221060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:25.234848 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8359f463-64c8-44fe-a801-346542994770 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.366225 Nov 02 12:27:25.234848 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2971/5974] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:24 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:26.258854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:26.260158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:26.272305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.272812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.273262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.273985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:26.274488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:26.274960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:26.450519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:26.454814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-44523865-4151-4552-91cd-8dc66dfb1268 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.203395 Nov 02 12:27:26.455469 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3004/5975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:26 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:27.481569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:27.483547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:27.488908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:27.497770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.498884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.500152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.501562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:27.503438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:27.504417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:27.788934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:27.831209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d2b1b622-69c0-4fe8-9a5d-98e3675e680f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.350219 Nov 02 12:27:27.834582 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2972/5976] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:27 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:28.861928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:28.862747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:28.871863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.872618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.873150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:28.874785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:28.875353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:28.875816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:29.069995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:29.080669 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d243dd9c-fde7-49f4-9be6-b7a293e62079 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.224512 Nov 02 12:27:29.081504 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3005/5977] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:28 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:30.113354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:30.121320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:30.150372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:30.156835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.158223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.158925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.160539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:30.166546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:30.166546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:30.414889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:30.424989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82f39cc6-5d19-4431-8314-27661d31c39e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.322970 Nov 02 12:27:30.428284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2973/5978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:30 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:31.092600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa00049-b24a-44bf-91c3-d837e0acfce0", "name": "network-vif-plugged", "status": "completed", "tag": "7895972b-58ec-421e-aee9-1f80f8744540"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:31.101624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.102160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.102615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.122754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] Creating event network-vif-plugged:7895972b-58ec-421e-aee9-1f80f8744540 for instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 on n-h1-855649-4 Nov 02 12:27:31.132408 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-59c7e4da-c039-4230-9b12-ad9b4413edfe req-2db0f4f5-b0c0-45ca-a640-109ebcab5c27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279804 Nov 02 12:27:31.133855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3006/5979] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:27:31.294212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-354555285", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba6c2373-9a81-452f-a522-659a15bb02e6"}], "security_groups": [{"name": "tempest-securitygroup--1020112851"}], "key_name": "tempest-keypair-1483489476", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:31.463719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:31.465327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:31.478408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.479280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.480596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.481674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:31.482305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:31.483128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:31.574754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] validate_networks() for [('ba6c2373-9a81-452f-a522-659a15bb02e6', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:27:31.973900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:31.998055 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2294686d-ec72-4228-8aa6-f2dd8da7524c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1363 microversion: 2.1 time: 0.540478 Nov 02 12:27:31.999966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3007/5980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:31 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:32.547481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:27:32.548081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:27:32.548698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:27:32.549327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:27:32.549959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:27:32.569387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.571302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.571302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.572225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:32.575453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:32.576689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:32.609296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:27:32.619247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:27:32.639184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:27:32.642087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:27:32.883356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6e7818a-2467-4bec-bcb4-64a835d5a5e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.596677 Nov 02 12:27:32.889055 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2974/5981] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:27:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:27:32.911615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-145fa6cd-4775-4a04-bd0b-4e6a089ebb80 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:32.911615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-145fa6cd-4775-4a04-bd0b-4e6a089ebb80 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:33.034392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:33.036026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:33.049777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.051125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.052197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.053916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.055842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.063831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-145fa6cd-4775-4a04-bd0b-4e6a089ebb80 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:33.068946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.098156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-145fa6cd-4775-4a04-bd0b-4e6a089ebb80 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1241 microversion: 2.1 time: 0.197365 Nov 02 12:27:33.104783 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3008/5982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:32 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:33.516306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:33.534181 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9141f4be-40eb-41cd-a47a-8ad5b60c987f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1549 microversion: 2.1 time: 0.515050 Nov 02 12:27:33.535395 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2975/5983] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:33 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1549 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:33.579162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:33.581588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:33.603902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.606049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.609892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.615364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:33.616346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:33.624388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:33.952359 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-329f6bd6-87ab-4130-91ac-bde7f3ddff72 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.381083 Nov 02 12:27:33.954471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3009/5984] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:27:33 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:34.132308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19b5924a-051d-4927-a485-4240ba1ca254 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:34.134552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19b5924a-051d-4927-a485-4240ba1ca254 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:34.234042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19b5924a-051d-4927-a485-4240ba1ca254 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:34.244083 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19b5924a-051d-4927-a485-4240ba1ca254 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1241 microversion: 2.1 time: 0.117937 Nov 02 12:27:34.245739 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2976/5985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:34 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:35.289960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3904946-9ea3-46c4-ac6b-2f670cd63cb4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:35.295592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3904946-9ea3-46c4-ac6b-2f670cd63cb4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:35.565701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3904946-9ea3-46c4-ac6b-2f670cd63cb4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:35.592304 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3904946-9ea3-46c4-ac6b-2f670cd63cb4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1241 microversion: 2.1 time: 0.318197 Nov 02 12:27:35.598806 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3010/5986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:35 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1241 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:36.410869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa00049-b24a-44bf-91c3-d837e0acfce0", "tag": "7895972b-58ec-421e-aee9-1f80f8744540"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:36.460352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:36.470093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:36.471527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:36.474455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:36.522440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:36.534535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] Creating event network-changed:7895972b-58ec-421e-aee9-1f80f8744540 for instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 on n-h1-855649-4 Nov 02 12:27:36.559476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b80e8fc2-2c22-4e6a-b12f-c2a9a0507fda req-fb8e6ae9-5443-49c3-ac16-7f0165898811 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169632 Nov 02 12:27:36.578971 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2977/5987] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:36.631876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:36.633221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:36.664721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:36.665606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:36.666259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:36.667263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:36.668029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:36.668697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:36.863092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:36.873395 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17a42f58-d7cc-47a4-9535-a783deb52b22 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1293 microversion: 2.1 time: 0.246216 Nov 02 12:27:36.878767 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3011/5988] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:36 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:37.902192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:37.903189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:37.930729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.930729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.930729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:37.934705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:37.938110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:37.939412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:38.267731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:38.282775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41a16aa3-4438-406a-9d59-44950c3fd9d0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1301 microversion: 2.1 time: 0.385014 Nov 02 12:27:38.284217 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2978/5989] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:37 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1301 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:39.320827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:39.321766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:39.326205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:39.335330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.337292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.337292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:39.338630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:39.339579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:39.340439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:39.347940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:39.517748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:39.555243 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87252851-35b6-4ed4-bbd3-86fca1fc5977 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1299 microversion: 2.1 time: 0.236696 Nov 02 12:27:39.559853 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3012/5990] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:39 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1299 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:40.594727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:40.595627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:40.618393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.619362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.620002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.621072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:40.621930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:40.622566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:40.997442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:41.009935 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98675dd6-3826-4c2a-b371-e3c6ee60c288 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.419427 Nov 02 12:27:41.023024 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2979/5991] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:40 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:42.055386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:42.058768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:42.077106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.078662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.079470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.082074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:42.085112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:42.086284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:42.520988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:42.540627 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa951bd5-d90d-431e-a937-31f7244c8b69 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.499480 Nov 02 12:27:42.540627 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3013/5992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:42 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:43.065888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:43.224123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907f524c-67d3-49c9-bbe5-935aa72069a5", "tag": "a6705145-816a-492e-a97f-4e62927f0a68"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:43.235480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:43.236280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:43.237027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.250364 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] Creating event network-changed:a6705145-816a-492e-a97f-4e62927f0a68 for instance 907f524c-67d3-49c9-bbe5-935aa72069a5 on n-h2-855649-4 Nov 02 12:27:43.258123 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c439f619-cc99-4487-a471-7198a00e28ca req-61b82fce-50b7-49de-9b25-744ef2c49a3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204477 Nov 02 12:27:43.259109 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2980/5993] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:43.557582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:43.559397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:43.583084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:43.583915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:43.584543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.585543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:43.586190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:43.586792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:43.924543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:43.953540 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eaecf1e8-cba4-4991-960e-dfacdf254f8b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.400660 Nov 02 12:27:43.954526 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3014/5994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:43 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:44.984535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:44.986111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:44.992005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:44.997090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:44.997671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:44.998186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:44.999199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:45.000316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:45.001023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:45.226397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:45.241781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-27aebcbc-7211-4301-bdc7-bc0e27525679 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.264152 Nov 02 12:27:45.243298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2981/5995] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:44 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:46.266907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:46.267556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:46.270827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:46.277196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.278254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.278712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.279475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:46.279938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:46.280375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:46.601828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:46.619318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cdff785a-8275-4ee9-a0a8-0bc054248413 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.356841 Nov 02 12:27:46.620348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3015/5996] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:46 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:47.648435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:47.650576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:47.662590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.663415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.664083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.665329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:47.665998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:47.666594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:47.856130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:47.866247 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dcc45a9c-35d2-4419-a799-e3d4f433f3e7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.223994 Nov 02 12:27:47.866867 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2982/5997] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:47 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:48.891405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:48.899477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:48.917910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.926557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.927456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:48.928235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:48.928746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:48.929181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:49.102403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:49.121780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff88a39b-ed37-4a0f-bb62-834d69802d8a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.234224 Nov 02 12:27:49.123211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3016/5998] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:48 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:50.146340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:50.147010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:50.159106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.160406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.162769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.165173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.166861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.168887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.420183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:50.436757 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d506351-46f5-4d37-bc87-a80ea2d4c549 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.293610 Nov 02 12:27:50.437420 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2983/5999] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:50 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:50.500889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907f524c-67d3-49c9-bbe5-935aa72069a5", "name": "network-vif-plugged", "status": "completed", "tag": "a6705145-816a-492e-a97f-4e62927f0a68"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:50.511869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:50.512357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:50.513140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:50.527078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] Creating event network-vif-plugged:a6705145-816a-492e-a97f-4e62927f0a68 for instance 907f524c-67d3-49c9-bbe5-935aa72069a5 on n-h2-855649-4 Nov 02 12:27:50.536618 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d9cfda4d-1af2-476a-bce0-3c2868a57037 req-d5769ff7-5f47-418d-9b61-7103baecb78e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 Nov 02 12:27:50.537259 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3017/6000] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:51.489568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:51.489568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:51.505388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:51.507794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:51.511126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:51.515680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:51.516893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:51.518899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:51.941735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:51.957138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e86261c-f5a9-4f27-bca0-da8632f50a34 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1367 microversion: 2.1 time: 0.488131 Nov 02 12:27:51.958662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2984/6001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:51 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:27:52.987961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:52.991616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:53.019345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.020690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.021439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.023038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.023789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.024682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.471388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:27:53.488994 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ab62f4f-3d53-4c28-bf54-9b4c1a1d4f4d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1556 microversion: 2.1 time: 0.510252 Nov 02 12:27:53.490622 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3018/6002] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:27:52 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1556 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:53.517635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:53.519113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:27:53.528463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.529577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.530501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.532022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:53.532718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:53.533376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:53.675679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ec1bbad-d22b-484f-84f5-88a498306462 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163659 Nov 02 12:27:53.676941 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2985/6003] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:27:53 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:27:55.873232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907f524c-67d3-49c9-bbe5-935aa72069a5", "tag": "a6705145-816a-492e-a97f-4e62927f0a68"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:27:55.886528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:55.887091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:55.887651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:55.906332 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] Creating event network-changed:a6705145-816a-492e-a97f-4e62927f0a68 for instance 907f524c-67d3-49c9-bbe5-935aa72069a5 on n-h2-855649-4 Nov 02 12:27:55.912640 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-08141146-8c11-464d-87eb-1776b13acb02 req-9189618d-a3de-48b1-9115-0c2b8619fda2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043801 Nov 02 12:27:55.913571 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3019/6004] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:28:09.008071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=17 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:09.010397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=43 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:09.020312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:09.021727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:09.032632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.033642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.034453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.036070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:09.036892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:09.037573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:09.111096 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8dc04eaa-afc2-4ed1-96d4-b3bd2456ca5d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/ips" status: 200 len: 145 microversion: 2.1 time: 0.106766 Nov 02 12:28:09.112238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2986/6005] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:28:09 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/ips => generated 145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:13.007617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061d5cf0-10e0-4338-b937-9867c996f6a4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:13.022915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=15 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=39 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:13.052645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:14.178904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f9d22cff-cf17-480f-a276-9a4675ca8126 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.196059 Nov 02 12:28:14.190857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3020/6006] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:28:12 2022] POST /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:28.938321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:28.944635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:28.958889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.959856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.960666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:28.962008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:28.962856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:28.966025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.058440 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d3473f0-cd4b-4992-bb70-5496dc85371a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129457 Nov 02 12:28:29.065838 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2987/6007] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:28:28 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:28:29.071924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:29.095740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:29.096481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:29.114773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.115765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.116612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.119312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:29.120305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:29.121119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:29.201532 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45a47c6b-707f-4413-9e61-921511cb3a86 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4" status: 200 len: 194 microversion: 2.1 time: 0.133352 Nov 02 12:28:29.207225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3021/6008] 10.222.0.48 () {58 vars in 1413 bytes} [Wed Nov 2 12:28:29 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:32.526341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6854f76f-cb76-4440-86f3-312aac3edaee"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:32.529969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:32.541345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.542549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.545100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:32.545100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:32.546850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:32.547654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:33.831353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22ce1a7a-ab12-4e2b-8950-6a456820032c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "POST /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.309705 Nov 02 12:28:33.835160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2988/6009] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:28:32 2022] POST /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:28:33.966140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1458539597", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "d1335f1c-8378-479a-937d-ad105cb6848a"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:34.131678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] validate_networks() for [('d1335f1c-8378-479a-937d-ad105cb6848a', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:28:35.415862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:28:35.418039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:28:35.419328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:28:35.421044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:28:35.423943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:28:35.476578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:35.485295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:35.486774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:35.491417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:35.493199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:35.496991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:35.570184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Getting quotas for project 2b2463b145044745952b7b9bd418d7a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:28:35.582310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Getting quotas for user 79f902f0f0b3483cb83837faf4d8edf8 and project 2b2463b145044745952b7b9bd418d7a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:28:35.607470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:28:35.615668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:28:36.214089 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed160b52-a5c8-4f05-a23b-6efb9d769b46 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252988 Nov 02 12:28:36.215102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3022/6010] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:28:36.233486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d90005cb-e8c9-45ac-91b3-fc6b5bea819f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:36.236181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d90005cb-e8c9-45ac-91b3-fc6b5bea819f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:36.424433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d90005cb-e8c9-45ac-91b3-fc6b5bea819f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:36.439730 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d90005cb-e8c9-45ac-91b3-fc6b5bea819f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1214 microversion: 2.1 time: 0.215110 Nov 02 12:28:36.441497 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2989/6011] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:36 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:37.485610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3567a1c6-47de-4177-a6a4-ddf982692a15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:37.486909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3567a1c6-47de-4177-a6a4-ddf982692a15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:37.631682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3567a1c6-47de-4177-a6a4-ddf982692a15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:37.652342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3567a1c6-47de-4177-a6a4-ddf982692a15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1214 microversion: 2.1 time: 0.173878 Nov 02 12:28:37.667350 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3023/6012] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:37 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:38.696276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-113074f8-383d-4f46-8c98-6dd14f747afa tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:38.697120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-113074f8-383d-4f46-8c98-6dd14f747afa tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:38.785295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-113074f8-383d-4f46-8c98-6dd14f747afa tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:38.794956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-113074f8-383d-4f46-8c98-6dd14f747afa tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1214 microversion: 2.1 time: 0.102749 Nov 02 12:28:38.796659 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2990/6013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:38 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:39.841956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:39.848553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:39.867393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.868139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.869752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.870960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:39.871749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:39.872359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:39.992909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:40.004109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3be5b44-f59a-406f-a076-f619d4a75459 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1210 microversion: 2.1 time: 0.175166 Nov 02 12:28:40.004509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3024/6014] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:39 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1210 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:41.043403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:41.044886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:41.056290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.059532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.059996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.061564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:41.062488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:41.063208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:41.136026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:41.146283 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62bf27d1-07e9-4501-9029-6b1dde6773cb tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1266 microversion: 2.1 time: 0.108141 Nov 02 12:28:41.146932 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2991/6015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:41 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:42.168501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:42.170434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:42.182146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.182924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.183686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.184596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:42.185222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:42.186332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:42.277949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:42.288259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69035030-27d3-485f-9e9c-0367c8e71ed0 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1284 microversion: 2.1 time: 0.123615 Nov 02 12:28:42.305890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3025/6016] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:42 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:43.316970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:43.318323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:43.336364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:43.336364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:43.336364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:43.336364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:43.336364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:43.342629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:43.728888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:43.750714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d86d44a-6a19-4f19-b399-81db4361badc tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.436313 Nov 02 12:28:43.755033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2992/6017] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:43 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:44.580461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad01163-1466-4baa-ab36-e77281add9ab", "tag": "2867e2e3-d327-41b3-975f-f063eee5d33a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:44.593122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.593606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.594224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.605364 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] Creating event network-changed:2867e2e3-d327-41b3-975f-f063eee5d33a for instance bad01163-1466-4baa-ab36-e77281add9ab on n-h1-855649-4 Nov 02 12:28:44.610845 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1ac8fa3e-8722-44a0-881d-bdc38f78323a req-f0ea6d96-3eef-4d70-9ca5-06c188bdc7a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038097 Nov 02 12:28:44.611505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3026/6018] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:44.777210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:44.778517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:44.788144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.788641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.789591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:44.791153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:44.791969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:44.792596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:45.176130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:45.184999 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66838a32-f745-434e-ae9c-045c81f839ed tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.411977 Nov 02 12:28:45.186183 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2993/6019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:44 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:46.210005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:46.215334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:46.216104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:46.222634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.223266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.223707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.224428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:46.225025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:46.225414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:46.500532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:46.517235 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-910561f1-5148-4ef0-8660-f81bd5f83d19 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.310303 Nov 02 12:28:46.519137 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3027/6020] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:46 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:47.553192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:47.554479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:47.563510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.564312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.564893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.565813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:47.566452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:47.567094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:47.758155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:47.771978 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ca7e7d8-cfde-4737-916c-226fc3abfb09 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.223545 Nov 02 12:28:47.772748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2994/6021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:47 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:48.393610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.396762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.401952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:48.408139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.412123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.418576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.418576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.418576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.418576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.473353 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61bf7a01-1f3e-4e3b-94f4-9824ed506452 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.084388 Nov 02 12:28:48.473740 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3028/6022] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:48.639802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.641576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.676250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.677089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.678837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.680167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.681432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.682060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.741995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a08016f-6525-4850-a596-039436895df7 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4" status: 200 len: 194 microversion: 2.1 time: 0.111167 Nov 02 12:28:48.744096 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2995/6023] 10.222.0.48 () {58 vars in 1413 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:48.754765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.755524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.763027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.764439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.765096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.766253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.766919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.767537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.812944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:48.814115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:48.821372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:48.835101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.835438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.837696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.839569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:48.842790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:48.847615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:48.892535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lazy-loading 'services' on Instance uuid 4aa00049-b24a-44bf-91c3-d837e0acfce0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:28:49.039648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:49.048903 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37fc0300-805c-48ed-a554-64ef5ddc4104 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.240833 Nov 02 12:28:49.049672 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2996/6024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:48 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:49.261900 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbfcc20c-1afa-484f-8eef-ae39b247b912 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4" status: 202 len: 0 microversion: 2.1 time: 0.510890 Nov 02 12:28:49.273937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3029/6025] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:28:48 2022] DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/061d5cf0-10e0-4338-b937-9867c996f6a4 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:50.075515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:50.079338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:50.094839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.094839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.094839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.095523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:50.096239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:50.096818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:50.256429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:50.276063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9e2bdd2d-8f97-4b1a-a4c0-2635987c4a27 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.204056 Nov 02 12:28:50.277020 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2997/6026] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:50 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:51.050313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad01163-1466-4baa-ab36-e77281add9ab", "name": "network-vif-plugged", "status": "completed", "tag": "2867e2e3-d327-41b3-975f-f063eee5d33a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:51.063117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.063605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.064086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.076205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] Creating event network-vif-plugged:2867e2e3-d327-41b3-975f-f063eee5d33a for instance bad01163-1466-4baa-ab36-e77281add9ab on n-h1-855649-4 Nov 02 12:28:51.081574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0e11b8ec-707b-4569-8bc3-86358146e23a req-8c7b1eb1-5f5f-4fc2-92ca-db94d4bb7e10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038359 Nov 02 12:28:51.083141 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3030/6027] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:51.308931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:51.309564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:51.327158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.333443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.335163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.335932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:51.339438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:51.340516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:51.527834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:51.537032 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40b6e389-270e-4a7c-9a64-3793fa10f528 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.238196 Nov 02 12:28:51.537952 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2998/6028] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:51 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:52.562934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:52.563667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:52.570958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.571733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.572300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.573239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:52.573698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:52.574127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:52.735594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:52.744785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f465bad-4845-419f-a738-6b346cdaa86d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1314 microversion: 2.1 time: 0.187973 Nov 02 12:28:52.759318 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3031/6029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:52 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:53.771698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:53.774939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:53.781389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.782470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.783151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.784064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:53.784714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:53.785329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:53.985578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:53.995705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f62f829d-7cde-405b-9bf6-fed6226bef8e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1497 microversion: 2.1 time: 0.229527 Nov 02 12:28:54.013310 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 2999/6030] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:53 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:55.350171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:55.351488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:55.359615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.360108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.360546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.361286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.361734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.362158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.389467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:28:55.789996 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac29f193-8757-495e-ad3e-0cee056ca62d tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 204 len: 0 microversion: 2.1 time: 0.443906 Nov 02 12:28:55.790627 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3032/6031] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:28:55 2022] DELETE /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:28:55.802743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:55.804338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:55.816021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.816515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.816938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.817648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.818177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.818608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.933210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:55.933817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:55.940445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.940945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.945584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.945584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:55.945584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:55.945584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:55.959614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:55.970329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9c99b43-7a45-4b68-9ffb-ab89962d0689 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1503 microversion: 2.1 time: 0.174966 Nov 02 12:28:55.971068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3000/6032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:55 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:55.988339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7c083c3-2853-4f55-a681-ff66d898b25c tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/6854f76f-cb76-4440-86f3-312aac3edaee" status: 200 len: 194 microversion: 2.1 time: 0.059450 Nov 02 12:28:55.989152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3033/6033] 10.222.0.48 () {58 vars in 1413 bytes} [Wed Nov 2 12:28:55 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/6854f76f-cb76-4440-86f3-312aac3edaee => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:28:56.000693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:56.001323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:56.009038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.009488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.010021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.010950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:56.011492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:56.011933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:56.117773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lazy-loading 'services' on Instance uuid 4aa00049-b24a-44bf-91c3-d837e0acfce0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:28:56.453858 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0eaba057-db02-419b-ad8d-8d6f048a037a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/6854f76f-cb76-4440-86f3-312aac3edaee" status: 202 len: 0 microversion: 2.1 time: 0.457567 Nov 02 12:28:56.454631 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3001/6034] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:28:55 2022] DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments/6854f76f-cb76-4440-86f3-312aac3edaee => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:28:56.996605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:56.999153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:57.008969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.009474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.010188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.011178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:57.011931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:57.012710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:57.267543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:57.275705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b148aea-8cc8-4353-933c-dec588368365 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1503 microversion: 2.1 time: 0.284402 Nov 02 12:28:57.277365 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3034/6035] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:56 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:28:58.302184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:58.302911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:58.329639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:58.330734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:58.331499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:58.332218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:58.332683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:58.333295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:58.344332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad01163-1466-4baa-ab36-e77281add9ab", "name": "network-vif-deleted", "tag": "2867e2e3-d327-41b3-975f-f063eee5d33a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:28:58.361089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:58.362057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:58.362616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:58.400661 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] Creating event network-vif-deleted:2867e2e3-d327-41b3-975f-f063eee5d33a for instance bad01163-1466-4baa-ab36-e77281add9ab on n-h1-855649-4 Nov 02 12:28:58.431966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-43d537f7-14a3-4695-9982-9671c83db469 req-37dbde28-e52d-43c7-bef9-e7f9f42933b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101877 Nov 02 12:28:58.453644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3035/6036] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:28:58.519314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:58.523450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:58.532139 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f9d71a0c-628f-497f-abed-7970ae5b9c94 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1461 microversion: 2.1 time: 0.235233 Nov 02 12:28:58.533683 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3002/6037] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:58 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1461 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:28:59.576272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:28:59.577050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:28:59.607498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.611824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.611824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.611824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.611824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.611824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.615144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:59.656433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:59.658017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:59.658735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:59.659425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lazy-loading 'fault' on Instance uuid bad01163-1466-4baa-ab36-e77281add9ab {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:28:59.715912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:28:59.726182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8baa3a04-a5e8-40b6-a037-4ec8f5c4a793 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 200 len: 1304 microversion: 2.1 time: 0.155568 Nov 02 12:28:59.727653 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3036/6038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:28:59 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:00.768719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:00.770517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: bad01163-1466-4baa-ab36-e77281add9ab] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:00.780413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=39 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:00.797873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.799173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.800060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.802383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:00.803245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:00.803983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:00.841526 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] HTTP exception thrown: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Request method failure captured: Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab HTTP/1.1 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmJuC-L-StMNRqgeqvSO7alM_ePT7L8anGGZufOgFKqNYsdqb9ePRG5BXf4x1uy0cmaRMIWlC3__rTIzZU_tqQXoq1rwtYzwMXUpbv2RFWy81_ImsOG8K4974B6UhrBjq__oDUTcmT1yr5DqpZLzL6WkeM96c0xktESZTviCVgE_Tc0 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2b2463b145044745952b7b9bd418d7a0 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesActionsTest-295328966 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b2463b145044745952b7b9bd418d7a0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesActionsTest-295328966 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2b2463b145044745952b7b9bd418d7a0 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesActionsTest-295328966 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesActionsTest-295328966-project Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 79f902f0f0b3483cb83837faf4d8edf8 Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesActionsTest-295328966-project Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'bad01163-1466-4baa-ab36-e77281add9ab'} Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:00.844683 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Returning 404 to user: Instance bad01163-1466-4baa-ab36-e77281add9ab could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1843d30b-159b-493c-aa4a-03dce07590f4 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab" status: 404 len: 111 microversion: 2.1 time: 0.086236 Nov 02 12:29:00.858251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3003/6039] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:00 2022] GET /compute/v2.1/servers/bad01163-1466-4baa-ab36-e77281add9ab => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:00.924265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-758965936", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "d1335f1c-8378-479a-937d-ad105cb6848a"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:01.005338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] validate_networks() for [('d1335f1c-8378-479a-937d-ad105cb6848a', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:01.786466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:01.786860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:01.787484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:01.788285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:01.788836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:01.805384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.806435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.807152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.809244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:01.809244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:01.810096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:01.834635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Getting quotas for project 2b2463b145044745952b7b9bd418d7a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:01.845624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Getting quotas for user 79f902f0f0b3483cb83837faf4d8edf8 and project 2b2463b145044745952b7b9bd418d7a0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:01.863464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:01.866301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:02.081101 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8072820b-2023-44ad-95fa-779717ab60e7 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162908 Nov 02 12:29:02.101041 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3037/6040] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:29:02.108465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e85dc1e-c40b-4342-ba15-722975c6023f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.109517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e85dc1e-c40b-4342-ba15-722975c6023f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:02.302479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e85dc1e-c40b-4342-ba15-722975c6023f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:02.326723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e85dc1e-c40b-4342-ba15-722975c6023f tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1213 microversion: 2.1 time: 0.225275 Nov 02 12:29:02.329985 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3004/6041] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:03.368850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b890db2-b48f-46f8-8577-b9e7965d5c45 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.371367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b890db2-b48f-46f8-8577-b9e7965d5c45 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:03.506289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b890db2-b48f-46f8-8577-b9e7965d5c45 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:03.518504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b890db2-b48f-46f8-8577-b9e7965d5c45 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1213 microversion: 2.1 time: 0.163316 Nov 02 12:29:03.535711 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3038/6042] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:04.545953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.546610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:04.569310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.569617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.569949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.570694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.571260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.571699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.679197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.682374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:04.691373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:04.692412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:04.694602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.695420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.696077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.699989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-735b72e6-e609-42e3-b7eb-3191fcfb184c tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1265 microversion: 2.1 time: 0.159075 Nov 02 12:29:04.700745 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3005/6043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:04.702968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.704228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.705052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.774915 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3eabd1f2-7ef9-4994-9219-2f5a992772e4 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100766 Nov 02 12:29:04.775684 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3039/6044] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:29:04.942654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.946393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:04.969046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.052311 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02e1bb25-a497-4ce6-ac74-7b010983963f tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114485 Nov 02 12:29:05.054604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3006/6045] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:29:05.195394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.200077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:05.203391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.204867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.205327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.206112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.206785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.207277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.253241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:05.725169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.726428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:05.738273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.741245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.741245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.741245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.741245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.741245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.812490 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-929f19e5-095a-447f-815e-9e35800f00fa tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 204 len: 0 microversion: 2.1 time: 0.620679 Nov 02 12:29:05.814205 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3040/6046] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:05 2022] DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:05.827071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.830031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:05.839101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.840154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.840811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.841854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:05.842576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:05.843264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:05.870081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:05.882864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfdfaa05-c2d6-49f0-ad66-cd6d9042be78 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1283 microversion: 2.1 time: 0.161071 Nov 02 12:29:05.888225 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3007/6047] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:06.644307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:06.656849 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04c26861-52a6-4a70-ad40-63c96e46670a tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1673 microversion: 2.1 time: 0.837764 Nov 02 12:29:06.658138 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3041/6048] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1673 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:06.911490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.912132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:06.924930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.925533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.926280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:06.927059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:06.930386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:06.931040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.022557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:07.039165 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3a58cc9-3f30-484d-b25f-01a5b35fcf77 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1271 microversion: 2.1 time: 0.130425 Nov 02 12:29:07.040146 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3008/6049] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:07.683506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.684196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:07.696996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.698018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.698929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:07.713193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:07.713193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:07.713193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.069561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:08.071377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:08.084024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.085265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.087408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.088495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:08.088836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.089611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:08.090392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:08.108440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff3208bb-d704-48df-a5a1-368f5e100c3b tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1673 microversion: 2.1 time: 0.431124 Nov 02 12:29:08.111216 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3042/6050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1673 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:08.494460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:08.510138 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-118b2c6d-56f9-486e-a27c-f6af1cc67c15 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.449400 Nov 02 12:29:08.515599 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3009/6051] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:08 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:09.139894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:09.139894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:09.146559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.147364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.147996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.148728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.149211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.149616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.268582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:09.285394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b554bf56-4783-4379-b227-70dde9cf51c9 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1606 microversion: 2.1 time: 0.152009 Nov 02 12:29:09.287113 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3043/6052] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:09 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1606 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:09.423417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa00049-b24a-44bf-91c3-d837e0acfce0", "name": "network-vif-deleted", "tag": "7895972b-58ec-421e-aee9-1f80f8744540"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:09.446841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.447792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.448588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.474683 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] Creating event network-vif-deleted:7895972b-58ec-421e-aee9-1f80f8744540 for instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 on n-h1-855649-4 Nov 02 12:29:09.488979 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f68a1cdd-70f9-4a7e-990c-441939cb0f43 req-fa74d8ce-7354-4023-8c48-b1be24057e3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072734 Nov 02 12:29:09.496154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3010/6053] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:09.542789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:09.543914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:09.552103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.553071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.553794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:09.554793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:09.555517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:09.556169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.079500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:10.091237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dafc6552-c1b3-47e4-9d68-ee3526bde264 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.560632 Nov 02 12:29:10.108040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3044/6054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:09 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:10.319350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:10.320985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:10.334402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.334915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.336136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.336908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.338027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.338027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.427407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:10.428154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:10.428362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:10.430273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lazy-loading 'fault' on Instance uuid 4aa00049-b24a-44bf-91c3-d837e0acfce0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:10.592615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866e943ff5b94fbebec3c8974ee053dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '214c458d28ab4aecbbf38ba8d4f2dbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:10.595447 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71879082-a71a-4467-9187-7fb7ef14ff39 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 200 len: 1328 microversion: 2.1 time: 0.277314 Nov 02 12:29:10.610684 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3011/6055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:10 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 1328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:11.121527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:11.125482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:11.151269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:11.157276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:11.157949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:11.159099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:11.159698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:11.160389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:11.473198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:11.497096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec8af94e-0894-4ff7-ae76-07fd34fab106 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.381770 Nov 02 12:29:11.512565 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3045/6056] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:11 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:11.518070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd91f0b-44bf-4371-a2a6-c1502a707e97", "tag": "6a22e48c-a677-4461-a592-8129496ae963"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:11.535951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:11.539212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:11.539212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:11.554696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] Creating event network-changed:6a22e48c-a677-4461-a592-8129496ae963 for instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 on n-h1-855649-4 Nov 02 12:29:11.562393 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e52b4edc-8072-4ec0-996e-27f3c8dc1649 req-064521e0-67c0-4d31-92e6-5d301518af31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050946 Nov 02 12:29:11.563322 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3012/6057] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:11.640520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:11.641719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:11.655508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:11.656073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:11.660054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:11.660931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:11.661438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:11.665475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:11.692564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 HTTP/1.1 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4aa00049-b24a-44bf-91c3-d837e0acfce0'} Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:11.694523 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a941770-7a68-475e-9c58-ccd0edc76f2d tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 404 len: 111 microversion: 2.1 time: 0.078197 Nov 02 12:29:11.708980 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3046/6058] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:11 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:11.709817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06e6f2cc-dd64-4b13-80d4-4310ac539d3e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '.version_select at 0x7ff1b2227b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:11.802702 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06e6f2cc-dd64-4b13-80d4-4310ac539d3e tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479677581" status: 202 len: 0 microversion: 2.1 time: 0.098187 Nov 02 12:29:11.803753 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3013/6059] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479677581 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:12.522268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:12.527063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:12.534541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:12.542170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:12.545131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:12.545920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:12.547108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:12.547780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:12.549502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:12.791722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:12.803459 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2349a05-14cb-47d9-8a1f-368dafb7884e tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.285430 Nov 02 12:29:12.804481 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3047/6060] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:12 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:13.842523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:13.850388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.854094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:13.864103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.864809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.865363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:13.866459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:13.867236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:13.867872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:14.275799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:14.287283 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9de3053d-f6bb-44e7-b8b4-ed0081370951 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.446639 Nov 02 12:29:14.303819 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3014/6061] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:15.124944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd91f0b-44bf-4371-a2a6-c1502a707e97", "name": "network-vif-plugged", "status": "completed", "tag": "6a22e48c-a677-4461-a592-8129496ae963"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:15.134656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:15.142746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.143667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.144308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.168601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] Creating event network-vif-plugged:6a22e48c-a677-4461-a592-8129496ae963 for instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 on n-h1-855649-4 Nov 02 12:29:15.178815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9a26a6a6-645a-48f2-9318-1441701b45b7 req-fd7f207d-f36f-4c92-bac4-90c920b395b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060071 Nov 02 12:29:15.182777 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3048/6062] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:15.330800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.332243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:15.365280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.366186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.368491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.374144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:15.374912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:15.379473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:15.650913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:15.679688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1bf1816e-da72-4fa8-bf77-80e07e219111 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1313 microversion: 2.1 time: 0.362408 Nov 02 12:29:15.684504 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3015/6063] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:16.709534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:16.710415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:16.727383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.732986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.732986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:16.732986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:16.732986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:16.732986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:17.007956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:17.020610 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8e129c4-71b4-498b-ade7-5503f77f4e72 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1496 microversion: 2.1 time: 0.316276 Nov 02 12:29:17.021225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3049/6064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:16 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1496 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:18.399365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:18.400539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:18.410132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.410964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.420914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.422137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.422814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.423482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.481459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:18.899984 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-444a13b7-187c-4300-a7cb-fe87a13954c9 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 204 len: 0 microversion: 2.1 time: 0.504796 Nov 02 12:29:18.901281 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3016/6065] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:18 2022] DELETE /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:29:18.911849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:18.912605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:18.934030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.934943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.935819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.937244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.938119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.938961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:19.358443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:19.358443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e1fbff0-313e-42ba-be1f-06c20ee508b5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1502 microversion: 2.1 time: 0.401167 Nov 02 12:29:19.358443 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3050/6066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:18 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1502 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:20.349124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.354824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:20.384618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.389225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.392018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.394553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.396073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.402422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.860821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:20.875221 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9aae6d53-4e28-4b33-82d5-83b112476232 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1502 microversion: 2.1 time: 0.542607 Nov 02 12:29:20.893320 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3017/6067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1502 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:21.026516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.027243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.043762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.046487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.047745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.049478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.051780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.053910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.129532 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0151f4d-058e-4a5b-a151-24b5545d2011 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.107750 Nov 02 12:29:21.144193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98e9151c-a9c1-40f3-97bf-edfa46d2269e"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.147276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.151804 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3051/6068] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:21.176110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.176974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.177754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.183429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.183937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.186114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.396570 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/os-volume_attachments HTTP/1.1 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 74 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: {"volumeAttachment": {"volumeId": "98e9151c-a9c1-40f3-97bf-edfa46d2269e"}} Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '907f524c-67d3-49c9-bbe5-935aa72069a5', 'body': {'volumeAttachment': {'volumeId': '98e9151c-a9c1-40f3-97bf-edfa46d2269e'}}} Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:29:21.402091 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 Nov 02 12:29:21.415277 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:21.422965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 400 to user: Invalid volume: volume 98e9151c-a9c1-40f3-97bf-edfa46d2269e is already attached to instances: d9e6c38c-73d6-406d-9da6-5c7759b786e2 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:21.422965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ee37545-85ae-4adb-8443-6fe10c17f104 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.280711 Nov 02 12:29:21.425253 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3018/6069] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5/os-volume_attachments => generated 174 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:21.433505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.434009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.441533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.442025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.442482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.443224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.443688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.461971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.469192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd91f0b-44bf-4371-a2a6-c1502a707e97", "name": "network-vif-deleted", "tag": "6a22e48c-a677-4461-a592-8129496ae963"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.488552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.489328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.489943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.491531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:21.502936 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] Creating event network-vif-deleted:6a22e48c-a677-4461-a592-8129496ae963 for instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 on n-h1-855649-4 Nov 02 12:29:21.510832 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bc5ba019-deb8-434b-8c19-9dd232ed684c req-f1dc4453-2200-4e78-bfcf-85d3cbfc492f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045292 Nov 02 12:29:21.512753 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3019/6070] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:21.740903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:21.924053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.928735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.937999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.938504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.940560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.941521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:21.942273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:21.942834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:21.976260 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d7b574d-0abb-4f7a-bd00-4afc9230c9b3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 204 len: 0 microversion: 2.1 time: 0.545754 Nov 02 12:29:21.977179 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3052/6071] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:21 2022] DELETE /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:21.987584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.988527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.999656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.001823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.003499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.006074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.007617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.008237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.018480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.018480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.018480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.019136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lazy-loading 'fault' on Instance uuid 5dd91f0b-44bf-4371-a2a6-c1502a707e97 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:22.179067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f902f0f0b3483cb83837faf4d8edf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2463b145044745952b7b9bd418d7a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:22.192180 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3bcc420-3a17-4558-9485-dba1098ebd28 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 200 len: 1303 microversion: 2.1 time: 0.276434 Nov 02 12:29:22.194101 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3020/6072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 1303 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:22.806031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:22.820273 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-542647f8-7711-4caf-9c90-ef7bbb8a802f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1681 microversion: 2.1 time: 0.837676 Nov 02 12:29:22.823235 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3053/6073] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1681 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:23.225799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.227557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] [instance: 5dd91f0b-44bf-4371-a2a6-c1502a707e97] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.244066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.245325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.246613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.248000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.249710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.250878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.310499 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] HTTP exception thrown: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Request method failure captured: Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 HTTP/1.1 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmJuC-L-StMNRqgeqvSO7alM_ePT7L8anGGZufOgFKqNYsdqb9ePRG5BXf4x1uy0cmaRMIWlC3__rTIzZU_tqQXoq1rwtYzwMXUpbv2RFWy81_ImsOG8K4974B6UhrBjq__oDUTcmT1yr5DqpZLzL6WkeM96c0xktESZTviCVgE_Tc0 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2b2463b145044745952b7b9bd418d7a0 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesActionsTest-295328966 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b2463b145044745952b7b9bd418d7a0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b2463b145044745952b7b9bd418d7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesActionsTest-295328966 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2b2463b145044745952b7b9bd418d7a0 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesActionsTest-295328966 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesActionsTest-295328966-project Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 79f902f0f0b3483cb83837faf4d8edf8 Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesActionsTest-295328966-project Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '5dd91f0b-44bf-4371-a2a6-c1502a707e97'} Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:23.314694 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. Nov 02 12:29:23.322500 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:23.339837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] Returning 404 to user: Instance 5dd91f0b-44bf-4371-a2a6-c1502a707e97 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:23.343845 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4574a8c4-123c-4e73-b8ed-313d9f5bbca5 tempest-VolumesActionsTest-295328966 tempest-VolumesActionsTest-295328966-project] 10.222.0.48 "GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97" status: 404 len: 111 microversion: 2.1 time: 0.126878 Nov 02 12:29:23.348897 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3021/6074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/5dd91f0b-44bf-4371-a2a6-c1502a707e97 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:23.877391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.878019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.891033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.893493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.894028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:23.900973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:23.901565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:23.902227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.905911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.915844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0f22ac3-0c1f-4711-9059-557f95ba3175 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1681 microversion: 2.1 time: 1.044125 Nov 02 12:29:24.923696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3054/6075] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1681 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:25.949903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:25.951187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:25.964772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.967699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.967699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:25.971637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:25.972144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:25.972599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.020735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:26.150398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:26.163436 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a30ff68e-ce14-48fa-a019-c97f997daea5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1613 microversion: 2.1 time: 0.217437 Nov 02 12:29:26.184115 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3022/6076] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:25 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1613 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:27.155653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907f524c-67d3-49c9-bbe5-935aa72069a5", "name": "network-vif-deleted", "tag": "a6705145-816a-492e-a97f-4e62927f0a68"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:27.193664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.195452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.207974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.215006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.215006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.223547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.224386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.225613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.226653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.228178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.229220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.261804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] Creating event network-vif-deleted:a6705145-816a-492e-a97f-4e62927f0a68 for instance 907f524c-67d3-49c9-bbe5-935aa72069a5 on n-h2-855649-4 Nov 02 12:29:27.282358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-10126955-fe71-4bef-8fc5-682e958589d3 req-e55789a1-d7cb-4fb7-a585-5ebabf3af83b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169246 Nov 02 12:29:27.299831 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3055/6077] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:27.465502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.527723 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77ca11c3-dcff-4594-9517-dd3fec9eff4e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1613 microversion: 2.1 time: 0.331654 Nov 02 12:29:27.528644 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3023/6078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1613 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:27.584321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.586397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.622251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.631081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.634128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.642584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.646663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.650230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.708154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 HTTP/1.1 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4aa00049-b24a-44bf-91c3-d837e0acfce0'} Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:27.710400 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:27.715038 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-660cea35-1233-403f-9399-c8dcdfcd2475 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 404 len: 111 microversion: 2.1 time: 0.155033 Nov 02 12:29:27.720371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3056/6079] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:27 2022] DELETE /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:27.728303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.729335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 4aa00049-b24a-44bf-91c3-d837e0acfce0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.743253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.744126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.746559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.748912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.749599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.750752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.793733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 HTTP/1.1 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '4aa00049-b24a-44bf-91c3-d837e0acfce0'} Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:27.803164 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 4aa00049-b24a-44bf-91c3-d837e0acfce0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:27.808525 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f6e93e6-c6ea-4896-bacc-646761771942 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0" status: 404 len: 111 microversion: 2.1 time: 0.081029 Nov 02 12:29:27.814116 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3024/6080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/4aa00049-b24a-44bf-91c3-d837e0acfce0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:28.560937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.561839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.578825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.590768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.592148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.600359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.601525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.602496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.714829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.723882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:28.724483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.724978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'fault' on Instance uuid 907f524c-67d3-49c9-bbe5-935aa72069a5 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:28.865729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.891901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47488766-ce75-4ac7-a4be-e658471100dc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 200 len: 1331 microversion: 2.1 time: 0.335487 Nov 02 12:29:28.897141 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3057/6081] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 1331 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.107149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.137412 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 HTTP/1.1 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '907f524c-67d3-49c9-bbe5-935aa72069a5'} Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:30.144175 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:29:30.151572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.153538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:30.156803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b533d6a6-2cd8-4744-b4da-65281763fefb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 404 len: 111 microversion: 2.1 time: 0.232869 Nov 02 12:29:30.177159 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3025/6082] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:29 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:30.179085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-860d05aa-ecd9-4b9a-a7ab-d1d4960a84a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '.version_select at 0x7ff1b38543a0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:30.307004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-860d05aa-ecd9-4b9a-a7ab-d1d4960a84a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483489476" status: 202 len: 0 microversion: 2.1 time: 0.133596 Nov 02 12:29:30.308969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3058/6083] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:29:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483489476 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:29:32.539646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:32.541697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:32.581182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:32.591797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.591797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.591797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.596329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.598289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.601320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.855222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'services' on Instance uuid d9e6c38c-73d6-406d-9da6-5c7759b786e2 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:33.219987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6abcc1b-4240-4a0d-853f-c8ce6feeff66 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments/98e9151c-a9c1-40f3-97bf-edfa46d2269e" status: 202 len: 0 microversion: 2.1 time: 0.686188 Nov 02 12:29:33.220514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3026/6084] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:29:32 2022] DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments/98e9151c-a9c1-40f3-97bf-edfa46d2269e => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:33.232214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:33.234703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.282106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.296723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.306055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.308538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.309733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.318422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.443650 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4ce5f2e-f99c-474f-86e5-2ba13a52a929 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201879 Nov 02 12:29:33.450689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3059/6085] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:33 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:34.470245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.476508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.511497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.513987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.514187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.517509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.521199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.521803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.724648 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87b1463a-3ffc-447a-80da-9c8c07ca3e94 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260184 Nov 02 12:29:34.724648 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3027/6086] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:34 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:35.741594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:35.746266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:35.785538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:35.795788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.798228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.799929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.802435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.808629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.809531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.926600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33223fba-a095-40a6-b74f-575fb11cc8ba tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191890 Nov 02 12:29:35.931579 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3060/6087] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:35 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:36.413055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.414346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.475573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.484044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.487187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.490351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.500225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.501098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.592222 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 HTTP/1.1 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '029a6a4d-879d-424c-83ab-23ecdc9f54f1'} Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:36.594724 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:36.601480 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0bafb9a-228d-4e8d-a911-42f83b515e34 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 404 len: 111 microversion: 2.1 time: 0.191766 Nov 02 12:29:36.606909 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3028/6088] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:36 2022] DELETE /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:36.617269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.618386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] [instance: 029a6a4d-879d-424c-83ab-23ecdc9f54f1] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.650476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.654632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.654632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.654632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.654632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.654632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.723511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] HTTP exception thrown: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Request method failure captured: Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 HTTP/1.1 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmDNVTCrgK1e7cjwbEgoJIdTgVcdA1yduWpoFE3uqe5ew6_N1nBFDT3atBeBCYIcJgBE_h29eQ071HmWe762gO5JS_xEdPYTZXs8YnMpuB9HufK7h1dwqSoknlBnSM3tSJdOzFWNHYuDt_rNAfRNZS27cYd1tEXk0bQnMcDWB3D1G4Y Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_214c458d28ab4aecbbf38ba8d4f2dbe6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/214c458d28ab4aecbbf38ba8d4f2dbe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 214c458d28ab4aecbbf38ba8d4f2dbe6 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787969258 Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 866e943ff5b94fbebec3c8974ee053dc Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeTestJSON-1787969258-project Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '029a6a4d-879d-424c-83ab-23ecdc9f54f1'} Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:36.739131 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. Nov 02 12:29:36.745959 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:29:36.748336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] Returning 404 to user: Instance 029a6a4d-879d-424c-83ab-23ecdc9f54f1 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:36.750581 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-762773b8-072c-4f35-bd57-8d4c24354575 tempest-AttachVolumeTestJSON-1787969258 tempest-AttachVolumeTestJSON-1787969258-project] 10.222.0.48 "GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1" status: 404 len: 111 microversion: 2.1 time: 0.137873 Nov 02 12:29:36.752978 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3061/6089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/029a6a4d-879d-424c-83ab-23ecdc9f54f1 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:36.945632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.948153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.981474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.991954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.992540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.993620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.994233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.999720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.192300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63aa79fd-9154-4755-89ac-1ea027517aa0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243900 Nov 02 12:29:37.195991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3029/6090] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:38.221174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:38.241390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:38.268387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.269711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.271672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:38.273324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.276294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.280668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:38.438948 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-735d2a49-d89b-4da2-b4e6-1412514168a4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233981 Nov 02 12:29:38.486486 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3062/6091] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:38 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:39.483869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:39.486193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:39.505877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.506382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.506838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.507630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.508096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.515790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.622242 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e81743bb-f1ca-4682-b064-84120742e7cc tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142521 Nov 02 12:29:39.623710 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3030/6092] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:40.642022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.645868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:40.665122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.665778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.666442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.668478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.669259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.669767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.741801 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18ff8aaa-49fb-4214-abb8-5adf8859e7c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106895 Nov 02 12:29:40.743272 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3063/6093] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:40 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:41.755795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:41.760272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:41.778742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.779695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.780429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.781416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.782108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.782793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.830725 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f361d4ca-5b75-45c7-a631-738dc6c05424 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078856 Nov 02 12:29:41.832075 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3031/6094] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:41 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:42.846503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.850309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.871228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.871739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.872355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.873091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.873564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.882477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.988758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c12d44f-58cd-495d-8513-18492484147d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146658 Nov 02 12:29:42.993899 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3064/6095] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:44.002875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.005858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.031649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.037968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.039523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.042662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.047567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.050833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.206471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea6e8ba0-7597-4f81-b7f5-0c6bf61cb69f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207680 Nov 02 12:29:44.215045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3032/6096] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:43 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:45.233779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.238995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:45.256971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.258101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.258941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.260408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.261542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.265705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.322018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d7abcb0-33a9-4e38-9d71-e3a003141144 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097585 Nov 02 12:29:45.323513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3065/6097] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:45 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:46.342075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.349530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.395945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.396685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.400631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.406308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.406797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.407268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.538926 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1054d5ec-086a-468c-b6e7-02d37d49c9f0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202467 Nov 02 12:29:46.539808 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3033/6098] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:29:46.733162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.734724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.761863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.766397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.767514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.773465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.773465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.773465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.856043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:47.319671 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d535c84-2867-4997-b15a-b4db2d2d6e51 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 204 len: 0 microversion: 2.1 time: 0.592534 Nov 02 12:29:47.319671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3066/6099] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:46 2022] DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:29:47.358481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.359528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.370919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.371630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.372839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.374078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.374232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.374757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.218012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.236290 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3de3efe8-9fb0-4b9c-a873-3238272c0358 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1683 microversion: 2.1 time: 0.885241 Nov 02 12:29:48.239316 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3034/6100] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1683 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:49.270394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:49.271318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:49.316367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.317051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.326945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.327950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.336241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.343117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.674824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.695728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-044a67d3-4c07-420a-b654-5409b0f8647b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1683 microversion: 2.1 time: 0.432046 Nov 02 12:29:49.719906 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3067/6101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:49 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1683 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.749740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.753995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.769817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.770679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.771180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.772075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.772710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.773516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.163494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.185686 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8cde3aeb-7bd3-428f-993b-62b7c226815f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1683 microversion: 2.1 time: 0.447278 Nov 02 12:29:51.187206 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3035/6102] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1683 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:52.109784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e6c38c-73d6-406d-9da6-5c7759b786e2", "name": "network-vif-deleted", "tag": "b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:52.132468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.133015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.133500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.137029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:52.181724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] Creating event network-vif-deleted:b3b5ce9f-b09e-42c0-b1ef-deaf62ddf53c for instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 on n-h2-855649-4 Nov 02 12:29:52.208304 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1a89fd3f-d33b-472c-ba88-3f83c76e9ec4 req-05fc5834-312f-410f-a8e9-f6c8a1c110b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102438 Nov 02 12:29:52.216338 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3068/6103] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:52.226194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:52.236749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:52.277425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.279725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.281510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.283937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.308580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.309337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.491881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:52.503581 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0fd2d863-e59b-4bf5-b848-199918aa5fdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1615 microversion: 2.1 time: 0.290963 Nov 02 12:29:52.509959 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3036/6104] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:52 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1615 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:53.049620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.050675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.066688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.074479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.084541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.089708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.091676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.093963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.282666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:29:53.554698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.557268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.593581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.612224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.616239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.622956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.622956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.622956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.756870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.756870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.756870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.757348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'fault' on Instance uuid d9e6c38c-73d6-406d-9da6-5c7759b786e2 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:29:53.851676 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40f0e6a3-2837-44c8-becf-955910e2400e tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 204 len: 0 microversion: 2.1 time: 1.493235 Nov 02 12:29:53.854238 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3069/6105] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:29:52 2022] DELETE /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:29:53.872869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.876453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.881583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.893304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-071b3331-9846-48be-b392-a72d7d65ffc3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 200 len: 1332 microversion: 2.1 time: 0.345274 Nov 02 12:29:53.903432 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3037/6106] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:53 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 1332 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:53.930737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.944674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.952259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.952259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.952259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.952259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.308541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.320613 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1432cb53-cdb5-4c7d-b5dd-54a480ff4613 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1731 microversion: 2.1 time: 0.461078 Nov 02 12:29:54.324384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3070/6107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:53 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1731 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:54.943079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.943778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.971799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.972343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.976602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.982269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.982825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.987445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.038443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 HTTP/1.1 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd9e6c38c-73d6-406d-9da6-5c7759b786e2'} Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:55.040122 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:55.046049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cab55fbd-3408-458a-8b3c-edeab3f68750 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 404 len: 111 microversion: 2.1 time: 0.102901 Nov 02 12:29:55.050630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8aff292-0724-4ef1-8127-fbe86435366d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '.version_select at 0x7ff1bbb76160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.082196 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3038/6108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:55.226418 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8aff292-0724-4ef1-8127-fbe86435366d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378627975" status: 202 len: 0 microversion: 2.1 time: 0.179345 Nov 02 12:29:55.227344 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3071/6109] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378627975 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:29:55.360027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.361227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:55.376614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.382265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.383801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.384870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.386625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.389456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.201663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.229160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87720c6e-476b-496e-bcb5-c34cd1cbc0be tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1731 microversion: 2.1 time: 0.874949 Nov 02 12:29:56.265931 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3039/6110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:55 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1731 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:57.085028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2af455b0-64b7-4e66-84b7-8181ddac635e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: .version_select at 0x7ff1b2c35790>, body: {"keypair": {"name": "tempest-keypair-678537104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF90vpDnvii9HkEnwmnuk2c7SMZRvp+5Xig0u68cRnRa/s5OjOmGx3TevGpqzn/vZGqxH9EtjeY8mMLBCP2j9tCul/GjytC1gSeXreMpTT+v5Ne2SKaEKwSxeTIyizIaQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:57.105030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2af455b0-64b7-4e66-84b7-8181ddac635e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:57.111564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-2af455b0-64b7-4e66-84b7-8181ddac635e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:57.266917 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2af455b0-64b7-4e66-84b7-8181ddac635e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189034 Nov 02 12:29:57.266917 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3072/6111] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:29:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:57.278670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:57.279548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:57.297673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.298542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.311858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.316595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.318342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.323769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.737746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:57.751558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:57.766792 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2668a3a9-a034-46fb-b19c-f39e912eee28 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1664 microversion: 2.1 time: 0.493932 Nov 02 12:29:57.787390 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3040/6112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:57 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1664 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:58.560720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9", "name": "network-vif-deleted", "tag": "56a902d8-3135-4f4b-94cb-d1b237ac7fd3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:58.589587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.590195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.591304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.617933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] Creating event network-vif-deleted:56a902d8-3135-4f4b-94cb-d1b237ac7fd3 for instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 on n-h1-855649-4 Nov 02 12:29:58.632400 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1216d2c6-95b6-4983-ab19-e38651cf5db5 req-08436cfb-4140-44a7-bda5-eea67071715c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076167 Nov 02 12:29:58.645233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3073/6113] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:58.808661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:58.809583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:58.823809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.826463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.833146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.834110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.834716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.835383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.168737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e2c93c5dbc48479bbd24b4a2ecd959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53c0fab318497fadd6a36ae5dd1479', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:59.181287 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff0d22e6-9bce-448a-8311-93551a9bd4b2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 200 len: 1383 microversion: 2.1 time: 0.377128 Nov 02 12:29:59.181881 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3041/6114] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:58 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 1383 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:00.217663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:00.229764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:00.241419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.244408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.250690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.250690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.255882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.256744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.299916 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] HTTP exception thrown: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Request method failure captured: Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 HTTP/1.1 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmF6-vuDtCzY_ECBcJ36rPjjpvTF-_GQIMs1LlZUP0Tb8tN_s1DcfIIw8CMsy-dUANkcZb2hIdwF72tWhoD6TsC5UMjEZzE-1hPg1bzOt0cr32C9b9xUS2rgrGkfYgYBEKmpiIuP_X4hTdLLxFPBZht-97vEb4pYVuwxWq4P_1PZRkU Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa53c0fab318497fadd6a36ae5dd1479", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 24e2c93c5dbc48479bbd24b4a2ecd959 Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9'} Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:00.302386 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:00.312340 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:00.314813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Returning 404 to user: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:00.318698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae87c30b-131a-4e79-9961-45c067f967e2 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 404 len: 111 microversion: 2.1 time: 0.105904 Nov 02 12:30:00.320390 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3074/6115] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:00 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:03.670099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:03.671598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.674775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:03.685911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.690843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.690843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.690843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.691640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.692337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.714091 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] HTTP exception thrown: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Request method failure captured: Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 HTTP/1.1 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmF6-vuDtCzY_ECBcJ36rPjjpvTF-_GQIMs1LlZUP0Tb8tN_s1DcfIIw8CMsy-dUANkcZb2hIdwF72tWhoD6TsC5UMjEZzE-1hPg1bzOt0cr32C9b9xUS2rgrGkfYgYBEKmpiIuP_X4hTdLLxFPBZht-97vEb4pYVuwxWq4P_1PZRkU Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa53c0fab318497fadd6a36ae5dd1479", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 24e2c93c5dbc48479bbd24b4a2ecd959 Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9'} Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:03.717068 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Returning 404 to user: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1458d1b1-34d7-4afc-b8b0-0e80d17d5fa5 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 404 len: 111 microversion: 2.1 time: 0.055027 Nov 02 12:30:03.724443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3042/6116] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:03 2022] DELETE /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:30:03.730620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:03.731969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] [instance: 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.740097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.740996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.741504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.742390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.743144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.743768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.781046 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] HTTP exception thrown: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Request method failure captured: Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 HTTP/1.1 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmF6-vuDtCzY_ECBcJ36rPjjpvTF-_GQIMs1LlZUP0Tb8tN_s1DcfIIw8CMsy-dUANkcZb2hIdwF72tWhoD6TsC5UMjEZzE-1hPg1bzOt0cr32C9b9xUS2rgrGkfYgYBEKmpiIuP_X4hTdLLxFPBZht-97vEb4pYVuwxWq4P_1PZRkU Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa53c0fab318497fadd6a36ae5dd1479", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa53c0fab318497fadd6a36ae5dd1479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fa53c0fab318497fadd6a36ae5dd1479 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestServerBasicOps-1970742264 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 24e2c93c5dbc48479bbd24b4a2ecd959 Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestServerBasicOps-1970742264-project Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9'} Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:03.784634 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. Nov 02 12:30:03.789431 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:30:03.795010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Returning 404 to user: Instance 5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:03.796918 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cf58054-eed3-4312-a550-3bfc7c22b6fc tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9" status: 404 len: 111 microversion: 2.1 time: 0.070597 Nov 02 12:30:03.799887 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3075/6117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:03 2022] GET /compute/v2.1/servers/5ddccfd5-557b-40f2-85b6-4f5b92e8c5c9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:04.760759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b454d51-056f-4865-990f-1b7dc26fc394 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] Calling method '.version_select at 0x7ff1b31b90d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:04.888466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b454d51-056f-4865-990f-1b7dc26fc394 tempest-TestServerBasicOps-1970742264 tempest-TestServerBasicOps-1970742264-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959966774" status: 202 len: 0 microversion: 2.1 time: 0.132681 Nov 02 12:30:04.889141 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3043/6118] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-959966774 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:30:06.037534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-893232440", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba6c2373-9a81-452f-a522-659a15bb02e6"}], "security_groups": [{"name": "tempest-securitygroup--1553211162"}], "key_name": "tempest-keypair-678537104", "user_data": "}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:06.287425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] validate_networks() for [('ba6c2373-9a81-452f-a522-659a15bb02e6', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:07.008553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:07.119500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:07.914309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:07.915242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:07.919571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:07.920986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:07.921947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:07.947364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.949797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.951276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.954849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.956281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.957097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:08.013149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:08.021425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:08.068669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:08.077750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:08.320816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0a2bb7c-1a00-44eb-a45d-767c024e500f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.288133 Nov 02 12:30:08.334733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3076/6119] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:30:09.024630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89baf412-a6a0-448c-9004-8b6bfb63c0f5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:09.026503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89baf412-a6a0-448c-9004-8b6bfb63c0f5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:09.166662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89baf412-a6a0-448c-9004-8b6bfb63c0f5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:09.204647 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89baf412-a6a0-448c-9004-8b6bfb63c0f5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1240 microversion: 2.1 time: 0.861379 Nov 02 12:30:09.221020 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3044/6120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:08 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1240 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:10.235491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-813c6f8c-5321-417b-b31a-9379c5d066ac tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:10.236327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-813c6f8c-5321-417b-b31a-9379c5d066ac tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:10.497589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-813c6f8c-5321-417b-b31a-9379c5d066ac tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:10.519718 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-813c6f8c-5321-417b-b31a-9379c5d066ac tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1240 microversion: 2.1 time: 0.291080 Nov 02 12:30:10.524981 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3077/6121] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:10 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:11.553867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:11.554821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:11.604947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.680286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.680286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.680286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.680286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.680286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:12.264493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:12.264493 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7931231b-b037-44fe-b866-0057e5e2b1cd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1236 microversion: 2.1 time: 0.527136 Nov 02 12:30:12.264493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3045/6122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:11 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1236 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:13.109436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:13.110266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:13.125777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.126295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.127077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.129533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.130675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.131559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.409777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:13.445826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b301330-a259-4857-a301-2c5a405314a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1300 microversion: 2.1 time: 0.341196 Nov 02 12:30:13.471245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3078/6123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:13 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1300 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:14.487804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:14.488693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:14.501135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:14.502535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:14.505672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.508276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:14.509536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:14.510969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.903414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:14.938551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecffc465-8735-4038-be5b-e7777c62f9cb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1298 microversion: 2.1 time: 0.455393 Nov 02 12:30:14.961589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3046/6124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:14 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1298 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:15.970311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:15.971012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:15.987765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.988613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:15.991305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:15.996909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:16.003325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:16.006145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:16.360034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:16.386112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a138b119-e6b0-4821-a60f-7235c4312558 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 0.421058 Nov 02 12:30:16.391499 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3079/6125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:15 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:17.396041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e5e96-c900-479a-894b-21d0ad693880", "tag": "86dff7e1-5746-43f0-808e-c058c229896c"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:17.416834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:17.419176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:17.427502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.431548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.432527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.438658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.439683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.440703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.443187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.443930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.445185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.467159 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] Creating event network-changed:86dff7e1-5746-43f0-808e-c058c229896c for instance 982e5e96-c900-479a-894b-21d0ad693880 on n-h1-855649-4 Nov 02 12:30:17.483200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-1df7112f-9fbe-4296-99ae-ffb06e73b47c req-294b0e45-8987-4c2e-be01-7b9072b2a118 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091105 Nov 02 12:30:17.490785 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3047/6126] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:17.971524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:18.194787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.250244 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a101d33-2d38-46ff-9325-6196b1ccd318 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 0.838072 Nov 02 12:30:18.251381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3080/6127] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:17 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:19.279238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:19.284345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:19.285363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:19.322805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.323358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.323816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.335560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.346085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.346669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.976797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:20.007668 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f8afc9ff-bb84-42b6-8f5b-c4f633bdf9eb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 0.731026 Nov 02 12:30:20.023948 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3048/6128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:19 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:21.041761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:21.044399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:21.057519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:21.076793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.077891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.084617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.086194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.087300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.100057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.997756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:22.009717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df808ceb-4677-4a79-9bed-eb49a13713a8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 0.975966 Nov 02 12:30:22.016240 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3081/6129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:21 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:23.060424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.061330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.083571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.084607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.085994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.087443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.088767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.089661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.435835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:23.497371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c55d2bc3-8113-47f0-9b22-448ce82fd3e8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 0.440327 Nov 02 12:30:23.500662 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3049/6130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:23.592750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e5e96-c900-479a-894b-21d0ad693880", "name": "network-vif-plugged", "status": "completed", "tag": "86dff7e1-5746-43f0-808e-c058c229896c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:23.630090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.636539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.639866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.643093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:23.694649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] Creating event network-vif-plugged:86dff7e1-5746-43f0-808e-c058c229896c for instance 982e5e96-c900-479a-894b-21d0ad693880 on n-h1-855649-4 Nov 02 12:30:23.719619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d5e08845-ee62-4935-b13d-f3b65e66a78d req-cfbc5604-590f-4d59-91d6-aff1d666a790 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130341 Nov 02 12:30:23.741941 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3082/6131] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:24.537964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:24.560570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:24.617695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.623185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.628089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.634548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.634548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.637677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.750443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.771719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95153e6a-b934-414b-ad30-2351582910c6 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1366 microversion: 2.1 time: 1.247506 Nov 02 12:30:25.788594 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3050/6132] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:24 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1366 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:26.805354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.806947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.835103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.837226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.837226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.842681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.849065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.849837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.931030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:27.941847 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1d4a697-24c9-4330-96ea-290aab6b6e09 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1556 microversion: 2.1 time: 1.144417 Nov 02 12:30:27.942876 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3083/6133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1556 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:27.965952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:27.967101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:27.974998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.975825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.976484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.977503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.978207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.980073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.278297 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-148db418-79a7-4918-8169-5a6834eab39d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317235 Nov 02 12:30:28.284479 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3051/6134] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:30:27 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:31.133450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e5e96-c900-479a-894b-21d0ad693880", "tag": "86dff7e1-5746-43f0-808e-c058c229896c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:31.169438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.182752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.183452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.253800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] Creating event network-changed:86dff7e1-5746-43f0-808e-c058c229896c for instance 982e5e96-c900-479a-894b-21d0ad693880 on n-h1-855649-4 Nov 02 12:30:31.275499 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d8c44ece-ee6f-4463-af9b-871b05383982 req-b67576b3-cc54-40fd-8214-edb22ef9d1c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146411 Nov 02 12:30:31.283179 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3084/6135] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:05.145500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:05.146575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=45 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:05.153266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.153942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.172627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.173151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.173638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.174662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.175376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.175972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.239708 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d3d8409-82a4-442c-b493-e8c2bdc2f0c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/ips" status: 200 len: 149 microversion: 2.1 time: 0.097273 Nov 02 12:31:05.263181 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3052/6136] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/ips => generated 149 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:09.673313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7226a264-2e0b-4786-815b-477f15fbbbce"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:09.675867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.688721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:09.689518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:09.691555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.696093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.696093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.696093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.696093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.696093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.754211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5d31cc6-ab3b-4bbd-9b8a-3f046a91932f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.085143 Nov 02 12:31:10.766531 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3085/6137] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:31:09 2022] POST /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 194 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:29.600286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7226a264-2e0b-4786-815b-477f15fbbbce"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:29.605252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.642181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.643027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.643756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.645087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.645860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.659114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.822764 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments HTTP/1.1 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 74 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: {"volumeAttachment": {"volumeId": "7226a264-2e0b-4786-815b-477f15fbbbce"}} Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: exception: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '982e5e96-c900-479a-894b-21d0ad693880', 'body': {'volumeAttachment': {'volumeId': '7226a264-2e0b-4786-815b-477f15fbbbce'}}} Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:29.829917 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 400 to user: Invalid volume: volume 7226a264-2e0b-4786-815b-477f15fbbbce is already attached to instances: 982e5e96-c900-479a-894b-21d0ad693880 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93de475d-68f9-4582-abbb-71a0d449566b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.275540 Nov 02 12:31:29.840851 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3053/6138] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:31:29 2022] POST /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 174 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:31:30.000006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.003494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.004668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:30.005546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:30.017666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.018527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.019316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.020562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.024531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.024531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.181906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'services' on Instance uuid 982e5e96-c900-479a-894b-21d0ad693880 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:30.512595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-727a6ffc-1846-40e1-9d3d-92c591f5fc70 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments/7226a264-2e0b-4786-815b-477f15fbbbce" status: 202 len: 0 microversion: 2.1 time: 0.519659 Nov 02 12:31:30.513523 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3086/6139] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:31:29 2022] DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments/7226a264-2e0b-4786-815b-477f15fbbbce => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:31:30.527850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.531316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.540834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.541636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.542465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.543654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.544392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.545084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.593563 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4c9d8f0-336d-4ecf-8c27-c8c8fc7990b1 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073303 Nov 02 12:31:30.599192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3054/6140] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:31.613053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.623433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.639100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.647780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.648487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.649402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.650202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.651035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.764905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79c3f249-4d56-491d-af8b-df0e2de8c795 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161009 Nov 02 12:31:31.771063 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3087/6141] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:32.780029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:32.782709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:32.801482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.805521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.806078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.808793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.809362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.811098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.861709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9fce839-4d22-4012-a74d-3143bbbc0f45 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087276 Nov 02 12:31:32.862407 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3055/6142] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:32 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:33.875064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.878113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.890183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.890914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.891640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.892543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.893167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.893756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.935052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e170fbce-7563-4fa1-a839-c67e0511f334 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064713 Nov 02 12:31:33.939115 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3088/6143] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:34.959981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.962194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.969943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.970436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.971516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.972254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.972715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.973147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.015966 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0a59fd0-3705-4eee-98ee-3915fc713121 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065800 Nov 02 12:31:35.017030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3056/6144] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:36.043537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.055656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.079365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.080007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.081736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.082660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.085750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.087661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.217504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-599327bc-2c0a-49b1-9a59-76070fe9aa0b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186514 Nov 02 12:31:36.222334 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3089/6145] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:37.247127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.250588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.261561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.262472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.263277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.266115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.266843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.267532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.329220 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4f5009f-b668-484c-9c7d-ccd7951034c3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100756 Nov 02 12:31:37.329824 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3057/6146] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:31:37.433754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.438189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.446582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.448286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.448734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.449459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.450089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.450400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.482071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:37.919816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a50b85ab-4c42-4faa-b482-07d48291f0e3 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 204 len: 0 microversion: 2.1 time: 0.492487 Nov 02 12:31:37.933707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3090/6147] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:37 2022] DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:37.936419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.938586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.969345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.978064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.981396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.984081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.988286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.990345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.211394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.221227 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6074f3fd-639e-444b-88d1-73b6070813a7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1680 microversion: 2.1 time: 0.292627 Nov 02 12:31:38.233778 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3058/6148] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:39.257543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.257543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.270168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.271065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.271783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.272884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.273578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.274346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.570246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.582852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d4f7297-14ca-47f4-a322-a81867185597 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1680 microversion: 2.1 time: 0.338708 Nov 02 12:31:39.585908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3091/6149] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:40.610944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:40.611682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:40.619484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.620634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.621167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.622189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.623107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.626159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.033038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.043071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa47e490-9eb2-498d-b5b7-77a57956718f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1680 microversion: 2.1 time: 0.437388 Nov 02 12:31:41.065332 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3059/6150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:40 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1680 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:41.453095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e5e96-c900-479a-894b-21d0ad693880", "name": "network-vif-deleted", "tag": "86dff7e1-5746-43f0-808e-c058c229896c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:41.472290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.473782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.474588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.504831 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] Creating event network-vif-deleted:86dff7e1-5746-43f0-808e-c058c229896c for instance 982e5e96-c900-479a-894b-21d0ad693880 on n-h1-855649-4 Nov 02 12:31:41.513321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6fb75b54-7530-4e5d-8a1a-9eea2d3f923c req-3d50f377-286c-448c-9036-82cbbac3b31c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063999 Nov 02 12:31:41.524484 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3092/6151] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:42.071117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.072710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.081485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.082537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.083267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.084234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.084908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.085549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.126127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.126958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.127661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.128251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'fault' on Instance uuid 982e5e96-c900-479a-894b-21d0ad693880 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:42.198529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.212601 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2cbb4719-ee08-4697-abaa-2a051b1724bd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 200 len: 1330 microversion: 2.1 time: 0.146428 Nov 02 12:31:42.213717 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3060/6152] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 1330 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:43.244386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.246566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.256289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.257396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.258130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.259185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.259999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.261352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.285825 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 HTTP/1.1 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '982e5e96-c900-479a-894b-21d0ad693880'} Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:43.288228 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:31:43.292476 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:31:43.294853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:43.296085 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc8d324d-f94d-4421-abbe-822b34e21a19 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 404 len: 111 microversion: 2.1 time: 0.060162 Nov 02 12:31:43.309576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9056fcb5-1f65-4a2c-b4a0-bc014d018214 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '.version_select at 0x7ff1b2226790>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.313813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3093/6153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:43 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:43.568740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9056fcb5-1f65-4a2c-b4a0-bc014d018214 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-678537104" status: 202 len: 0 microversion: 2.1 time: 0.265431 Nov 02 12:31:43.580017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3061/6154] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 12:31:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-678537104 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:45.376995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac719851-f47e-442b-bb4d-53b800e9efff tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: .version_select at 0x7ff1b2b199d0>, body: {"keypair": {"name": "tempest-keypair-1962987377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzdCQLchhHBO4vZdn8EvcC8Lj9iMwxgtdNcfQogmWySM4EzdqastIbytDrlmvXOmBuPNqWetBcLOOlmWcDdm17DL6W40qmrUoUYMt5A0MejUtVzIDdmgWxI6EfiEQC3Pg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:45.398961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac719851-f47e-442b-bb4d-53b800e9efff tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:45.408643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ac719851-f47e-442b-bb4d-53b800e9efff tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:45.595412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac719851-f47e-442b-bb4d-53b800e9efff tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225433 Nov 02 12:31:45.595412 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3094/6155] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:31:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:49.744685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1106454929", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ba6c2373-9a81-452f-a522-659a15bb02e6"}], "security_groups": [{"name": "tempest-securitygroup--437004980"}], "key_name": "tempest-keypair-1962987377", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:49.981580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] validate_networks() for [('ba6c2373-9a81-452f-a522-659a15bb02e6', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:50.854464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:50.855142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:50.855582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:50.856004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:50.856551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:50.869657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.870368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.871016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.871926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.872615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.873176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.900610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:50.909168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Getting quotas for user b1acc870f7a84feaaa20efa5916b3201 and project 0655dfadd0f846c98fa1472403061817. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:50.933737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:50.940752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:51.238348 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d982ec7a-a1cd-4bee-b18a-03bb9a118136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.498979 Nov 02 12:31:51.239062 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3062/6156] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:51.251496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f48d7669-e990-49ec-8c4b-e24ffd1f667f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.252231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f48d7669-e990-49ec-8c4b-e24ffd1f667f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.323390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f48d7669-e990-49ec-8c4b-e24ffd1f667f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.331366 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f48d7669-e990-49ec-8c4b-e24ffd1f667f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1242 microversion: 2.1 time: 0.084019 Nov 02 12:31:51.374650 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3095/6157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:52.396579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0fd99d6-2fb5-438c-9d97-19d2e9209863 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.398294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0fd99d6-2fb5-438c-9d97-19d2e9209863 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.500440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0fd99d6-2fb5-438c-9d97-19d2e9209863 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.517059 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0fd99d6-2fb5-438c-9d97-19d2e9209863 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1242 microversion: 2.1 time: 0.126793 Nov 02 12:31:52.518757 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3063/6158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:53.546251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3519b80c-683b-43d8-9ebc-b165654f7268 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:53.546862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3519b80c-683b-43d8-9ebc-b165654f7268 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.549927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:53.630733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3519b80c-683b-43d8-9ebc-b165654f7268 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.642044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3519b80c-683b-43d8-9ebc-b165654f7268 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1242 microversion: 2.1 time: 0.099897 Nov 02 12:31:53.644059 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3096/6159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:53 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:54.672010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:54.683856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:54.691570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.692152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.692664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.693632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.694812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.695361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.773192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:54.783590 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57798e32-ca9f-4d3e-b969-6cde410d1e39 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1246 microversion: 2.1 time: 0.121152 Nov 02 12:31:54.797799 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3064/6160] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:54 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1246 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:55.808580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:55.809242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:55.817874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.818483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.818812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.819551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.820006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.820433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.902059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.910243 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d9fc030-ff23-44dd-81f3-cc52d82c10d8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1246 microversion: 2.1 time: 0.106637 Nov 02 12:31:55.910935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3097/6161] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:55 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:56.950310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:56.954404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.963375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.964375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.964813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.974734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.975552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.977860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.103506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:57.113404 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d703199d-1e2b-4ea9-ad47-a6926a84ef4f tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1238 microversion: 2.1 time: 0.179608 Nov 02 12:31:57.118579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3065/6162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:56 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:58.158843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:58.159511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:58.167376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.167880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.168909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.169027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.187942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.188305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.371115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:58.389257 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9c2eb61-7a66-42e5-9071-3741555cb8ae tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1302 microversion: 2.1 time: 0.232255 Nov 02 12:31:58.403371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3098/6163] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:58 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1302 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:59.447153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.471443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.540799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:59.550855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb54c20e-d6fe-4735-8919-0fb060243b8d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1300 microversion: 2.1 time: 0.108253 Nov 02 12:31:59.551907 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3066/6164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:59 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:00.576552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:00.578275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:00.586880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:00.596972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.598070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.598926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.600054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.600777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.601548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.958886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.970065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ae883db4-25b4-4d16-8ce1-16bd3eadef71 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.400035 Nov 02 12:32:00.970941 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3099/6165] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:00 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:01.444849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7c7ee2-eeca-4e37-aa53-92d7131f6ead", "tag": "0fb61304-43af-4cf1-a3b1-7540d5277233"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:01.456808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:01.457606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:01.470847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.471483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.475547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.475547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=75 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:01.488181 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] Creating event network-changed:0fb61304-43af-4cf1-a3b1-7540d5277233 for instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead on n-h1-855649-4 Nov 02 12:32:01.494670 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6df43161-d681-4cb5-b02d-bad2f65b27df req-bc9d79c3-42e8-4803-b2b3-fc9ee6891a1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056721 Nov 02 12:32:01.495969 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3067/6166] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:02.004328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.004964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.013166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.014500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.015511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.017312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.018163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.018951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.209234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.218096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d65b24ab-2fa2-493b-9c3b-dc3d5ffd3f61 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.223900 Nov 02 12:32:02.222338 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3100/6167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:03.245312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:03.246152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:03.249705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:03.258075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.258576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.259130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.261344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.262036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.262677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.764942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:03.777834 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b140906-3c50-4cf3-8069-d103f4e44b47 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.537028 Nov 02 12:32:03.780269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3068/6168] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:03 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:04.807758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:04.808192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:04.812215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:04.819797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.820612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.821591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.822540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.823869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.824519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.995345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.003910 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2892953d-ab13-4f26-a59e-fda8deeda0ce tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.203815 Nov 02 12:32:05.004784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3101/6169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:04 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:05.999447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7c7ee2-eeca-4e37-aa53-92d7131f6ead", "name": "network-vif-plugged", "status": "completed", "tag": "0fb61304-43af-4cf1-a3b1-7540d5277233"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:06.010830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.011469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.012114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.033159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:06.033777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:06.042545 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] Creating event network-vif-plugged:0fb61304-43af-4cf1-a3b1-7540d5277233 for instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead on n-h1-855649-4 Nov 02 12:32:06.048476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.050429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.051314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.053372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.054122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.054756 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c8808ee3-4f7d-4b20-802c-6e7cb7ec31e0 req-59bd4ccb-3cb3-4a54-9fb4-b43bf00fcc36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058451 Nov 02 12:32:06.055453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.057786 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3069/6170] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:06.324121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.332648 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ece94267-01b0-4500-8ed4-1c798a9c4407 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.307034 Nov 02 12:32:06.342312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3102/6171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:07.367951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:07.369273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.380269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.380765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.381204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.381920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.382372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.383513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.572274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.581709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cd3ec60-0be7-43fb-bbf9-209f7eae4d3a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1367 microversion: 2.1 time: 0.218424 Nov 02 12:32:07.582727 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3070/6172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:07 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:08.606600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.607483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.616686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.617932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.618517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.619906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.620437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.620965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.786893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.801124 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17e88015-1052-4344-bf07-7195b94a46ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1557 microversion: 2.1 time: 0.198605 Nov 02 12:32:08.802342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3103/6173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1557 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:08.829022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.829755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.838180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.839864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.839864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.840464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.841156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.841650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.984537 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d33b576c-4050-4001-a509-ae16d53eef86 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160123 Nov 02 12:32:08.987735 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3071/6174] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:10.824242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7c7ee2-eeca-4e37-aa53-92d7131f6ead", "tag": "0fb61304-43af-4cf1-a3b1-7540d5277233"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:10.845870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.846527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.848871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.867268 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] Creating event network-changed:0fb61304-43af-4cf1-a3b1-7540d5277233 for instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead on n-h1-855649-4 Nov 02 12:32:10.876538 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b7a790a4-2186-4815-a5ff-f2b52a253294 req-73eeef33-7f6d-47e3-b8d2-364318b64a5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059244 Nov 02 12:32:10.878189 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3104/6175] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:44.934713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:44.937007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:44.944352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:44.945527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=19 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:44.947428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.948113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.948716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:44.949815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.950439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.951066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:44.991297 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45c37b96-955d-4aad-94f6-ea66361d7cfd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/ips" status: 200 len: 150 microversion: 2.1 time: 0.060986 Nov 02 12:32:44.992721 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3072/6176] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:32:44 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:48.376199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=11 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:48.376979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:48.381818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "497075f8-bafb-4e08-a56e-1336d437a3cc"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:48.388345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.393422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.394086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.394534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.395374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.395963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.396401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.463440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32daa9e4-6653-41a8-acd4-f5f34ffa906b tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "POST /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088760 Nov 02 12:32:49.464441 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3105/6177] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:32:48 2022] POST /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 194 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:05.533606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:05.535922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:05.550060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.553064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.553575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.554850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.555386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.558197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.703850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'services' on Instance uuid 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:06.177104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c88602cf-6e4f-440f-a487-6c4fdd904437 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments/497075f8-bafb-4e08-a56e-1336d437a3cc" status: 202 len: 0 microversion: 2.1 time: 0.650067 Nov 02 12:33:06.182321 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3073/6178] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:33:05 2022] DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments/497075f8-bafb-4e08-a56e-1336d437a3cc => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:06.187634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:06.190009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:06.193243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:06.193928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:06.207514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.208029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.208480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.209224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.209720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.210168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.261635 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26181e57-f707-4ee3-b5ae-44e957d88136 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078667 Nov 02 12:33:06.263103 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3106/6179] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:06 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:07.278997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:07.284520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:07.316818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:07.317994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:07.322136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:07.323695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:07.325516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:07.329666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:07.406442 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ca76d40-ed45-4dc0-b839-9c0c21f4cbf9 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134396 Nov 02 12:33:07.414784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3074/6180] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:07 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:08.423126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.426049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.480508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.482046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.482565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.485744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.490773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.491443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.600303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f5fa3fb-6acd-4f0f-a102-2c561d67d4c4 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181824 Nov 02 12:33:08.613646 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3107/6181] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:09.625516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:09.627800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:09.652776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.653279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.653722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.654445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.658766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.664487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.772956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0563daa-38ee-470d-a769-40fbb7ba4044 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132929 Nov 02 12:33:09.775535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3075/6182] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:09 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:10.819227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:10.849826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:10.935595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:10.936100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:10.936548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:10.937278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:10.937813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:10.938252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:11.100130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ec5d523-3dd3-468a-be2e-945551ba2ad7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.312685 Nov 02 12:33:11.107192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3108/6183] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:10 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:12.134201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:12.137764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:12.158242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:12.158242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:12.158677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:12.159959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:12.160588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:12.161704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:12.230287 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c4aa124-f801-430b-9e3e-27ccd30af3ab tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112681 Nov 02 12:33:12.238694 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3076/6184] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:12 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:13.250364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:13.253292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:13.261564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:13.262315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:13.262954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.263885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:13.264770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:13.265378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.347862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90b693e5-adc0-4210-bf75-c78310425d2e tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101702 Nov 02 12:33:13.348810 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3109/6185] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:13 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:14.361024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:14.363285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:14.378262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.378759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.379237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.379954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.380417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.380941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.450212 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d4a5fdf-4f5f-4ada-84c4-970ab485235c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093089 Nov 02 12:33:14.450834 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3077/6186] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:14 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:15.463254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:15.467921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:15.486268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.486752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.487220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.504248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.510357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.510357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.564771 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15db70f4-3bb3-423f-b4e4-ea4faddac767 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106295 Nov 02 12:33:15.572165 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3110/6187] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:15 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:33:16.582379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.587810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.605423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.605976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.606428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.607274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.607739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.608172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.660779 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bea337a2-a333-4bbc-ae74-f733bbeaa28c tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082325 Nov 02 12:33:16.661385 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3078/6188] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 12:33:16 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:33:16.776177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.777274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.791958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.792705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.793516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.794104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.794615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.799157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.847683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:17.360758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd884960-7180-4b0f-8f34-aef4a408bd79 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 204 len: 0 microversion: 2.1 time: 0.579833 Nov 02 12:33:17.363653 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3111/6189] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:16 2022] DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:17.372150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:17.373096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:17.381563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.384407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.385108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.387159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.393489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.394364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.637137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:17.663518 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c176a3a1-a70b-44f4-951a-1af5e0b77527 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1682 microversion: 2.1 time: 0.295354 Nov 02 12:33:17.664309 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3079/6190] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:17 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1682 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:18.693290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:18.693998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:18.701293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.701816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.702265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.703015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.703746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.704164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.928375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:18.937598 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2dbf6d06-9f76-46a2-8ac8-86126529de52 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1682 microversion: 2.1 time: 0.248610 Nov 02 12:33:18.938270 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3112/6191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:18 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:19.963193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:19.963904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.984184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.985251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.985919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.987082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.987751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.988319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.146744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:20.161178 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a766d53-97c6-43d3-9dd8-dcc310f827b7 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1615 microversion: 2.1 time: 0.201421 Nov 02 12:33:20.182348 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3080/6192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:19 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1615 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:20.419661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7c7ee2-eeca-4e37-aa53-92d7131f6ead", "name": "network-vif-deleted", "tag": "0fb61304-43af-4cf1-a3b1-7540d5277233"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:20.441968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:20.442817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:20.443467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:20.481434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] Creating event network-vif-deleted:0fb61304-43af-4cf1-a3b1-7540d5277233 for instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead on n-h1-855649-4 Nov 02 12:33:20.494967 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2d59f310-5eee-434e-b533-3fec7ff89ff5 req-3f8c778c-ae15-4297-bf2f-e3f1c7b2f3de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417562 Nov 02 12:33:20.496200 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3113/6193] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:21.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lazy-loading 'fault' on Instance uuid 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:21.306452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1acc870f7a84feaaa20efa5916b3201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0655dfadd0f846c98fa1472403061817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:21.328232 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-57342f0a-82d1-4cf4-9cb2-7a45a7687bcb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 200 len: 1332 microversion: 2.1 time: 0.141921 Nov 02 12:33:21.331724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3081/6194] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:21 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:22.358931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:22.359692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:22.381510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.382661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.382661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.383343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:22.384376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:22.384822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:22.459689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead HTTP/1.1 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1e7c7ee2-eeca-4e37-aa53-92d7131f6ead'} Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:22.462149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6d24b4f-e9d4-41cb-8cd4-6f58ffe53cdd tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 404 len: 111 microversion: 2.1 time: 0.110150 Nov 02 12:33:22.466516 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3114/6195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:22 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:22.477633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b365b0c6-17d4-4b23-a77c-9e583bbe094d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '.version_select at 0x7ff1b274da60>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:22.645028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b365b0c6-17d4-4b23-a77c-9e583bbe094d tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962987377" status: 202 len: 0 microversion: 2.1 time: 0.174259 Nov 02 12:33:22.645780 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3082/6196] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 12:33:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962987377 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:29.857180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.857180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.874643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.880061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.884315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.884315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.884315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.884616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.939047 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead HTTP/1.1 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1e7c7ee2-eeca-4e37-aa53-92d7131f6ead'} Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:29.943214 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:29.948721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:29.949709 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1dba3dc3-7639-4958-86ff-a31dc72932bb tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 404 len: 111 microversion: 2.1 time: 0.098392 Nov 02 12:33:29.959446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.960743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.965275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3115/6197] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:29 2022] DELETE /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:30.002326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.003226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.004762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.006031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.007774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.009269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.089412 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead HTTP/1.1 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1e7c7ee2-eeca-4e37-aa53-92d7131f6ead'} Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:30.093965 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 1e7c7ee2-eeca-4e37-aa53-92d7131f6ead could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:30.098135 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b3c6adc-c5e5-45f7-af5d-90cc684ea262 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead" status: 404 len: 111 microversion: 2.1 time: 0.140088 Nov 02 12:33:30.105342 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3083/6198] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:29 2022] GET /compute/v2.1/servers/1e7c7ee2-eeca-4e37-aa53-92d7131f6ead => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:33:36.059811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.060589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.067757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.069409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.070394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.071946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.072624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.073335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.090080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 HTTP/1.1 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '982e5e96-c900-479a-894b-21d0ad693880'} Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:36.094373 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.098239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.100578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:36.101661 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf7424c3-e4cb-45d3-a88a-5ffaa030a62a tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 404 len: 111 microversion: 2.1 time: 0.046760 Nov 02 12:33:36.102862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3116/6199] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:36 2022] DELETE /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:36.111768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.112541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 982e5e96-c900-479a-894b-21d0ad693880] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.115453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:36.147789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.148501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.150059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.152366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.155133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.156744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.165140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:36.244069 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 HTTP/1.1 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '982e5e96-c900-479a-894b-21d0ad693880'} Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.246877 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. Nov 02 12:33:36.250542 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.252598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 982e5e96-c900-479a-894b-21d0ad693880 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:36.253746 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f64192e6-efcc-43d6-b930-064f10019dd8 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880" status: 404 len: 111 microversion: 2.1 time: 0.145868 Nov 02 12:33:36.266763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.268615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.275355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3084/6200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/982e5e96-c900-479a-894b-21d0ad693880 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:36.278192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.278928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.279784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.280743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.281478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.282259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.334532 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 HTTP/1.1 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '907f524c-67d3-49c9-bbe5-935aa72069a5'} Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:36.339647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.343174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.349098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:36.350280 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-04a1b072-f551-4a9d-95ef-d688eef1e1e5 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 404 len: 111 microversion: 2.1 time: 0.090140 Nov 02 12:33:36.353121 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3117/6201] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:36 2022] DELETE /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:36.361637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.362561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: 907f524c-67d3-49c9-bbe5-935aa72069a5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.372212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.375680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.376423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.377411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.380089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.380782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.397436 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 HTTP/1.1 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '907f524c-67d3-49c9-bbe5-935aa72069a5'} Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:36.399807 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. Nov 02 12:33:36.403381 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:36.405339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance 907f524c-67d3-49c9-bbe5-935aa72069a5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:36.406518 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5ae9048b-2646-4443-b72f-342efdf606ec tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5" status: 404 len: 111 microversion: 2.1 time: 0.048927 Nov 02 12:33:36.418459 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3085/6202] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/907f524c-67d3-49c9-bbe5-935aa72069a5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:44.873026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.874384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.877346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:44.889333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.896830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.911891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.913052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.921510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.922285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.956247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 HTTP/1.1 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd9e6c38c-73d6-406d-9da6-5c7759b786e2'} Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:33:44.967716 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6e226a4-73bb-49ce-81bf-d75e9ad569ca tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 404 len: 111 microversion: 2.1 time: 0.093809 Nov 02 12:33:44.971236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3118/6203] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:44 2022] DELETE /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:44.979481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.980704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] [instance: d9e6c38c-73d6-406d-9da6-5c7759b786e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.993615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.008143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.009003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.010197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.010955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.012395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.047737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] HTTP exception thrown: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Request method failure captured: Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 HTTP/1.1 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmGjNXTeIIyH7YDuzqQooVfIGAZNblAbd2gJvtUlXkvmUgCi8uXb9lFOacfhC8XgUCAURLjYCUYWgsKwqzzVcu68NdG8DTqHITX16JSuCFAdJ8EXEPHnR0_1dTEJCT0MKnjTrzBbJ08zYjpZDjDe3KR3UZdIcHdMUgnjzEo8bEDs_kk Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0655dfadd0f846c98fa1472403061817", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0655dfadd0f846c98fa1472403061817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0655dfadd0f846c98fa1472403061817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 0655dfadd0f846c98fa1472403061817 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186244727 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b1acc870f7a84feaaa20efa5916b3201 Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-AttachVolumeNegativeTest-186244727-project Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd9e6c38c-73d6-406d-9da6-5c7759b786e2'} Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:45.049968 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] Returning 404 to user: Instance d9e6c38c-73d6-406d-9da6-5c7759b786e2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:45.054350 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-feb192e4-25fc-4c01-a21f-249e5bd4e3c0 tempest-AttachVolumeNegativeTest-186244727 tempest-AttachVolumeNegativeTest-186244727-project] 10.222.0.48 "GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2" status: 404 len: 111 microversion: 2.1 time: 0.084408 Nov 02 12:33:45.067839 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3086/6204] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/d9e6c38c-73d6-406d-9da6-5c7759b786e2 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:59.210206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a05870b-1a1e-4a31-a07c-f23b11840623 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Action: 'create', calling method: .version_select at 0x7ff1b2e1b0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1031249132"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:00.535810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a05870b-1a1e-4a31-a07c-f23b11840623 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.538718 Nov 02 12:34:00.546210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3119/6205] 10.222.0.48 () {60 vars in 1155 bytes} [Wed Nov 2 12:33:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1550 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:34:00.551178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd359b74-d532-44d5-87fa-c6ac8718d92e tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b218dee0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:00.668032 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd359b74-d532-44d5-87fa-c6ac8718d92e tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 345 microversion: 2.1 time: 0.120872 Nov 02 12:34:00.669235 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3087/6206] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:00 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:01.685788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b77cd3f-b483-4835-bae4-e86d4bd13402 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2e1b8b0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:01.750850 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b77cd3f-b483-4835-bae4-e86d4bd13402 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 345 microversion: 2.1 time: 0.072151 Nov 02 12:34:01.754294 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3120/6207] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:01 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:02.766512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1283d5f6-a7f2-44c7-9d5c-726d77a6f617 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b28944c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:02.827447 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1283d5f6-a7f2-44c7-9d5c-726d77a6f617 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 346 microversion: 2.1 time: 0.065383 Nov 02 12:34:02.828933 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3088/6208] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:02.843674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eceb13df-0dcc-435e-9eb0-80f6b2ecf5ab tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Action: 'create', calling method: .version_select at 0x7ff1b3054f70>, body: {"snapshot": {"volume_id": "e473a28d-a33d-4351-b85c-aaf2804ef6f6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-769502335"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:03.759640 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eceb13df-0dcc-435e-9eb0-80f6b2ecf5ab tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.920798 Nov 02 12:34:03.760266 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3121/6209] 10.222.0.48 () {60 vars in 1162 bytes} [Wed Nov 2 12:34:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:03.771654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebe59978-3891-46f4-9c4d-9d5e3d87b834 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b39f0b80>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:03.839761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebe59978-3891-46f4-9c4d-9d5e3d87b834 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.071962 Nov 02 12:34:03.840476 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3089/6210] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:03 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:03.853445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2a24690-b674-4d49-bedd-36978690564f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2e1b550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:03.925423 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2a24690-b674-4d49-bedd-36978690564f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.076267 Nov 02 12:34:03.926579 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3122/6211] 10.222.0.48 () {58 vars in 1140 bytes} [Wed Nov 2 12:34:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:03.938558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e1582ba-d922-4682-a94c-bfcca9c9efc4 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b227ef70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:04.000163 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e1582ba-d922-4682-a94c-bfcca9c9efc4 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.065638 Nov 02 12:34:04.001320 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3090/6212] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:03 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:05.023516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f061ed6-33aa-44b5-86f3-858db2a051ba tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b305bdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.105621 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f061ed6-33aa-44b5-86f3-858db2a051ba tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.095680 Nov 02 12:34:05.106946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3123/6213] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:06.123217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f24eb97d-52bf-4abd-b411-ce87eda8258d tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b227ef70>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:06.199645 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f24eb97d-52bf-4abd-b411-ce87eda8258d tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.083173 Nov 02 12:34:06.199645 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3091/6214] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:06 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:07.214941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f3dd5ac-df84-4e81-b824-e9d36bd960f2 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b38c4dc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.270488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f3dd5ac-df84-4e81-b824-e9d36bd960f2 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 287 microversion: 2.1 time: 0.061866 Nov 02 12:34:07.272840 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3124/6215] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:07 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:07.285225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8d2ce5c-aa69-40d9-a6c2-3861ef0eabcc tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2217700>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.546375 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8d2ce5c-aa69-40d9-a6c2-3861ef0eabcc tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 202 len: 0 microversion: 2.1 time: 0.266101 Nov 02 12:34:07.548570 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3092/6216] 10.222.0.48 () {58 vars in 1254 bytes} [Wed Nov 2 12:34:07 2022] DELETE /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:07.568346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c6d30f3-92dd-42a0-b33d-80629c90d850 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2fd1f70>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.629823 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c6d30f3-92dd-42a0-b33d-80629c90d850 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.075695 Nov 02 12:34:07.630430 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3125/6217] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:07 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:34:08.650596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b656e73-4e68-4ba5-bcb8-2695c691a7c8 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b21ae4c0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.727399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b656e73-4e68-4ba5-bcb8-2695c691a7c8 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.084098 Nov 02 12:34:08.732488 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3093/6218] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:09.738186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:09.743737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4692b7e2-b7d2-4f19-9fbe-2820767bff8f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2e1b4c0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:09.817578 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4692b7e2-b7d2-4f19-9fbe-2820767bff8f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 200 len: 286 microversion: 2.1 time: 0.081029 Nov 02 12:34:09.818181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3126/6219] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:09 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:10.838920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-490e07e1-e7b9-4dca-9b70-8d76daef5f66 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b28941f0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:10.850701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:10.852224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:10.874548 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-490e07e1-e7b9-4dca-9b70-8d76daef5f66 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] HTTP exception thrown: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-490e07e1-e7b9-4dca-9b70-8d76daef5f66 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Request method failure captured: Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 HTTP/1.1 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmO2GeGbkaVAdQC600T3I8X29wvS-jFWS_MKeaGJZXU9kM0g3VlG5QoisIaMrnFYaD3c4GFmb48PNiTQJeNPAGeL-gmuDPmxElSht8Bu6pQzjTDlE2kNInoJLqrB8daFBRMWvciI5qe3ogmszO5FnWA4rf8fjQHQ_FDk5aYNE-GVXLI Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_72b6647f0ba344b6b7f0916206dbdd07", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 35ac416b44934568a6c8c4fc75f751a9 Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: exception: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c595b81d-9562-4fb0-a924-27dee48920f2'} Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. (HTTP 404) (Request-ID: req-32fda8d3-b18e-4c60-94c9-484464f95b14) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:34:10.889325 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-490e07e1-e7b9-4dca-9b70-8d76daef5f66 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Returning 404 to user: Snapshot c595b81d-9562-4fb0-a924-27dee48920f2 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-490e07e1-e7b9-4dca-9b70-8d76daef5f66 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2" status: 404 len: 111 microversion: 2.1 time: 0.064533 Nov 02 12:34:10.895769 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3094/6220] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:10 2022] GET /compute/v2.1/os-snapshots/c595b81d-9562-4fb0-a924-27dee48920f2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:10.904777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:10.911254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e73c67e-d6ef-46a2-87fe-0c8e12102d92 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2b8d790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:11.306038 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e73c67e-d6ef-46a2-87fe-0c8e12102d92 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 202 len: 0 microversion: 2.1 time: 0.407768 Nov 02 12:34:11.306636 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3127/6221] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:34:10 2022] DELETE /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:11.319020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-663e6b40-d418-449d-92c1-251b36eadb97 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b22239d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:11.416717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-663e6b40-d418-449d-92c1-251b36eadb97 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 345 microversion: 2.1 time: 0.104027 Nov 02 12:34:11.425242 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3095/6222] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:11 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:12.435368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e27bbeb8-f1ec-463c-a8ae-d94b81b9628b tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2d93430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:12.492599 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e27bbeb8-f1ec-463c-a8ae-d94b81b9628b tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 345 microversion: 2.1 time: 0.062912 Nov 02 12:34:12.493689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3128/6223] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:12 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:13.512467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18ee9495-64b0-4136-a40a-2f831e66cd9f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b21a3ca0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:13.698701 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18ee9495-64b0-4136-a40a-2f831e66cd9f tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 200 len: 345 microversion: 2.1 time: 0.191437 Nov 02 12:34:13.699630 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3096/6224] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:13 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:14.715008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200d49d3-f7f5-4945-bc04-3a33495bf7fa tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b2b881f0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:14.790860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-200d49d3-f7f5-4945-bc04-3a33495bf7fa tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] HTTP exception thrown: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200d49d3-f7f5-4945-bc04-3a33495bf7fa tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Request method failure captured: Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 HTTP/1.1 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmO2GeGbkaVAdQC600T3I8X29wvS-jFWS_MKeaGJZXU9kM0g3VlG5QoisIaMrnFYaD3c4GFmb48PNiTQJeNPAGeL-gmuDPmxElSht8Bu6pQzjTDlE2kNInoJLqrB8daFBRMWvciI5qe3ogmszO5FnWA4rf8fjQHQ_FDk5aYNE-GVXLI Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_72b6647f0ba344b6b7f0916206dbdd07", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 35ac416b44934568a6c8c4fc75f751a9 Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'e473a28d-a33d-4351-b85c-aaf2804ef6f6'} Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. (HTTP 404) (Request-ID: req-1e37e477-142f-4f5c-a458-01576cd107a6) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:34:14.795600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200d49d3-f7f5-4945-bc04-3a33495bf7fa tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Returning 404 to user: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:14.802912 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-200d49d3-f7f5-4945-bc04-3a33495bf7fa tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 404 len: 109 microversion: 2.1 time: 0.087277 Nov 02 12:34:14.815600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fa835c1-883d-4b9a-8674-dbf324d61121 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b274d160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:14.816172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3129/6225] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:14 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3fa835c1-883d-4b9a-8674-dbf324d61121 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] HTTP exception thrown: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fa835c1-883d-4b9a-8674-dbf324d61121 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Request method failure captured: Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 HTTP/1.1 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmO2GeGbkaVAdQC600T3I8X29wvS-jFWS_MKeaGJZXU9kM0g3VlG5QoisIaMrnFYaD3c4GFmb48PNiTQJeNPAGeL-gmuDPmxElSht8Bu6pQzjTDlE2kNInoJLqrB8daFBRMWvciI5qe3ogmszO5FnWA4rf8fjQHQ_FDk5aYNE-GVXLI Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_72b6647f0ba344b6b7f0916206dbdd07", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 35ac416b44934568a6c8c4fc75f751a9 Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: method: Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: exception: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e473a28d-a33d-4351-b85c-aaf2804ef6f6'} Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. (HTTP 404) (Request-ID: req-e3f1a52a-d7ae-4042-b258-53a498609613) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:34:14.873332 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3fa835c1-883d-4b9a-8674-dbf324d61121 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Returning 404 to user: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:14.877182 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3fa835c1-883d-4b9a-8674-dbf324d61121 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 404 len: 109 microversion: 2.1 time: 0.068422 Nov 02 12:34:14.885368 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3097/6226] 10.222.0.48 () {58 vars in 1248 bytes} [Wed Nov 2 12:34:14 2022] DELETE /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:14.887019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16054e53-fe1a-4979-b6b0-24685b278768 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Calling method '.version_select at 0x7ff1b391c310>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:14.934732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-16054e53-fe1a-4979-b6b0-24685b278768 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] HTTP exception thrown: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16054e53-fe1a-4979-b6b0-24685b278768 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Request method failure captured: Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 HTTP/1.1 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmO2GeGbkaVAdQC600T3I8X29wvS-jFWS_MKeaGJZXU9kM0g3VlG5QoisIaMrnFYaD3c4GFmb48PNiTQJeNPAGeL-gmuDPmxElSht8Bu6pQzjTDlE2kNInoJLqrB8daFBRMWvciI5qe3ogmszO5FnWA4rf8fjQHQ_FDk5aYNE-GVXLI Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_72b6647f0ba344b6b7f0916206dbdd07", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/72b6647f0ba344b6b7f0916206dbdd07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 72b6647f0ba344b6b7f0916206dbdd07 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2052287869 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 35ac416b44934568a6c8c4fc75f751a9 Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2052287869-project Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: method: Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: exception: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'e473a28d-a33d-4351-b85c-aaf2804ef6f6'} Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. (HTTP 404) (Request-ID: req-7309e6c5-4d32-4f4b-94da-36e09e923562) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:34:14.942692 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16054e53-fe1a-4979-b6b0-24685b278768 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] Returning 404 to user: Volume e473a28d-a33d-4351-b85c-aaf2804ef6f6 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:14.948196 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16054e53-fe1a-4979-b6b0-24685b278768 tempest-VolumesSnapshotsTestJSON-2052287869 tempest-VolumesSnapshotsTestJSON-2052287869-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6" status: 404 len: 109 microversion: 2.1 time: 0.063536 Nov 02 12:34:14.959004 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3130/6227] 10.222.0.48 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:14 2022] GET /compute/v2.1/os-volumes/e473a28d-a33d-4351-b85c-aaf2804ef6f6 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:02.476204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2dbd6804-4487-4a0a-9dfb-0099357d74f7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Action: 'create', calling method: .version_select at 0x7ff1b2223c10>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-478619787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN718YNEGy+LI8kEGb9/GiGnnlTYuGlWjXQncFCEICrFtJtrgGaQwGWez3NUAw6Bkq9F1CxfTs3+UZgqXHNu4SD2QK9PDxuyRsyCQZ2nBpAU64meUujoe9b8mE32cb3SwA=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:02.494856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2dbd6804-4487-4a0a-9dfb-0099357d74f7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Getting quotas for project 4334347d19364ae8acf6a8ff32c4d9d0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:02.501096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2dbd6804-4487-4a0a-9dfb-0099357d74f7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Getting quotas for user 17dc9b4ac7604ab685a52d678d7bfdef and project 4334347d19364ae8acf6a8ff32c4d9d0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:02.602816 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2dbd6804-4487-4a0a-9dfb-0099357d74f7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.133194 Nov 02 12:35:02.603274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3098/6228] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:35:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:06.150508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1070606293", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "04840deb-084c-49af-aa2c-b9db08384a99", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-478619787", "security_groups": [{"name": "tempest-secgroup-smoke-1909976501"}], "networks": [{"uuid": "694b91c2-c66d-4e17-8ae4-2aabca7f9533"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:06.362887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] validate_networks() for [('694b91c2-c66d-4e17-8ae4-2aabca7f9533', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:07.219312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:07.220018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:07.220634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:07.221146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:07.221950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:07.234111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.234624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.235264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.239218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.246208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.246208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.264540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Getting quotas for project 4334347d19364ae8acf6a8ff32c4d9d0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:07.271283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Getting quotas for user 17dc9b4ac7604ab685a52d678d7bfdef and project 4334347d19364ae8acf6a8ff32c4d9d0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:07.348538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:07.351577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04840deb-084c-49af-aa2c-b9db08384a99',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:07.956691 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [a86afada-22b6-4d03-adf6-147c3860d733] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:35:08.976685 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [a86afada-22b6-4d03-adf6-147c3860d733] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38900. Nov 02 12:35:08.984028 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fca8f265-83c3-4434-a03e-3a8e0212ac08 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.848654 Nov 02 12:35:08.985976 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3131/6229] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:08.997932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f4964b8-6f34-402f-8062-76caf6d6bc13 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.998788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f4964b8-6f34-402f-8062-76caf6d6bc13 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.064778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f4964b8-6f34-402f-8062-76caf6d6bc13 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.072596 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f4964b8-6f34-402f-8062-76caf6d6bc13 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1098 microversion: 2.1 time: 0.078734 Nov 02 12:35:09.073389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3099/6230] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1098 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:10.098661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5949d074-d15f-4c1d-b551-abe2a6aa99b8 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.100588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5949d074-d15f-4c1d-b551-abe2a6aa99b8 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.168708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5949d074-d15f-4c1d-b551-abe2a6aa99b8 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.191611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5949d074-d15f-4c1d-b551-abe2a6aa99b8 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1098 microversion: 2.1 time: 0.083573 Nov 02 12:35:10.191611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3132/6231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1098 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:11.208129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52b95e5f-e032-4613-8159-5253795378f4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.209782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52b95e5f-e032-4613-8159-5253795378f4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.300600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52b95e5f-e032-4613-8159-5253795378f4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.309904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52b95e5f-e032-4613-8159-5253795378f4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1098 microversion: 2.1 time: 0.108191 Nov 02 12:35:11.310492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3100/6232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1098 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.335356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8f9df06-a46d-47f9-a515-a0b6e0618132 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.336116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8f9df06-a46d-47f9-a515-a0b6e0618132 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.395604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8f9df06-a46d-47f9-a515-a0b6e0618132 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.403613 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8f9df06-a46d-47f9-a515-a0b6e0618132 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1098 microversion: 2.1 time: 0.072073 Nov 02 12:35:12.404225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3133/6233] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.442132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f86ac70-bd82-449f-b06a-8f2223e58d6b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.444615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f86ac70-bd82-449f-b06a-8f2223e58d6b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.509934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1f86ac70-bd82-449f-b06a-8f2223e58d6b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.518362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f86ac70-bd82-449f-b06a-8f2223e58d6b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1098 microversion: 2.1 time: 0.082609 Nov 02 12:35:13.519008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3101/6234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1098 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:14.542065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.542698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.555159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.555740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.556189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.556933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.557660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.558085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.668580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.709694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc33efc1-226b-4808-b105-32cc289bb914 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1148 microversion: 2.1 time: 0.168146 Nov 02 12:35:14.710881 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3134/6235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1148 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:15.735291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.735291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.774905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.775477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.775940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.776690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.777154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.777593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.879346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.888962 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb59eb9e-79be-49cb-9b89-0a844eabaed7 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1140 microversion: 2.1 time: 0.158578 Nov 02 12:35:15.905363 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3102/6236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1140 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:16.915128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.915756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.944390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.945309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.945889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.947813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.948401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.952886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.099598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.116587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-870712b2-5fd9-48e2-94a1-437ccfb1254d tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1214 microversion: 2.1 time: 0.207317 Nov 02 12:35:17.117446 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3135/6237] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.152970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.155783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.167288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.168541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.169428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.173477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.176791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.181644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.672935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.685018 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ea0f9604-c5fe-4195-a67a-261b4c258977 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.539630 Nov 02 12:35:18.702220 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3103/6238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.714449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.715153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.725057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:19.732115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.740686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.743512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.744478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.745053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.748945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.209504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.227123 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89a206b4-bf7d-4eca-ae71-1841ac49fe1f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.516713 Nov 02 12:35:20.228497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3136/6239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:20.563405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:20.586729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.587510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.587955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.606105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] Creating event network-changed:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:35:20.612330 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a1b77ff5-e8bb-4b8b-b4bc-610b34f1dc21 req-ff8a041e-f177-40d9-adc0-ced8c485042d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057146 Nov 02 12:35:20.613865 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3104/6240] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:21.251637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.252848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.259242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.259810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.260334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.261103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.261629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.262143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.522601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:21.535518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8eba9a8c-e431-4168-9c93-c00322bb9fca tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.285289 Nov 02 12:35:21.556937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3137/6241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:22.563411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:22.564067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:22.573082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.573641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.574097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.574864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.575731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.576156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.771491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.798705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e5e637b-0651-4be7-b056-fd7727d3d46a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.227117 Nov 02 12:35:22.799724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3105/6242] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:22 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:23.830888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.831957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.839399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:23.841086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.842005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.842488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.843246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.843822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.844151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.123285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.139455 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9dd0c6ca-8e56-481b-ac86-4f96e7d7e3b9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.312721 Nov 02 12:35:24.140450 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3138/6243] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:23 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:25.166371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.167166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.169361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=10 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:25.185086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.187210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.189656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.190759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.191378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.193523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.697527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.706651 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75aa1561-0c8b-4d31-9451-339b1449ff33 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.545186 Nov 02 12:35:25.717886 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3106/6244] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:26.731369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.732554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:26.740466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.741419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.742038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.744595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.745313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.745920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.929959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.959607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42144ec9-f431-4bc3-951b-4e280549db7f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1282 microversion: 2.1 time: 0.218916 Nov 02 12:35:26.959607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3139/6245] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.983332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.984275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.999984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.000835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.001530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.002261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.002727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.003413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.250223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.262818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-840e0ce6-73b1-4b99-a09c-31890b965211 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.291336 Nov 02 12:35:28.263473 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3107/6246] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:29.292412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.294044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.304198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.305016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.305700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.307863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.308523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.309107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.798258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.816807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2083e96c-f233-4122-bebb-0fd1649f7c64 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.528526 Nov 02 12:35:29.817857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3140/6247] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:30.847460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.848089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.856399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.856989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.857429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.858318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.859001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.859441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.081426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.090871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4b91326-3740-4aed-b41e-8b6cadce2274 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.248174 Nov 02 12:35:31.091880 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3108/6248] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:32.117840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.118631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.129305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.131398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.132057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.132790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.133242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.133992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.349308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.358922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab8a0ff2-9cd9-4dca-a874-07077e09407b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.247516 Nov 02 12:35:32.360266 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3141/6249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:33.388747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.389488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.393099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:33.399372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.399860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.400310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.401099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.401610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.402092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.575088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.587489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c90b9e9f-9efa-4296-bd76-c4d0a66b04d4 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.207262 Nov 02 12:35:33.588218 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3109/6250] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:34.611475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.612251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.622309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.622907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.623689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.624644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.625408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.626096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.811015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.822228 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-707a6406-72e7-4a0b-91a2-dcb81acce2c9 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.215290 Nov 02 12:35:34.825901 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3142/6251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:35.851506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.852531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:35.864219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.864712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.865190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.865908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.866368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.866797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.017699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.031758 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-057aa0ac-afec-4d4a-910b-ea3e31169a37 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.182233 Nov 02 12:35:36.031758 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3110/6252] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:37.057529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.058724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.075461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.075461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.075461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.076323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.079334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.080180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.315345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "name": "network-vif-plugged", "status": "completed", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:37.353820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:37.361266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.362762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.363756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.432268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=57 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:37.432903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.438328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] Creating event network-vif-plugged:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:35:37.452975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f4a1003-bcc9-419c-82d9-90ce995337bf tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.402600 Nov 02 12:35:37.461452 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e593829d-44bf-4f62-a670-298dca72c7d1 req-cd081510-1632-40da-89f3-22d82921d339 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623546 Nov 02 12:35:37.464019 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3111/6253] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:37.482898 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3143/6254] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:38.500368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.506071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.518653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.519768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.520715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.522868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.523831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.524692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.794328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.829713 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53daec25-b71a-4fc6-8104-b9d1ad7071d1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1270 microversion: 2.1 time: 0.337498 Nov 02 12:35:38.830897 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3112/6255] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1270 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:39.878438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.880035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.891810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.892407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.892925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.893754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.894310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.895141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.249289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.303256 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-60fac0af-5f21-453e-b7a5-26937bc18fc1 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1459 microversion: 2.1 time: 0.427511 Nov 02 12:35:40.307836 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3144/6256] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1459 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:40.352715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.353867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.368306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.370627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.371985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.373393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.375495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.376755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.783820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.802008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2c7c999-d0c6-4b9f-8a52-fd72a3cebbd5 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1459 microversion: 2.1 time: 0.459731 Nov 02 12:35:40.804010 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3113/6257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1459 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:45.907537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.976180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.977053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.977913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.001840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] Creating event network-changed:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:35:46.010488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6cbfb64f-a3fd-48b2-b004-97d7942af063 req-2a459cfc-7736-443c-bf7b-5b191bc5937d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506969 Nov 02 12:35:46.011807 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3145/6258] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:48.688170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}, {"name": "network-changed", "server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:48.775379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.788613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.789680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.797560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=69 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:48.822681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Creating event network-changed:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:35:48.830394 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] Creating event network-changed:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:35:48.855377 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-993f6c54-373a-4f6d-9913-bbe8db960cc5 req-1984a2ea-f61b-47a0-a43e-d0c43144b587 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.174264 Nov 02 12:35:48.856959 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3114/6259] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:05.126353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-338122441", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "69d633ea-7430-4a1b-98a1-8ba0bb08b1d7"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:05.164923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:05.166049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:05.237052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] validate_networks() for [('69d633ea-7430-4a1b-98a1-8ba0bb08b1d7', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:06.148353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:06.149293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:06.149547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:06.150090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:06.150657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:06.170934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.172083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.173030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.175215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:06.176535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:06.177634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:06.227224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Getting quotas for project ee9bc46eb1b14f98822a38d4cac02bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:06.271063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Getting quotas for user 76937e3055a84634882975548ab1c19b and project ee9bc46eb1b14f98822a38d4cac02bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:06.324631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:36:06.330083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:36:06.507594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b09b5a0-2c0f-4451-9d48-81044ade445a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389971 Nov 02 12:36:06.528942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=11 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:06.539787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3146/6260] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:36:06.540225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a95b1b93-02ec-471d-99de-6587d6d38301 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:06.541521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a95b1b93-02ec-471d-99de-6587d6d38301 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:06.660574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a95b1b93-02ec-471d-99de-6587d6d38301 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.673835 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a95b1b93-02ec-471d-99de-6587d6d38301 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1218 microversion: 2.1 time: 0.151833 Nov 02 12:36:06.674459 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3115/6261] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:06 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:07.710659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e387c76-807c-412b-809e-d7104d9ff73c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:07.713082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e387c76-807c-412b-809e-d7104d9ff73c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:07.912277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e387c76-807c-412b-809e-d7104d9ff73c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:07.923319 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e387c76-807c-412b-809e-d7104d9ff73c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1218 microversion: 2.1 time: 0.221919 Nov 02 12:36:07.924196 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3147/6262] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:07 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:08.956765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2af30780-abe8-4fd4-adfd-57dd2ef1d969 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:08.959307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2af30780-abe8-4fd4-adfd-57dd2ef1d969 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:09.071424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2af30780-abe8-4fd4-adfd-57dd2ef1d969 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:09.085009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2af30780-abe8-4fd4-adfd-57dd2ef1d969 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1218 microversion: 2.1 time: 0.134969 Nov 02 12:36:09.086104 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3116/6263] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:08 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:10.123521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:10.124860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:10.133210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.134067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.134579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.135450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.136113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.136561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.233829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:10.253018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11baabb6-e8d1-49a8-ab51-fd4bd50e7532 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1222 microversion: 2.1 time: 0.133324 Nov 02 12:36:10.255000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3148/6264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:10 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:11.279556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.280443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:11.295594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.296102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.296548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.297308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.297751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.300474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.407397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:11.439063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0799311-9565-4506-8842-b886f7dae0f2 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1270 microversion: 2.1 time: 0.159040 Nov 02 12:36:11.440708 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3117/6265] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:12.506513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.508718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:12.525979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.526839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.531877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.533540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.545297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.555125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.850746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:12.881525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c49a3c7-ed22-424a-8ea9-db59de4441fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1278 microversion: 2.1 time: 0.398654 Nov 02 12:36:12.888917 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3149/6266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:13.929128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:13.930548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:13.943254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.945566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.947232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.948280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.949031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.949644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.048867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:14.059169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-edabdf81-771f-439c-98ac-572f89934fcb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1276 microversion: 2.1 time: 0.136572 Nov 02 12:36:14.068097 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3118/6267] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:13 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:15.099375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.101656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.134847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.137078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.139046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.140435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.141332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.142470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.686407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.699117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81db2267-93ac-4927-a3b8-3a4bd805cf9d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.610483 Nov 02 12:36:15.700519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3150/6268] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:16.765242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.778926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.826786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.833855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.838338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.840354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.841449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.843900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.340426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:17.357992 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e54984c-2bb7-402a-ae60-d5a90624e257 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.619256 Nov 02 12:36:17.360324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3119/6269] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:17.428580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31aaeb80-9c75-4b2a-97cc-998c45f71e41", "tag": "3a52c398-ddda-4808-a6a2-c05689de835e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:17.444445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:17.451829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.453153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.454039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.491043 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] Creating event network-changed:3a52c398-ddda-4808-a6a2-c05689de835e for instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 on n-h2-855649-4 Nov 02 12:36:17.501559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2b800b71-2136-4a7a-8a98-5078a49098a9 req-e0048b32-703e-4d6b-9164-cfd03e82af95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082762 Nov 02 12:36:17.503387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3151/6270] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:18.405997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.406795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.443535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.444318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.445023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.446241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.447017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.466367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.994476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.024175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98c6a1e7-9b83-44fa-aa7d-4ec704f34c50 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.637441 Nov 02 12:36:19.025626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3120/6271] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:20.067643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:20.084385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.085154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.104938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.106622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.107584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.108809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.109573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.110304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.605280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.625489 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9891ae12-ab4e-4929-87cf-67cc128bf623 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.562749 Nov 02 12:36:20.628057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3152/6272] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:21.663909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:21.672093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.682470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.717649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.718856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.720180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.721855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.723732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.725981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.166068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:22.218847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-72f7adbe-f852-4a66-9778-88294b7dec3e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.551030 Nov 02 12:36:22.225054 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3121/6273] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:23.267108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.268082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:23.287511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.288347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.289010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.289784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.290269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.290710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.510540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:23.531203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-998db380-47cf-4d47-be81-c0ba7eb4507e tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.268472 Nov 02 12:36:23.533209 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3153/6274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:24.559554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.561069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.568811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.569766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.570477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.571914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.572665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.573376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.576811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aaeb80-9c75-4b2a-97cc-998c45f71e41", "name": "network-vif-plugged", "status": "completed", "tag": "3a52c398-ddda-4808-a6a2-c05689de835e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:24.607649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.609210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.610364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.639398 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] Creating event network-vif-plugged:3a52c398-ddda-4808-a6a2-c05689de835e for instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 on n-h2-855649-4 Nov 02 12:36:24.661168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-aa84d566-8ca7-466b-8c8f-1df7a9b62a56 req-e238776c-1c42-41ef-bdd7-3b4c4fcf5e9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088221 Nov 02 12:36:24.661168 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3154/6275] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:24.895479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.908026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0366275-9c80-46a8-9250-bd3baa5c6bed tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.354519 Nov 02 12:36:24.908661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3122/6276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.945009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.946269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.966276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.967190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.967990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.969491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.970964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.971543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.258769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.279490 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5248353d-860f-4c22-af93-14e5c57ba0eb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1318 microversion: 2.1 time: 0.340126 Nov 02 12:36:26.280399 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3155/6277] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.326548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.327823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.341261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.342358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.347389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.347389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.347389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.347389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.855115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.874609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e610e1d-44e6-4c7a-aa7c-b56bd681ddae tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1507 microversion: 2.1 time: 0.555380 Nov 02 12:36:27.876269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3123/6278] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:05.340870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:05.351607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:05.357633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:05.358817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:05.370747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:05.405286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.412397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.414294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:05.418037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.420594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:05.422960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.428310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=43 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:05.428773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:05.442383 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:37:05.442383 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 12:37:05.452408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.461420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.462867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:05.522491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:05.568423 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] Creating event network-changed:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:37:05.592571 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e0dcc0e1-6b41-4ed0-98f6-a355bfcb58ff req-1b2020f7-66ae-47fb-a09c-932b49d281c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228294 Nov 02 12:37:05.606758 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3124/6279] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:06.171129 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-420bca42-637d-4073-a0d7-f078e56bf54b tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 204 len: 0 microversion: 2.1 time: 0.838150 Nov 02 12:37:06.177065 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3156/6280] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:05 2022] DELETE /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:06.185547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:06.186540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:06.209110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.213506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.215380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.216768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.220188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.222174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.602664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:07.625603 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91fa7b9f-0e0a-49d5-92d7-01ce52ce1481 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1584 microversion: 2.1 time: 1.442205 Nov 02 12:37:07.626501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3125/6281] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:06 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1584 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:08.676438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:08.680143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:08.695779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:08.697137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:08.697936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:08.700006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:08.700965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:08.701812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.051907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:09.070607 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db59d2e4-5338-4bef-8ff3-c84463ad657f tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1465 microversion: 2.1 time: 0.400605 Nov 02 12:37:09.070607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3157/6282] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:08 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1465 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:09.482622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d263934-473c-4d50-8c5e-2e302edf1352", "name": "network-vif-deleted", "tag": "f9041eba-8861-43c9-aa9a-3c986651d477"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:09.508760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.520124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.520124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.535269 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] Creating event network-vif-deleted:f9041eba-8861-43c9-aa9a-3c986651d477 for instance 4d263934-473c-4d50-8c5e-2e302edf1352 on n-h1-855649-4 Nov 02 12:37:09.560117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-983a8a53-5163-4798-b327-7be46a169dd2 req-18335c8d-06ed-439d-b0f4-126ba3cb8415 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070233 Nov 02 12:37:09.569882 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3126/6283] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:10.100616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:10.104919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:10.129228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:10.132733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:10.133905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:10.136365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:10.138197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:10.138954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:10.422553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.443339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c930bf4d-eded-4dc4-86f3-894646f5c56a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.353613 Nov 02 12:37:10.443953 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3158/6284] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:10 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.487501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.492794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.522178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.522888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.523707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.524627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.525096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.525531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.690106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:11.705583 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e15b3d0-78c5-4785-ad90-57b74d67a045 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.240511 Nov 02 12:37:11.726704 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3127/6285] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:12.287291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-241885ba-6053-44fb-83b7-d0dc9330c0d5 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-32550557", "availability_zone": "foo_zone"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.297682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.aggregate [None req-241885ba-6053-44fb-83b7-d0dc9330c0d5 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Generated uuid b4370a5b-375f-4849-8236-ab22de418ceb for aggregate {{(pid=127567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:37:12.301016 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-241885ba-6053-44fb-83b7-d0dc9330c0d5 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:37:12.737415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.738658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:12.761795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:12.762633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:12.777887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:12.782901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:12.783962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:12.800061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:12.989435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:13.013502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ff2146a-16ea-4ce0-82ab-3bdcaf793493 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.283199 Nov 02 12:37:13.024869 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3128/6286] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:13.318107 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-241885ba-6053-44fb-83b7-d0dc9330c0d5 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 41930. Nov 02 12:37:13.493062 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-241885ba-6053-44fb-83b7-d0dc9330c0d5 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 1.586154 Nov 02 12:37:13.510211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3159/6287] 10.222.0.48 () {60 vars in 1164 bytes} [Wed Nov 2 12:37:11 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:13.514746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5eb8004b-aa16-4c18-bd2f-fe84df0eef1a tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:13.683878 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5eb8004b-aa16-4c18-bd2f-fe84df0eef1a tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.176314 Nov 02 12:37:13.686336 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3129/6288] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 12:37:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:13.709625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:13.729860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.731199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.732015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.733847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.734701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.736575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.809291 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e0d44410-e791-4c09-9f25-e0d314991a29 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.108115 Nov 02 12:37:13.824809 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3160/6289] 10.222.0.48 () {58 vars in 1176 bytes} [Wed Nov 2 12:37:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:13.832901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66470d88-6ca2-443b-86d3-d12e3e51a52e tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:13.872559 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66470d88-6ca2-443b-86d3-d12e3e51a52e tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.046327 Nov 02 12:37:13.873680 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3130/6290] 10.222.0.48 () {58 vars in 1143 bytes} [Wed Nov 2 12:37:13 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:13.896890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ecc8d1f-bf1a-4df8-8d28-320380096389 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-855649-4"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:13.940984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecc8d1f-bf1a-4df8-8d28-320380096389 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.941999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecc8d1f-bf1a-4df8-8d28-320380096389 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.942760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ecc8d1f-bf1a-4df8-8d28-320380096389 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.071865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.076075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.101018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.101913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.107236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.114267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.115863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.125733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.317970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:14.334434 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-daddf2b2-ce21-41ed-8cd3-f1d7f78e9ff0 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.271835 Nov 02 12:37:14.337196 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3131/6291] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:14 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:15.163838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ecc8d1f-bf1a-4df8-8d28-320380096389 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 1.276402 Nov 02 12:37:15.169811 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3161/6292] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 12:37:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:15.190829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7bf5c241-9958-46b7-abb3-8acc5421ccb2 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.210731 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7bf5c241-9958-46b7-abb3-8acc5421ccb2 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.029879 Nov 02 12:37:15.218396 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3132/6293] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:15.225770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-69172262-14e1-49ba-8e80-93c0c748df64 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-465981163", "availability_zone": "foo_zone"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.382267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.383937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.394970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.396295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.397353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.398913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.399976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.400968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.417797 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-69172262-14e1-49ba-8e80-93c0c748df64 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.197852 Nov 02 12:37:15.434729 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3162/6294] 10.222.0.48 () {60 vars in 1173 bytes} [Wed Nov 2 12:37:15 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:15.454525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4681832-683e-4c48-ab42-505c0b83f177 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.621058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:15.624394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4681832-683e-4c48-ab42-505c0b83f177 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.178831 Nov 02 12:37:15.629255 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3163/6295] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 12:37:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:15.644273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac2885ae-d4a1-4c98-aa4d-1178b3552aa1", "device": "/dev/sdb"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.654812 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a7fca0a-b2bb-4bac-bf65-004eb2381181 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1233 microversion: 2.1 time: 0.276916 Nov 02 12:37:15.657724 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3133/6296] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:15 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1233 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:15.663276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.693382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-53cb0509-77f8-48af-bc69-3c3cbbaa8d09 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.696918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.697430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.702325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.708818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.709621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.710244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.737473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-53cb0509-77f8-48af-bc69-3c3cbbaa8d09 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.069074 Nov 02 12:37:15.739807 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3134/6297] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:15.762874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dde477b-e1e7-4d73-9c0a-fec5e04476a7 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-855649-4"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.782045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dde477b-e1e7-4d73-9c0a-fec5e04476a7 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.782959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dde477b-e1e7-4d73-9c0a-fec5e04476a7 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.784192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dde477b-e1e7-4d73-9c0a-fec5e04476a7 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.550114 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dde477b-e1e7-4d73-9c0a-fec5e04476a7 tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.801888 Nov 02 12:37:16.551473 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3135/6298] 10.222.0.48 () {60 vars in 1194 bytes} [Wed Nov 2 12:37:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:16.571697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aeb67ef8-67fa-4b54-9c1f-b08727b83fdd tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.733412 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aeb67ef8-67fa-4b54-9c1f-b08727b83fdd tempest-TestAggregatesBasicOps-698989315 tempest-TestAggregatesBasicOps-698989315-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.167377 Nov 02 12:37:16.736526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3136/6299] 10.222.0.48 () {58 vars in 1155 bytes} [Wed Nov 2 12:37:16 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:37:16.750534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.751809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:16.765681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.766639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.767541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.768877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.769745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.770544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.894248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-077920c0-67a6-4994-bd5b-f3cb5a767bdc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "POST /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.257962 Nov 02 12:37:16.897670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3164/6300] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:37:15 2022] POST /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41/os-volume_attachments => generated 194 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:16.928260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:16.945216 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ce2d91b-4288-41e4-aeab-1e954a16ce0e tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.206344 Nov 02 12:37:16.945734 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3137/6301] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:16 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:17.978625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:17.980291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:18.021179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.022938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.024241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.032772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.034844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.035981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.274721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:18.318457 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90875fd7-8373-42a0-b375-b25c520ed5f3 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1229 microversion: 2.1 time: 0.339852 Nov 02 12:37:18.318457 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3165/6302] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:17 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1229 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:19.352504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:19.353268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:19.367865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.368099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.368547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.369287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.369756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.370179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.435353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.435850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.436553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.437030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lazy-loading 'fault' on Instance uuid 4d263934-473c-4d50-8c5e-2e302edf1352 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:19.501434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17dc9b4ac7604ab685a52d678d7bfdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4334347d19364ae8acf6a8ff32c4d9d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.510818 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6e01a3a5-4801-4a88-b27e-bf7d07225c6a tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 200 len: 1234 microversion: 2.1 time: 0.162558 Nov 02 12:37:19.511864 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3138/6303] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 1234 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:20.554810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:20.555991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] [instance: 4d263934-473c-4d50-8c5e-2e302edf1352] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:20.585118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.585629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.586087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.586829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.587333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.587782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.636807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] HTTP exception thrown: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Request method failure captured: Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 HTTP/1.1 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmL-1TRsITNfTTl2cUVHBaDKuSjhgLmqlFI-NSn1wLn9Wze0La_zzxN7zUUHyRkYDYbb_-wyP1Nkoj4wvus28k1np7kKlgmBSARm_bjDStO8oFZN1uXISsNmnZ-VUsINz-qSETQ3gkx-uS-8vY9FFeRfO5BWWmaAttQBYO62RFKbng8 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 4334347d19364ae8acf6a8ff32c4d9d0 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBackupRestore-367075863 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4334347d19364ae8acf6a8ff32c4d9d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4334347d19364ae8acf6a8ff32c4d9d0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4334347d19364ae8acf6a8ff32c4d9d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4334347d19364ae8acf6a8ff32c4d9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBackupRestore-367075863 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 4334347d19364ae8acf6a8ff32c4d9d0 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBackupRestore-367075863 Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBackupRestore-367075863-project Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 17dc9b4ac7604ab685a52d678d7bfdef Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBackupRestore-367075863-project Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4d263934-473c-4d50-8c5e-2e302edf1352'} Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:20.640329 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Returning 404 to user: Instance 4d263934-473c-4d50-8c5e-2e302edf1352 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-538a4f48-c16b-48cb-af67-4bc9566a6793 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352" status: 404 len: 111 microversion: 2.1 time: 0.092909 Nov 02 12:37:20.649931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3166/6304] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:20 2022] GET /compute/v2.1/servers/4d263934-473c-4d50-8c5e-2e302edf1352 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:21.404473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3904f972-9afe-43dd-aa51-d905ef07e881 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] Calling method '.version_select at 0x7ff1b2179310>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.594663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3904f972-9afe-43dd-aa51-d905ef07e881 tempest-TestVolumeBackupRestore-367075863 tempest-TestVolumeBackupRestore-367075863-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-478619787" status: 202 len: 0 microversion: 2.1 time: 0.194099 Nov 02 12:37:21.595679 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3139/6305] 10.222.0.48 () {58 vars in 1266 bytes} [Wed Nov 2 12:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-478619787 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:12.091685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.107811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.144475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:12.148837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:12.155937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:12.159716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.166303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.167319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.168982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.174619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.176837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.510019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lazy-loading 'services' on Instance uuid 31aaeb80-9c75-4b2a-97cc-998c45f71e41 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:12.785187 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6733b17-2125-4d18-a6fa-74913ab9ea83 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41/os-volume_attachments/ac2885ae-d4a1-4c98-aa4d-1178b3552aa1" status: 202 len: 0 microversion: 2.1 time: 0.738715 Nov 02 12:38:12.785929 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3167/6306] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:38:12 2022] DELETE /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41/os-volume_attachments/ac2885ae-d4a1-4c98-aa4d-1178b3552aa1 => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:13.556761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=52 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:13.559391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:13.575099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68f6c123-d826-46fd-84cb-abb0a38e2c9d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: .version_select at 0x7ff1b21b43a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-583338157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkvJ2lU8RlxJ3gln3y9XW8xTCHjqCLgJdD4AmNchW9kRLBW398HWPwSHGotBx7c2yjIlzJDm/uABhedWF+Zm1R1Ad2CNpNL/Df4rEIZHjeqFqkPe3xBmX/jOXitsaipiQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:13.648888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-68f6c123-d826-46fd-84cb-abb0a38e2c9d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:13.664335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-68f6c123-d826-46fd-84cb-abb0a38e2c9d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:13.832759 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68f6c123-d826-46fd-84cb-abb0a38e2c9d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.280035 Nov 02 12:38:13.835555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3140/6307] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:38:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:19.252433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-128035113", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "cc33a715-1d8c-493e-9367-fcb4bf167159"}], "key_name": "tempest-TestNetworkBasicOps-583338157", "security_groups": [{"name": "tempest-secgroup-smoke-1316608814"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:19.487223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] validate_networks() for [('cc33a715-1d8c-493e-9367-fcb4bf167159', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:19.621747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.626468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.629163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.630565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.632163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.633146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.634535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.689809 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c133aec0-7e1f-4e2e-9eff-669012543642 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.401315 Nov 02 12:38:19.691066 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3141/6308] 10.222.0.48 () {58 vars in 1185 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:20.015608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-145135616", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "availability_zone": "nova:n-h2-855649-4", "networks": [{"uuid": "c26107d9-32f9-42bb-a192-cbd2efd7f998"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:20.239277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] validate_networks() for [('c26107d9-32f9-42bb-a192-cbd2efd7f998', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:20.626674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:20.629348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:20.630533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:20.631298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:20.631900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:20.664411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.665497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.666318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.667399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.668200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.668913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.721031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:20.733923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:20.781899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:20.785814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:21.014160 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92f8f1f9-fdf2-4873-825c-416988cdcf2d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.766734 Nov 02 12:38:21.016645 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3168/6309] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:21.030041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19c3c7f8-ce8c-4af5-a6bb-f26c9a780860 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:21.031092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19c3c7f8-ce8c-4af5-a6bb-f26c9a780860 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:21.308643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19c3c7f8-ce8c-4af5-a6bb-f26c9a780860 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:21.355904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19c3c7f8-ce8c-4af5-a6bb-f26c9a780860 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1247 microversion: 2.1 time: 0.323078 Nov 02 12:38:21.355904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3169/6310] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:21 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1247 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:21.635076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:21.635710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:21.636213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:21.636631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:21.638328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:21.653386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:21.653894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:21.654347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.655734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:21.656255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:21.656701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.698108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Getting quotas for project 9e38bfed8734436596a72c90c8c45947. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:21.711670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Getting quotas for user 4a73e55d09284e33ad36e9d5a72222be and project 9e38bfed8734436596a72c90c8c45947. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:21.737145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:21.744437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:21.921336 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-224d73df-303b-4824-a5ae-11f5d06bf664 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.909369 Nov 02 12:38:21.927154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3142/6311] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:38:21.954228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc98f1c9-f924-48b1-891a-bb466a30c1e8 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:21.956305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc98f1c9-f924-48b1-891a-bb466a30c1e8 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.154650 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc98f1c9-f924-48b1-891a-bb466a30c1e8 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1328 microversion: 2.1 time: 0.215794 Nov 02 12:38:22.154650 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3170/6312] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:21 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:22.386491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e47fc794-2e05-459e-aa19-bffea45502a2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.390251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e47fc794-2e05-459e-aa19-bffea45502a2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.504264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e47fc794-2e05-459e-aa19-bffea45502a2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:22.520105 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e47fc794-2e05-459e-aa19-bffea45502a2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1247 microversion: 2.1 time: 0.145335 Nov 02 12:38:22.522202 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3143/6313] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1247 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:23.187473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b616d5af-7ded-454d-af73-8a031e73389d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.188092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b616d5af-7ded-454d-af73-8a031e73389d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.339182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b616d5af-7ded-454d-af73-8a031e73389d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1328 microversion: 2.1 time: 0.162363 Nov 02 12:38:23.356425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3171/6314] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:23.555560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.556658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.578097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.578918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.579862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.582240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.583459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.584503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.717061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.717061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.736753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.738327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.739522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.741360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.742549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.743750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.761630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:23.781862 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29ce5b44-8c60-4692-a1b2-8586cbb42a20 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1251 microversion: 2.1 time: 0.238196 Nov 02 12:38:23.800092 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3144/6315] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1251 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:23.865258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:24.381972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.383015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.393014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.393691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.396908 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f176530-02e3-4ef1-bb2c-f296a3097915 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 204 len: 0 microversion: 2.1 time: 0.689477 Nov 02 12:38:24.397530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3172/6316] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:23 2022] DELETE /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:24.401586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.408064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.408064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.408064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.415900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.416901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.468712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.469629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.472953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.474305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.483022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.483858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.591378 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0933f2b6-8f92-4b2e-9352-82fbfe95061d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1345 microversion: 2.1 time: 0.214568 Nov 02 12:38:24.594284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3145/6317] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1345 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:24.819879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.825259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.826281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.852089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.853353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.854457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.856047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.857164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.859232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.861809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7042a353-7b51-4f84-b033-58d7ef0e1be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1513 microversion: 2.1 time: 0.457899 Nov 02 12:38:24.862436 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3173/6318] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1513 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:24.970245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.988146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6557df7c-2143-4df0-90df-c3330a4478e8 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1299 microversion: 2.1 time: 0.169340 Nov 02 12:38:25.007122 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3146/6319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:25.624676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.625822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:25.637508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.638165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.643693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.643693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.643693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.643693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.766206 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c06d4301-e454-40aa-9c2c-716e2964c5e3 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1337 microversion: 2.1 time: 0.149767 Nov 02 12:38:25.767017 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3174/6320] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:25 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1337 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:25.922489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.924327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:25.935261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.936204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.936865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.937896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.938601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.939359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.033907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.036140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.052670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.063272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.063272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.063761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.065258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.067335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.395459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.411418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.421712 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-736cbb0c-af33-4844-8a44-3296b2e05b28 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1513 microversion: 2.1 time: 0.516217 Nov 02 12:38:26.432003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3147/6321] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:25 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.442507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d74f1332-0cef-4acd-81c4-9c549f2bd4bb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1305 microversion: 2.1 time: 0.420840 Nov 02 12:38:26.444047 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3175/6322] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1305 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.820337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.821758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.833853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.834881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.842901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.842901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.842901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.842901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.984298 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba078396-b31a-4e00-aaef-ae20f7a95f15 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1415 microversion: 2.1 time: 0.172920 Nov 02 12:38:26.985539 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3148/6323] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1415 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:27.477097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.527362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.527616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.528950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.214141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.230337 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03ab5ca9-e615-4118-b7cd-465945dc4be1 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1513 microversion: 2.1 time: 0.770503 Nov 02 12:38:28.231876 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3176/6324] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1513 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.241662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.243383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:28.256778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.258064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.259247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.260794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.261932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.263228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.278851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.308304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30b76776-5ef2-4ed4-a21a-79abc5089825 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.831011 Nov 02 12:38:28.317153 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3149/6325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.543617 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c5da1c8-0914-484b-8f16-1ce374c0ea80 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1421 microversion: 2.1 time: 0.309285 Nov 02 12:38:28.549226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3177/6326] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1421 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.662504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31aaeb80-9c75-4b2a-97cc-998c45f71e41", "name": "network-vif-deleted", "tag": "3a52c398-ddda-4808-a6a2-c05689de835e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:28.680728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.681523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.682282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.704624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] Creating event network-vif-deleted:3a52c398-ddda-4808-a6a2-c05689de835e for instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 on n-h2-855649-4 Nov 02 12:38:28.712421 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9a823d90-0064-42f5-9f8a-097311ac93f7 req-2978e1c5-10e1-45fa-812e-863b0be107a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312101 Nov 02 12:38:28.713658 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3150/6327] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:29.276411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.277135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.284813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.285314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.285764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.286547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.287074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.287743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.331462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.332472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.333308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.334235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lazy-loading 'fault' on Instance uuid 31aaeb80-9c75-4b2a-97cc-998c45f71e41 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:29.364480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.367343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.390567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.390567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.399078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.401932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.402861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.403857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.462801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:29.488928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91e9678b-7fe6-4f98-a346-e892a8846757 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 200 len: 1308 microversion: 2.1 time: 0.216911 Nov 02 12:38:29.491609 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3178/6328] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:29.597289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.599694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.615784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.617036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.618113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.619800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.620878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.621873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.599946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.619175 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4906103-9758-4384-be2d-b5efadebd15f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 1.265086 Nov 02 12:38:30.633777 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-01f0c843-346a-462e-a327-420ee414f72e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 1.043889 Nov 02 12:38:30.636019 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3151/6329] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.636459 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3179/6330] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:30.658755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.665053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 31aaeb80-9c75-4b2a-97cc-998c45f71e41] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.675637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.676692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.677539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.678837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.680203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.681046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.715528 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] HTTP exception thrown: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Request method failure captured: Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 HTTP/1.1 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmOwkR2ehAJh-oT45Kc2lRyXFSfBELOmLPI_hR0NHsgREAds2-xmSrKsEaTr-kbNuq-vcID6iom3Q8GLVFPqlvwh-cOXvMsprvPVnwhmYULBpNShZ155uJwrHZ5NsPM_-k2V3UbJq0TTXSx8-NdG5DDbs8WDO45AzJSkawuZ5iRMEqI Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ee9bc46eb1b14f98822a38d4cac02bb8 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee9bc46eb1b14f98822a38d4cac02bb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ee9bc46eb1b14f98822a38d4cac02bb8 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotTestJSON-2059812606-project Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 76937e3055a84634882975548ab1c19b Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotTestJSON-2059812606-project Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '31aaeb80-9c75-4b2a-97cc-998c45f71e41'} Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:30.721049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Returning 404 to user: Instance 31aaeb80-9c75-4b2a-97cc-998c45f71e41 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76992886-c5f5-456f-ad09-9be01ab48ac9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41" status: 404 len: 111 microversion: 2.1 time: 0.088067 Nov 02 12:38:30.740225 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3152/6331] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/31aaeb80-9c75-4b2a-97cc-998c45f71e41 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:31.166434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865c0c8e-f442-4632-ae7b-69221cab34c3", "tag": "04a810a8-8b7a-4efd-8d5a-584d77ca8803"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:31.175218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:31.184675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.185489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.186264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.199740 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] Creating event network-changed:04a810a8-8b7a-4efd-8d5a-584d77ca8803 for instance 865c0c8e-f442-4632-ae7b-69221cab34c3 on n-h1-855649-4 Nov 02 12:38:31.206958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-59607ed5-6b14-4d44-8f13-efd508aad09b req-651e1539-956c-4865-8bca-f2c3d796c925 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052623 Nov 02 12:38:31.214431 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3180/6332] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:31.668873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.674004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.677555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:31.684554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.686249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.700472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.700765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.701728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.702222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.702696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.704079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.705207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.705900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.706669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.707014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.708112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.708417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.280518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.291951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-31a6548a-4e86-4ca6-9821-b4f8542560c7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.629662 Nov 02 12:38:32.293210 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3153/6333] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:32.340342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-915fe163-1905-40a2-b7bc-c946036ba14d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.664723 Nov 02 12:38:32.341455 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3181/6334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:33.235435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d28ea4-0085-4db4-9a52-0d3244389688", "tag": "b0529d72-19c4-46b8-802d-ae0bd0eb6203"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:33.249188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:33.253098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.254125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.254784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.271351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] Creating event network-changed:b0529d72-19c4-46b8-802d-ae0bd0eb6203 for instance d4d28ea4-0085-4db4-9a52-0d3244389688 on n-h2-855649-4 Nov 02 12:38:33.285889 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2749c23e-12e6-409e-b4ff-2eed20f5c004 req-fa2edcbb-5e11-403b-820a-98c08d369810 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054683 Nov 02 12:38:33.291895 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3154/6335] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:33.331134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.332013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.338656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:33.340313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.340819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.341269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.342036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.342912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.342912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.370520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.371987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.386459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.387334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.389399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.394812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.394812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.394812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.914790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.925473 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d263796-8d5c-4d82-beb9-601a39ad72e1 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.601156 Nov 02 12:38:33.926234 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3182/6336] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:33.992069 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb06d816-6ef8-4470-b278-85c148a303a1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.629882 Nov 02 12:38:33.993135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3155/6337] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.953694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:34.953694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:34.962011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.962912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.963530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.964383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.965035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.965887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.032179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.034596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:35.043283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.043895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.044415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.045528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.046238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.047826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.282063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.321283 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b0181915-3795-452d-8852-9ef686a207b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.368843 Nov 02 12:38:35.322571 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96edec2c-fefb-4623-a927-81a1e949c871 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.299191 Nov 02 12:38:35.323488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3183/6338] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:34 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:35.335103 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3156/6339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.363210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.363210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.371450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.373374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.373538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.373728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.374403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.375745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.382906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.383685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.384277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.385318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.386679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.387657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.387869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.388601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.970496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.977074 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd12cdc4-76e2-425a-9ed2-92009268ed2f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.610774 Nov 02 12:38:36.978137 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3157/6340] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.988564 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-529d7545-62b1-4a19-9be3-f8520980fc9e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.633276 Nov 02 12:38:36.989486 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3184/6341] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:37.734623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865c0c8e-f442-4632-ae7b-69221cab34c3", "name": "network-vif-plugged", "status": "completed", "tag": "04a810a8-8b7a-4efd-8d5a-584d77ca8803"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:37.755464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.756367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.757226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.780195 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] Creating event network-vif-plugged:04a810a8-8b7a-4efd-8d5a-584d77ca8803 for instance 865c0c8e-f442-4632-ae7b-69221cab34c3 on n-h1-855649-4 Nov 02 12:38:37.789830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7aa11bf5-176a-438e-8e2b-f938e2a63542 req-316cb795-95c8-48a0-94f1-adbbcc6246a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062501 Nov 02 12:38:37.791011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3158/6342] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:38.009598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.011658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.024057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.026098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.027150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.028219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.028798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.030280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.036263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.036735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:38.048776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.072466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.073737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.074800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.077984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.079199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.080576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.384783 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abb1eca7-393d-43e8-b1ae-685b7f55f1c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.384066 Nov 02 12:38:38.385779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3185/6343] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:37 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:38.390517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:38.404995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a86fe0c4-a89c-408d-93d4-4e70354da6da tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1373 microversion: 2.1 time: 0.377130 Nov 02 12:38:38.406117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3159/6344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1373 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:39.410860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.411829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.435269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.451098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.454256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:39.478284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.478804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.479554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.480606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.481316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.481814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.786645 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2be16524-d51c-4914-beae-59fd062aea2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.380568 Nov 02 12:38:39.787297 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3186/6345] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:39.816225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d28ea4-0085-4db4-9a52-0d3244389688", "name": "network-vif-plugged", "status": "completed", "tag": "b0529d72-19c4-46b8-802d-ae0bd0eb6203"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:39.837325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.838192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.839023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.841581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:39.852114 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa4fc78c-7c99-45e1-9ddb-f7e71bcdb65b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1546 microversion: 2.1 time: 0.411384 Nov 02 12:38:39.853070 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3160/6346] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1546 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:39.863277 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] Creating event network-vif-plugged:b0529d72-19c4-46b8-802d-ae0bd0eb6203 for instance d4d28ea4-0085-4db4-9a52-0d3244389688 on n-h2-855649-4 Nov 02 12:38:39.872944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-03f57006-4dc8-4ba1-bff1-d82466bdb510 req-c1dd8b52-d26a-4271-b43d-22fe2519e6b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062108 Nov 02 12:38:39.891234 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3187/6347] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:39.905422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.906582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:39.925881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.927907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.929262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.932361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.933987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.935125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.308287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:40.319202 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8fd2992-047e-4fa4-a278-3312c7ea9428 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1546 microversion: 2.1 time: 0.439232 Nov 02 12:38:40.321017 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3161/6348] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1546 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:40.819582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:40.821730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:40.835880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.838046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.838898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.840335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.841213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.842028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.225169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83d32d12-3ccb-441c-a958-c40e09a33ce2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1463 microversion: 2.1 time: 0.415507 Nov 02 12:38:41.226907 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3188/6349] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:40 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1463 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:42.014200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1549523398", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "69d633ea-7430-4a1b-98a1-8ba0bb08b1d7"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:42.093242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] validate_networks() for [('69d633ea-7430-4a1b-98a1-8ba0bb08b1d7', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:42.251274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.252266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.269277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.269861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.270379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.271427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.272091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.272568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.675095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd9bb57f-5611-4f4f-8264-6e806803058c tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1649 microversion: 2.1 time: 0.427601 Nov 02 12:38:42.676226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3189/6350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1649 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:42.724148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.725840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.736996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:42.740550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.742170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.743413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.745106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.746326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.747466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.139488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e2138af-1aff-4ace-8fe8-bd73134df92d tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1649 microversion: 2.1 time: 0.425582 Nov 02 12:38:43.140404 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3190/6351] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1649 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:43.180619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.184659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.195962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.197286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.198350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.200070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.201480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.202489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.364396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:43.365276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:43.366243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:43.367305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:43.368080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:43.386140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.387080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.387887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.389294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.390188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.390967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.442758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Getting quotas for project ee9bc46eb1b14f98822a38d4cac02bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:43.460536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Getting quotas for user 76937e3055a84634882975548ab1c19b and project ee9bc46eb1b14f98822a38d4cac02bb8. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:43.495037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:43.498153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:43.560180 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab664a7b-3e15-40b1-a7b0-c6b8d4abb0bf tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1649 microversion: 2.1 time: 0.383626 Nov 02 12:38:43.562704 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3191/6352] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1649 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:43.683518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1916133483", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "availability_zone": "nova:n-h1-855649-4", "networks": [{"uuid": "c26107d9-32f9-42bb-a192-cbd2efd7f998"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:43.691451 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61ad26f4-5270-4013-96db-a3fb8a34e4f9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684040 Nov 02 12:38:43.693338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3162/6353] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:38:43.717621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2925d81d-c96d-4861-94f3-baec007be30b tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.719548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2925d81d-c96d-4861-94f3-baec007be30b tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.783583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:43.801006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] validate_networks() for [('c26107d9-32f9-42bb-a192-cbd2efd7f998', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:43.931762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2925d81d-c96d-4861-94f3-baec007be30b tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:43.949383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2925d81d-c96d-4861-94f3-baec007be30b tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1219 microversion: 2.1 time: 0.240815 Nov 02 12:38:43.950647 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3163/6354] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:44.992263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c93cbd72-073a-4e29-866d-8af31f3defe9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:44.992941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c93cbd72-073a-4e29-866d-8af31f3defe9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.009733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:45.009733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:45.009733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:45.009733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:45.009733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:45.022375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.023280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.024100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.025757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.026625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.027500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.066335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Getting quotas for project 9e38bfed8734436596a72c90c8c45947. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:45.073520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c93cbd72-073a-4e29-866d-8af31f3defe9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:45.077958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Getting quotas for user 4a73e55d09284e33ad36e9d5a72222be and project 9e38bfed8734436596a72c90c8c45947. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:45.084263 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c93cbd72-073a-4e29-866d-8af31f3defe9 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1219 microversion: 2.1 time: 0.096179 Nov 02 12:38:45.086629 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3164/6355] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:44 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:45.105203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:45.110304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:45.477863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-301999cd-9665-4bd4-b632-4355e36286af tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802483 Nov 02 12:38:45.479717 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3192/6356] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:45.503956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2000ea1c-996b-4e5f-b658-4895cbff0b78 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.505552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2000ea1c-996b-4e5f-b658-4895cbff0b78 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.709779 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2000ea1c-996b-4e5f-b658-4895cbff0b78 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1329 microversion: 2.1 time: 0.211954 Nov 02 12:38:45.710518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3165/6357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1329 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:45.715183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865c0c8e-f442-4632-ae7b-69221cab34c3", "tag": "04a810a8-8b7a-4efd-8d5a-584d77ca8803"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:45.734071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.737372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.738218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.766203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] Creating event network-changed:04a810a8-8b7a-4efd-8d5a-584d77ca8803 for instance 865c0c8e-f442-4632-ae7b-69221cab34c3 on n-h1-855649-4 Nov 02 12:38:45.785015 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d0cc7863-a9d0-4829-a6bd-08267de7d917 req-ac1fe3dc-f63c-4c54-8479-c228c7d6b27f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074085 Nov 02 12:38:45.786152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3193/6358] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:46.111341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:46.112412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:46.127407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:46.135413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:46.136113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:46.137160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:46.142047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:46.151307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:46.156577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=99 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:46.335526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.351989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eaa4f833-f901-48ba-8527-6276599350d8 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1215 microversion: 2.1 time: 0.245732 Nov 02 12:38:46.356752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3166/6359] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:46 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:46.756383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a921206e-131d-41ad-a52f-d106700b473b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:46.757449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a921206e-131d-41ad-a52f-d106700b473b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:46.898258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a921206e-131d-41ad-a52f-d106700b473b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1329 microversion: 2.1 time: 0.150935 Nov 02 12:38:46.899342 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3194/6360] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:46 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1329 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.384309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.385884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.398032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.398697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.399343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.400350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.400973 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.401540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.510685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:47.527751 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-110918b5-8b33-4cff-805f-9c22c4e0b297 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1279 microversion: 2.1 time: 0.152911 Nov 02 12:38:47.529209 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3167/6361] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:47 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.930073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.931319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.944925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.945787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.947088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.948009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.948692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.949229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.100982 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2e1fc0f-99ba-4dca-b95e-d4439c13f856 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1416 microversion: 2.1 time: 0.181004 Nov 02 12:38:48.102160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3195/6362] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:47 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1416 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:48.562437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.563439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:48.571751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.572261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.581165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.581165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.581165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.581165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.681626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:48.693509 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9be922dd-89fa-4666-8077-de944b5847ba tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1277 microversion: 2.1 time: 0.135277 Nov 02 12:38:48.695447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3168/6363] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.143708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.146860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:49.158734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.159857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.160255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.161748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.162870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.164535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.292117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4d53ddb-061a-4300-9d64-cac21f8e8fe0 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1434 microversion: 2.1 time: 0.160102 Nov 02 12:38:49.293840 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3196/6364] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1434 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.742543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.744756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:49.761150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.764608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.764608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.764608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.765152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.765484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.203114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.229721 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dffbb359-6be0-4e01-83f9-ad3752ebd21d tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.499189 Nov 02 12:38:50.243532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3169/6365] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:50.330723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.331389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:50.347034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.347936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.348576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.349513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.353195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.353927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.598385 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3e4369c-f310-4341-8435-5cafbc068e9e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.271082 Nov 02 12:38:50.605478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3197/6366] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:51.276814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.278125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:51.292223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.305872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.307113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.309113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.310240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.313074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.533481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1a6430-baa7-449c-9b8f-cdf5f4e75f13", "tag": "371034c7-a191-4876-8f1d-a627ba9584cf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:51.551109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.551917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.552848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.568969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] Creating event network-changed:371034c7-a191-4876-8f1d-a627ba9584cf for instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 on n-h1-855649-4 Nov 02 12:38:51.578875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-da11cb72-b7ad-45f7-824d-0dc2c5f0f3e8 req-c6a8f1f4-8248-4109-bb27-49fabe7a1583 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051168 Nov 02 12:38:51.580772 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3198/6367] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:51.629021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.630377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:51.643250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.644937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.645259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.647032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.648453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.649481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.707176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:51.717881 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df241e5d-f868-4aa6-a36e-f9c601c2e30a tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.448039 Nov 02 12:38:51.726602 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3170/6368] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:52.032203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-926f106e-bc61-4cc1-8583-c83549c9cef1 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.410685 Nov 02 12:38:52.033348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3199/6369] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:52.846034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:52.847101 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:52.855169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.855803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.856431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:52.857341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.858121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.859516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.061902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.062615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:53.076593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.077124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.077522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.078448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.079205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.079922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.258709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.275908 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec72711f-6440-4976-a781-b970bec717c3 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.516956 Nov 02 12:38:53.276542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3171/6370] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:52 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:53.440637 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e78686f5-fea5-4e7a-abe5-479358acdf44 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.382708 Nov 02 12:38:53.442785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3200/6371] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:53.616731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f786109e-d708-44c3-9f11-af343832883a", "tag": "2c145414-d6e1-4b3f-93dc-af2f7644cb8f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:53.621718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:53.627687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.628030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.628466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.641122 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] Creating event network-changed:2c145414-d6e1-4b3f-93dc-af2f7644cb8f for instance f786109e-d708-44c3-9f11-af343832883a on n-h1-855649-4 Nov 02 12:38:53.647778 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ed37c3fe-fafd-47b9-836f-12586623fd1a req-62a66a52-d3a2-4307-bcba-3ef842314b48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034873 Nov 02 12:38:53.648774 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3172/6372] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:54.304159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.305275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:54.316426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.317281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.318043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.320241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.325409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.325409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.490495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.492936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:54.508853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.509789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.515606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.515606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.515606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.515606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.546458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:54.562572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63627e4c-24e7-4460-8be5-84f67e0435fa tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.262638 Nov 02 12:38:54.564013 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3201/6373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:54.757791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3709f47-fe8c-4795-8168-13b90231fa8f tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.277358 Nov 02 12:38:54.759118 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3173/6374] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:55.593373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.595127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.603436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:55.639699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.642381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.643544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.644954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.645829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.646658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.798455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.800319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.816169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:55.823967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.825058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.825941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.827106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.827961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.828851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.711861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.731972 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a019a265-d24f-4776-869e-a60a54c7fe14 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 1.147198 Nov 02 12:38:56.733916 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3202/6375] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:56.775329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1a3bd91-c3d1-41df-8344-4d683c648390 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.980783 Nov 02 12:38:56.776078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3174/6376] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:57.773938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.773938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.776722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:57.788544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.789819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.790808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.792562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.793734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.794744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.816939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.830087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.862172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.863182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.867623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.868687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.869304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.877205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.238471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.257519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-59ea632d-ac8b-48fc-87b4-3a1e98acf6a0 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.491582 Nov 02 12:38:58.259851 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3203/6377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:58.268893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1a6430-baa7-449c-9b8f-cdf5f4e75f13", "name": "network-vif-plugged", "status": "completed", "tag": "371034c7-a191-4876-8f1d-a627ba9584cf"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:58.285818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.287576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.288492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.333339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] Creating event network-vif-plugged:371034c7-a191-4876-8f1d-a627ba9584cf for instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 on n-h1-855649-4 Nov 02 12:38:58.350746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b671cc39-3c1e-440d-87b5-a7fdd982195c req-771bc88c-3538-4a60-9d83-eb910cdabbc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087583 Nov 02 12:38:58.352262 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3204/6378] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:58.393758 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c5c51a63-e111-4d9f-8ebc-1123ba3fd899 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.582301 Nov 02 12:38:58.395207 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3175/6379] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:59.302856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.303834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.315749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.316257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.316700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.317420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.318373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.318811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.437977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.439527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.453729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.455617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.456417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.457740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.458614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.459641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.602004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.615742 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73f8e07c-cbad-4e75-accf-5342edc360fd tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1319 microversion: 2.1 time: 0.320958 Nov 02 12:38:59.626099 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3205/6380] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:59.716416 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2032552c-aa5f-4f1a-bc2e-f00fa35e0bd2 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.285254 Nov 02 12:38:59.722033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3176/6381] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:00.374062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f786109e-d708-44c3-9f11-af343832883a", "name": "network-vif-plugged", "status": "completed", "tag": "2c145414-d6e1-4b3f-93dc-af2f7644cb8f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:00.388816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.389306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.389750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.394864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:00.409519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] Creating event network-vif-plugged:2c145414-d6e1-4b3f-93dc-af2f7644cb8f for instance f786109e-d708-44c3-9f11-af343832883a on n-h1-855649-4 Nov 02 12:39:00.418906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bf178cea-6cf2-48c6-813e-a49cc4c7ee94 req-804419e0-567d-40d9-8833-84d1d4ebe73f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048585 Nov 02 12:39:00.419947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3206/6382] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:00.661592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.663044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.671694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.672319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.673453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.674389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.675136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.675650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.764135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.765564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.783660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.783660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.783660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.784813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.784986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.785313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.944056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.960608 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-792d2443-1823-44d8-bc75-669a46c42da4 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1509 microversion: 2.1 time: 0.307934 Nov 02 12:39:00.961639 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3177/6383] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:01.002303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e2ad4d5-9894-49b6-b111-fdbebc99f63c", "device": "/dev/sdb"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:01.006555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:01.018197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.019057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.019844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.021124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.022309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.023007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.031649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a14effb9-cba7-4ab3-a928-0e2516d606fd tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.274497 Nov 02 12:39:01.046219 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3207/6384] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:02.063019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.066352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.080155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.082019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.083097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.084487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.085587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.086412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.344149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c56ce8d-80b4-47f3-9b4b-09387c31eb7a tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1464 microversion: 2.1 time: 0.289129 Nov 02 12:39:02.347090 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3208/6385] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1464 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:02.417312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5a719d5-7c8e-44ab-aaea-745243dbbd55 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "POST /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.419524 Nov 02 12:39:02.418484 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3178/6386] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 12:39:00 2022] POST /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13/os-volume_attachments => generated 194 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:03.373869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.378248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.385916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.386691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.387427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.388603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.389355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.390326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.646103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ecf350e0-8a21-448e-bbbe-9a6eeb8261c7 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1649 microversion: 2.1 time: 0.277089 Nov 02 12:39:03.647792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3209/6387] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1649 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:03.690297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.692625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.704117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.705007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.705794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.707088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.707921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.708678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.947637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f676e46f-81b6-4470-9455-516720fb5ec4 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1649 microversion: 2.1 time: 0.266453 Nov 02 12:39:03.948773 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3179/6388] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1649 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:03.981776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.989379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.995933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.996933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.997771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.999267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.000266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.001191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.236994 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3121c42-aac4-4fef-887e-a098bc89f088 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1649 microversion: 2.1 time: 0.265765 Nov 02 12:39:04.243327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3210/6389] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1649 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:04.285434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:04.287176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:04.299650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.300161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.300640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.306032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.306908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.307755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.362491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:04.582306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:04.908792 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3229ecc5-4233-4c67-a7ed-073c2871d1e5 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 204 len: 0 microversion: 2.1 time: 0.629427 Nov 02 12:39:04.909847 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3180/6390] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:04 2022] DELETE /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:04.920705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:04.922267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:04.933354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.934125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.934723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.935839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.936537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.937307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.218507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a5202e7-149f-44da-a662-450047b98073 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1655 microversion: 2.1 time: 0.302665 Nov 02 12:39:05.220807 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3211/6391] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:04 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1655 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:06.268441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.270173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.286876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.301804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.302738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.307751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.323042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.323042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.627889 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26f4109f-0a7f-4736-aaaa-859fa7b8e46b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1655 microversion: 2.1 time: 0.369386 Nov 02 12:39:06.629313 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3181/6392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1655 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.670266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:07.675844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:07.697861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:07.698611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:07.703492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.713106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f786109e-d708-44c3-9f11-af343832883a", "name": "network-vif-deleted", "tag": "2c145414-d6e1-4b3f-93dc-af2f7644cb8f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:07.719198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:07.720793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:07.722722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.745907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:07.746950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:07.747880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.826094 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] Creating event network-vif-deleted:2c145414-d6e1-4b3f-93dc-af2f7644cb8f for instance f786109e-d708-44c3-9f11-af343832883a on n-h1-855649-4 Nov 02 12:39:07.841229 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b23f3625-2440-43e3-98d2-0b84c2eed104 req-b58f33ee-b603-41c3-b2fa-fabada4096fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133957 Nov 02 12:39:07.843481 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3182/6393] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:07.968237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37aaf615-1a4a-42f8-9bf7-81f605abff2b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1613 microversion: 2.1 time: 0.305979 Nov 02 12:39:07.970746 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3212/6394] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:07 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1613 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.320827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:08.323506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:08.336365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.337330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.338080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.339469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.340336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.349842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.562868 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4598b85d-17b9-42d2-9e69-f56b1cdfb13e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3/action" status: 200 len: 24566 microversion: 2.1 time: 0.265483 Nov 02 12:39:08.565003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3183/6395] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:39:08 2022] POST /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3/action => generated 24566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:09.004430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.005828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:09.016955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.022852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.022852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.022852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.022852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.022852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.087319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.088191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.088974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.089816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lazy-loading 'fault' on Instance uuid f786109e-d708-44c3-9f11-af343832883a {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:09.183134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6e3bbb7-95b2-4302-82cc-787e510d221b tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 200 len: 1454 microversion: 2.1 time: 0.182386 Nov 02 12:39:09.184848 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3213/6396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.209926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.211204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: f786109e-d708-44c3-9f11-af343832883a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.219968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.220625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.221186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.222014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.222572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.223136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.240738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] HTTP exception thrown: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Request method failure captured: Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a HTTP/1.1 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmS7yptryADDwRKsnWVx-7276cx5Bjre0Bb5AD9KhvsTehyfJ58frerYrXpB8ZEltFpZom8jmSXXDHuyHY3YDkU78wQJ-_vbcgyL5F0xvcm8_X2QaXUODH9hdpfaF40v1OgghAxZNUzfN_wo4IJFj-49vDDDemAv76THWQ1M9z13eFM Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9e38bfed8734436596a72c90c8c45947 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestServerMultinode-518969213 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e38bfed8734436596a72c90c8c45947", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestServerMultinode-518969213 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9e38bfed8734436596a72c90c8c45947 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestServerMultinode-518969213 Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestServerMultinode-518969213-project-admin Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4a73e55d09284e33ad36e9d5a72222be Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestServerMultinode-518969213-project-admin Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'f786109e-d708-44c3-9f11-af343832883a'} Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:10.242556 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Returning 404 to user: Instance f786109e-d708-44c3-9f11-af343832883a could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5543987b-ac93-40f6-b988-2b52d5aa6f37 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a" status: 404 len: 111 microversion: 2.1 time: 0.040350 Nov 02 12:39:10.251338 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3184/6397] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/f786109e-d708-44c3-9f11-af343832883a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:10.258903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.259791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.272752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.273247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.274002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.275340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.276127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.276839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.333149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:10.718200 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-739478af-d795-4529-85c7-26a67adf5017 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 204 len: 0 microversion: 2.1 time: 0.465408 Nov 02 12:39:10.719336 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3214/6398] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:10 2022] DELETE /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:10.732448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.733829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.742541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.743256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.743881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.744694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.745273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.745801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.945126 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0aef7ef5-9ab6-4a9d-a4db-869f542d110e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1655 microversion: 2.1 time: 0.218795 Nov 02 12:39:10.949814 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3185/6399] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1655 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:11.972175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.973302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:11.981674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.982336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.982896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.983782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.985253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.985808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.241984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ad08ac2-ec4f-47e7-93bc-06a67145102e tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1655 microversion: 2.1 time: 0.275081 Nov 02 12:39:12.243249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3215/6400] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1655 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.987169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d28ea4-0085-4db4-9a52-0d3244389688", "name": "network-vif-deleted", "tag": "b0529d72-19c4-46b8-802d-ae0bd0eb6203"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:13.002957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.004123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.006751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.031837 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] Creating event network-vif-deleted:b0529d72-19c4-46b8-802d-ae0bd0eb6203 for instance d4d28ea4-0085-4db4-9a52-0d3244389688 on n-h2-855649-4 Nov 02 12:39:13.042420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-499fa384-dc6d-4ab3-a513-1787969bb8bb req-60b77e54-0145-49c7-bd52-d09871a00b45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063190 Nov 02 12:39:13.044693 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3186/6401] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:13.288314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:13.289533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:13.294274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:13.302417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.304397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.304397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.304762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.305072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.305668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.423217 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27a722a6-98ce-4839-99b5-d76321399521 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 200 len: 1448 microversion: 2.1 time: 0.142099 Nov 02 12:39:13.436935 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3216/6402] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:13 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 1448 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:14.467455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.468792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] [instance: d4d28ea4-0085-4db4-9a52-0d3244389688] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.470341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:14.476254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.476752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.477505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.478716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.478716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.479181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.496495 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] HTTP exception thrown: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Request method failure captured: Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 HTTP/1.1 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmS7yptryADDwRKsnWVx-7276cx5Bjre0Bb5AD9KhvsTehyfJ58frerYrXpB8ZEltFpZom8jmSXXDHuyHY3YDkU78wQJ-_vbcgyL5F0xvcm8_X2QaXUODH9hdpfaF40v1OgghAxZNUzfN_wo4IJFj-49vDDDemAv76THWQ1M9z13eFM Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 9e38bfed8734436596a72c90c8c45947 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestServerMultinode-518969213 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e38bfed8734436596a72c90c8c45947", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e38bfed8734436596a72c90c8c45947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestServerMultinode-518969213 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 9e38bfed8734436596a72c90c8c45947 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestServerMultinode-518969213 Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestServerMultinode-518969213-project-admin Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4a73e55d09284e33ad36e9d5a72222be Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestServerMultinode-518969213-project-admin Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'd4d28ea4-0085-4db4-9a52-0d3244389688'} Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:14.498395 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] Returning 404 to user: Instance d4d28ea4-0085-4db4-9a52-0d3244389688 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ccfe71f-590f-48d8-87ca-bd08c9c69257 tempest-TestServerMultinode-518969213 tempest-TestServerMultinode-518969213-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688" status: 404 len: 111 microversion: 2.1 time: 0.037748 Nov 02 12:39:14.510132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3187/6403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/d4d28ea4-0085-4db4-9a52-0d3244389688 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:27.253332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a830090-0406-4726-a248-f952f996d849 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: .version_select at 0x7ff1b270fc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-400117479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUUfDUieGRGr/zotgO/U4OqdEIlWh9Thv3RpBNr/MiwrodL34wQQ/ymyyDVBsbiOKpynuYx3AE/lL8W0nC5DQav3bhVWa+L0AzidMIH5pGQKbnhDOfYcDXxj9r01c0HyA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:27.290748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:27.341216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6a830090-0406-4726-a248-f952f996d849 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:27.373542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6a830090-0406-4726-a248-f952f996d849 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:27.570094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a830090-0406-4726-a248-f952f996d849 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.353094 Nov 02 12:39:27.572037 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3217/6404] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:39:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:33.205907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-486628375", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "a5f6f4cb-4a16-4e94-ad14-c58e9a9c3427"}], "key_name": "tempest-TestNetworkBasicOps-400117479", "security_groups": [{"name": "tempest-secgroup-smoke-1111764355"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:33.251338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:33.608754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] validate_networks() for [('a5f6f4cb-4a16-4e94-ad14-c58e9a9c3427', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:34.328821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:34.329962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:34.330374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:34.331127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:34.331890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:34.344524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.345192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.345705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.346634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.347272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.347826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.378614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:34.388234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:34.413367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:34.417705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:34.564133 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a7152cb7-130a-42cf-9bce-9175bd0772f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.366037 Nov 02 12:39:34.572905 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3188/6405] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:34.584784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-463d63d6-7cec-4539-bdf5-0b5cf819de90 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:34.586098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-463d63d6-7cec-4539-bdf5-0b5cf819de90 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:34.686012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-463d63d6-7cec-4539-bdf5-0b5cf819de90 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:34.698855 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-463d63d6-7cec-4539-bdf5-0b5cf819de90 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1247 microversion: 2.1 time: 0.123686 Nov 02 12:39:34.703032 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3218/6406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:34 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:35.198515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.199693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.214230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.215185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.216044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.217383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.218237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.219127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.400642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lazy-loading 'services' on Instance uuid 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:35.655689 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-066ba48d-8aa8-4ab2-ba3e-7503135d767c tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13/os-volume_attachments/9e2ad4d5-9894-49b6-b111-fdbebc99f63c" status: 202 len: 0 microversion: 2.1 time: 0.458043 Nov 02 12:39:35.655689 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3189/6407] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 12:39:35 2022] DELETE /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13/os-volume_attachments/9e2ad4d5-9894-49b6-b111-fdbebc99f63c => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:39:35.742402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc3de248-8e59-4341-9754-be2bb6a690c6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.743640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc3de248-8e59-4341-9754-be2bb6a690c6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.828948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc3de248-8e59-4341-9754-be2bb6a690c6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.839895 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc3de248-8e59-4341-9754-be2bb6a690c6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1247 microversion: 2.1 time: 0.105434 Nov 02 12:39:35.840535 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3219/6408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1247 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:36.885936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:36.887282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:36.895904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.896577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.897145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.897983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.898590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.899204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:37.017503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.026884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20514c43-2a27-4e10-806f-0fa3e25accc4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1299 microversion: 2.1 time: 0.147621 Nov 02 12:39:37.027595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3190/6409] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:36 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:38.058226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:38.060398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:38.073850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.074641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.075465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.076762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:38.077620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:38.078646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:38.247059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:38.274651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3744372-8296-48b0-8f22-09d1c8db72e5 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1305 microversion: 2.1 time: 0.222660 Nov 02 12:39:38.278361 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3220/6410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:38 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1305 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:39.321748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:39.324162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:39.340226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.341963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.343007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:39.344647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:39.345703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:39.346746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:40.055389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:40.069207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05904ad4-7e5f-4a56-8fbd-52892637d028 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.756715 Nov 02 12:39:40.070001 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3191/6411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:39 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:41.050334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a16339-bd7c-4af4-ac0e-50d693b83265", "tag": "ac9cb782-7e59-4d18-b99f-342f917c28dc"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:41.078575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.080553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.083175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.126921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] Creating event network-changed:ac9cb782-7e59-4d18-b99f-342f917c28dc for instance 31a16339-bd7c-4af4-ac0e-50d693b83265 on n-h2-855649-4 Nov 02 12:39:41.130292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:41.136109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:41.137641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a6059578-fc0a-478d-93fe-3a80ffcd354e req-ecdd4d07-8260-4ec9-8b63-f563c307d10c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098650 Nov 02 12:39:41.139589 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3221/6412] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:41.153060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.154010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.154838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.156767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:41.157959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:41.159785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:41.832370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:41.843006 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f56ff6b3-cc0d-40fb-a0c6-829792e438ca tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.737503 Nov 02 12:39:41.845039 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3192/6413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:41 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:42.808275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:42.809061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:42.818206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.818840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.819604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:42.820574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.821949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.822785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:42.857765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:42.878042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:42.879619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:42.898094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.899385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.900551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:42.905004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:42.905834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:42.906640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.133065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.146551 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a3befb3-844d-4c89-9409-bb90826d2765 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.272854 Nov 02 12:39:43.147954 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3193/6414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:42 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:43.270844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7b8de1b-1150-47f9-af7f-7d1b1c6185bf tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 204 len: 0 microversion: 2.1 time: 0.467041 Nov 02 12:39:43.271723 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3222/6415] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:42 2022] DELETE /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:39:43.287403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:43.288611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:43.300037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.301219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.302034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.303858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.304361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.304811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.528027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:43.537443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c990f0f1-4d4a-4f25-83b5-b9531b717208 tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1515 microversion: 2.1 time: 0.258511 Nov 02 12:39:43.538255 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3194/6416] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:43 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:44.175834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.177101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.190077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.190872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.191771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.193039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.193891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.194661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.570460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.572871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.584198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:44.585501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:44.590474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.591403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.592614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.599189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.599189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.599189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.624007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:44.650931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-060a9ddc-0cce-4032-a2b8-600c3e6b3d7e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.483460 Nov 02 12:39:44.654956 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3223/6417] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:45.065023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.079929 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ef66251-6f5d-46c4-b0c6-0998ca719ddb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1515 microversion: 2.1 time: 0.517972 Nov 02 12:39:45.080544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3195/6418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1515 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:45.695204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:45.697174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:45.707192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.708144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.708892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.710142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:45.710935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:45.711639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.841491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:46.051022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1a6430-baa7-449c-9b8f-cdf5f4e75f13", "name": "network-vif-deleted", "tag": "371034c7-a191-4876-8f1d-a627ba9584cf"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:46.096789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.098672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.102492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.130009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.143577 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] Creating event network-vif-deleted:371034c7-a191-4876-8f1d-a627ba9584cf for instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 on n-h1-855649-4 Nov 02 12:39:46.150924 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b69ebd68-a8c0-4cbc-adad-eceb41bca9ff req-0251442c-8f3f-464d-a843-867f2eca5dad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107370 Nov 02 12:39:46.160544 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3196/6419] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:46.176864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.179159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:46.195149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.196463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.197562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.199713 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07667ae6-f0ae-4c21-b086-0dc8ee3dd533 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.509125 Nov 02 12:39:46.200284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.201446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.201741 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3224/6420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:45 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:46.202731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.344823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76937e3055a84634882975548ab1c19b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9bc46eb1b14f98822a38d4cac02bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.371157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9cfb63ae-f312-460a-bf9a-de414cfec3dc tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 200 len: 1473 microversion: 2.1 time: 0.207458 Nov 02 12:39:46.377212 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3197/6421] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:47.243313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.247444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.273614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.274906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.275758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.277065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.278162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.279249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.401391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.402111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] [instance: 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.410262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.411196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.411907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.412943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.413653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.414268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.431610 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] HTTP exception thrown: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Request method failure captured: Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 HTTP/1.1 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmOwkR2ehAJh-oT45Kc2lRyXFSfBELOmLPI_hR0NHsgREAds2-xmSrKsEaTr-kbNuq-vcID6iom3Q8GLVFPqlvwh-cOXvMsprvPVnwhmYULBpNShZ155uJwrHZ5NsPM_-k2V3UbJq0TTXSx8-NdG5DDbs8WDO45AzJSkawuZ5iRMEqI Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: ee9bc46eb1b14f98822a38d4cac02bb8 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee9bc46eb1b14f98822a38d4cac02bb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee9bc46eb1b14f98822a38d4cac02bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: ee9bc46eb1b14f98822a38d4cac02bb8 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2059812606 Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-VolumesSnapshotTestJSON-2059812606-project Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 76937e3055a84634882975548ab1c19b Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-VolumesSnapshotTestJSON-2059812606-project Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '1c1a6430-baa7-449c-9b8f-cdf5f4e75f13'} Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:47.434424 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. Nov 02 12:39:47.440361 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:39:47.442585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] Returning 404 to user: Instance 1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:47.443593 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73f3a2eb-5706-49cf-b943-3e3ce76b89fb tempest-VolumesSnapshotTestJSON-2059812606 tempest-VolumesSnapshotTestJSON-2059812606-project] 10.222.0.48 "GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13" status: 404 len: 111 microversion: 2.1 time: 0.046481 Nov 02 12:39:47.447772 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3198/6422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/1c1a6430-baa7-449c-9b8f-cdf5f4e75f13 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:39:47.519328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a16339-bd7c-4af4-ac0e-50d693b83265", "name": "network-vif-plugged", "status": "completed", "tag": "ac9cb782-7e59-4d18-b99f-342f917c28dc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:47.533538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.534485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.535745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.554328 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] Creating event network-vif-plugged:ac9cb782-7e59-4d18-b99f-342f917c28dc for instance 31a16339-bd7c-4af4-ac0e-50d693b83265 on n-h2-855649-4 Nov 02 12:39:47.560504 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-feaa5fa0-4a48-41d7-a8b2-a890e60203a4 req-ba09fea0-b6c4-478c-a45d-23a527d135dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046103 Nov 02 12:39:47.561872 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3199/6423] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:47.637178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.653006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2476442f-55a1-47af-aaa1-fd451b1e1b1d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.417329 Nov 02 12:39:47.668378 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3225/6424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:48.696404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.697529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:48.705248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.705808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.706477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.707778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.714329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.714329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.248383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:49.264786 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f45c22d5-84f4-4cc9-ae4e-f12373f45a76 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1373 microversion: 2.1 time: 0.573986 Nov 02 12:39:49.267511 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3200/6425] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:48 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1373 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:50.308815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.309828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.325177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.325973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.326707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.328103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.329040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.329675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.556182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:50.569026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83051ac8-7ad4-493c-a673-ce36e316b4f7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1545 microversion: 2.1 time: 0.264817 Nov 02 12:39:50.905506 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3226/6426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1545 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.914424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.963522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:50.974397 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd296ddb-f0dc-4bfb-9887-b398799c7f07 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1545 microversion: 2.1 time: 0.361965 Nov 02 12:39:50.976068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3201/6427] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1545 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:30.954913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.956170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.963646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:30.965052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:30.967173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.972114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.973244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.974786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.976380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.977159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.039215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:31.545678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-122ad516-590f-4d0c-96ed-aa5fdc1be0f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 204 len: 0 microversion: 2.1 time: 0.594961 Nov 02 12:40:31.546945 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3227/6428] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:30 2022] DELETE /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:40:31.560936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.562935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.566730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:31.568235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:31.569878 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:40:31.570171 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 (ip 10.222.0.48) !!! Nov 02 12:40:31.582019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.582950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.583594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.584695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.585812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.590966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.362364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.371124 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b391ab61-61d6-4d6a-92ab-9582102d46ad tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1551 microversion: 2.1 time: 0.817183 Nov 02 12:40:32.372203 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3202/6429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1551 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.404377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.409183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.425811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.426717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.427576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.429136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.429965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.430749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.774023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.818809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3a13c2f-638f-4f0a-85f4-79faa31544b2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1551 microversion: 2.1 time: 0.421071 Nov 02 12:40:33.819940 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3228/6430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1551 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:34.195862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a16339-bd7c-4af4-ac0e-50d693b83265", "name": "network-vif-deleted", "tag": "ac9cb782-7e59-4d18-b99f-342f917c28dc"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:34.210353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.210850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.214155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.225235 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] Creating event network-vif-deleted:ac9cb782-7e59-4d18-b99f-342f917c28dc for instance 31a16339-bd7c-4af4-ac0e-50d693b83265 on n-h2-855649-4 Nov 02 12:40:34.231312 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b90e7e3e-10d5-4b02-aa3e-a95caf5a780f req-4c2e40a1-7a94-4ea7-81e4-1d71f63b210d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039514 Nov 02 12:40:34.232559 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3203/6431] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:34.848497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.849575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.861742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.863008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.863008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.863984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.863984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.865052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.912816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.913613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.915133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.915133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lazy-loading 'fault' on Instance uuid 31a16339-bd7c-4af4-ac0e-50d693b83265 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:34.962899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.971912 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81c268e3-6fbc-48d6-a07c-52ae6c4e801d tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 200 len: 1337 microversion: 2.1 time: 0.129419 Nov 02 12:40:34.972650 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3229/6432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 1337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:35.999218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.999852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 31a16339-bd7c-4af4-ac0e-50d693b83265] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.009759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.010621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.011542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.012782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.013642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.014562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.035448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] HTTP exception thrown: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Request method failure captured: Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 HTTP/1.1 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmSdXEccehjqh_7DTI49PssFOGeGOZqEBSa5rxXl4GWhH9x3o5BEHTW1BaShy5oNKzBZa88565bihhj0GRoGpaOh3wk3YRNG7JVEcEZ0djWUDYyHxpv6JbuiC5sPe6AeXN_WXSIQafcSrs2FBsj8yWit2wi1Olfei5J9UoJ0unKEnHc Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_11150af44227419f99f42472d67db6c4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/11150af44227419f99f42472d67db6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ccb0021f1a4a4589a1bcd1b67917f1be Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '31a16339-bd7c-4af4-ac0e-50d693b83265'} Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:36.037499 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Returning 404 to user: Instance 31a16339-bd7c-4af4-ac0e-50d693b83265 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-38c465c7-99e2-4cdb-9d5f-de6733ec06d7 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265" status: 404 len: 111 microversion: 2.1 time: 0.046706 Nov 02 12:40:36.048851 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3204/6433] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/31a16339-bd7c-4af4-ac0e-50d693b83265 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:36.432078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cad02253-9b4f-4483-b3a8-154f635c4c95 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '.version_select at 0x7ff1b3950790>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.541591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cad02253-9b4f-4483-b3a8-154f635c4c95 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-400117479" status: 202 len: 0 microversion: 2.1 time: 0.117863 Nov 02 12:40:36.542915 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3230/6434] 10.222.0.48 () {58 vars in 1254 bytes} [Wed Nov 2 12:40:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-400117479 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:40.391960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "865c0c8e-f442-4632-ae7b-69221cab34c3", "tag": "04a810a8-8b7a-4efd-8d5a-584d77ca8803"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:40.396074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.397581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.403969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.405526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.405998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.411552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.412444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.424547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.424547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:40.424547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:40.424547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.424953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] Creating event network-changed:04a810a8-8b7a-4efd-8d5a-584d77ca8803 for instance 865c0c8e-f442-4632-ae7b-69221cab34c3 on n-h1-855649-4 Nov 02 12:40:40.425628 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2c1d3dca-f395-4ed6-9d3c-b32ae416f1a8 req-e9874bd9-b92f-4783-8cc4-e61559ccb918 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036478 Nov 02 12:40:40.430435 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3231/6435] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:40.470278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:41.046081 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8043cdec-25c5-4f46-a214-b8c72e7e3cfb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 204 len: 0 microversion: 2.1 time: 0.657686 Nov 02 12:40:41.048722 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3205/6436] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:40 2022] DELETE /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:41.068856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.073937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.102541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.113280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.114462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.116302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.117371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.118326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.436479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.450021 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b6615b1-9bf5-4f44-802a-f1342b253568 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1671 microversion: 2.1 time: 0.390050 Nov 02 12:40:41.451135 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3232/6437] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:42.497920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:42.500202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:42.519324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.520663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.521804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.523362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.523983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.528789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.033178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:43.049638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97b812f7-4a83-454d-80f7-10519b70dc0e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1552 microversion: 2.1 time: 0.558183 Nov 02 12:40:43.064469 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3206/6438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:42 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1552 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:43.881710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "865c0c8e-f442-4632-ae7b-69221cab34c3", "name": "network-vif-deleted", "tag": "04a810a8-8b7a-4efd-8d5a-584d77ca8803"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:43.894483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.894992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.898593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.913302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] Creating event network-vif-deleted:04a810a8-8b7a-4efd-8d5a-584d77ca8803 for instance 865c0c8e-f442-4632-ae7b-69221cab34c3 on n-h1-855649-4 Nov 02 12:40:43.928204 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-51c0e6b3-157e-4f0e-90da-2aec27a0cb22 req-3088df44-3ab8-493b-a8c5-b6bfd97ac294 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048350 Nov 02 12:40:43.930769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3233/6439] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:44.098052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:44.100546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:44.117705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.118999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.120292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.122262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.123301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.128088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.207068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:44.238719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6564f3ae-d730-41ec-a93b-c19adfa9840a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 200 len: 1332 microversion: 2.1 time: 0.146499 Nov 02 12:40:44.239447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3207/6440] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:44 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:45.270558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.273056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: 865c0c8e-f442-4632-ae7b-69221cab34c3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:45.283524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.284173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.284714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.285657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.286389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.287058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.312577 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] HTTP exception thrown: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Request method failure captured: Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 HTTP/1.1 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmSdXEccehjqh_7DTI49PssFOGeGOZqEBSa5rxXl4GWhH9x3o5BEHTW1BaShy5oNKzBZa88565bihhj0GRoGpaOh3wk3YRNG7JVEcEZ0djWUDYyHxpv6JbuiC5sPe6AeXN_WXSIQafcSrs2FBsj8yWit2wi1Olfei5J9UoJ0unKEnHc Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_11150af44227419f99f42472d67db6c4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/11150af44227419f99f42472d67db6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ccb0021f1a4a4589a1bcd1b67917f1be Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '865c0c8e-f442-4632-ae7b-69221cab34c3'} Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:45.315579 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Returning 404 to user: Instance 865c0c8e-f442-4632-ae7b-69221cab34c3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-409a6080-b388-4ff2-900d-71078e5702f2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3" status: 404 len: 111 microversion: 2.1 time: 0.057565 Nov 02 12:40:45.340001 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3234/6441] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/servers/865c0c8e-f442-4632-ae7b-69221cab34c3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:40:45.671446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8889be6-7054-479d-83ad-57afa42d0a08 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '.version_select at 0x7ff1b21efe50>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.861150 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8889be6-7054-479d-83ad-57afa42d0a08 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-583338157" status: 202 len: 0 microversion: 2.1 time: 0.198700 Nov 02 12:40:45.862180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3208/6442] 10.222.0.48 () {58 vars in 1254 bytes} [Wed Nov 2 12:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-583338157 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:41:04.652474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90520a17-a13e-4dc0-b89b-36c808ef487b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: .version_select at 0x7ff1b3054f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1340296113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNN+zpVjzqNByYXUzzs+mhIQV08ChV0inx8XjkvKu7k5PB7rlzSPHodcHzoFcBoZjpJgyAtNzlxUY6IBMVJUMj+Oqi8AKs/FFY9dRtg/jStJOcftNxjVcAfuBhTHT3E8w=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:04.686296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:04.690947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:04.745007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-90520a17-a13e-4dc0-b89b-36c808ef487b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:04.773439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-90520a17-a13e-4dc0-b89b-36c808ef487b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:04.939781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90520a17-a13e-4dc0-b89b-36c808ef487b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.295004 Nov 02 12:41:04.941179 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3235/6443] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:41:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:09.243829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1107475309", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "c072bd44-8517-4da1-9af6-66fb1e0c271f"}], "key_name": "tempest-TestNetworkBasicOps-1340296113", "security_groups": [{"name": "tempest-secgroup-smoke-1002161405"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:09.314287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:09.316220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:09.474213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] validate_networks() for [('c072bd44-8517-4da1-9af6-66fb1e0c271f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:10.167334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:10.167774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:10.168269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:10.168696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:10.169150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:10.181089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.181517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.182184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.182963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.183464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.183911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.205264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:10.211807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Getting quotas for user ccb0021f1a4a4589a1bcd1b67917f1be and project 11150af44227419f99f42472d67db6c4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:10.229783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:10.229783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:10.409354 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f550f48-9104-43ec-9f50-4439f13489d4 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.181698 Nov 02 12:41:10.410429 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3209/6444] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:10.440543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1e55109-5044-4ea8-8054-2f720a79bebc tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:10.441710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1e55109-5044-4ea8-8054-2f720a79bebc tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:10.565000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1e55109-5044-4ea8-8054-2f720a79bebc tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:10.584658 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1e55109-5044-4ea8-8054-2f720a79bebc tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1249 microversion: 2.1 time: 0.156040 Nov 02 12:41:10.597117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3236/6445] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:10 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1249 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:11.630590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abc2744a-aeae-45b9-9413-ad0a29b63457 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.631683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abc2744a-aeae-45b9-9413-ad0a29b63457 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:11.744779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abc2744a-aeae-45b9-9413-ad0a29b63457 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.759331 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abc2744a-aeae-45b9-9413-ad0a29b63457 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1249 microversion: 2.1 time: 0.133514 Nov 02 12:41:11.760214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3210/6446] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:12.807415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc21058a-30e5-483b-93e0-e10d64e8eb94 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.808830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc21058a-30e5-483b-93e0-e10d64e8eb94 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:12.899596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc21058a-30e5-483b-93e0-e10d64e8eb94 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:12.916129 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc21058a-30e5-483b-93e0-e10d64e8eb94 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1249 microversion: 2.1 time: 0.118509 Nov 02 12:41:12.917804 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3237/6447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1249 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:13.959357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:13.962440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:13.975547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.976829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.977636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:13.979011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.979882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.980650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.112227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:14.122474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02a991fb-4fc6-45d8-bc06-e23200398761 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1253 microversion: 2.1 time: 0.170762 Nov 02 12:41:14.123343 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3211/6448] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:13 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1253 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:15.159695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:15.160945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:15.182330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.183901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.185940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.188118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:15.189450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:15.190515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:15.326934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:15.339657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3a61c74-45c9-49d4-a039-73523564fe70 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1301 microversion: 2.1 time: 0.184892 Nov 02 12:41:15.341233 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3238/6449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:15 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1301 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:16.384921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.386118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.399868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.400771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.401547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.402895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.404267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.405066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.570461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:16.581965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c4776b0-438a-4f6f-a757-60aa755cb12a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1309 microversion: 2.1 time: 0.204519 Nov 02 12:41:16.582593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3212/6450] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:17.613064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.616528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:17.629077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.630848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.632045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.635473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.636730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.637843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.058922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:18.069051 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e899e34f-115d-4ef9-b0cb-a6829dbc9399 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.466017 Nov 02 12:41:18.069841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3239/6451] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:17 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:19.100459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:19.102297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:19.113710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.114967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.116466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.118081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.119313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.120279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.214355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882b1ae-7400-41c1-9182-fceaf48b4304", "tag": "264cb464-7551-4323-96b4-9d919f25abaa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:19.265132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.266008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.266770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.291224 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] Creating event network-changed:264cb464-7551-4323-96b4-9d919f25abaa for instance a882b1ae-7400-41c1-9182-fceaf48b4304 on n-h1-855649-4 Nov 02 12:41:19.303925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5eaac84c-9949-4b18-aed4-b26a3aa2fd02 req-4983e176-6b4f-483e-93ed-b05f5d8c550b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096106 Nov 02 12:41:19.313572 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3240/6452] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:19.553399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:19.576685 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c010594-fb7a-48e8-8d00-064a8aae8883 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.482338 Nov 02 12:41:19.590752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3213/6453] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:19 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:20.621772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.622651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:20.630856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.631474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.631993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.632797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.633355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.633855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.818691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:20.833605 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f8921e5-db28-45d3-9957-36cfc5be9ad2 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.215883 Nov 02 12:41:20.835057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3241/6454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:21.874401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.875588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:21.880360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:21.881821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:21.892280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.893345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.894202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:21.895604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:21.896455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:21.897232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.146014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.164618 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c52b9ce9-857b-4e49-b584-3f03dee2b0fb tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.298140 Nov 02 12:41:22.166595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3214/6455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:23.191829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.194170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:23.199631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:23.210796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.212044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.213150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.215275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.216902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.218136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.462091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:23.470827 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-919e0e9e-7ac1-4625-b984-c057197ef922 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.284669 Nov 02 12:41:23.471465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3242/6456] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:24.517047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.518398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:24.531558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.532714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.533724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.535440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.536264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.537372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.803027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:24.818160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca7b9f8e-dd13-47dd-9a39-638ad47c038f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.310143 Nov 02 12:41:24.834538 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3215/6457] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:24.867974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882b1ae-7400-41c1-9182-fceaf48b4304", "name": "network-vif-plugged", "status": "completed", "tag": "264cb464-7551-4323-96b4-9d919f25abaa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:24.883033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:24.884692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:24.885854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.934215 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] Creating event network-vif-plugged:264cb464-7551-4323-96b4-9d919f25abaa for instance a882b1ae-7400-41c1-9182-fceaf48b4304 on n-h1-855649-4 Nov 02 12:41:24.934215 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-76ac19d9-f787-4423-9e50-b3e087f9dec3 req-f2f5096d-55cf-4c67-b514-c3a830fa166d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225438 Nov 02 12:41:24.934215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3243/6458] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:25.860797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:25.861442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:25.871578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.872658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.873302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:25.874467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:25.875205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:25.875859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.068328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:26.078077 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-971de50c-2751-4316-bc5b-12ea0d7f287f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1375 microversion: 2.1 time: 0.223123 Nov 02 12:41:26.078896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3216/6459] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:25 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1375 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:27.109832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:27.117267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:27.120462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.121000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.121602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.122855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.123485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.123917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.317249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.337290 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be12df58-4615-4e38-b874-9119ec78e146 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1547 microversion: 2.1 time: 0.236251 Nov 02 12:41:27.338402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3244/6460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:27 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1547 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:27.373953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:27.374796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:27.384785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.385403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.385931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.386597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.388463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.388463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.618546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.627479 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d89d31e5-82de-4c4a-b8eb-61670947b43a tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1547 microversion: 2.1 time: 0.259744 Nov 02 12:41:27.628097 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3217/6461] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:27 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1547 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:31.032645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882b1ae-7400-41c1-9182-fceaf48b4304", "tag": "264cb464-7551-4323-96b4-9d919f25abaa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:31.056316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.064953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.065555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.082229 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] Creating event network-changed:264cb464-7551-4323-96b4-9d919f25abaa for instance a882b1ae-7400-41c1-9182-fceaf48b4304 on n-h1-855649-4 Nov 02 12:41:31.088859 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8b47ed06-e04a-4e79-9ef4-80c81b8b7c1f req-b7d3ad81-3c6d-46b6-bfef-4bb03ab1b6ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059947 Nov 02 12:41:31.089110 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3245/6462] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:55.633040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:55.635874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:55.638537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:55.639582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=44 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:55.646212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.646921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.649421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.649421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:55.649421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:55.649421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:55.716487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db1f477a-7204-4fb2-be2c-85c85055379f tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304/action" status: 200 len: 24537 microversion: 2.1 time: 0.087699 Nov 02 12:41:55.717472 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3218/6463] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:41:55 2022] POST /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304/action => generated 24537 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:42:06.846933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:06.848059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:06.853487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:06.856272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:06.866257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.867155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.867948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.869219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.869900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.870520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.939725 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-200ee054-f3db-4419-9b1a-c5a390e72b88 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "POST /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304/action" status: 200 len: 32606 microversion: 2.1 time: 0.094439 Nov 02 12:42:06.940655 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3246/6464] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:06 2022] POST /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304/action => generated 32606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:42:08.667131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:08.667956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:08.671851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:08.680111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.680809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.681274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.682127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.682594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.683388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.716811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:42:08.915687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a882b1ae-7400-41c1-9182-fceaf48b4304", "tag": "264cb464-7551-4323-96b4-9d919f25abaa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:08.928324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.929059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.929412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.943529 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] Creating event network-changed:264cb464-7551-4323-96b4-9d919f25abaa for instance a882b1ae-7400-41c1-9182-fceaf48b4304 on n-h1-855649-4 Nov 02 12:42:08.949863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cc8d1816-2829-4c3f-bcb2-89bcae4147d5 req-0fe83944-d4a2-4e53-a8fb-32c54a36c2e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283898 Nov 02 12:42:08.950532 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3247/6465] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:09.217538 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0b4eefc1-5043-49e0-a917-cd4c89123529 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 204 len: 0 microversion: 2.1 time: 0.555107 Nov 02 12:42:09.219371 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3219/6466] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:42:08 2022] DELETE /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:42:09.228824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:09.230176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:09.242186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.243141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.244001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.245609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.247846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.248990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.503872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:09.513686 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5a819f0-dae4-45db-8c04-5778b021b621 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1672 microversion: 2.1 time: 0.289334 Nov 02 12:42:09.514303 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3248/6467] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:09 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1672 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:10.541331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:10.543309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:10.557352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.558302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.559926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.561158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.562115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.562790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.890338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:10.899420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a4f50f57-8ce6-40de-9257-bc8287f715f0 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1672 microversion: 2.1 time: 0.363770 Nov 02 12:42:10.900042 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3220/6468] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:10 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1672 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:11.930123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:11.931602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:11.934736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a882b1ae-7400-41c1-9182-fceaf48b4304", "name": "network-vif-deleted", "tag": "264cb464-7551-4323-96b4-9d919f25abaa"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:11.945947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.946767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.947602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.948861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.949618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:11.949826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.950143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:11.950578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.950732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.964182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] Creating event network-vif-deleted:264cb464-7551-4323-96b4-9d919f25abaa for instance a882b1ae-7400-41c1-9182-fceaf48b4304 on n-h1-855649-4 Nov 02 12:42:11.970840 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-57f3db1a-a94a-4599-b01e-e3ad2bf10c20 req-884a5474-e391-4254-a89b-c309245c0541 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052031 Nov 02 12:42:11.971788 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3249/6469] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:12.052719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:12.066340 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec678d0b-a9f8-4a7f-8151-7996764f20ff tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1485 microversion: 2.1 time: 0.145239 Nov 02 12:42:12.067501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3221/6470] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:11 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1485 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:13.092938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:13.093913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:13.102121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.102663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.103148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.103899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.104414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.104904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.153066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:13.153566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:13.154019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.154574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lazy-loading 'fault' on Instance uuid a882b1ae-7400-41c1-9182-fceaf48b4304 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:42:13.226505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb0021f1a4a4589a1bcd1b67917f1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11150af44227419f99f42472d67db6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:13.243002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e1f9348e-ddaf-4ae1-a065-9208fc61f59b tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 200 len: 1339 microversion: 2.1 time: 0.154072 Nov 02 12:42:13.244839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3250/6471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:13 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:14.278658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:14.279598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] [instance: a882b1ae-7400-41c1-9182-fceaf48b4304] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:14.299285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:14.300165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:14.300800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:14.302076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:14.302838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:14.303480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:14.322828 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] HTTP exception thrown: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Request method failure captured: Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 HTTP/1.1 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmSdXEccehjqh_7DTI49PssFOGeGOZqEBSa5rxXl4GWhH9x3o5BEHTW1BaShy5oNKzBZa88565bihhj0GRoGpaOh3wk3YRNG7JVEcEZ0djWUDYyHxpv6JbuiC5sPe6AeXN_WXSIQafcSrs2FBsj8yWit2wi1Olfei5J9UoJ0unKEnHc Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_11150af44227419f99f42472d67db6c4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/11150af44227419f99f42472d67db6c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/11150af44227419f99f42472d67db6c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 11150af44227419f99f42472d67db6c4 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkBasicOps-1829117058 Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ccb0021f1a4a4589a1bcd1b67917f1be Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkBasicOps-1829117058-project Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a882b1ae-7400-41c1-9182-fceaf48b4304'} Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:14.324750 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Returning 404 to user: Instance a882b1ae-7400-41c1-9182-fceaf48b4304 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f024af94-542a-4e70-a3c1-8b48af9895a6 tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304" status: 404 len: 111 microversion: 2.1 time: 0.053445 Nov 02 12:42:14.336896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3222/6472] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:14 2022] GET /compute/v2.1/servers/a882b1ae-7400-41c1-9182-fceaf48b4304 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:42:14.732774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-531d9223-981b-43b6-98b5-7cee13467f6e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] Calling method '.version_select at 0x7ff1b270f700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:14.846023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-531d9223-981b-43b6-98b5-7cee13467f6e tempest-TestNetworkBasicOps-1829117058 tempest-TestNetworkBasicOps-1829117058-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1340296113" status: 202 len: 0 microversion: 2.1 time: 0.121495 Nov 02 12:42:14.847058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3251/6473] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 12:42:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1340296113 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:33.929938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:33.931271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:34.140615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: .version_select at 0x7ff1b218da60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1571792887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuUZBEaOHYpITOcbUnfap8Xe3I8NmDml4/numT+up25rlYYR7SsuEb8u4oRBRxlU3A2J8F2mUF1fDev1VtLGq/BXjBQmH2rXADQv9J5xIzYho2oGFBnxY7RsNXRJsXPWQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:34.168066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:34.177801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:34.194579 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:43:35.204375 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47246. Nov 02 12:43:35.289856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b2e7475-f4a0-4117-97fe-9cec7c26b9be tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.371534 Nov 02 12:43:35.290784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3223/6474] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:43:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:47.793694 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:43:47.796581 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:43:47.796581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:47.796581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:47.805090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-52032036", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "0a0d26c8-4fce-4acb-8e24-be34def8f865"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1571792887", "security_groups": [{"name": "tempest-secgroup-smoke-479168037"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:48.017808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] validate_networks() for [('0a0d26c8-4fce-4acb-8e24-be34def8f865', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:48.664812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:48.665404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:48.666220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:48.666930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:48.667679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:48.683525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.684711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.685488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.686418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.687055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.687614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.719517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:48.731198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:48.755368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:48.758782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:48.913258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d59bef64-f576-4d3f-9fb2-d301732295d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.122855 Nov 02 12:43:48.914171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3252/6475] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:43:48.932807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e30d98cb-32e2-4949-a092-929e7d4469cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.934170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e30d98cb-32e2-4949-a092-929e7d4469cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:48.938970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:48.940453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:49.085736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e30d98cb-32e2-4949-a092-929e7d4469cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:49.100821 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e30d98cb-32e2-4949-a092-929e7d4469cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1265 microversion: 2.1 time: 0.177339 Nov 02 12:43:49.107293 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3224/6476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:48 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:50.131483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-991dfb77-bb2f-48d0-804a-b7501c5a8039 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.132886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-991dfb77-bb2f-48d0-804a-b7501c5a8039 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.257821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-991dfb77-bb2f-48d0-804a-b7501c5a8039 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:50.276369 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-991dfb77-bb2f-48d0-804a-b7501c5a8039 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1265 microversion: 2.1 time: 0.148254 Nov 02 12:43:50.277445 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3253/6477] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:51.303230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.303931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:51.324422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.325316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.325924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.327872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.328822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.329854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.456588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.469856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aace0b6f-0f34-40ba-8f94-69c7c8ee9b48 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1261 microversion: 2.1 time: 0.171927 Nov 02 12:43:51.470559 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3225/6478] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:51 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:52.502105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:52.507862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:52.517363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.518450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.519310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.520630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:52.521490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:52.522273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:52.645973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:52.663710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9a272f3-2f95-45b7-a0b4-8a85a78bb915 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1335 microversion: 2.1 time: 0.169490 Nov 02 12:43:52.664245 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3254/6479] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:52 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:53.694819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.697654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.712675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.713459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.714218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.715574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.716292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.717018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.040121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:54.052705 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d7c9066-3c9f-470a-829f-069522115d69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.366503 Nov 02 12:43:54.053318 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3226/6480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:55.054351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:55.079755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.080609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.083618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.084588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.089806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.096855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.097625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.098693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.100054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.100704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.101408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.113178 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] Creating event network-changed:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h1-855649-4 Nov 02 12:43:55.122853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-de53874a-8618-4cc0-a2e1-fcc80e624e17 req-9031fdde-c8e6-4dd3-bf6c-e673be8e18f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208431 Nov 02 12:43:55.124181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3255/6481] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:55.440749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.451048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10ab8ebf-37c7-4dce-bc04-6e667a5a1fb4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.376806 Nov 02 12:43:55.451782 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3227/6482] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:56.494645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.496054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.510028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.510935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.511789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.513114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.513967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.514758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.767040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.782908 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-893f39e7-9070-453a-bb3f-ad68b543d21e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.296273 Nov 02 12:43:56.784035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3256/6483] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:57.826949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.828305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.841289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.843450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.843450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.844381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.845187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.845915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.044547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.057974 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5eaed9f8-5bd4-4f28-a783-98ea4ee3496e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.238263 Nov 02 12:43:58.061226 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3228/6484] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:57 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:59.098526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.099651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.102693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:59.109881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.110393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.110845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.111699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.112151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.112587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.333475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.343364 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1f9c86c-f967-44dc-be13-1c8fa28e7149 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.248832 Nov 02 12:43:59.343973 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3257/6485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:59.526678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "name": "network-vif-plugged", "status": "completed", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:59.539345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:59.546667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.554127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.554127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.568945 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] Creating event network-vif-plugged:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h1-855649-4 Nov 02 12:43:59.576313 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d3364b44-ec00-47fd-b9e1-4927fa281d09 req-555229e6-94ef-4492-954e-ae90b9fafd45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055609 Nov 02 12:43:59.577282 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3229/6486] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:00.372091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.372784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.375611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:00.380967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.381471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.381943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.382879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.383214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.383652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.553567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.562575 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a4ded33b-63c7-4b33-94cb-72f8912c33bc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1390 microversion: 2.1 time: 0.195472 Nov 02 12:44:00.563440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3258/6487] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1390 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:01.588348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:01.588965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:01.596080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.596571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.597016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.597721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.598322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.598811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.757156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.769086 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4e15cc5-305d-43b6-bfc1-1a67d7940206 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1561 microversion: 2.1 time: 0.186534 Nov 02 12:44:01.769691 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3230/6488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:01 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:01.794776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:01.795672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:01.802575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.803105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.803547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.804279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.804760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.805193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.959930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.969539 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bedfe388-6d0e-4fab-baec-d959bebdaafa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1561 microversion: 2.1 time: 0.180588 Nov 02 12:44:01.970670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3259/6489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:01 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:05.063316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.065328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.071573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:05.081253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.082031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.083026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.083988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.085199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.086866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.088323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.089606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.089606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.105215 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] Creating event network-changed:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h1-855649-4 Nov 02 12:44:05.111342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3d9f6850-ac68-459a-9992-a32104aa2c74 req-27f51c84-8757-415d-8e3a-edbc84b1ef14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046670 Nov 02 12:44:05.115602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3260/6490] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:05.417623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:05.436269 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e8b95eb-0fdd-49b5-9f1f-11716a5348a0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1561 microversion: 2.1 time: 0.378469 Nov 02 12:44:05.437825 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3231/6491] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1561 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:24.821046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.825473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:24.830687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:24.831841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:24.839151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:24.857858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:24.857858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:24.857858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:24.857858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:24.857858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:24.899768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2785787d-8a8e-4455-b588-df0c9c8dc11f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action" status: 200 len: 24564 microversion: 2.1 time: 0.086330 Nov 02 12:44:24.900387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3261/6492] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action => generated 24564 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:44:35.980608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:35.981419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:35.984042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:35.984767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:35.990816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:35.991554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:35.998928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:35.998928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:35.998928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:35.998928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.406342 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bfdc87f3-43b0-4a06-bae7-0dad83b30bfc tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1830 microversion: 2.1 time: 0.430199 Nov 02 12:44:36.406924 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3232/6493] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:35 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1830 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:36.432140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:36.432915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:36.441493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.441989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.442429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.443232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.443642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.444076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.598758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:36.607506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-083a9b17-584a-444f-886c-448df52cf21c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1679 microversion: 2.1 time: 0.180480 Nov 02 12:44:36.608288 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3262/6494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:36 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:36.738742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:36.745810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:36.748404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.748897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.749352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.750076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:36.750535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:36.750961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:36.816239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c052b395-28bf-4eb7-ac8d-e8ce2d07ac25 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action" status: 200 len: 32630 microversion: 2.1 time: 0.084737 Nov 02 12:44:36.816919 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3233/6495] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:44:36 2022] POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action => generated 32630 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:44:37.017425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:37.018003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:37.026843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.027367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.027818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.028556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.029011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.029461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.078124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '843c91b28da945ffba5d395c29077ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405f770b963744ee9185b0a12e294708', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:37.078930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] flavor_id is None. Assuming migration. {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:44:37.079423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:44:37.628849 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9d46920f-d49d-4222-8143-fe75a7a6bbbd tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action" status: 202 len: 0 microversion: 2.1 time: 0.615063 Nov 02 12:44:37.629911 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3263/6496] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:44:37 2022] POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:44:37.644564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:37.647076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:37.661072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.661958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.662676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.664083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:37.665465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:37.666033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:37.828787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:37.840001 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-40c09d13-548e-4f1b-8625-d6c2c34fc2fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1688 microversion: 2.1 time: 0.203363 Nov 02 12:44:37.841058 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3234/6497] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:37 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:38.866572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:38.867396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:38.875585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.876162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.876614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:38.877353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:38.877812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:38.878244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:39.059396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:39.068087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06b62a91-0d7d-4641-8da7-ba206c8d6341 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1688 microversion: 2.1 time: 0.206138 Nov 02 12:44:39.068693 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3264/6498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:38 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:40.093758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:40.094666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:40.101616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:40.102184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:40.102822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:40.103582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:40.104041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:40.118195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:40.248411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:40.256629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cf746e9-964d-4af8-bcbd-0fedcbe91160 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1688 microversion: 2.1 time: 0.166977 Nov 02 12:44:40.259045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3235/6499] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:40 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:41.285624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:41.286700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:41.299705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.300567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.301247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.303175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:41.304273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:41.305987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:41.586220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:41.602195 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d6958cd-97e5-4308-905a-bd9f5d5c3975 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1688 microversion: 2.1 time: 0.323948 Nov 02 12:44:41.603460 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3265/6500] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:41 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1688 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:42.635457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:42.636302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:42.645624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:42.646127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:42.646587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.647377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:42.647840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:42.648282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:42.827815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:42.838847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34d0389b-192f-44f3-80a5-3da54ab31600 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.209660 Nov 02 12:44:42.839671 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3236/6501] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:42 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:43.867654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:43.868696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:43.877627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.878223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.878680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:43.879490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:43.879974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:43.880527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:44.078085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:44.086454 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a388f098-1b5c-4c88-aea0-5eaa5b6d7864 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.224832 Nov 02 12:44:44.098368 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3266/6502] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:43 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:45.114971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:45.116124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:45.129107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:45.129990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:45.130781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:45.132135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:45.133007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:45.134350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:45.323922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:45.332675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-81531256-73a4-4767-a5cb-5a43900fa3ba tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.225202 Nov 02 12:44:45.333285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3237/6503] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:45 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:46.362695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:46.363959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:46.376423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:46.377309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:46.378050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:46.379383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:46.380198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:46.380976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:46.625912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:46.635177 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67cf6f36-b293-4f94-bb98-8979778cb1d6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.279792 Nov 02 12:44:46.635770 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3267/6504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:46 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:47.660616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:47.661534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:47.669071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.669663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.670293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.671483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:47.671968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:47.672479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:47.841154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:47.850160 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6debddc7-8c26-40a0-9468-bf648f9b6ab8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.194066 Nov 02 12:44:47.850742 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3238/6505] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:47 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:48.876149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:48.877053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:48.886394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:48.887160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:48.887805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:48.888760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:48.889269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:48.889780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:49.151940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:49.165005 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-592a71c0-680f-4d8c-824a-b607cd5ce8d8 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.292630 Nov 02 12:44:49.165699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3268/6506] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:48 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:50.199413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:50.200543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:50.212628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.213496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.214479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:50.215604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:50.216252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:50.216749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:50.488945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:50.501484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a530fa47-829d-47e9-a6e3-79c4f70c214c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.310154 Nov 02 12:44:50.502099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3239/6507] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:50 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:51.525919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:51.526696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:51.536286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:51.536815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:51.537295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:51.538053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:51.538725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:51.539201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:51.715079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:51.729454 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fd06a08-6a07-4c37-b6d6-bc94ce2d86fd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.207586 Nov 02 12:44:51.730514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3269/6508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:51 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:52.770039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:52.770801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:52.779320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.779832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.780286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.781031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:52.781510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:52.781952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:52.958711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:52.970537 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37126fc2-0073-4fc9-830d-526646561a6a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.204568 Nov 02 12:44:52.971453 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3240/6509] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:52 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:54.004976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:54.009566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:54.014184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.014748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.015223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.015955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:54.016422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:54.016848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:54.188512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:54.199682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-755d8550-e474-4a3e-b41b-80150e7eb3c3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1693 microversion: 2.1 time: 0.199526 Nov 02 12:44:54.200459 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3270/6510] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:53 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1693 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:55.224692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "name": "network-vif-unplugged", "status": "completed", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:55.225749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:55.226481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:55.235288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.235794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.236243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.237182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.237959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.238406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.248780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:55.248780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:55.248780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:55.270051 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Creating event network-vif-unplugged:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h2-855649-4 Nov 02 12:44:55.282076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:44:55.302653 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-835963d8-6359-4391-9d29-d1e70fb35bb4 req-dfbfa8cc-1160-4b5c-a4c8-f734863cb984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085227 Nov 02 12:44:55.304039 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3241/6511] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:55.579104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:55.595609 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a13e025-bc56-4fc8-b2e0-3d9f6fbd9724 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1692 microversion: 2.1 time: 0.373396 Nov 02 12:44:55.596890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3271/6512] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:55 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1692 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:56.639904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:56.641140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:56.655044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:56.656455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:56.656728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:56.658014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:56.658872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:56.659824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:56.855786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:56.869899 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c70c8a6b-9fcb-4f53-b50a-bd5f14657254 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1692 microversion: 2.1 time: 0.239291 Nov 02 12:44:56.871016 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3242/6513] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:56 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1692 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:57.333817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:57.345635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.346107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.346538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.361051 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Creating event network-changed:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h2-855649-4 Nov 02 12:44:57.369530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:44:57.382064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c8844641-2c15-476e-b454-a271b853ba26 req-d8b389d9-5d85-4044-a4bf-90288f24e21a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052360 Nov 02 12:44:57.382703 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3272/6514] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:57.896085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:57.897152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:57.909538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.910362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.911313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:57.916387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:57.916387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:57.916387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:58.194638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:58.204213 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c0da3da-a792-4419-bcb9-bb101e7a48da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1690 microversion: 2.1 time: 0.313230 Nov 02 12:44:58.204761 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3243/6515] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:57 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1690 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:59.238610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:59.239861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:59.250674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:59.251574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:59.252358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:59.253798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:59.254403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:59.254916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:59.428436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:59.438206 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40aa51fe-29fd-4636-979e-211953350e83 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1690 microversion: 2.1 time: 0.207095 Nov 02 12:44:59.442900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3273/6516] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:59 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1690 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:00.468760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:00.469537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:00.478388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:00.479748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:00.479748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:00.480369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:00.480765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:00.481214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:01.113980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:01.132375 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58f492d0-1ce9-44f2-9531-036e4488a9e1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1690 microversion: 2.1 time: 0.668091 Nov 02 12:45:01.133511 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3244/6517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:00 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1690 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:02.175001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:02.175801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:02.184125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.191162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.191162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.191162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.191162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.191162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.357536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:02.366282 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c153b9d9-0921-4942-840b-166a1e71686e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1687 microversion: 2.1 time: 0.195513 Nov 02 12:45:02.367048 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3274/6518] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:02 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:02.390803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:02.391418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:02.399614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.400133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.400587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.401349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.401826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.402268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.656799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ad5ce8f-62ab-48fe-a50b-5dbe48f06ece tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action" status: 204 len: 0 microversion: 2.1 time: 0.269934 Nov 02 12:45:02.657685 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3245/6519] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:45:02 2022] POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:45:02.666440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:02.667157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:02.674006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.674498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.674944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.675761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:02.676230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:02.676666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:02.863219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:02.873428 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a021d122-edb1-4b10-96b5-fb7cc8c6870f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1687 microversion: 2.1 time: 0.211328 Nov 02 12:45:02.874284 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3275/6520] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:02 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1687 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:03.900922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:03.901808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:03.908818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:03.909328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:03.909819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:03.910667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:03.911184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:03.911621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:04.126681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:04.136739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94c3a355-15f3-4d73-907a-f817985c01b9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1687 microversion: 2.1 time: 0.241998 Nov 02 12:45:04.137490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3246/6521] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:03 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1687 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:04.744784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "name": "network-vif-plugged", "status": "completed", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:04.759325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:04.760191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:04.760691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:04.783922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] Creating event network-vif-plugged:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h2-855649-4 Nov 02 12:45:04.793618 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ff75fb88-4049-44b3-aea4-bcdb5d80ce33 req-fe449ba1-20a8-439f-88ff-0fef994e9dbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052933 Nov 02 12:45:04.794777 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3276/6522] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:05.165863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:05.168169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:05.181035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:05.181798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:05.182346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:05.183243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:05.183842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:05.184375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:05.379457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:05.391735 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5dbce5f5-bd34-4dc0-b2ea-b582109e9ec7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1679 microversion: 2.1 time: 0.233593 Nov 02 12:45:05.392719 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3247/6523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:45:05 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:39.737691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=34 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:39.738616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:39.739773 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:45:39.739956 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action (ip 10.222.0.48) !!! Nov 02 12:45:39.746087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:39.753152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:39.762329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:39.762910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:39.763440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:39.764397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:39.764983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:39.765605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:39.837906 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b105b1d-3c74-4fc1-8262-d023af2149f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action" status: 200 len: 24546 microversion: 2.1 time: 0.102192 Nov 02 12:45:39.838587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3277/6524] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:45:39 2022] POST /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5/action => generated 24546 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:46:02.561056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:02.561887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:02.564522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=32 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:02.565393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:02.567347 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 12:46:02.575963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.576559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.577086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.577885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:02.578601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:02.579391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:02.874019 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2eb9b46a-58d2-4c54-8a60-aee9d084de70 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1830 microversion: 2.1 time: 0.316955 Nov 02 12:46:02.875141 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3248/6525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:02 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1830 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:04.336277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.337123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:04.341313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:04.345022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:04.351034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.352157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.353225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.354612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.355499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.356441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.368994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.370390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.371330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.392788 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] Creating event network-changed:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h2-855649-4 Nov 02 12:46:04.404226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4675f906-9f3f-4a10-82b6-5d71c21279ef req-a1a158ab-3814-4b50-b61a-35042d2aac95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068484 Nov 02 12:46:04.404466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:46:04.405361 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3249/6526] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:46:04.789705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-042636a8-ee96-48e5-9705-04509110b4a7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 204 len: 0 microversion: 2.1 time: 0.458975 Nov 02 12:46:04.791100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3278/6527] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:46:04 2022] DELETE /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:04.808447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.809866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:04.826515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.831096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.833857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.839857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.841967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.843213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.075898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.091059 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67b111c0-f2d2-442e-9bf2-3c342a99d1ae tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1685 microversion: 2.1 time: 0.291663 Nov 02 12:46:05.092333 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3250/6528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1685 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:06.132279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:06.133020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:06.143265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.143765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.144639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.146733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.148088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.148554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.558931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:06.576209 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f221390c-a37b-48d7-94c2-a6333e636b47 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1685 microversion: 2.1 time: 0.449314 Nov 02 12:46:06.577582 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3279/6529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:06 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1685 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:07.387988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21da0fb-657f-4ae9-bcfa-ee0af64c50f5", "name": "network-vif-deleted", "tag": "4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:07.402171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.402479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.402846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.422951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] Creating event network-vif-deleted:4791b7d0-1b1e-4a13-89ae-1cb28a7c9f09 for instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 on n-h2-855649-4 Nov 02 12:46:07.432145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9bb8d0e6-01ba-44c5-b567-423f8f6ac024 req-15bff712-65d5-48d3-b768-792ba56f59ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047523 Nov 02 12:46:07.432925 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3251/6530] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:07.616648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:07.617494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:07.626377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.627065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.627773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.628769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:07.629630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:07.630366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.735973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.751847 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0db4b455-8237-4e21-abbf-cca6da63a8da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 200 len: 1350 microversion: 2.1 time: 0.139325 Nov 02 12:46:07.752964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3280/6531] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:07 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:08.798763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:08.800170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a21da0fb-657f-4ae9-bcfa-ee0af64c50f5] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:08.812631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.813537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.814295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.815619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.816464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.817243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.847485 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] HTTP exception thrown: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Request method failure captured: Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 HTTP/1.1 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmX0tasmeT_6n4o15ANbhi0WhsypHKC1pauXr79mi-ejEtCSpB9cjLK__f6mVQwaPvsjx7cce3qdS5Pzwm3xrePbwykCR2BSEqAaJPSYjURw6l8r3hv1Ec210eQKGoKAc_Cmksiuc_OH-IRw4qlzot-c0fAilSPB92DJr2e18Ikl3rU Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b097698897854b2585438068e3f7c2b0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b097698897854b2585438068e3f7c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ed9ce0baeed448b6b2655a90728abc40 Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a21da0fb-657f-4ae9-bcfa-ee0af64c50f5'} Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:46:08.850923 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Returning 404 to user: Instance a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66373bdb-119f-43d7-986a-dbb41736770e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5" status: 404 len: 111 microversion: 2.1 time: 0.065609 Nov 02 12:46:08.858484 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3252/6532] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:08 2022] GET /compute/v2.1/servers/a21da0fb-657f-4ae9-bcfa-ee0af64c50f5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:46:15.135724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-262913b8-508b-4d99-b30d-cf1acf40f38f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '.version_select at 0x7ff1b2618700>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:15.240250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-262913b8-508b-4d99-b30d-cf1acf40f38f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1571792887" status: 202 len: 0 microversion: 2.1 time: 0.117248 Nov 02 12:46:15.241632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3281/6533] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 12:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1571792887 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:15.286749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-82205336-5d0c-4fe8-8205-e58c80fe8b12 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: .version_select at 0x7ff1b28c6310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1908152233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsE8p8RxUS2HZHuRktiPThzMzFAIx9mdSFQHO9ZJ3PlNuJbWndkxD8H4bu77e7ssCkBC8ZwfB1owf25+dqpK7xLVQpciYaxl1ASM1pXdzJHLBwoQCXJHLnfiIMRnZnC2Q=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:15.314256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-82205336-5d0c-4fe8-8205-e58c80fe8b12 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:15.325541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-82205336-5d0c-4fe8-8205-e58c80fe8b12 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:15.475843 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-82205336-5d0c-4fe8-8205-e58c80fe8b12 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.192735 Nov 02 12:46:15.476545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3253/6534] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:46:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:27.602872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1033840759", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "fbd9085e-8407-443f-b8ee-540b78cf1999"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1908152233", "security_groups": [{"name": "tempest-secgroup-smoke-1574746355"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:27.616087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:27.619064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:27.846609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] validate_networks() for [('fbd9085e-8407-443f-b8ee-540b78cf1999', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:46:28.618376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:46:28.620272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:46:28.621035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:46:28.621746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:46:28.622788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:46:28.636276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.637104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.637767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.639048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.639723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.640606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.665307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:28.674068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:28.691686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:46:28.696198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:46:28.857205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db45c3ee-1e33-4ddb-88b5-bc9ee57eb677 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259932 Nov 02 12:46:28.858232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3282/6535] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:46:28.872910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2e5ab3a6-0756-4682-ab6b-5e080f62261b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:28.874996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2e5ab3a6-0756-4682-ab6b-5e080f62261b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:28.880349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:28.882261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:28.883304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:28.993944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2e5ab3a6-0756-4682-ab6b-5e080f62261b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:29.008768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2e5ab3a6-0756-4682-ab6b-5e080f62261b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1267 microversion: 2.1 time: 0.140312 Nov 02 12:46:29.010355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3254/6536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:28 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:30.050236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c5e6840-ff6a-4202-8b62-9148b4635370 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:30.051510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c5e6840-ff6a-4202-8b62-9148b4635370 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:30.156377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c5e6840-ff6a-4202-8b62-9148b4635370 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:30.171785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c5e6840-ff6a-4202-8b62-9148b4635370 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1267 microversion: 2.1 time: 0.130973 Nov 02 12:46:30.177080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3283/6537] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:30 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:31.210422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-06975435-2b22-43fe-b052-2b57f4d383f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.211539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-06975435-2b22-43fe-b052-2b57f4d383f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:31.298173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-06975435-2b22-43fe-b052-2b57f4d383f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.316402 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-06975435-2b22-43fe-b052-2b57f4d383f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1267 microversion: 2.1 time: 0.111992 Nov 02 12:46:31.319650 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3255/6538] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:32.341783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:32.342512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:32.350944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.351512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.351962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.352726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.353200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.353631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.423628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:32.432662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-adb7d85b-ff30-4412-8df8-8beb36d22c96 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1271 microversion: 2.1 time: 0.095134 Nov 02 12:46:32.433373 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3284/6539] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:32 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:33.457536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:33.458416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:33.466811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.467690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.468491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.471274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.471274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.471274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.557216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:33.572340 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cef1a2d-a3e6-4021-b2bb-14b7a79c279c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1319 microversion: 2.1 time: 0.118951 Nov 02 12:46:33.583463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3256/6540] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:33 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:34.604966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:34.606573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:34.619529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.620375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.621130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.643687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.643687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.643687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.737963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:34.752695 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc55e182-49d7-469b-a81b-aaee2ae66e53 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1325 microversion: 2.1 time: 0.151702 Nov 02 12:46:34.752695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3285/6541] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:34 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:35.794625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:35.795838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:35.808716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.809611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.810431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.811802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.812649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.813424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.139871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:36.151931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9a7d9cb-5896-4a46-a085-95726bd38253 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.365070 Nov 02 12:46:36.152564 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3257/6542] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:35 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:36.425488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:36.442499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:36.443226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:36.443791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:36.467172 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] Creating event network-changed:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:46:36.473360 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-407677c2-9b8f-4356-9cde-ba4814949179 req-36c9e97c-bc26-4ace-b033-6edac47dbdb7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052549 Nov 02 12:46:36.474908 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3286/6543] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:37.183825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:37.185134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:37.196858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.197514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.198021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:37.199686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.199686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.200189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:37.429840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.446298 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-99e76f55-cc31-49c7-8dc9-51d00d5dee72 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.269485 Nov 02 12:46:37.447484 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3258/6544] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:37 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:38.474450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.475237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:38.482262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.482751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.483228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.484177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.484653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.485236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.656171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:39.072437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.080955 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ecd0cd0-be11-4a6a-bd67-63109d7e1edd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.611881 Nov 02 12:46:39.082030 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3287/6545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:40.109278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:40.109278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.118524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.119404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.119913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.121205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.121983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.122463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.300462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.316029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-90067266-63f1-43bf-92a9-739dcb3ef837 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.213736 Nov 02 12:46:40.316029 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3259/6546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:40 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:41.346267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:41.347535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:41.353127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:41.362895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.363825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.364635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.366483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.367385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.368183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.528981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.538743 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d2e95c5-a627-4bb4-b597-15db3d205b59 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.199837 Nov 02 12:46:41.539665 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3288/6547] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:41 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:41.987467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:42.068818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-plugged", "status": "completed", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:42.079567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.080052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.080511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.096819 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] Creating event network-vif-plugged:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:46:42.104456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ccc4faeb-4551-4344-b835-976e4755874b req-96f313a2-45d3-4283-9692-5602e9c125c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123085 Nov 02 12:46:42.105424 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3260/6548] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:42.579880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:42.580807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:42.588221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.588708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.589153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.589869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.590328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.591063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.749318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:42.759264 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cc75077-b245-41cb-a2a0-81e8753bc891 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1393 microversion: 2.1 time: 0.183326 Nov 02 12:46:42.759683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3289/6549] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:42 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:43.785595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:43.786314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:43.793146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.793643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.794095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.794918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.795413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.795851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.956700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.965694 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d69c7aef-90d7-47b4-937c-5700ddbfa87e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1563 microversion: 2.1 time: 0.185719 Nov 02 12:46:43.966623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3261/6550] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:43 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:43.990146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:43.990851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:43.998840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:43.999371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:43.999818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.000545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.001009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.001440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.179721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.193787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-53b98678-6a4b-4c6e-b548-25c7a90777f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1563 microversion: 2.1 time: 0.207781 Nov 02 12:46:44.194852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3290/6551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:43 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1563 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:47.381956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:47.382751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:47.391500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.391785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:47.392399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.392624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.393666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.394510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.395303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.411182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.411949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.412749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.435775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] Creating event network-changed:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:46:47.446017 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ef5fa057-421f-4c9c-a9d5-4a5449898916 req-860dd6b8-8d81-44d3-9ec5-7adc10841384 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063928 Nov 02 12:46:47.447435 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3291/6552] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:47.808388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:47.820804 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76f00e63-5f50-459c-a1d0-1911ec4b28cd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1682 microversion: 2.1 time: 0.444142 Nov 02 12:46:47.821658 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3262/6553] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:47 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1682 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:08.304720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:08.306109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:08.314438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:08.319211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:08.329183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:08.329838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:08.330396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:08.331289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:08.331935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:08.332465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:08.398940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ec2c68e-5ae6-4fa6-ad4a-acadb6010a4b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action" status: 200 len: 24575 microversion: 2.1 time: 0.098016 Nov 02 12:47:08.400471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3292/6554] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:08 2022] POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action => generated 24575 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:47:19.408589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.409631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.413647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=22 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:19.414852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:19.424572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.434266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.434266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.434266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.434266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.434266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.660501 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86dff8aa-1d69-4439-a521-7142aa96fc8b tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1833 microversion: 2.1 time: 0.258276 Nov 02 12:47:19.661698 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3263/6555] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1833 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:19.703544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.704921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.721504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.722407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.723259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.725142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.725982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.726738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:19.941199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:19.956988 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de79a058-1862-41e2-8e81-7ddc348710c5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1682 microversion: 2.1 time: 0.260394 Nov 02 12:47:19.958602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3293/6556] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:20.150336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:20.154458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:20.166328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.167275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.168071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.169334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.170172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.170952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.247169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e68f0889-1bb3-40fe-929b-17ff8f68c93e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action" status: 200 len: 32645 microversion: 2.1 time: 0.104198 Nov 02 12:47:20.248204 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3264/6557] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:20 2022] POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action => generated 32645 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:47:20.443041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:20.443631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:20.451582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.452158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.452650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.453492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.453998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.454490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.504223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '843c91b28da945ffba5d395c29077ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405f770b963744ee9185b0a12e294708', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.505684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] flavor_id is None. Assuming migration. {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 12:47:20.506486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 12:47:20.878505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b752dd10-2237-4221-8240-f029ad6f6c41 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action" status: 202 len: 0 microversion: 2.1 time: 0.440081 Nov 02 12:47:20.880433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3294/6558] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:20 2022] POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:47:20.894893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:20.897016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:20.909439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.915350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.915350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.915350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.915350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.915350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:21.174329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:21.190728 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-75817533-337f-4972-b72e-3413bbf93a69 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1691 microversion: 2.1 time: 0.304121 Nov 02 12:47:21.192493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3265/6559] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:20 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:22.225269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:22.226377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:22.238444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.239904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.240732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.242174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.243116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.243915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.499505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.508891 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-843654fd-6f1e-445d-8ae8-675bb706cb5b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1691 microversion: 2.1 time: 0.292953 Nov 02 12:47:22.509491 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3295/6560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:22 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:23.534130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:23.538488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:23.544026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.544293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.544913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.545713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.546541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.547056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.738554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:23.754441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd4ad8a7-e693-4799-98c5-b8ac94d7ceef tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1691 microversion: 2.1 time: 0.224453 Nov 02 12:47:23.755633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3266/6561] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:23 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:24.797332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.798442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:24.807465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.811315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.811315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.811315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.811315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.811315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:25.004632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:25.015037 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-611f5daf-4cff-470b-b9a0-0a30e09b9eaf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1691 microversion: 2.1 time: 0.222859 Nov 02 12:47:25.015837 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3296/6562] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:24 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:26.055693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:26.056566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:26.066094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:26.066606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:26.067712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:26.068641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:26.069064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:26.069415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:26.439947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:26.448790 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14372616-116e-4cfa-bdf0-f15d55db8b31 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1691 microversion: 2.1 time: 0.398653 Nov 02 12:47:26.449406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3267/6563] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:26 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1691 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:27.475355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:27.475994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:27.483617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:27.484487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:27.485033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:27.485986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:27.486491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:27.487083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:27.651852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.661344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1efdd22-05fb-42e5-b095-91ab98106b9e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.189493 Nov 02 12:47:27.661960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3297/6564] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:27 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:28.686855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:28.687733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:28.696552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.697141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.697633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.698443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.699014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.699501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.901657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:28.911322 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc858436-05c2-46e7-819e-f54a8ac1d06f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.228821 Nov 02 12:47:28.912119 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3268/6565] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:28 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:29.943097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:29.944356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:29.957933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:29.959011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:29.959758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:29.961148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:29.962035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:29.962840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:30.185768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:30.195386 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7d802dc-8f99-4b07-80e9-07c8f99439c6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.260526 Nov 02 12:47:30.196000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3298/6566] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:29 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:31.220774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:31.221550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:31.230235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.230743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.231231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.231974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:31.232482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:31.232982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.434451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:31.443820 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8001bfc1-42b8-4536-ad28-9e7abf9d35e6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.227250 Nov 02 12:47:31.444492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3269/6567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:31 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:32.471821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:32.472871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:32.485583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.486405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.487172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:32.488307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.489034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.489731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:32.662228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.671355 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d611ff58-ca26-49f0-8213-25ad588b971e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.206373 Nov 02 12:47:32.672021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3299/6568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:32 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:33.699317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:33.700200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:33.709121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.709629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.710079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.710846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.711352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.711807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.905145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:33.914103 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ed2d7dda-5f13-4c56-9b4e-22bde520bb7b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.221098 Nov 02 12:47:33.914709 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3270/6569] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:33 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:34.940221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:34.940924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:34.950755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.951519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.952141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:34.953086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.953731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.954274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:35.111891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.121130 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6932dc5-dd2c-4ef1-a597-f706c5e0ffc9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.185098 Nov 02 12:47:35.128297 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3300/6570] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:34 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:36.146705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:36.147445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:36.154815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.155426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.156099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:36.157094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.157639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.158126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:36.321409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:36.329842 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4d8172f-b243-444d-8a8d-ab1f995e4b2a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.187728 Nov 02 12:47:36.330446 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3271/6571] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:36 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:37.357939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:37.359150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:37.370445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.371372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.372189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.373365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.374136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.374921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.568619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:37.577534 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdca47c3-d745-4b85-a09b-4087e4a8fe54 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.226560 Nov 02 12:47:37.578198 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3301/6572] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:37 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:38.603088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:38.603645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:38.610908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:38.611435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:38.611874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:38.612589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:38.613046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:38.613509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:38.776353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.792399 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d32c4cfa-8cbc-425a-a4f2-61f4a0a23d9a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1696 microversion: 2.1 time: 0.192989 Nov 02 12:47:38.793593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3272/6573] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:38 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:39.833884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:39.835020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:39.848307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.849178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.849953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.851274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.852092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.862619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:40.101774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:40.111836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5641884b-b719-41a3-943b-92bc88f3b2f3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1695 microversion: 2.1 time: 0.285626 Nov 02 12:47:40.112497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3302/6574] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:39 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1695 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:40.175597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-unplugged", "status": "completed", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:40.188053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:40.188772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:40.189341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:40.204798 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Creating event network-vif-unplugged:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h2-855649-4 Nov 02 12:47:40.212673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:47:40.227853 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6e62bc54-3e63-4f7f-a11c-43570f595aaa req-10b505ca-bd52-4fd6-b0c4-17e9e1a4050b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058378 Nov 02 12:47:40.228919 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3273/6575] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:47:41.147317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:41.148004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:41.155431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:41.155919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:41.156372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:41.157082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:41.157594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:41.158018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:41.455609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.465102 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-62e76e53-a1d6-457e-ac16-4a64d9a35a5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1695 microversion: 2.1 time: 0.323335 Nov 02 12:47:41.465852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3303/6576] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:41 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1695 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:42.247497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:42.258304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.258788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.259343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.273933 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Creating event network-changed:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h2-855649-4 Nov 02 12:47:42.280265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:47:42.293151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-27c39e66-d579-4994-a299-da5106833ae6 req-54ad462d-c31f-45c6-b46a-f1f2cba1bcee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050959 Nov 02 12:47:42.297417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3274/6577] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:42.510101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:42.511414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:42.525034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.532998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.532998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.532998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.532998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.532998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.809694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:42.818948 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-733bbb25-4063-47a5-9af4-6aa95a0544a5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1693 microversion: 2.1 time: 0.316285 Nov 02 12:47:42.819586 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3304/6578] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:42 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:43.842939 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:47:43.843549 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:47:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 (ip 10.222.0.48) !!! Nov 02 12:47:43.849893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:43.850614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:43.859170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:43.859654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:43.860093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:43.860833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:43.861286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:43.861717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.033513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:44.042271 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15a2f613-7a75-471d-8eaf-b3084152523f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1693 microversion: 2.1 time: 0.200241 Nov 02 12:47:44.042885 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3275/6579] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:43 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:45.074733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:45.075574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:45.083591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:45.084088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:45.084601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:45.085320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:45.085787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:45.086214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:45.310792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.319593 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37b475f7-9e2c-4563-a731-10d170c9b78b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1693 microversion: 2.1 time: 0.249302 Nov 02 12:47:45.320433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3305/6580] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:45 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:46.345336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:46.346061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.354197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.354691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.355169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.355898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.356358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.356788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.501386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:46.510207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c49aae5d-8ea5-4bf5-ad11-89820040914e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1690 microversion: 2.1 time: 0.168874 Nov 02 12:47:46.511035 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3276/6581] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:46 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:46.537623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:46.538591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.550541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.552117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.552857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.554128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.555126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.555828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.653952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:46.954613 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d3814fe-3c96-41da-913b-aa59be4f9d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action" status: 202 len: 0 microversion: 2.1 time: 0.424024 Nov 02 12:47:46.955537 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3306/6582] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:47:46 2022] POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:47:46.965189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:46.965887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.974090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.974728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.978745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.978745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.978745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.978745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:47.196346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.205030 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21f3a37d-3e93-4015-816b-18b749e073cf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.243782 Nov 02 12:47:47.210811 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3277/6583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:46 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:48.244351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:48.248312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:48.255311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.256145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.256627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.257421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.257888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.258322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.425511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:48.433835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aab592e2-8501-46c7-be97-9e28b1b61060 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.196861 Nov 02 12:47:48.434438 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3307/6584] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:48 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:49.457961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:49.463183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:49.465617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.466121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.466643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.467608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.468086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.468608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.587453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-plugged", "status": "completed", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:49.599939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.600416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.600853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.615643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Creating event network-vif-plugged:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h2-855649-4 Nov 02 12:47:49.622279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:47:49.634623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9b32ccf1-1ff2-4771-9b4e-3c8c9ff1ebbe req-c51b828d-71a4-40f6-849b-831228a2c621 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051244 Nov 02 12:47:49.635292 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3308/6585] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:49.659089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.662484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=89 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:49.669233 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fb602f03-f580-4ea9-a493-304d6538706f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.215795 Nov 02 12:47:49.669945 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3278/6586] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:49 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:50.697462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:50.698181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:50.700399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=41 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:50.705858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.708426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.708426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.708426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.708426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.708426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.987365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:50.995892 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47107f31-032e-4f45-a681-124ef13417ce tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.304555 Nov 02 12:47:50.996502 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3309/6587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:50 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:51.342923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-unplugged", "status": "completed", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:51.362180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:51.372608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:51.373497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:51.374610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:51.397848 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Creating event network-vif-unplugged:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:47:51.408270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:47:51.430472 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a5b5b44d-2395-4902-b25f-f8d28bdef887 req-2ea5b569-c8fe-4c87-842d-c0de6b9a1922 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093693 Nov 02 12:47:51.431213 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3279/6588] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:52.023052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:52.026247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:52.033573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:52.034205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:52.034821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:52.036901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:52.037515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:52.038086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:52.279804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.282756 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7620496a-2813-4243-9c71-83aa22ba7d65 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.265185 Nov 02 12:47:52.283408 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3310/6589] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:52 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:53.311722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:53.312844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:53.320150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.320645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.321092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.321927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.322393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.322898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.459605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:53.470233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.470715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.472320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.486024 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Creating event network-changed:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:47:53.492306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 12:47:53.505856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3941da97-8111-4f37-b1d9-6caa2633803f req-55711729-eaf3-4af6-8fd7-5cea50fe74c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050464 Nov 02 12:47:53.506862 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3311/6590] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:53.515544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:53.526641 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9cf306b-cd16-4bec-960a-26afdac3e424 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.221101 Nov 02 12:47:53.527661 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3280/6591] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:53 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:54.558468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:54.559800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:54.571104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:54.571957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:54.572766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:54.574184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:54.575045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:54.575745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:54.844572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.854809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-493ecba6-ef48-431c-a56d-a59942ce443f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1689 microversion: 2.1 time: 0.303637 Nov 02 12:47:54.867010 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3312/6592] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:54 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1689 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:55.879873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:55.880615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:55.887851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.888343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.888799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:55.889508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.889974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.890406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.055296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.063303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a3fe48f-876d-4fdf-9360-d1eb840eb38e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1682 microversion: 2.1 time: 0.187218 Nov 02 12:47:56.063920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3281/6593] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:47:55 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:56.472083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-plugged", "status": "completed", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:56.484603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.485101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.485604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.498869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] Creating event network-vif-plugged:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:47:56.505408 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5b6cfe6b-af56-4790-a4d7-7984c79d3e46 req-c76255d7-e3b5-4cdd-917a-58252273d43d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 Nov 02 12:47:56.506028 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3313/6594] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:20.266050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:20.268510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:20.271731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=5 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:20.272605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=17 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:20.277407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:20.277964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:20.278367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.279126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:20.279594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:20.280038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.339428 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-367870ca-cfd8-4fb1-b0d0-d090166e8c45 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action" status: 200 len: 63218 microversion: 2.1 time: 0.077101 Nov 02 12:48:20.340114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3282/6595] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:48:20 2022] POST /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7/action => generated 63218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:48:26.687233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:26.688029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:26.692710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:26.693422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:26.700374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:26.707272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:26.707272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:26.707272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:26.707272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:26.707272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:26.988342 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1d00369e-84ec-4d0b-b414-911809b21233 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1833 microversion: 2.1 time: 0.302773 Nov 02 12:48:26.988931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3314/6596] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:26 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1833 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:28.313918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:28.314507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:28.325354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.326668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.326937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.327745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.328520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.328953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.368734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:48:28.435409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:28.446081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.446563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.447095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.459580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] Creating event network-changed:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:48:28.465286 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6bf52bc5-f8cd-47c2-876d-fbc3d85b1fb3 req-5d2c44b5-d582-4b3e-a049-8d87c69013ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090543 Nov 02 12:48:28.465944 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3315/6597] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:28.692793 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d8bcd37e-9e47-41db-8bda-f13766fa6369 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 204 len: 0 microversion: 2.1 time: 0.383577 Nov 02 12:48:28.694203 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3283/6598] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:48:28 2022] DELETE /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:48:28.703198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:28.703943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:28.711120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.711637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.712066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.712794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:28.713249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:28.713682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:28.873460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:28.881701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2613ec7d-b27e-45f7-9ff8-d24a14268c86 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1688 microversion: 2.1 time: 0.182893 Nov 02 12:48:28.882384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3316/6599] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:28 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:29.906751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:29.907549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:29.919442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:29.919956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:29.920678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:29.921412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:29.921877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:29.922319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:30.366383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:30.375280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3f8c9529-1c42-4c40-b724-e7c527defceb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1688 microversion: 2.1 time: 0.472724 Nov 02 12:48:30.375909 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3284/6600] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:29 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1688 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:30.732705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99109a8c-a2d3-466f-8257-dcc4c3c879a7", "name": "network-vif-deleted", "tag": "f145d4bb-d54c-459a-bc26-31ca067092c8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:30.744273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:30.744752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:30.745189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:30.757180 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] Creating event network-vif-deleted:f145d4bb-d54c-459a-bc26-31ca067092c8 for instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 on n-h1-855649-4 Nov 02 12:48:30.762893 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6e74395d-b4af-4d11-8b9c-62eecba57477 req-3ec8ca61-2965-49af-ba04-ab3536f4e5dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 Nov 02 12:48:30.763870 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3317/6601] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:31.402086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:31.402718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:31.409801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.410301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.410753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.411505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.411974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.412415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.446275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:31.446773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:31.447783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:31.447783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lazy-loading 'fault' on Instance uuid 99109a8c-a2d3-466f-8257-dcc4c3c879a7 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:48:31.489799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:31.497773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1903653a-4047-45bd-8a43-add95a7135e3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 200 len: 1357 microversion: 2.1 time: 0.099859 Nov 02 12:48:31.498359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3285/6602] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:31 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:32.522696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:32.523417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 99109a8c-a2d3-466f-8257-dcc4c3c879a7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:32.530048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:32.530548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:32.531006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:32.531791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:32.532339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:32.532771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:32.549172 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] HTTP exception thrown: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Request method failure captured: Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 HTTP/1.1 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmX0tasmeT_6n4o15ANbhi0WhsypHKC1pauXr79mi-ejEtCSpB9cjLK__f6mVQwaPvsjx7cce3qdS5Pzwm3xrePbwykCR2BSEqAaJPSYjURw6l8r3hv1Ec210eQKGoKAc_Cmksiuc_OH-IRw4qlzot-c0fAilSPB92DJr2e18Ikl3rU Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b097698897854b2585438068e3f7c2b0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b097698897854b2585438068e3f7c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: ed9ce0baeed448b6b2655a90728abc40 Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '99109a8c-a2d3-466f-8257-dcc4c3c879a7'} Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:48:32.550943 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Returning 404 to user: Instance 99109a8c-a2d3-466f-8257-dcc4c3c879a7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a51ec098-d2c4-4bb4-985c-9eed234fcebe tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7" status: 404 len: 111 microversion: 2.1 time: 0.035305 Nov 02 12:48:32.555625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3318/6603] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:32 2022] GET /compute/v2.1/servers/99109a8c-a2d3-466f-8257-dcc4c3c879a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:48:36.571384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a64079f2-17fa-4a85-b391-a3731d233e2e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '.version_select at 0x7ff1b22265e0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:36.576120 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a64079f2-17fa-4a85-b391-a3731d233e2e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:48:37.586351 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-a64079f2-17fa-4a85-b391-a3731d233e2e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 47834. Nov 02 12:48:37.676154 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a64079f2-17fa-4a85-b391-a3731d233e2e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1908152233" status: 202 len: 0 microversion: 2.1 time: 1.108723 Nov 02 12:48:37.676743 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3286/6604] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 12:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1908152233 => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:37.715252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66f19f0a-842d-45de-a2d7-2259783b97f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: .version_select at 0x7ff1b2749b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2109115613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkZjr86FHCWviDuzBVbRoksm3gglTvF4u/U4BISQWrQqmAY3P2N5dEuKcw8iusMBtY6DhN0Vgr1TaZ3j7Cw96tGHMEkJTaWrzQ2G55KyPrqeW7PiJM630BHV9rQAgQ8Sw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:37.733592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-66f19f0a-842d-45de-a2d7-2259783b97f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:37.740451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-66f19f0a-842d-45de-a2d7-2259783b97f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:37.812678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66f19f0a-842d-45de-a2d7-2259783b97f9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.101468 Nov 02 12:48:37.813279 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3319/6605] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:48:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:47.838149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:47.839288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:47.846362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1120453197", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "09108466-f5e5-41bb-a2cd-c308239a975e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2109115613", "security_groups": [{"name": "tempest-secgroup-smoke-2054171821"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:47.989370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] validate_networks() for [('09108466-f5e5-41bb-a2cd-c308239a975e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:48.594854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:48:48.595336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:48:48.595831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:48:48.597450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:48:48.597907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:48:48.607355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.607856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.608308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.609056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:48.609522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:48.609963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:48.628245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:48.633900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:48.648059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:48:48.650622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:48:48.760396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aca032c4-c3bd-4187-bd68-256d1bf974f2 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.924003 Nov 02 12:48:48.761074 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3287/6606] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:48:48.780562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f213418-539a-4eee-ade9-49c2e650066e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:48.782072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f213418-539a-4eee-ade9-49c2e650066e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:48.785964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:48.787148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:48.787755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:48.857233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f213418-539a-4eee-ade9-49c2e650066e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:48.868525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f213418-539a-4eee-ade9-49c2e650066e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1267 microversion: 2.1 time: 0.093167 Nov 02 12:48:48.869357 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3320/6607] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:48 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:49.896826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-af82d2c9-31be-4e28-b1f4-0d71d047e473 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:49.897652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-af82d2c9-31be-4e28-b1f4-0d71d047e473 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:49.960478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-af82d2c9-31be-4e28-b1f4-0d71d047e473 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:49.968078 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-af82d2c9-31be-4e28-b1f4-0d71d047e473 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1267 microversion: 2.1 time: 0.076651 Nov 02 12:48:49.969552 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3288/6608] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:49 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:50.993135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:50.999604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:51.004495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.005001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.005451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.006243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:51.006679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:51.007167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:51.099537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:51.115710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d37da54-1449-4149-8d23-a4f69e2f9176 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1319 microversion: 2.1 time: 0.127186 Nov 02 12:48:51.117106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3321/6609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:50 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:52.142280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:52.143190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:52.150895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:52.151564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:52.152160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:52.153194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:52.153917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:52.154569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:52.346731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:52.355070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1d16dd8-8ec3-4dd5-b207-035216156820 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.216810 Nov 02 12:48:52.355671 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3289/6610] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:52 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:53.284676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:53.309819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.310377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.310820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.324133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] Creating event network-changed:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h1-855649-4 Nov 02 12:48:53.329938 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6f9be514-7a93-41b6-aac3-3d576c08ba08 req-ad0dc6e7-fd28-4bf2-97ca-d8c455d5d3a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053383 Nov 02 12:48:53.330821 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3322/6611] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:53.387920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:53.388556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:53.395936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.397001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.397001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.397729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:53.398304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:53.398649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:53.620495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:53.629593 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9dd2bd70-6661-4fb6-9e7f-c9088f1bd9a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.245737 Nov 02 12:48:53.643046 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3290/6612] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:53 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:54.655367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:54.656108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:54.663010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:54.663529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:54.663969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:54.664674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:54.665132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:54.665561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:54.808492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:54.817280 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8083cb1b-ceef-4854-8f52-70fd1e66c4d7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.166811 Nov 02 12:48:54.821991 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3323/6613] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:54 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:55.840275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:55.840834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:55.848334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:55.848824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:55.849271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:55.849992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:55.850448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:55.851201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:56.017314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:56.025972 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0791e7da-c906-422f-8000-ef525ec7e289 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.189637 Nov 02 12:48:56.027932 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3291/6614] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:55 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:57.049829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:57.050573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:57.057725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:57.058218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:57.058662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:57.059416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:57.060039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:57.060312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:57.226052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:57.235461 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff02ff8a-37dd-4914-903c-3874108bc1b5 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.189501 Nov 02 12:48:57.236055 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3324/6615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:57 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:58.261394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:58.262077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:58.269241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:58.269731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:58.270176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:58.271200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:58.271711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:58.272169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:58.447338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:58.457336 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e2814ac1-a85a-49c5-9fcf-0b70ac3559cc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.200516 Nov 02 12:48:58.457924 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3292/6616] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:58 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:48:59.487573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:59.488188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:59.495654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:59.496135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:59.496571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:59.497267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:59.497720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:59.498140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:59.652012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:59.663737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b65ed2bd-fe31-4d44-9df3-c8e40c02d54b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.180819 Nov 02 12:48:59.664358 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3325/6617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:48:59 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:00.691240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:00.695601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:00.695601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:00.696304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:00.701680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.702173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.702935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.704032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.704503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.705092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.757073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "name": "network-vif-plugged", "status": "completed", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:00.769133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:00.769744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:00.770298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:00.783004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] Creating event network-vif-plugged:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h1-855649-4 Nov 02 12:49:00.788642 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d2643eef-2536-4c85-838d-01b0933ed9bb req-ed9faa2a-aba1-499c-8ec7-a528171cc46d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091183 Nov 02 12:49:00.789548 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3326/6618] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:49:00.912932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:00.922676 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5024cc5-ae95-4d59-b0be-d4e78882f6ec tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.237691 Nov 02 12:49:00.923328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3293/6619] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:00 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:01.950002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:01.951804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:01.952950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:01.960246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:01.960815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:01.961326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:01.962001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:01.962466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:01.966104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:02.151245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:02.159484 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ed47726-061c-45f5-8158-c2392913a148 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1393 microversion: 2.1 time: 0.213920 Nov 02 12:49:02.160089 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3327/6620] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:01 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1393 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:03.198022 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.198598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.206360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.206838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.207327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.208081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.208555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.208995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.401361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:03.416264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89d09590-e59e-4628-b7d3-c7c09888a96c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1565 microversion: 2.1 time: 0.222609 Nov 02 12:49:03.420114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3294/6621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:03 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:03.446535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:03.447389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:03.454946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.455859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.456299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.457104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:03.457481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:03.457946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:03.607221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:03.616573 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4dded57-3074-4960-93e3-db79bdd5e550 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1565 microversion: 2.1 time: 0.174030 Nov 02 12:49:03.617197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3328/6622] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:03 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:06.567708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:06.569847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:06.572073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:06.584164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.585036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.585838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.588799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.590592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.592058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.594060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:06.595255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:06.596840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:06.614117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] Creating event network-changed:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h1-855649-4 Nov 02 12:49:06.623391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8f49911c-44cf-4cdc-a9cb-904e971db75e req-a7543ee5-f2ab-4506-a2b8-f926751085f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061437 Nov 02 12:49:06.632475 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3329/6623] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:49:06.964164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:06.974284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2f58b66-edf8-46c7-a14f-d519ab96623a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1565 microversion: 2.1 time: 0.418447 Nov 02 12:49:06.975335 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3295/6624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:06 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1565 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:26.330599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:26.331351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:26.335556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:26.337870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:26.344401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:26.346088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:26.346088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:26.346567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:26.347045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:26.347507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:26.401112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed194290-62ba-48ee-b821-bf9978fe71b1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action" status: 200 len: 24573 microversion: 2.1 time: 0.072108 Nov 02 12:49:26.401775 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3330/6625] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:26 2022] POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:49:37.411415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:37.412053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:37.414541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:37.415384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=44 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:37.421457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.422076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.422618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:37.424011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.424487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.424959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:37.575565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:37.585427 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c905bee4-13d7-41a1-8461-3ba3270d73d3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1684 microversion: 2.1 time: 0.178151 Nov 02 12:49:37.586055 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3296/6626] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:37 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:37.697383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:37.699818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:37.702849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:37.708419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.708908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.709354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:37.710470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.710613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.711073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:37.774058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11a60aee-94a1-4e77-a0b5-3df33d246c40 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action" status: 200 len: 32649 microversion: 2.1 time: 0.080993 Nov 02 12:49:37.774736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3331/6627] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:37 2022] POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action => generated 32649 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:49:37.945691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:37.950564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:37.958069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.958571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.959065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:37.959786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:37.960253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:37.960689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:38.101814 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f0efa4b-4b05-4795-997a-29de36ee9345 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1835 microversion: 2.1 time: 0.160615 Nov 02 12:49:38.102434 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3297/6628] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:37 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1835 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:38.134754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:38.137353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:38.146917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:38.147443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:38.147883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:38.148597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:38.149049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:38.149485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:38.180445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lazy-loading 'flavor' on Instance uuid 986579b0-4b69-476d-b9dd-3bce3eb5ceee {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:49:38.193970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Going to try to live migrate instance to another host {{(pid=127567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 12:49:41.870810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fa44a55-90fd-4eab-9fc9-7bab891c4399 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action" status: 202 len: 0 microversion: 2.1 time: 3.740240 Nov 02 12:49:41.871901 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3332/6629] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:49:38 2022] POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action => generated 0 bytes in 3742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:49:41.881826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:41.882702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:41.890879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.891416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.892507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:41.893234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:41.893700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:41.894133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:42.042526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:42.052833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ebb4165b-c43c-4220-a021-f4ec1861a7b6 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.175370 Nov 02 12:49:42.053439 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3298/6630] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:41 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:43.077984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:43.078642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:43.088380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:43.088886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:43.089337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:43.090055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:43.090558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:43.091005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:43.670129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:43.679505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e32958c-591b-4144-95db-c4f0c2523e3e tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.605489 Nov 02 12:49:43.680091 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3333/6631] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:43 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:43.987066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "name": "network-vif-unplugged", "status": "completed", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:43.997446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:43.997931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:43.998369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:44.014388 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] Creating event network-vif-unplugged:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h1-855649-4 Nov 02 12:49:44.021987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-13948c74-5928-4070-b117-f1b71802cc21 req-6f76859e-fe1c-472a-b709-9c396c59b71e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090976 Nov 02 12:49:44.023177 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3299/6632] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:44.705660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:44.711923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:44.714214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:44.714708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:44.715180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:44.715896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:44.716350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:44.716776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:44.870850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:44.880865 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6a0f16d-7a14-4d42-acf9-32a5c3a6b7ad tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.179574 Nov 02 12:49:44.887237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3334/6633] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:44 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:45.909658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:45.910409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:45.917288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:45.917784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:45.918232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:45.919248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:45.919974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:45.920405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:46.066144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:46.068493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:46.076719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7eb0a8b-1a24-46f0-a179-d2df75e94225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.172934 Nov 02 12:49:46.077215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:46.077335 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3300/6634] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:45 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:46.077706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:46.078141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:46.090843 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] Creating event network-changed:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h1-855649-4 Nov 02 12:49:46.095923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b10e6b10-6216-4a50-b85e-3660ea364179 req-9693969f-44ed-41e3-b2c1-9cf51bbf1be0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Nov 02 12:49:46.096813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3335/6635] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:49:47.102451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:47.103124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:47.110958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:47.111513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:47.111978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:47.112752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:47.113231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:47.113679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:47.267163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:47.275988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-08439b75-e8e4-4f3f-b589-81b8d9081c51 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.178067 Nov 02 12:49:47.276623 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3301/6636] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:47 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:48.304081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:48.305017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:48.314371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:48.314872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:48.315391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:48.316171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:48.316707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:48.317140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:48.461179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:48.469556 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a53856e-3140-418d-bd3c-d125427205bd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.172236 Nov 02 12:49:48.471928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3336/6637] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:48 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:49:49.495986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:49.496614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:49.504889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:49.511965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:49.511965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:49.511965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:49.511965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:49.511965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:49.652449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:49.660796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-988abd5d-97dc-4c3f-b881-cd854e172de3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.168841 Nov 02 12:49:49.661389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3302/6638] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:49 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:50.686545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:50.687246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:50.695287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:50.701629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:50.701629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:50.701629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:50.701629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:50.701629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:50.843101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:50.851551 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1071bd01-294f-41f2-ba07-15018dd373b7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.168876 Nov 02 12:49:50.852168 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3337/6639] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:50 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:51.875861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:51.877141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:51.884352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:51.884848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:51.885299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:51.886020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:51.886482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:51.887052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:52.040666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:52.049292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98a8f1fe-38bb-45b1-9ef2-45e05cf57143 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.177464 Nov 02 12:49:52.049894 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3303/6640] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:51 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:53.075206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:53.075971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:53.083964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:53.084466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:53.084924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:53.085639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:53.086105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:53.086539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:53.223984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:53.231844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79d19448-8432-4a6d-8285-18472f1ab3ff tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.161366 Nov 02 12:49:53.232422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3338/6641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:53 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:54.255586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:54.256113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:54.264072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:54.264561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:54.265043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:54.265753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:54.266212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:54.266748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:54.412749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:54.421386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-86c331bd-ed03-483b-8c1d-2c5ad99aa6f0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.169764 Nov 02 12:49:54.421994 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3304/6642] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:54 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:55.446279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:55.447874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:55.454567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:55.455114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:55.455558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:55.456283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:55.456752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:55.457182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:55.675898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:55.684949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f552450d-650d-4c26-8ac5-94ef11c15508 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.242538 Nov 02 12:49:55.685551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3339/6643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:55 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:56.710344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:56.711293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:56.723585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:56.724129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:56.724591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:56.725342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:56.725813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:56.726268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:56.937803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:56.946371 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d370298-55aa-4ea3-aed1-691b1b450e42 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1694 microversion: 2.1 time: 0.240534 Nov 02 12:49:56.947008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3305/6644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:56 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1694 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:57.974753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:57.975887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:57.984479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:57.989102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:57.989102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:57.989102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:57.989102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:57.989102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.191721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:58.204108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f0e5a7d3-50d0-44c8-8370-1e137f310edc tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1684 microversion: 2.1 time: 0.234094 Nov 02 12:49:58.208993 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3340/6645] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:57 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1684 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:58.253493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:58.253493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:58.259412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.260068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.260541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.261534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.262162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.262725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.481911 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68e418e9-a184-4a70-802e-2bc62f8df577 tempest-TestNetworkAdvancedServerOps-935284514 tempest-TestNetworkAdvancedServerOps-935284514-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1835 microversion: 2.1 time: 0.238581 Nov 02 12:49:58.482827 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3306/6646] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:58 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1835 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:49:58.527841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:58.528904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:49:58.540378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.541274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.542111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.543440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:58.544537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:58.545344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:58.714863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:49:58.724256 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f12c175-8884-430c-9588-368bbe38dd2f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1684 microversion: 2.1 time: 0.204088 Nov 02 12:49:58.724865 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3341/6647] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:49:58 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1684 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:00.845858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:00.848359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:00.856027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:00.856522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:00.856964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:00.857683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:00.858140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:00.858624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:00.916692 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da498997-1015-498b-a3bc-6b8fbd4086b3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action" status: 200 len: 38625 microversion: 2.1 time: 0.076046 Nov 02 12:50:00.917405 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3307/6648] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:50:00 2022] POST /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee/action => generated 38625 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:50:02.359233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:02.359845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:02.361398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:02.367589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:02.368887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:02.368887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:02.369980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:02.370569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:02.371151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:02.372364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:02.372856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:02.373293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:02.387502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] Creating event network-changed:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h2-855649-4 Nov 02 12:50:02.393361 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b91f4fa5-056f-4537-b468-831380727804 req-fe293e9a-ef27-49da-b198-8a756d74aff4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Nov 02 12:50:02.394180 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3308/6649] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:02.417797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:50:02.872999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-985e2d35-6758-4d68-ba7f-8f7064b85687 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 204 len: 0 microversion: 2.1 time: 0.518096 Nov 02 12:50:02.873993 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3342/6650] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:50:02 2022] DELETE /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:50:02.889923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:02.891231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:02.905802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:02.906691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:02.907661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:02.908939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:02.909901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:02.910712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:03.110174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:03.123395 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4431d24-be31-4f50-8ddc-b1910c2dd231 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1690 microversion: 2.1 time: 0.242405 Nov 02 12:50:03.124023 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3309/6651] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:02 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:04.152701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:04.153312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:04.163535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:04.169137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:04.169137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:04.169137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:04.169137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:04.169137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:04.261301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:04.270576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5021911-3595-4175-9926-92e7b0f80da9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1503 microversion: 2.1 time: 0.122404 Nov 02 12:50:04.286126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3343/6652] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:04 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1503 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:04.414096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986579b0-4b69-476d-b9dd-3bce3eb5ceee", "name": "network-vif-deleted", "tag": "58a6edfb-0f09-4f88-a6e8-aa667ef5fea2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:04.425521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:04.426010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:04.426453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:04.441749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] Creating event network-vif-deleted:58a6edfb-0f09-4f88-a6e8-aa667ef5fea2 for instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee on n-h2-855649-4 Nov 02 12:50:04.447461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-490d0cd7-f4d5-40f7-bdaa-c025aabd3310 req-2c997069-d283-432d-97d3-77a043827368 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037841 Nov 02 12:50:04.448092 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3310/6653] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:05.310025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:05.313382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:05.326531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:05.328462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:05.331997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:05.333017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:05.333533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:05.333976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:05.357724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:05.372737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:05.373485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:05.373933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:05.374672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lazy-loading 'fault' on Instance uuid 986579b0-4b69-476d-b9dd-3bce3eb5ceee {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:50:05.426603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:05.435871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5f62503-229d-4a80-8b02-14cdacfdcfd3 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 200 len: 1357 microversion: 2.1 time: 0.130285 Nov 02 12:50:05.436425 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3344/6654] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:05 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 1357 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:06.465128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:06.466028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: 986579b0-4b69-476d-b9dd-3bce3eb5ceee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:06.474051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:06.474563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:06.475261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:06.476048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:06.476539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:06.476989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:06.496663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] HTTP exception thrown: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Request method failure captured: Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee HTTP/1.1 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmX0tasmeT_6n4o15ANbhi0WhsypHKC1pauXr79mi-ejEtCSpB9cjLK__f6mVQwaPvsjx7cce3qdS5Pzwm3xrePbwykCR2BSEqAaJPSYjURw6l8r3hv1Ec210eQKGoKAc_Cmksiuc_OH-IRw4qlzot-c0fAilSPB92DJr2e18Ikl3rU Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b097698897854b2585438068e3f7c2b0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b097698897854b2585438068e3f7c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ed9ce0baeed448b6b2655a90728abc40 Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '986579b0-4b69-476d-b9dd-3bce3eb5ceee'} Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:50:06.498557 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Returning 404 to user: Instance 986579b0-4b69-476d-b9dd-3bce3eb5ceee could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1a4aff3d-4b45-4442-a7b2-c0c6a73715ac tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee" status: 404 len: 111 microversion: 2.1 time: 0.043304 Nov 02 12:50:06.506285 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3311/6655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:06 2022] GET /compute/v2.1/servers/986579b0-4b69-476d-b9dd-3bce3eb5ceee => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:50:11.256353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4034d28-6913-4ab8-8cf2-d9fe15f806d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '.version_select at 0x7ff1b26d5e50>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:11.265631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:11.376892 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4034d28-6913-4ab8-8cf2-d9fe15f806d4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2109115613" status: 202 len: 0 microversion: 2.1 time: 0.125555 Nov 02 12:50:11.377550 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3345/6656] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 12:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2109115613 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:50:11.420610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-256fcd3a-5fe4-4a72-a3c0-e507a66bddd9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: .version_select at 0x7ff1b28941f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1129319122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx7unvYqZxyaHrtQKGCNoojiwSj3SVZVpgekUDiy0OqCg/Wt5631gwqVZC2JCVm0Yx3nB+GIotFqFn4cRR1o3uVaMepYXy71b/Kq9/sU7hzmEhnTcRgTqWIZCmoOYq5Ew=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:11.432904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:11.457390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-256fcd3a-5fe4-4a72-a3c0-e507a66bddd9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:11.469576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-256fcd3a-5fe4-4a72-a3c0-e507a66bddd9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:11.628208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-256fcd3a-5fe4-4a72-a3c0-e507a66bddd9 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215465 Nov 02 12:50:11.628865 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3312/6657] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:50:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:22.373138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1582435086", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "d9f49eed-61a2-4f3c-b574-77c9b31ac558"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1129319122", "security_groups": [{"name": "tempest-secgroup-smoke-1591685859"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:22.513649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] validate_networks() for [('d9f49eed-61a2-4f3c-b574-77c9b31ac558', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:23.098661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:50:23.099128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:50:23.099599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:50:23.100042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:50:23.100471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:50:23.113740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.114237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.114685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:23.115497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:23.115966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:23.116420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:23.141356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:23.147217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Getting quotas for user ed9ce0baeed448b6b2655a90728abc40 and project b097698897854b2585438068e3f7c2b0. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:23.162162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:50:23.164841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:50:23.378669 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8aae2a86-463d-4095-9129-ce21d19b9cfa tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014242 Nov 02 12:50:23.383363 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3346/6658] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:50:23.388417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=78 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:23.389838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:23.395061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a17d53b-bc50-4727-8dbf-b73e4ac1e6cb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:23.396077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a17d53b-bc50-4727-8dbf-b73e4ac1e6cb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:23.482582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a17d53b-bc50-4727-8dbf-b73e4ac1e6cb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:23.492286 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a17d53b-bc50-4727-8dbf-b73e4ac1e6cb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1267 microversion: 2.1 time: 0.105241 Nov 02 12:50:23.493136 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3313/6659] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:23 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:24.518479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-149bd321-9d90-4f02-ab72-ce1628bb35c4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:24.519054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-149bd321-9d90-4f02-ab72-ce1628bb35c4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:24.581555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-149bd321-9d90-4f02-ab72-ce1628bb35c4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:24.589328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-149bd321-9d90-4f02-ab72-ce1628bb35c4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1267 microversion: 2.1 time: 0.076822 Nov 02 12:50:24.590120 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3347/6660] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:24 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:25.613408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.614026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:25.622138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.622709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.623079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:25.623783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:25.624240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:25.624669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:25.691603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:25.700795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-589993d1-0e58-4b10-849c-1bd8917a0643 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1319 microversion: 2.1 time: 0.092009 Nov 02 12:50:25.701390 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3314/6661] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:25 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:26.725390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:26.726932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:26.734689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:26.735580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:26.736118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:26.737392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:26.737887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:26.738304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:26.829773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:26.833534 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1ede7a6-5c98-4588-8db5-d084ac094d60 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1337 microversion: 2.1 time: 0.112435 Nov 02 12:50:26.834128 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3348/6662] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:26 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:27.857527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:27.858387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:27.865986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.866483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.866938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:27.867681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:27.868176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:27.868640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:28.092314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:28.101239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2e947d1-989a-4e4e-963f-aa564e9d43dd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.247666 Nov 02 12:50:28.102102 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3315/6663] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:27 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:28.316517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:28.327548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:28.328182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:28.328691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:28.342166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] Creating event network-changed:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:50:28.349375 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-31e21239-add9-465c-8910-90a26f42d3e6 req-b82ec838-2fa2-4204-bf61-3fd5f9381984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036535 Nov 02 12:50:28.350003 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3349/6664] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:29.125895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:29.126531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:29.134393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.134931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.135450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.136163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:29.136651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:29.137085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:29.276202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:29.284788 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2acf65d0-33e4-4cb6-88e0-e2bff3889071 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.162945 Nov 02 12:50:29.285388 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3316/6665] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:29 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:30.310907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:30.311653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:30.321335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:30.321966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:30.322613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:30.323504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:30.324053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:30.324571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:30.503254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:30.513542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-136a5176-6117-4e0b-9cef-060ba078678d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.207826 Nov 02 12:50:30.514530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3350/6666] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:30 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:31.539018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:31.539018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:31.546889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.547425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.547966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.548693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:31.549812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:31.550255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:31.691612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:31.700053 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d82e3c9b-b27e-4ea8-902a-9aa0b4c6d80a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.165419 Nov 02 12:50:31.700573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3317/6667] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:31 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:32.723514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:32.724134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:32.731174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.731664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.732101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:32.732836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:32.733283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:32.733712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:32.876209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:32.884431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06cabfec-4ae5-40cf-aebc-863fedebc3da tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.165413 Nov 02 12:50:32.885135 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3351/6668] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:32 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:33.910988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:33.911628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:33.919245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:33.919738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:33.920180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:33.920927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:33.921390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:33.922207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:34.066335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:34.074995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc853d47-3fbd-4eed-94e2-72a681cce588 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.168950 Nov 02 12:50:34.075591 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3318/6669] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:33 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:50:35.100021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:35.100847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:35.103073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:35.104378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:35.109900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:35.110375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:35.110823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:35.112154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:35.112616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:35.113049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:35.196384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "name": "network-vif-plugged", "status": "completed", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:35.214779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:35.215709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:35.216509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:35.243750 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] Creating event network-vif-plugged:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:50:35.252719 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e2047cbe-67e3-4754-8a7c-720a38b5c1a3 req-84bf1baa-c81f-4f5d-937b-eca9f3b90b9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061381 Nov 02 12:50:35.253854 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3319/6670] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:35.282515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:35.292326 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef72b7c2-6015-4c89-bbda-c0c74f589838 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.196637 Nov 02 12:50:35.292931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3352/6671] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:35 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:36.314437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:36.319895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:36.322767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:36.327896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.328421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.328865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.329579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:36.330632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:36.331094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:36.496073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:36.508332 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c3407ecc-7304-4b77-876e-78bc1156c8bf tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1393 microversion: 2.1 time: 0.194847 Nov 02 12:50:36.508970 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3320/6672] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:36 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:37.535529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:37.536227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:37.545213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.545716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.546162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.546923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.547429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.547870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.722311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:37.731113 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e9015d5-e6e4-4772-b96f-609a8cc79772 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1566 microversion: 2.1 time: 0.201090 Nov 02 12:50:37.731738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3353/6673] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:37 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:37.773538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:37.774282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:37.781916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.782411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.782853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.783650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:37.784109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:37.784538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:37.933607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:37.942965 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28b9ceb0-9aad-4e79-ab57-e78a5b92bb4c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1566 microversion: 2.1 time: 0.173419 Nov 02 12:50:37.943613 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3321/6674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:37 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:50:40.611904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:40.612566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:50:40.614704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:40.620714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:40.621247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:40.621701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:40.622465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:40.622944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:40.623591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:40.628649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:50:40.629306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:50:40.629986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:50:40.644389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] Creating event network-changed:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:50:40.650896 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-340ff2c2-81b0-4f06-9c82-51ac3e799dda req-b38f5dee-88d2-43c0-8d64-eb97a1ed6896 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041139 Nov 02 12:50:40.651630 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3322/6675] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:40.870127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:50:40.879984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93f59043-a97f-41ed-aeac-b82d1663152f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1566 microversion: 2.1 time: 0.272637 Nov 02 12:50:40.880843 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3354/6676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:40 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1566 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:02.144107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:02.144887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=46 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:02.149327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:02.151736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:02.158710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:02.159245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:02.159760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:02.160496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:02.160957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:02.161399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:02.216323 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e56cf1ed-f9e8-4fbd-8f94-4f7bbbf685a1 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action" status: 200 len: 24570 microversion: 2.1 time: 0.074825 Nov 02 12:51:02.217001 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3323/6677] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:51:02 2022] POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action => generated 24570 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:51:08.574120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:08.576988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:08.579033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:08.579707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:08.585288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:08.585780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:08.586221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:08.586928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:08.587419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:08.587852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:08.668909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:51:08.669339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:51:08.669830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:51:08.670250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:51:08.670671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:51:08.926403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:08.932639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:08.933129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:08.933568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:08.934282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:08.934737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:08.935200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:08.965327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ad0c953-f2dd-4024-89c2-4e5f20f4ef0b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action" status: 202 len: 1139 microversion: 2.1 time: 0.395553 Nov 02 12:51:08.966784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3355/6678] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:51:08 2022] POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action => generated 1139 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:51:08.988170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:08.989019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:08.997715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:08.998478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:08.998932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:08.999689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:09.000272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:09.000716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:09.153025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:09.161805 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65ac3a04-83b6-4b80-93bd-3354cb2a2336 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.179196 Nov 02 12:51:09.162406 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3324/6679] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:08 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:10.186525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:10.187178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:10.194871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:10.195386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:10.195829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:10.196531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:10.196987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:10.197420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:10.340451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:10.349099 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0da773ac-795b-4457-8e9c-e0f33bfd239b tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.166461 Nov 02 12:51:10.349694 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3356/6680] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:10 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:11.373784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:11.374396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:11.382050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.382473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.382936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.383652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:11.384178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:11.384611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:11.528217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:11.537030 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07f3b5f1-957d-471b-b8d9-1666f3ab9488 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.167176 Nov 02 12:51:11.537606 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3325/6681] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:11 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:12.562081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:12.562641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:12.570012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:12.570497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:12.570938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:12.571691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:12.572150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:12.572582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:12.705484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:12.714126 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9671749-d132-49f6-84f5-a506e4e202db tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.156233 Nov 02 12:51:12.714705 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3357/6682] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:12 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:13.737533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:13.738156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:13.745588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.746089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.746541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.747284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:13.747756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:13.748261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:13.890554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:13.898642 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02e4ad24-df52-45b6-ad9d-4dc20f37ba5c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.165087 Nov 02 12:51:13.899270 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3326/6683] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:13 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:14.922719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:14.923342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:14.930806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.931333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.931779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:14.932475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:14.932930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:14.933357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:15.068328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:15.076584 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e54f69e-ca64-4915-a798-d27c9d05b225 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.157776 Nov 02 12:51:15.082409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3358/6684] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:14 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:16.100339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:16.100877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:16.107754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:16.108241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:16.108710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:16.109420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:16.109872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:16.110300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:16.249127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:16.257527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42d40cd6-b8ac-406c-935e-f94c16277fdb tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.161232 Nov 02 12:51:16.258114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3327/6685] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:16 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:17.281290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:17.281910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:17.288841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.289344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.290341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:17.291225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:17.291860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:17.292303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:17.434738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:17.442603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b4a8382-04bb-47a0-ab02-914e7ada0533 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.165469 Nov 02 12:51:17.443206 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3359/6686] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:17 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:51:18.467506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:18.468133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:18.476685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:18.477176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:18.477622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:18.478345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:18.478808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:18.479279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:18.615896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:18.623971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0f4fd6a8-45a2-426a-baba-4dcac46e0dc0 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.160472 Nov 02 12:51:18.624552 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3328/6687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:18 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:19.648720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:19.649338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:19.656398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.656892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.657333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.658039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:19.658499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:19.658933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:19.796912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:19.804864 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e72c9df-4b80-46cc-a493-0336b5cc857d tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.160100 Nov 02 12:51:19.805508 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3360/6688] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:19 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:20.828669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:20.829324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:20.836644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.837129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.837573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:20.838273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:20.838728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:20.839187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:20.978161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:20.986104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a6d4ad0-9578-4de7-bbbf-c0a893304779 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1694 microversion: 2.1 time: 0.161509 Nov 02 12:51:20.986666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3329/6689] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:20 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:22.009293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:22.009913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:22.016842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.017368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.017820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.018524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:22.019005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:22.019449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:22.161320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:22.170062 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fd81d636-2b4d-46dd-9373-5e2182fed733 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1700 microversion: 2.1 time: 0.164813 Nov 02 12:51:22.170655 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3361/6690] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:22 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1700 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:23.194226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:23.194786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:23.201707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.202205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.202654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:23.203397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:23.203866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:23.204307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:23.337542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:23.345608 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91ada280-1ebc-439e-a2a0-0f699be5333c tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1700 microversion: 2.1 time: 0.155529 Nov 02 12:51:23.346193 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3330/6691] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:23 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:24.369991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:24.371161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:24.378115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:24.378642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:24.379112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:24.379820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:24.380279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:24.380710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:24.520467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:51:24.528398 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38610564-c518-4ca3-9c7d-3ff923aeaab4 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1685 microversion: 2.1 time: 0.162639 Nov 02 12:51:24.528976 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3362/6692] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:24 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:51:25.262000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "name": "network-vif-unplugged", "status": "completed", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:25.273321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:25.276234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:25.276234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:25.286905 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] Creating event network-vif-unplugged:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:51:25.295873 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f0850a36-a3e4-43db-9c78-7ccf1084161b req-18fd60ab-6eea-4bae-b5ce-be6bbff10e48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035397 Nov 02 12:51:25.296702 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3331/6693] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:27.313106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "name": "network-vif-plugged", "status": "completed", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:27.323858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:27.324353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:27.324831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:27.337138 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] Creating event network-vif-plugged:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:51:27.346066 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-80183dad-8aec-4a19-9bd4-f826ca58b404 req-1a4d7cd2-d1f2-4b42-948d-104aaf13e615 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Nov 02 12:51:27.346792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3363/6694] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:51:48.736216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:48.736986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=48 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:48.741193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:48.748380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:51:48.752697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.753184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.753631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.754332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:51:48.754781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:51:48.755237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:51:48.812920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5f6896b5-d1d8-47b6-85c0-55bb5ee9dc7f tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action" status: 200 len: 24557 microversion: 2.1 time: 0.078617 Nov 02 12:51:48.813589 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3332/6695] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:51:48 2022] POST /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0/action => generated 24557 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:52:01.266381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:01.267932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:01.270087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:01.272424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:01.273115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:01.276255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:01.281047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.281654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.282155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.283103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.283516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.284148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.284436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.285094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.285560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.299392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] Creating event network-changed:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:52:01.308453 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a0eaf069-fb98-4214-bc1a-4f7e5de181fe req-13a78abd-f0d6-4223-ab97-883b9b62ad7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042779 Nov 02 12:52:01.311527 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3333/6696] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:01.317209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:52:01.756114 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31c6ceba-4368-44eb-b5b0-bd73d6131c62 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 204 len: 0 microversion: 2.1 time: 0.492856 Nov 02 12:52:01.757114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3364/6697] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:52:01 2022] DELETE /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:52:01.767676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:01.768280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:01.775368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.775874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.776521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.777257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:01.777735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:01.778152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:01.929683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:01.937963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a37dd40-9b0b-4216-a959-a6a0244f770a tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1691 microversion: 2.1 time: 0.176143 Nov 02 12:52:01.938562 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3334/6698] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:01 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:02.962671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:02.963545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:02.971062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:02.971565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:02.972658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:02.973413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:02.973917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:02.974345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.132917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:03.141333 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c1046ae-bc6d-42db-838a-384210398583 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1691 microversion: 2.1 time: 0.182987 Nov 02 12:52:03.141936 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3365/6699] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:02 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:03.720191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90239ee-9418-4308-8e65-89750c5374d0", "name": "network-vif-deleted", "tag": "3ac75dae-a9fe-4dcc-8083-52f701e7eedd"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:03.731372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:03.739413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:03.739413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:03.744460 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] Creating event network-vif-deleted:3ac75dae-a9fe-4dcc-8083-52f701e7eedd for instance a90239ee-9418-4308-8e65-89750c5374d0 on n-h1-855649-4 Nov 02 12:52:03.750369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-528dae47-721f-44cb-9394-db6daa1c8968 req-07cddc59-dcb0-46f5-b99f-7cbda114dba2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Nov 02 12:52:03.751020 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3335/6700] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:04.168579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:04.169230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:04.176320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.182894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.182894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.182894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.182894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.182894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.210417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:04.210933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:04.211407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:04.211868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lazy-loading 'fault' on Instance uuid a90239ee-9418-4308-8e65-89750c5374d0 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:04.257520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed9ce0baeed448b6b2655a90728abc40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b097698897854b2585438068e3f7c2b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:04.266303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fcfce3b-1c89-41d0-90d5-b8a3b0012ee7 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 200 len: 1357 microversion: 2.1 time: 0.104053 Nov 02 12:52:04.266874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3366/6701] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:04 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:05.293614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:05.294675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] [instance: a90239ee-9418-4308-8e65-89750c5374d0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:05.301573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.301689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.302095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.302810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:05.303296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:05.303729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:05.318589 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] HTTP exception thrown: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Request method failure captured: Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 HTTP/1.1 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmX0tasmeT_6n4o15ANbhi0WhsypHKC1pauXr79mi-ejEtCSpB9cjLK__f6mVQwaPvsjx7cce3qdS5Pzwm3xrePbwykCR2BSEqAaJPSYjURw6l8r3hv1Ec210eQKGoKAc_Cmksiuc_OH-IRw4qlzot-c0fAilSPB92DJr2e18Ikl3rU Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b097698897854b2585438068e3f7c2b0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b097698897854b2585438068e3f7c2b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b097698897854b2585438068e3f7c2b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: b097698897854b2585438068e3f7c2b0 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1199085920 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: ed9ce0baeed448b6b2655a90728abc40 Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1199085920-project Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a90239ee-9418-4308-8e65-89750c5374d0'} Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:52:05.320318 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Returning 404 to user: Instance a90239ee-9418-4308-8e65-89750c5374d0 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-945112a8-f5bd-4f31-a4de-6ae77287affd tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0" status: 404 len: 111 microversion: 2.1 time: 0.035250 Nov 02 12:52:05.325023 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3336/6702] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:05 2022] GET /compute/v2.1/servers/a90239ee-9418-4308-8e65-89750c5374d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:52:09.761439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-65ee0964-906e-4e5c-b195-05de7c6f3681 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] Calling method '.version_select at 0x7ff1b2737160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:09.883492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-65ee0964-906e-4e5c-b195-05de7c6f3681 tempest-TestNetworkAdvancedServerOps-1199085920 tempest-TestNetworkAdvancedServerOps-1199085920-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1129319122" status: 202 len: 0 microversion: 2.1 time: 0.126228 Nov 02 12:52:09.884146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3367/6703] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 12:52:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1129319122 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:18.074858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:18.075725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:18.238444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-894218131", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "9dd9576c-fb52-4fd2-be9f-a4fe4acad148"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:18.310999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] validate_networks() for [('9dd9576c-fb52-4fd2-be9f-a4fe4acad148', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:52:18.857187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:52:18.857617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:52:18.858107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:52:18.858522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:52:18.858943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:52:18.868400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.868894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.869341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:18.870078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:18.870561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:18.871023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:18.892782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Getting quotas for project fbae4bd2e0dd4aedbef9b42d39ec60f4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:52:18.898226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Getting quotas for user afd1c1159bad4e1eafb8f5e6908cc308 and project fbae4bd2e0dd4aedbef9b42d39ec60f4. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:52:18.912740 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:52:18.915276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:52:19.080519 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2385eb60-df35-4e2e-9507-2654b0184bef tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011819 Nov 02 12:52:19.081587 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3337/6704] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:52:19.097675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bbe87af9-8fd6-40d2-b875-116f068b6cfa tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:19.098733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bbe87af9-8fd6-40d2-b875-116f068b6cfa tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:19.106789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:19.170053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bbe87af9-8fd6-40d2-b875-116f068b6cfa tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:19.177404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bbe87af9-8fd6-40d2-b875-116f068b6cfa tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1214 microversion: 2.1 time: 0.086836 Nov 02 12:52:19.183208 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3368/6705] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:19 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:20.201378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b776f31-5e8f-4216-8f4e-c8b4c700358c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:20.202091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b776f31-5e8f-4216-8f4e-c8b4c700358c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:20.261994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8b776f31-5e8f-4216-8f4e-c8b4c700358c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:20.269568 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b776f31-5e8f-4216-8f4e-c8b4c700358c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1214 microversion: 2.1 time: 0.072839 Nov 02 12:52:20.273903 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3338/6706] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:20 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:21.294386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:21.295740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:21.304733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.305232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.305681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.306394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:21.306859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:21.307321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:21.376519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:21.384601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a054c142-4a68-4ac1-9882-5c0823fc9da2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1210 microversion: 2.1 time: 0.095513 Nov 02 12:52:21.385243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3369/6707] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:21 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:22.408914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:22.409542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:22.417144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:22.418437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:22.418869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:22.419637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:22.420103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:22.420541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:22.493017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:22.502274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8aeddeb5-eea9-4fac-ae18-96c32fd97e76 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1274 microversion: 2.1 time: 0.097580 Nov 02 12:52:22.503158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3339/6708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:22 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:23.539799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:23.540562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:23.549737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.550239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.564215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.564215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:23.564215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:23.564215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:23.750412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:23.758697 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e0a2736-f1f3-45dc-a916-bb1ac274734e tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.222807 Nov 02 12:52:23.759370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3370/6709] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:23 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:24.310644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ece257b-457f-454e-9078-680b1b10e16d", "tag": "e3433d12-b3c9-415f-8f31-780869cc4133"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:24.322182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.322781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.323253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.335159 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] Creating event network-changed:e3433d12-b3c9-415f-8f31-780869cc4133 for instance 4ece257b-457f-454e-9078-680b1b10e16d on n-h1-855649-4 Nov 02 12:52:24.344565 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-70288b6c-21c5-4e11-b810-4d3d604ca8ad req-776be5d3-f38a-460f-bde3-9c0a12e1a6c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037878 Nov 02 12:52:24.345421 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3340/6710] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:24.795556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:24.796245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:24.803168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.803641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.804086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:24.804799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:24.805260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:24.805689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:25.077056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:25.085049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cc42ee6-8350-46a0-b9f1-cb30b20380f0 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.293671 Nov 02 12:52:25.086098 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3371/6711] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:24 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:26.110608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:26.111339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:26.118510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.119025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.119474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.120179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:26.120639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:26.121069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:26.273019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:26.282024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9b25750-3e34-4326-80fa-0c706c8ce890 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.176210 Nov 02 12:52:26.282683 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3341/6712] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:26 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:27.307798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:27.308442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:27.316044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.316542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.316986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:27.317692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:27.318155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:27.318581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:27.464661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:27.473223 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82f899f3-6833-4f15-b4d1-144f7233a2a3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.169358 Nov 02 12:52:27.473969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3372/6713] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:27 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:28.497331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:28.497870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:28.504939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:28.505432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:28.505879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:28.506585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:28.507072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:28.507729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:28.642511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:28.650330 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4491c3f8-b454-4713-a3f7-20708a101fd6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.157043 Nov 02 12:52:28.650901 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3342/6714] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:28 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:29.674690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:29.675377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:29.678233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:29.683296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.683787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.684227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.685178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:29.685638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:29.686068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:29.829672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:29.836073 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-27621c74-8d0c-4da6-99cc-ee7d58f4c3b6 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.165620 Nov 02 12:52:29.836688 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3373/6715] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:29 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:30.860403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:30.861093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:30.863193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:30.864773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:30.869913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:30.870404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:30.870850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:30.879348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:30.879348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:30.879348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.014962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:31.022882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e817f00e-cf4d-458f-8db4-85a2b756d3b2 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.167096 Nov 02 12:52:31.023486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3343/6716] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:30 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:31.649577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ece257b-457f-454e-9078-680b1b10e16d", "name": "network-vif-plugged", "status": "completed", "tag": "e3433d12-b3c9-415f-8f31-780869cc4133"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:31.655175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:31.660348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:31.660824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:31.661256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:31.672838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] Creating event network-vif-plugged:e3433d12-b3c9-415f-8f31-780869cc4133 for instance 4ece257b-457f-454e-9078-680b1b10e16d on n-h1-855649-4 Nov 02 12:52:31.677999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7001c972-8ac5-49fb-964a-33ce02384965 req-3b91be8a-17fc-402b-a9f6-6144319f396b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032369 Nov 02 12:52:31.678796 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3374/6717] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:52:32.048165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:32.048716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:32.057437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:32.057937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:32.058387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:32.059220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:32.059628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:32.060721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:32.203523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:32.212073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33a307f1-8d58-4cdc-853a-1026932b91c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1314 microversion: 2.1 time: 0.169382 Nov 02 12:52:32.212682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3344/6718] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:32 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:33.236136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:33.236847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.244966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.246970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.246970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.246970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.247809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.248185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.390998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:33.398960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ec24ee4-a381-420f-b712-37e575d981bd tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1501 microversion: 2.1 time: 0.167873 Nov 02 12:52:33.399577 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3375/6719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:33.422035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:33.422687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.429863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.430364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.430809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.431551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.432021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.432455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.568995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:33.577003 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68975e14-d595-43a6-be0a-feea75cba35d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1501 microversion: 2.1 time: 0.159799 Nov 02 12:52:33.577590 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3345/6720] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:33.600225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:33.600761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.607676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.608061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.608507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.609205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.609663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.610123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.633664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lazy-loading 'flavor' on Instance uuid 4ece257b-457f-454e-9078-680b1b10e16d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:33.971736 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d385378-7d66-49fd-abb9-09b52065e67f tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action" status: 202 len: 0 microversion: 2.1 time: 0.375588 Nov 02 12:52:33.972408 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3376/6721] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:33 2022] POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:33.980701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:33.981333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:33.987428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.987917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.988356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:33.989062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:33.989523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:33.989954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:34.127467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:34.135678 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c247b224-086e-4500-863d-114b082d69ad tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1509 microversion: 2.1 time: 0.158840 Nov 02 12:52:34.136265 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3346/6722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:33 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:35.161702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:35.162406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:35.169344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.169860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.170347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.171136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.171590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.172017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.312288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:35.320159 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-51f52b36-a390-4083-8940-2373c660b202 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1492 microversion: 2.1 time: 0.163776 Nov 02 12:52:35.330541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3377/6723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:35 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1492 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:35.351380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:35.351931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:35.359031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.359536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.359983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.360708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.361170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.361600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.703501 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e4f479ef-97b5-4215-b661-7f7f8fbd0828 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action" status: 202 len: 0 microversion: 2.1 time: 0.355932 Nov 02 12:52:35.704236 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3347/6724] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:35 2022] POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:52:35.712758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:35.714859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:35.719774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.720308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.720757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.721466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:35.721922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:35.722352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:35.857589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:35.867464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9755824b-da36-43ae-97bf-74f0c0486404 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1498 microversion: 2.1 time: 0.157178 Nov 02 12:52:35.868188 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3378/6725] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:35 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:36.893245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:36.893938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:36.900292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.900772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.901209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:36.901908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:36.902358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:36.902782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:37.040675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:37.048763 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-09014eb3-b620-48ec-acb0-b3ddd83148c1 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1498 microversion: 2.1 time: 0.161386 Nov 02 12:52:37.049339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3348/6726] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:36 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:38.074118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.074747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:38.082487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.083014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.083454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.084168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.084628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.085158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.233863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:38.242216 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b208ab76-63c0-4725-bd4d-4a89f65f3563 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1501 microversion: 2.1 time: 0.172035 Nov 02 12:52:38.242818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3379/6727] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:38.268924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:38.269547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:38.276825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.277314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.277752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.279159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.279776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.280223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.313201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lazy-loading 'flavor' on Instance uuid 4ece257b-457f-454e-9078-680b1b10e16d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:38.811987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77f37ba0-0a5c-44b7-9564-0a059790fc45 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action" status: 202 len: 0 microversion: 2.1 time: 0.547678 Nov 02 12:52:38.812679 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3349/6728] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:38 2022] POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:52:38.820989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:38.821604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:38.828103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.828569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.829004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.829706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:38.830158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:38.830583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:38.967726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:38.975868 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-322b61de-0c70-4e31-bda6-9f2191e64b4d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1509 microversion: 2.1 time: 0.158915 Nov 02 12:52:38.976448 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3380/6729] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:38 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:40.001519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:40.002222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:40.008717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.009203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.009646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.010352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.010814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.011263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.161313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:40.176481 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5c6928e2-5af8-44f0-b633-ccc104b0d574 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1492 microversion: 2.1 time: 0.180195 Nov 02 12:52:40.177569 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3350/6730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:39 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1492 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:40.221968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:40.222881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:40.235649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.236529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.237337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.238613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.239502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.240277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.578100 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d53a66f-d40f-4837-b836-0346a3ab02d4 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action" status: 202 len: 0 microversion: 2.1 time: 0.363621 Nov 02 12:52:40.578845 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3381/6731] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:52:40 2022] POST /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:52:40.588762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:40.589612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:40.597953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.598602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.599306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.600215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:40.600782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:40.601322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:40.759304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:40.771989 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4710820-4406-47e7-8239-da98819497de tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1498 microversion: 2.1 time: 0.187812 Nov 02 12:52:40.773009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3351/6732] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:40 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:41.813426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:41.814210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:41.820536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:41.821033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:41.821473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:41.822238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:41.822693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:41.823160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:41.963533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:41.972779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45da7384-407b-42d2-bf3c-3046b9da8b81 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1498 microversion: 2.1 time: 0.164636 Nov 02 12:52:41.973417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3382/6733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:41 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:42.996731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:42.997363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:43.004668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.005158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.005628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.006339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.006802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.007275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.139036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:43.146971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0e7ed28-35b8-456b-815e-d1b4ec3c4741 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1501 microversion: 2.1 time: 0.154310 Nov 02 12:52:43.147604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3352/6734] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:42 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:43.170338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.170906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:43.177648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.178139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.178589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.179403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.179834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.180305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.198377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:43.207094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:52:43.710180 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-768cdec4-3563-4df4-b072-bf5b2fc9d0f3 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 204 len: 0 microversion: 2.1 time: 0.543683 Nov 02 12:52:43.710811 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3383/6735] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:52:43 2022] DELETE /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:52:43.719197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:43.719828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:43.725990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.726478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.726926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.727658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:43.728125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:43.728558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:43.732832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:43.866116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:43.875200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-773aeab1-2d49-4ee4-b18a-1f1379c63b6d tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1507 microversion: 2.1 time: 0.160038 Nov 02 12:52:43.875780 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3353/6736] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:43 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:44.899674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:44.900379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:44.908027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.908510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.908947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:44.909645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:44.910094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:44.910521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:45.045269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:45.053498 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40c0f9bc-10bd-4858-8260-709549fe8e9c tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1507 microversion: 2.1 time: 0.158144 Nov 02 12:52:45.054080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3384/6737] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:44 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:46.078028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:46.079655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:46.086701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:46.087152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:46.087603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:46.088334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:46.088781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:46.089218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:46.425312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:46.433623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c8e7fee-abd4-4c57-a502-d328908fbe85 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1465 microversion: 2.1 time: 0.360061 Nov 02 12:52:46.434211 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3354/6738] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:46 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1465 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:52:46.436768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ece257b-457f-454e-9078-680b1b10e16d", "name": "network-vif-deleted", "tag": "e3433d12-b3c9-415f-8f31-780869cc4133"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:46.446916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:46.447455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:46.447916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:46.460227 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] Creating event network-vif-deleted:e3433d12-b3c9-415f-8f31-780869cc4133 for instance 4ece257b-457f-454e-9078-680b1b10e16d on n-h1-855649-4 Nov 02 12:52:46.466691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2436e511-dd9c-4cd4-9cd7-642ef96da302 req-7334bc1a-7702-4b05-a52a-88c129bde2fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Nov 02 12:52:46.468023 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3385/6739] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:47.457590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:47.458228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:47.465198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.465690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.466643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.467382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.467847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.468280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.501579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:47.502155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:47.502603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:47.503125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lazy-loading 'fault' on Instance uuid 4ece257b-457f-454e-9078-680b1b10e16d {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:52:47.548221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afd1c1159bad4e1eafb8f5e6908cc308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbae4bd2e0dd4aedbef9b42d39ec60f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:52:47.556724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6edf852b-790d-4ca4-9c84-9ba5fef181df tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 200 len: 1304 microversion: 2.1 time: 0.103175 Nov 02 12:52:47.563153 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3355/6740] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:47 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:52:48.581062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:48.581673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] [instance: 4ece257b-457f-454e-9078-680b1b10e16d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:52:48.588838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:48.589323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:48.589768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:48.590464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:52:48.590921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:52:48.591369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:52:48.605011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] HTTP exception thrown: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Request method failure captured: Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d HTTP/1.1 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmf_rADACEgo3j2hq5O9gjWv4eyKIoKSCoG7Z6vMiUUGPd9W9a0Zb1cYWX88orhKnm5gsBf6Ewxo0grU8XrXQNxWVegeN5NzE6fxwUipIerJD1pxhHlVzH-aPbpa-6j6dnU-_sORod_ZeO77wJF3lwg-Y-ZHxCEM_aFbweF66qxCGsM Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: fbae4bd2e0dd4aedbef9b42d39ec60f4 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestServerAdvancedOps-485291528 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbae4bd2e0dd4aedbef9b42d39ec60f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fbae4bd2e0dd4aedbef9b42d39ec60f4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fbae4bd2e0dd4aedbef9b42d39ec60f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbae4bd2e0dd4aedbef9b42d39ec60f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestServerAdvancedOps-485291528 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: fbae4bd2e0dd4aedbef9b42d39ec60f4 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestServerAdvancedOps-485291528 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestServerAdvancedOps-485291528-project Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: afd1c1159bad4e1eafb8f5e6908cc308 Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestServerAdvancedOps-485291528-project Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '4ece257b-457f-454e-9078-680b1b10e16d'} Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:48.607175 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] Returning 404 to user: Instance 4ece257b-457f-454e-9078-680b1b10e16d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d8a5ddf-ad34-46b7-a492-ae86125c0b55 tempest-TestServerAdvancedOps-485291528 tempest-TestServerAdvancedOps-485291528-project] 10.222.0.48 "GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d" status: 404 len: 111 microversion: 2.1 time: 0.031913 Nov 02 12:52:48.611239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3386/6741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:52:48 2022] GET /compute/v2.1/servers/4ece257b-457f-454e-9078-680b1b10e16d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:11.380457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1053036042", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8c69d66b-325f-4cb2-87ec-25e910511798", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:11.390752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:11.391435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:11.392388 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:53:11.392537 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:53:11.450844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:53:11.836018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:53:11.836446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:53:11.836922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:53:11.837333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:53:11.837753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:53:11.847621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:11.848106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:11.848543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:11.849271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:11.849726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:11.850161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:11.866821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:53:11.872023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:53:11.931668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:53:11.933840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c69d66b-325f-4cb2-87ec-25e910511798',volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:53:12.461906 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-220cab39-1ebd-4b37-b9cd-9c819efeee9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085433 Nov 02 12:53:12.462911 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3356/6742] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:53:12.474041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-389e331a-c72e-4c44-b0fc-0eeb44debc9b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:12.474662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-389e331a-c72e-4c44-b0fc-0eeb44debc9b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:12.477203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:12.477857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:12.552308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-389e331a-c72e-4c44-b0fc-0eeb44debc9b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:12.570707 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-389e331a-c72e-4c44-b0fc-0eeb44debc9b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1057 microversion: 2.1 time: 0.093549 Nov 02 12:53:12.570707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3387/6743] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:12 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1057 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:13.588616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e032d603-2360-45de-8ea4-de35d1c1c248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:13.589763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e032d603-2360-45de-8ea4-de35d1c1c248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:13.645907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e032d603-2360-45de-8ea4-de35d1c1c248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:13.654000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e032d603-2360-45de-8ea4-de35d1c1c248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1057 microversion: 2.1 time: 0.070290 Nov 02 12:53:13.654618 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3357/6744] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:13 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1057 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:14.676577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d6a66dfb-281a-488b-a43c-de663295aea7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:14.677195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d6a66dfb-281a-488b-a43c-de663295aea7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:14.734155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d6a66dfb-281a-488b-a43c-de663295aea7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:14.741662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d6a66dfb-281a-488b-a43c-de663295aea7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1057 microversion: 2.1 time: 0.068923 Nov 02 12:53:14.742208 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3388/6745] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:14 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1057 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:15.764289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:15.765537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:15.773123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.773608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.774049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.774746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:15.775231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:15.775682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:15.840325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:15.848975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b37d53d-fa58-4b38-9a28-ed53cc7de752 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1107 microversion: 2.1 time: 0.088651 Nov 02 12:53:15.849561 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3358/6746] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:15 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1107 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:16.872473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:16.873223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:16.885851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:16.886746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:16.887570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:16.888986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:16.889542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:16.890119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:16.954670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:16.962603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1625e65-2528-49f6-bef2-9b5a14bada40 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1107 microversion: 2.1 time: 0.094686 Nov 02 12:53:16.963207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3389/6747] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:16 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1107 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:17.986595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:17.987201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:17.995921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.996422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.996879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:17.997626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:17.998117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:17.998548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:18.071826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:18.079971 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20b6a9a9-be75-4c66-be71-3fa4572ad843 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1155 microversion: 2.1 time: 0.098035 Nov 02 12:53:18.080573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3359/6748] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:17 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1155 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:19.104997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:19.107831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:19.114522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.115351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.115897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.116720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:19.119567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:19.120266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:19.341307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:19.351226 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3ea9f9b-3c03-494d-a075-d4f5687e4021 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1215 microversion: 2.1 time: 0.250732 Nov 02 12:53:19.351968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3390/6749] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:19 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:20.167824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8def96a-ff23-43c5-a978-21fc16779223", "tag": "5d54b73a-116a-4792-a941-0529012bce03"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:20.178204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:20.178890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:20.179372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:20.191940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] Creating event network-changed:5d54b73a-116a-4792-a941-0529012bce03 for instance d8def96a-ff23-43c5-a978-21fc16779223 on n-h1-855649-4 Nov 02 12:53:20.198075 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6037e880-8f3c-44c2-a9b5-195fb2694c40 req-59c4d351-c9d7-46ac-ac5d-395814d8a733 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034532 Nov 02 12:53:20.199202 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3360/6750] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:20.376720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:20.377366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:20.384039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:20.384790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:20.385245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:20.385981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:20.386449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:20.386879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:20.615558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:20.624817 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78ff5b43-fcfb-4824-b61f-fdd1658ba9a9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1215 microversion: 2.1 time: 0.252158 Nov 02 12:53:20.625709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3391/6751] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:20 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:21.650183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:21.650927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:21.658015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:21.658501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:21.658944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:21.659665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:21.660119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:21.660549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:21.799314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:21.807392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fcc03cce-1340-4cd7-bf54-b9ca61a855c2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1215 microversion: 2.1 time: 0.161453 Nov 02 12:53:21.808107 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3361/6752] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:21 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:22.830997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:22.831887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:22.841423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.841991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.842358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.843109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:22.843543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:22.843969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:22.980601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:22.989723 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b9d4d36-e2d8-4cee-9279-eb3dc11eeabe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1215 microversion: 2.1 time: 0.163666 Nov 02 12:53:22.990301 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3392/6753] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:22 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:24.013357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:24.014049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:24.016987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:24.018595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:24.022131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:24.022618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:24.023082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:24.023796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:24.024360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:24.024668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:24.162086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:24.170281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e17482e-b0c3-40be-8083-cc1f58ad1612 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1215 microversion: 2.1 time: 0.160760 Nov 02 12:53:24.170860 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3362/6754] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:24 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:25.193893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:25.194503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:25.197164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:25.201978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.202468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.203443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.204153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:25.207309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:25.207309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:25.338790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:25.347662 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fa16b699-54b5-4571-a6ce-1f5a62f62abc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.157821 Nov 02 12:53:25.348236 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3393/6755] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:25 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:26.370610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:26.371271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:26.378269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:26.378760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:26.379247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:26.379951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:26.380415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:26.380848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:26.516450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:26.524729 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44509b37-8fc5-4eb7-a2cc-b04b0c1220c6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.158017 Nov 02 12:53:26.525324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3363/6756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:26 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:27.548004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:27.548620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:27.555961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:27.556382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:27.556819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:27.557532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:27.557983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:27.558411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:27.844862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:27.853231 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a5bcc05-2893-45a0-a2a8-4863762df5c7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.309266 Nov 02 12:53:27.853808 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3394/6757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:27 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:28.876493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:28.877114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:28.884177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.884674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.885120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:28.885830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:28.886294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:28.886729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:29.073609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:29.081976 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee70633a-5f6a-4ee1-91c0-5cb35e5aeaa1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.209470 Nov 02 12:53:29.082557 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3364/6758] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:28 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:30.105597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:30.106228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:30.113011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:30.113540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:30.113990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:30.114704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:30.115206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:30.115643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:30.253943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:30.262052 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e347709-7317-4c1c-88ee-650bde476200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.160621 Nov 02 12:53:30.262644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3395/6759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:30 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:31.286439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:31.287131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:31.294567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:31.295068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:31.295518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:31.296276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:31.296741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:31.297180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:31.433458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:31.441862 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-664ee875-c55d-49fb-a363-74d41c81b32f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.160192 Nov 02 12:53:31.446184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3365/6760] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:31 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:32.465319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:32.465928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:32.473360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.473840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.474274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:32.474965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:32.475492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:32.475917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:32.614918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:32.622874 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af593e01-8cd5-470b-8a47-43eecdb5eb09 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.161559 Nov 02 12:53:32.623484 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3396/6761] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:32 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:33.646575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:33.647256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:33.654420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:33.654940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:33.655422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:33.656139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:33.656599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:33.657029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:33.787358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:33.797184 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4ac605ba-9ffa-4ee6-bece-fb489cba81d4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.153555 Nov 02 12:53:33.797184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3366/6762] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:33 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:34.819060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:34.819677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:34.826510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:34.827036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:34.827473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:34.828177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:34.828627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:34.829053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:34.964964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:34.972875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10b44b5a-ada5-4bda-912a-c5e730e2da47 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.158310 Nov 02 12:53:34.973833 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3397/6763] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:34 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:35.987874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8def96a-ff23-43c5-a978-21fc16779223", "name": "network-vif-plugged", "status": "completed", "tag": "5d54b73a-116a-4792-a941-0529012bce03"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:35.996649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:35.997273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:35.997790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:35.998274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:35.998705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:36.004505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:36.005043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:36.005485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:36.006191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:36.006649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:36.007123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:36.014487 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] Creating event network-vif-plugged:5d54b73a-116a-4792-a941-0529012bce03 for instance d8def96a-ff23-43c5-a978-21fc16779223 on n-h1-855649-4 Nov 02 12:53:36.023473 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4c4eeb1e-2dbf-4764-8578-dd2fba44f373 req-9e9dabf9-cb34-47ae-8304-2922b8d9fd64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035414 Nov 02 12:53:36.023473 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3367/6764] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:36.157726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:36.166091 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f0b1b3a-5a97-4812-9b5d-4dee03e59f57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.173412 Nov 02 12:53:36.166671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3398/6765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:35 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:37.190710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:37.191538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:37.197926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:37.198422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:37.198863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:37.199644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:37.200061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:37.200494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:37.344616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:37.352931 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5a56ee2d-c905-497b-8706-a7dd6f93834f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1203 microversion: 2.1 time: 0.167356 Nov 02 12:53:37.353535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3368/6766] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:37 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:38.376113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.376722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:38.384221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.384841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.385206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.385925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.386394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.386831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.522807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:38.531696 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2e4fe90-1651-4745-8b75-ba978d5ad224 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1390 microversion: 2.1 time: 0.159514 Nov 02 12:53:38.533005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3399/6767] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:38.555071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.555616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:38.562634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.563184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.563640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.564354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.564822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.565259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.698645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:38.706760 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34b1ac21-6dd8-4f4a-824c-66558b00fc1b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1390 microversion: 2.1 time: 0.156407 Nov 02 12:53:38.707355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3369/6768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:38.728318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.728933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:38.734950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.735476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.735927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.736628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.737088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.737521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.867495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:38.876002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-509003d3-337c-4345-a656-0f97a8d67010 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1390 microversion: 2.1 time: 0.151516 Nov 02 12:53:38.876592 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3400/6769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:38 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:38.899510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:38.900127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:38.906250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.906733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.907238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.907933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:38.908386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:38.908825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:38.935182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:53:39.258218 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50321069-9cbd-481b-b14d-0d7ff451f326 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 204 len: 0 microversion: 2.1 time: 0.362775 Nov 02 12:53:39.258836 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3370/6770] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:53:38 2022] DELETE /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:39.268251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:39.268868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:39.275627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:39.276118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:39.276575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:39.277265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:39.277717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:39.278145 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:39.421428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:39.429711 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57abf28b-678f-4d31-bf3c-3d741598e90e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1396 microversion: 2.1 time: 0.165385 Nov 02 12:53:39.430306 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3401/6771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:39 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:40.453678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:40.454394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:40.462719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:40.463242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:40.463688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:40.464394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:40.464862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:40.465295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:40.597871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:40.605791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-054e6309-8301-4c2a-92cc-56728fd61ba0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1396 microversion: 2.1 time: 0.156418 Nov 02 12:53:40.606380 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3371/6772] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:40 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:41.610859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8def96a-ff23-43c5-a978-21fc16779223", "name": "network-vif-deleted", "tag": "5d54b73a-116a-4792-a941-0529012bce03"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:41.623332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.625378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.625378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.628937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:41.629561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:41.633290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:41.638339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.638835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.638958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] Creating event network-vif-deleted:5d54b73a-116a-4792-a941-0529012bce03 for instance d8def96a-ff23-43c5-a978-21fc16779223 on n-h1-855649-4 Nov 02 12:53:41.639330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.640040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:41.641091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:41.641729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:41.645167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:41.645547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-aab61656-efa7-4052-86cc-9ee10f006674 req-af6f8274-5ecb-4b22-b95c-d68ebf5db3cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Nov 02 12:53:41.646271 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3402/6773] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:53:41.717046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:41.725607 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6570b7f-66cc-475e-91dd-2212acedcc10 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1354 microversion: 2.1 time: 0.101093 Nov 02 12:53:41.726211 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3372/6774] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:41 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:53:42.750478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:42.751329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:42.758575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.759086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.759531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.760239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:42.760697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:42.761130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:42.824954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:42.833290 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b274d685-73f9-4182-a87a-facd25460c6c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1188 microversion: 2.1 time: 0.087054 Nov 02 12:53:42.833938 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3403/6775] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:42 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:43.856577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:43.857307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:43.865770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:43.866317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:43.866828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:43.867565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:43.873534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:43.873534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:43.936382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:43.945441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f41c34c3-1b30-4069-ba4c-cee0d3ff1767 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1188 microversion: 2.1 time: 0.093441 Nov 02 12:53:43.946086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3373/6776] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:43 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:44.968289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:44.968946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:44.972217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:44.977225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:44.977726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:44.978178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:44.978968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:44.979463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:44.979912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:45.055976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:45.065074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4f18488-c992-48d4-bb76-146601cd9c9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1188 microversion: 2.1 time: 0.100717 Nov 02 12:53:45.065680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3404/6777] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:44 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:46.089852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:46.090479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:46.097955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.098511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.098891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.099623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:46.100091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:46.101588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:46.164460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:53:46.172858 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c9b7ed5-698f-4c02-9c5e-470224191769 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 200 len: 1188 microversion: 2.1 time: 0.087749 Nov 02 12:53:46.173442 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3374/6778] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:46 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:53:47.197318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:53:47.197992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: d8def96a-ff23-43c5-a978-21fc16779223] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:53:47.205119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:47.208407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:47.208407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:47.208407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:53:47.208407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:53:47.208407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:53:47.210847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=93 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:47.222691 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 HTTP/1.1 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd8def96a-ff23-43c5-a978-21fc16779223'} Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:53:47.224516 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance d8def96a-ff23-43c5-a978-21fc16779223 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2a088bc1-fedc-4d54-9612-8a2894762ef1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223" status: 404 len: 111 microversion: 2.1 time: 0.033845 Nov 02 12:53:47.228956 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3405/6779] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:53:47 2022] GET /compute/v2.1/servers/d8def96a-ff23-43c5-a978-21fc16779223 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:54.370535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-987204116", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "25843726-6c3e-495e-9777-33455aa12c39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:53:54.433236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:53:56.168965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=17 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:04.383778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:25.082828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:25.083720 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:55:25.083871 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:55:25.085171 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:55:25.085303 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:55:25.090489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1570378664", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c0987195-f3c0-468c-822f-4251d55969d9", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:25.185053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:55:25.623194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:55:25.623652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:55:25.624656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:55:25.625062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:55:25.625546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:55:25.634608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:25.635127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:25.635571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:25.636307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:25.636791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:25.637226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:25.655226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:55:25.660707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:55:25.673829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:55:25.676018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c0987195-f3c0-468c-822f-4251d55969d9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:55:25.825671 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9531dd64-67a7-42d0-bc5b-ea5f848a23ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744939 Nov 02 12:55:25.826511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3406/6780] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:55:25.838634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fba55472-897c-4b93-8780-f2dfcb57cbb8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:25.839278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fba55472-897c-4b93-8780-f2dfcb57cbb8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:25.899235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fba55472-897c-4b93-8780-f2dfcb57cbb8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:25.906392 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fba55472-897c-4b93-8780-f2dfcb57cbb8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1057 microversion: 2.1 time: 0.071612 Nov 02 12:55:25.906997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3407/6781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:25 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1057 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:26.930133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:26.930800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:26.937841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:26.938328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:26.938771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:26.939510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:26.939970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:26.940400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:27.008392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:27.016726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-171c55cc-daae-491c-b9fd-947399890135 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1061 microversion: 2.1 time: 0.090479 Nov 02 12:55:27.017325 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3408/6782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:26 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1061 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:28.039792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:28.040459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:28.049184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:28.049745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:28.050125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:28.050842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:28.051347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:28.052155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:28.146523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:28.154748 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-961b81fc-06ad-4e10-aeff-9b40c72abf48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1117 microversion: 2.1 time: 0.118939 Nov 02 12:55:28.155529 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3409/6783] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:28 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1117 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:29.181157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:29.182191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:29.191412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:29.191909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:29.192544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:29.193447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:29.194131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:29.194528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:29.415331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:29.424643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-442598e0-f39a-45d1-af09-ccb919f5448c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.248260 Nov 02 12:55:29.425244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3410/6784] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:29 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:30.040962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89085d19-90a0-4aa3-a016-af7a95d06f55", "tag": "bd68682f-2de9-4b22-8cb1-34d0a32c05cb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:55:30.067740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:30.068380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:30.068836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:30.082185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] Creating event network-changed:bd68682f-2de9-4b22-8cb1-34d0a32c05cb for instance 89085d19-90a0-4aa3-a016-af7a95d06f55 on n-h1-855649-4 Nov 02 12:55:30.087945 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-921b5152-bb37-417e-a12f-8ac011781cfd req-346e1124-af97-4a4b-8f31-078afd3b1fca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138878 Nov 02 12:55:30.088714 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3411/6785] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:55:30.450246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:30.450886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:30.457699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:30.458195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:30.458832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:30.459586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:30.460077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:30.460689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:30.668692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:30.677321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d5230b5-194e-4182-a4b5-0cf70554a33c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.232399 Nov 02 12:55:30.678267 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3412/6786] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:30 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:31.700581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:31.701402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:31.709111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:31.709597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:31.710033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:31.710728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:31.711206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:31.711754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:31.858042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:31.866202 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-344f8a10-7f17-458a-9175-2af27d5423f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.169586 Nov 02 12:55:31.866889 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3413/6787] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:31 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:32.892269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:32.893182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:32.900198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:32.900686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:32.901124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:32.901827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:32.902284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:32.902711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:33.056319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:33.065548 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b85635a1-e0b3-4020-a1e2-0f27ebb1ee34 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.179705 Nov 02 12:55:33.067803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3414/6788] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:32 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:34.092436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:34.093803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:34.101788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:34.102275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:34.102718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:34.103458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:34.103913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:34.104447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:34.250900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:34.258995 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8e94c16-e631-482d-8780-1aac9f498346 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.170699 Nov 02 12:55:34.260088 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3415/6789] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:34 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:35.285793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:35.286410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:35.293469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:35.293969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:35.294414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:35.295156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:35.295620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:35.296077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:35.437389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:35.446750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8091b996-6756-4d69-a524-b4f2e139c4f9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.164954 Nov 02 12:55:35.447597 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3416/6790] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:35 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:36.473953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:36.474725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:36.476777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:36.477472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:36.484618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:36.489091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:36.489091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:36.489091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:36.489091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:36.489091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:36.632279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:36.640348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8e9e1f0-e29b-4b89-a406-4c776e684c4f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.170506 Nov 02 12:55:36.640930 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3417/6791] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:36 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:37.665287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:37.666219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:37.674055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:37.674549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:37.675004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:37.676313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:37.677186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:37.677788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:37.818197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:37.826674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-892406e2-2dc8-4ad8-ad18-3aa89c6b4c5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.166617 Nov 02 12:55:37.827668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3418/6792] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:37 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:38.851880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:38.852773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:38.859485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:38.859977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:38.860413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:38.861120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:38.861576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:38.862002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:39.006454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:39.012852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23edbb95-74bc-4655-916b-2a17f8db1ce5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.164837 Nov 02 12:55:39.013444 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3419/6793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:38 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:40.036939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:40.037582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:40.045229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:40.045774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:40.046863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:40.048545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:40.048545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:40.049468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:40.201680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:40.210302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dce8c3a9-ab2c-4a00-a01b-c1d5893a6fa6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.177418 Nov 02 12:55:40.210894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3420/6794] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:40 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:41.236553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:41.237225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:41.243334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:41.243818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:41.244259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:41.244952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:41.245406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:41.245829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:41.383463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:41.391793 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6e725cb-5136-4eb8-a0b8-24a927f6d731 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.160547 Nov 02 12:55:41.392372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3421/6795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:41 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:42.415973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:42.417102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:42.424344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:42.425131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:42.425771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:42.426514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:42.427033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:42.427987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:42.573622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:42.585308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec447e84-6b63-492b-bac9-f1e003717d91 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.172976 Nov 02 12:55:42.585960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3422/6796] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:42 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:43.616108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:43.616880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:43.624417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:43.624905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:43.625355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:43.626068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:43.626523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:43.627034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:43.788855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:43.797829 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66645d53-bc3e-4888-a9bf-9b3c561e46a6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.190020 Nov 02 12:55:43.798410 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3423/6797] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:43 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:44.820520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:44.821206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:44.829027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:44.829572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:44.830010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:44.830711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:44.831202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:44.831629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:44.987029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:44.990789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:44.995426 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b590011d-631b-4cb6-98b6-ae80699d61bb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.178841 Nov 02 12:55:44.996058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3424/6798] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:44 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:46.020629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:46.021384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:46.030235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:46.030788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:46.031483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:46.032012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:46.032651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:46.033116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:46.168083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:46.176666 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc13dc08-b1e7-4416-a9f2-c7837dcb584c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.160438 Nov 02 12:55:46.177474 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3425/6799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:46 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:47.201898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:47.203959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:47.211808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:47.212299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:47.212732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:47.213432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:47.214062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:47.214486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:47.365222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:47.373118 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21272801-55fe-46c1-9dc0-9d2ecb27075e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.176672 Nov 02 12:55:47.373698 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3426/6800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:47 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:48.397890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:48.398627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:48.408674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:48.411203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:48.411203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:48.411203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:48.411203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:48.411866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:48.548776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:48.556724 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52128130-4db4-4e30-a840-6d4fcdfb6591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.162744 Nov 02 12:55:48.557228 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3427/6801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:48 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:49.580641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:49.581275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:49.588888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:49.589682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:49.590124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:49.590933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:49.591456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:49.591852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:49.733436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:49.742664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91ec8ae1-cffa-419e-a110-c029ea9718c1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.166291 Nov 02 12:55:49.743293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3428/6802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:49 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:50.765508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:50.766232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:50.773334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:50.773830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:50.774351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:50.775075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:50.775533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:50.775967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:50.912382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:50.920974 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49eae920-fb64-4699-8d61-5763ff5bce54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.159323 Nov 02 12:55:50.922184 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3429/6803] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:50 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:51.944226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:51.944971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:51.952333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:51.953570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:51.954013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:51.954720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:51.955212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:51.955646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:52.095224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:52.103299 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d1fed4e-226d-4e32-8a0e-4b86f58c14e0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.163004 Nov 02 12:55:52.103909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3430/6804] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:51 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:53.126132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:53.126818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:53.134129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:53.134624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:53.135097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:53.135813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:53.136268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:53.136691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:53.284408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:53.294042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-195a4829-4b9d-40ee-ac20-269d530f1d78 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.171941 Nov 02 12:55:53.294657 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3431/6805] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:53 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:54.318335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:54.319423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:54.329300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:54.329872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:54.330328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:54.331105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:54.331598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:54.332030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:54.485779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:54.494599 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3082de3-72af-4daf-989b-7dc59f48d405 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.180576 Nov 02 12:55:54.495423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3432/6806] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:54 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:55.520261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:55.521058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:55.524059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:55.531247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:55.531821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:55.538212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:55.538212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:55.538212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:55.538212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:55.687505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:55.688816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-38de816b-5bfa-4ff4-8e02-2043dbdebdab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.173825 Nov 02 12:55:55.689417 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3433/6807] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:55 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:56.720096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:56.720792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:56.727904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:56.728397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:56.728840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:56.729563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:56.730025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:56.730456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:56.884899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:56.893163 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e93f9af9-9280-4b7a-8f87-fb13c4338a54 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.177033 Nov 02 12:55:56.893770 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3434/6808] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:56 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:55:57.916820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:57.926380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:57.926380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:57.926380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:57.926380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:57.926947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:57.927445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:57.927975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:58.135268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:58.147933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-613f510c-acbd-42f2-8c26-35e377365680 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.235129 Nov 02 12:55:58.148663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3435/6809] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:57 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:55:59.176833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:55:59.177529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:55:59.184374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:59.184869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:59.185302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:59.186002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:55:59.186461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:55:59.186882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:55:59.331622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:55:59.339614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54d518b1-fcfa-4a81-880e-4cf2cc5dfc53 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1169 microversion: 2.1 time: 0.167830 Nov 02 12:55:59.340204 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3436/6810] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:55:59 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:00.363113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:00.363750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:00.370592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:00.371132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:00.371581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:00.372299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:00.372757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:00.373188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:00.508530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:00.517165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fab6486a-f40b-4491-93a0-eb3946626403 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.158635 Nov 02 12:56:00.517742 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3437/6811] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:00 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:01.540817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:01.541736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:01.549364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:01.549848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:01.554499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:01.554499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:01.554499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:01.554499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:01.692620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:01.700710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03c8ba63-f096-4707-af35-c26c93f2f30b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.163994 Nov 02 12:56:01.701294 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3438/6812] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:01 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:02.723901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:02.724581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:02.731581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:02.732077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:02.732526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:02.733228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:02.734194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:02.734626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:02.868067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:02.876655 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d29483a5-ccd4-40ef-a6f0-ed4d4ffd0c62 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.156736 Nov 02 12:56:02.877226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3439/6813] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:02 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:03.899755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:03.900581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:03.908228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:03.908725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:03.909169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:03.909878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:03.910342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:03.910776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:04.058772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:04.067071 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f12a96e1-9d21-4a0b-be9c-8cd28d406f0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.171194 Nov 02 12:56:04.067668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3440/6814] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:03 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:05.090048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:05.090795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:05.098030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.098526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.098966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:05.099749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:05.100202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:05.100626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:05.116564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:05.251089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:05.259612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6298581b-5d23-4e56-a9c5-40849eeb2052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.173621 Nov 02 12:56:05.260203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3441/6815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:05 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:06.282624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:06.283288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:06.290411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:06.290908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:06.291644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:06.292363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:06.292829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:06.293264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:06.439050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:06.447246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d3cbfb32-96f6-48a4-a99e-80ab028fcd4e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.168589 Nov 02 12:56:06.447839 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3442/6816] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:06 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:07.469969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:07.470671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:07.477997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:07.478500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:07.478951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:07.479721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:07.480185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:07.480621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:07.627500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:07.635587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b8c844b-2436-422d-8e66-8e7c319873e2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.169600 Nov 02 12:56:07.636191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3443/6817] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:07 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:08.659719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:08.660337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:08.667644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:08.669669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:08.669669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:08.669669 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:08.669925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:08.670197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:08.803519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:08.812294 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5acfa591-0df0-4075-a5a7-6751c4d2ee75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.156487 Nov 02 12:56:08.812892 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3444/6818] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:08 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:09.835878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:09.836617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:09.844394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.844907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.845343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.846063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:09.846518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:09.846943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:09.987807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:09.996193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94b1ef79-65ba-4c34-b6d1-a25a1303664f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.164243 Nov 02 12:56:09.996751 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3445/6819] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:09 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:10.839242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89085d19-90a0-4aa3-a016-af7a95d06f55", "name": "network-vif-plugged", "status": "completed", "tag": "bd68682f-2de9-4b22-8cb1-34d0a32c05cb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:10.850205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:10.853715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:10.853715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:10.862800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] Creating event network-vif-plugged:bd68682f-2de9-4b22-8cb1-34d0a32c05cb for instance 89085d19-90a0-4aa3-a016-af7a95d06f55 on n-h1-855649-4 Nov 02 12:56:10.867875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-03759d20-623e-42df-9429-199037ba2750 req-865866ad-e2cc-4621-b832-87f00757e29f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101210 Nov 02 12:56:10.868514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3446/6820] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:56:11.020438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:11.021344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:11.038893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.039449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.039994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.040654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:11.041131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:11.041845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:11.193199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:11.201563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f06c1b7-6541-4358-8c5f-bb83bc6db8aa tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1203 microversion: 2.1 time: 0.186045 Nov 02 12:56:11.202671 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3447/6821] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:11 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:12.225566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.226260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:12.236891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.237776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.238581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.239907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.240726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.241479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.398901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:12.408511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f048be33-4d96-4ad6-b845-8a6176195d07 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1390 microversion: 2.1 time: 0.186596 Nov 02 12:56:12.409587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3448/6822] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:12 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:12.437411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.438043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:12.444635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.445130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.445574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.446310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.446764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.447263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.595319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:12.605371 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06a391d6-b4d7-49f7-96d3-2f055d023832 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1390 microversion: 2.1 time: 0.171960 Nov 02 12:56:12.606207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3449/6823] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:12 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:12.629235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.629892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:12.636484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.636991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.637430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.638152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.638609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.639062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.793341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:12.801464 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1cc90bad-5496-4b73-8401-7885b7a54285 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1390 microversion: 2.1 time: 0.176281 Nov 02 12:56:12.802052 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3450/6824] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:12 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:12.887130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:12.887687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:12.894451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.894945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.895417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.896159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:12.896620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:12.897049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:12.924978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:56:13.342032 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50d389b4-9cd1-4a31-9090-ab67ba850367 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 204 len: 0 microversion: 2.1 time: 0.458445 Nov 02 12:56:13.343299 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3451/6825] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:12 2022] DELETE /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:56:13.355977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:13.356708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:13.363357 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:13.363851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:13.364299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:13.365008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:13.365539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:13.365968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:13.508983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:13.517358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-692e00a0-9ec9-4f1e-b9bf-29500d251a11 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1396 microversion: 2.1 time: 0.165944 Nov 02 12:56:13.522666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3452/6826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:13 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:14.540700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:14.541687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:14.549240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.549731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.550169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:14.550876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:14.551418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:14.551787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:14.688529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:14.697245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9b8d817-164c-423d-880c-3b93e227e5fe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1396 microversion: 2.1 time: 0.160428 Nov 02 12:56:14.697837 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3453/6827] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:14 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:15.330614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89085d19-90a0-4aa3-a016-af7a95d06f55", "name": "network-vif-deleted", "tag": "bd68682f-2de9-4b22-8cb1-34d0a32c05cb"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:56:15.341650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.343919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.343919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.355572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] Creating event network-vif-deleted:bd68682f-2de9-4b22-8cb1-34d0a32c05cb for instance 89085d19-90a0-4aa3-a016-af7a95d06f55 on n-h1-855649-4 Nov 02 12:56:15.361261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3ef5668f-0c3d-4686-99e8-96e719c4f39a req-51e87efa-ffcb-4873-8b66-5d0808f2edda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Nov 02 12:56:15.362042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3454/6828] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:56:15.722468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:15.723143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:15.730124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.730612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.731081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.731802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:15.732254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:15.732717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:15.802491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:15.810838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbe21346-72dd-4ec2-a6f8-62be6fb69591 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1188 microversion: 2.1 time: 0.093567 Nov 02 12:56:15.811434 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3455/6829] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:15 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:16.834771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:16.835610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:16.843381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.843881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.844328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.845117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:16.845582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:16.846024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:16.918953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:16.927730 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e22552f-ad5a-4df4-8f97-c2633fcca75c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1188 microversion: 2.1 time: 0.097365 Nov 02 12:56:16.928421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3456/6830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:16 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:17.952483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:17.953910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:17.961713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.962291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.962733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:17.963593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:17.964089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:17.964538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:18.044743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:18.048979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:18.062078 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-48acd65d-74a0-4c4b-8424-46081feea8e9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1188 microversion: 2.1 time: 0.113356 Nov 02 12:56:18.065624 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3457/6831] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:17 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:19.101724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:19.102487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:19.111018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:19.111522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:19.112022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:19.112752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:19.113229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:19.113657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:19.183132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:19.192098 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9964487a-c660-48e2-a4a3-b1050bd9ff19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1188 microversion: 2.1 time: 0.095095 Nov 02 12:56:19.192690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3458/6832] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:19 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:56:20.216668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:20.217462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:20.224980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.225474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.225914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.226621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:20.227107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:20.227541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:20.333168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:56:20.341532 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3955966a-cc57-4b31-bd90-85b826c2c969 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 200 len: 1188 microversion: 2.1 time: 0.129584 Nov 02 12:56:20.342125 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3459/6833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:20 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 1188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:56:21.366595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:21.367569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:21.374381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.380450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.380450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:21.380450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:21.380450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:21.380450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:21.393791 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 HTTP/1.1 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '89085d19-90a0-4aa3-a016-af7a95d06f55'} Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:21.395606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd9609b0-ba97-4a81-bc51-676109ada302 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 404 len: 111 microversion: 2.1 time: 0.035528 Nov 02 12:56:21.400058 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3460/6834] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:21 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:56:23.560254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:23.562030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:23.569068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.569568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.570049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:23.570835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.571334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.571769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:23.587824 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 HTTP/1.1 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '89085d19-90a0-4aa3-a016-af7a95d06f55'} Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:23.589405 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9a95e75-4582-4629-97f7-897c3edbc1dd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 404 len: 111 microversion: 2.1 time: 0.034868 Nov 02 12:56:23.593909 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3461/6835] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:56:23 2022] DELETE /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:56:23.599996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:56:23.600636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 89085d19-90a0-4aa3-a016-af7a95d06f55] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:56:23.607143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.608514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.608514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:23.608926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:56:23.613394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:56:23.613394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:56:23.626040 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 HTTP/1.1 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '89085d19-90a0-4aa3-a016-af7a95d06f55'} Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:56:23.629261 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 89085d19-90a0-4aa3-a016-af7a95d06f55 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-067d413e-0035-4abe-9e91-02dd79a49a38 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55" status: 404 len: 111 microversion: 2.1 time: 0.033264 Nov 02 12:56:23.635399 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3462/6836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:56:23 2022] GET /compute/v2.1/servers/89085d19-90a0-4aa3-a016-af7a95d06f55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:56:31.398621 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:56:31.399212 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:56:31.401422 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:56:31.401543 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:56:31.413983 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:56:31.414261 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:57:00.005875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-120568323", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "65265ae2-e209-461c-91e0-1fd86e1e71ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:00.016913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:00.017592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=19 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:00.072952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:00.473984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:00.474443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:00.474920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:00.475408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:00.475829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:00.485736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:00.486219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:00.486657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:00.487525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:00.487987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:00.488411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:00.506323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:00.512022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:00.575787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:00.578566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65265ae2-e209-461c-91e0-1fd86e1e71ef',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:01.105091 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d616aa56-df87-4f2c-ad37-8cc4cb4fb0b2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103257 Nov 02 12:57:01.111464 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3463/6837] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:57:01.118048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-30a48178-bea5-4d4b-8362-045934474279 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:01.118672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-30a48178-bea5-4d4b-8362-045934474279 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:01.183717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-30a48178-bea5-4d4b-8362-045934474279 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:01.192410 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-30a48178-bea5-4d4b-8362-045934474279 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1070 microversion: 2.1 time: 0.078383 Nov 02 12:57:01.193078 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3464/6838] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:01 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1070 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:02.217573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a8850ef-3efa-4e8b-bfea-2e3026918217 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:02.218633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a8850ef-3efa-4e8b-bfea-2e3026918217 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:02.282570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7a8850ef-3efa-4e8b-bfea-2e3026918217 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:02.290072 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a8850ef-3efa-4e8b-bfea-2e3026918217 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1070 microversion: 2.1 time: 0.076676 Nov 02 12:57:02.290689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3465/6839] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:02 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1070 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:03.315354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:03.316452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:03.324121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.324673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.325162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.325945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:03.327224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:03.327778 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:03.408369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:03.418224 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3718b700-4eed-42f8-8d41-6b8a4912dcb5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1168 microversion: 2.1 time: 0.107783 Nov 02 12:57:03.418803 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3466/6840] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:03 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1168 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:04.445444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:04.446270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:04.454485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.455084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.455531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.456275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:04.456733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:04.457162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:04.541771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:04.551199 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29f7f1e4-21bc-47ae-bce2-20588bb31d00 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1186 microversion: 2.1 time: 0.109318 Nov 02 12:57:04.552008 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3467/6841] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:04 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:05.577542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:05.579390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:05.591523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.592806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.593430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.594534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:05.595186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:05.596627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:05.865294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:05.880182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8643d8c8-5c88-47a0-bbf2-fca6f61941d5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1228 microversion: 2.1 time: 0.307528 Nov 02 12:57:05.881683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3468/6842] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:05 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1228 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:06.235773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb49c3d-7e3f-42f2-83a4-d1722727f5ba", "tag": "c6886f08-e85d-4c25-94a1-6adb2fa92a99"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:06.240018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.240806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.241603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.270004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] Creating event network-changed:c6886f08-e85d-4c25-94a1-6adb2fa92a99 for instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba on n-h1-855649-4 Nov 02 12:57:06.276202 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a47bed8b-ada6-4913-9a43-5113d9bea3bf req-cb2877c2-6ab5-45ce-a535-8b8dd5542ce4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054114 Nov 02 12:57:06.277494 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3469/6843] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 12:57:06.905647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:06.906371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:06.914705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.915245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.916189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:06.916925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:06.917399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:06.917833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:07.158600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:07.170357 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37838714-7cbc-4c02-a9fb-25b8a4cb6351 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1228 microversion: 2.1 time: 0.269068 Nov 02 12:57:07.175304 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3470/6844] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:06 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1228 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:08.200102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:08.201612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:08.211656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.212186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.212688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.213439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:08.213894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:08.214320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:08.357882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:08.366471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da674440-0bff-4645-aae3-0b996cb2d9da tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1228 microversion: 2.1 time: 0.171373 Nov 02 12:57:08.368690 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3471/6845] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:08 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1228 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:09.390623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:09.391296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:09.398845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.399364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.399806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.400509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:09.400961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:09.401385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:09.541845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:09.550650 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5de8cc1b-21ae-4f47-a3c4-e26342e1d177 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1228 microversion: 2.1 time: 0.164649 Nov 02 12:57:09.551259 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3472/6846] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:09 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:10.573938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:10.574840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:10.578947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:10.585630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:10.585630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:10.585630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:10.586119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:10.586613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:10.587068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:10.729251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:10.739544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-17736fc2-e325-4c03-873c-a53c1cc17f5e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1228 microversion: 2.1 time: 0.169552 Nov 02 12:57:10.740127 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3473/6847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:10 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1228 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:11.766371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:11.767087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:11.774001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.774592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.775027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.775755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:11.776198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:11.776625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:11.914841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:11.923612 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e330287d-ba27-4d7c-8814-f84044e22543 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.161739 Nov 02 12:57:11.924181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3474/6848] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:11 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:12.947554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:12.948247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:12.950051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:12.956378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.956865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.957309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:12.958006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:12.958467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:12.958900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:13.096744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:13.104804 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e547c965-671f-4eb8-9854-689b1dc2ec8f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.161154 Nov 02 12:57:13.105399 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3475/6849] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:12 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:14.127015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:14.127733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:14.134634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.135159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.135603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.136305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:14.136760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:14.137189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:14.276005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:14.284809 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-006561f6-8868-4bfe-bf7d-cb9e33145057 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.161619 Nov 02 12:57:14.285413 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3476/6850] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:14 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:15.308261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:15.308914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:15.316328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:15.316835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:15.317304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:15.318005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:15.318892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:15.319062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:15.454577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:15.462629 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dce85920-f0a8-43bb-9368-9894b2bc74de tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.158302 Nov 02 12:57:15.463244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3477/6851] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:15 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:16.485136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:16.485804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:16.492850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.493336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.493780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.494484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:16.494940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:16.495408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:16.638156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:16.647287 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2ee25293-fe12-4f41-9c74-a5d14b18273c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.166195 Nov 02 12:57:16.647882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3478/6852] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:16 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:17.670490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:17.671202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:17.677919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:17.678398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:17.678834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:17.679551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:17.680005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:17.680430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:17.818895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:17.827422 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab5cd922-0658-43ad-ab94-453f68d7b092 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.160946 Nov 02 12:57:17.828002 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3479/6853] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:17 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:18.850353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:18.851039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:18.858827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.859337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.859772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.860475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:18.860925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:18.861354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:18.995569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:19.003657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-975245c1-5f80-4ec0-b037-b0d35a81ae48 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.157216 Nov 02 12:57:19.004305 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3480/6854] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:18 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:20.026458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:20.027141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:20.034299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.034786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.035289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.035996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:20.036459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:20.036889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:20.175734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:20.183671 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f6e6c162-a951-41c7-822f-667689db430b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.161221 Nov 02 12:57:20.184249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3481/6855] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:20 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:21.158088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb49c3d-7e3f-42f2-83a4-d1722727f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "c6886f08-e85d-4c25-94a1-6adb2fa92a99"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:21.171315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.171793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.172230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.184022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] Creating event network-vif-plugged:c6886f08-e85d-4c25-94a1-6adb2fa92a99 for instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba on n-h1-855649-4 Nov 02 12:57:21.190373 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-52d2e066-ffdb-4066-a4a8-9b094d8b1797 req-a8b876f8-b1b6-4dba-938c-b01308780331 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037162 Nov 02 12:57:21.190640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3482/6856] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:57:21.209881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:21.210602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:21.218086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.218572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.219031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.219741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:21.220185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:21.220615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:21.241533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:21.428035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:21.436754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-659a5a00-fd4a-4606-b68f-2cfc3243848a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.232209 Nov 02 12:57:21.437412 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3483/6857] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:21 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:22.459450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:22.460194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:22.467915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.468410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.468852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.469618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:22.470077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:22.470504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:22.615460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:22.624195 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b7280e7f-5f5e-4ddb-9ede-5b190d675750 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1216 microversion: 2.1 time: 0.168088 Nov 02 12:57:22.625028 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3484/6858] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:22 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:23.648671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:23.649342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:23.656305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.656787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.657226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.657958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.658428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.658883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.793142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.801795 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4056b866-7219-444d-8c7a-c0ea2b59e5df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1403 microversion: 2.1 time: 0.157015 Nov 02 12:57:23.802385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3485/6859] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:23 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:23.824128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:23.824777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:23.830686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.831219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.831658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.832340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:23.832792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:23.833250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:23.969529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:23.977406 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd77ca92-973a-4fa0-a53c-72dd55932838 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1403 microversion: 2.1 time: 0.157046 Nov 02 12:57:23.977987 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3486/6860] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:23 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:24.000088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1866418936"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:24.002426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:24.008474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.008965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.009411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.010124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:24.010588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:24.011053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:24.104923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.compute.api [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Attempting to quiesce instance before volume snapshot. Nov 02 12:57:24.162169 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.compute.api [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 12:57:24.375887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Creating snapshot from volume 65265ae2-e209-461c-91e0-1fd86e1e71ef. {{(pid=127567) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 12:57:26.090328 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d88aae89-6177-470c-9abf-fefb08e094ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba/action" status: 202 len: 0 microversion: 2.1 time: 2.094377 Nov 02 12:57:26.090986 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3487/6861] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 12:57:23 2022] POST /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba/action => generated 0 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 12:57:27.258072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1027302456", "imageRef": "78db637c-c9da-4870-8408-8f4105b17661", "flavorRef": "452", "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:27.318752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:57:27.718390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:57:27.718856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:57:27.719373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:57:27.719802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:57:27.720234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:57:27.729624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:27.730127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:27.730576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.731356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:27.731937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:27.733382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:27.750881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:57:27.756191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:57:27.768628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:57:27.771475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e01918f6-6e28-408b-9097-c93ffb898a67',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:57:28.041068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-902b4c3a-1584-4c8e-ae19-eb06546bb4ce tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787734 Nov 02 12:57:28.041602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3488/6862] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:57:28.058063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84405baa-dea2-4c2f-b78c-a50695efa200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:28.058795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-84405baa-dea2-4c2f-b78c-a50695efa200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:28.118593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-84405baa-dea2-4c2f-b78c-a50695efa200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:28.126475 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84405baa-dea2-4c2f-b78c-a50695efa200 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1230 microversion: 2.1 time: 0.072551 Nov 02 12:57:28.127261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3489/6863] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:28 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1230 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:29.150361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3edf8d14-e8d9-4bad-857a-44aad135bac2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:29.150361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3edf8d14-e8d9-4bad-857a-44aad135bac2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:29.253348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3edf8d14-e8d9-4bad-857a-44aad135bac2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:29.253348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3edf8d14-e8d9-4bad-857a-44aad135bac2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1230 microversion: 2.1 time: 0.069640 Nov 02 12:57:29.253348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3490/6864] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:29 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:30.238620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:30.239409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:30.244262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:30.251481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.252319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.252772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.253489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:30.253961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:30.254402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:30.326202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:30.334475 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa09b85e-e6ec-4a7c-8ae9-89a219636c75 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1234 microversion: 2.1 time: 0.099792 Nov 02 12:57:30.335170 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3491/6865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:30 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1234 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:31.358438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:31.359377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:31.371179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.371179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.371179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:31.371179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:31.371179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:31.371651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:31.441643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:31.449551 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-197db78f-6621-4777-a8f5-8f3b7ad5319b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1300 microversion: 2.1 time: 0.095643 Nov 02 12:57:31.450139 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3492/6866] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:31 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:32.476802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:32.477724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:32.485353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:32.485910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:32.488426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:32.488426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:32.488426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:32.488426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:32.726738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:32.736497 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28ca152e-eb88-4537-a0dd-59c9a2b06cd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.263894 Nov 02 12:57:32.737464 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3493/6867] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:32 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:33.258910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c437d86b-ef0e-4e6e-9775-1c23610bcdf3", "tag": "9504be18-e144-4d98-98e4-172837f7e8b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:57:33.272056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:33.272559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:33.273085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:33.286815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] Creating event network-changed:9504be18-e144-4d98-98e4-172837f7e8b8 for instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 on n-h2-855649-4 Nov 02 12:57:33.292836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1522e3d1-4170-4068-b8af-6d7460533a99 req-0048bb1e-70f4-4121-a086-9aefeb314691 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040763 Nov 02 12:57:33.293670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3494/6868] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:57:33.763069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:33.764069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:33.770860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:33.771416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:33.771898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:33.772602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:33.773076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:33.773517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:34.007643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:34.017156 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfb71e41-5c22-4b99-b658-c9e91f5c8286 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.259681 Nov 02 12:57:34.017754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3495/6869] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:33 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:57:35.042960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:35.043659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:35.051821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.052320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.052987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.055824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:35.055824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:35.055824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:35.201755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:35.209773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-32e47aa7-6ff7-4c7a-a140-cc2c9a2fd102 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.171554 Nov 02 12:57:35.210456 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3496/6870] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:35 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:36.232969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:36.233636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:36.240985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:36.241500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:36.241965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:36.242760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:36.243258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:36.243704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:36.388571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:36.396860 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5877cce0-ff6f-4235-96d4-ec94437b254b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.168076 Nov 02 12:57:36.397440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3497/6871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:36 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:37.420719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:37.421376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:37.428757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.429294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.429744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.430450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:37.430917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:37.431442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:37.575562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:37.584321 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c756056-55b0-434d-b324-baa3c9916271 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.168065 Nov 02 12:57:37.584902 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3498/6872] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:37 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:38.610732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:38.611540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:38.613934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:38.620398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.621360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.622794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:38.624073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:38.624625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:38.625080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:38.769950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:38.777674 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4553bd6-5f5e-460d-9c4d-9e880b45d817 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.171950 Nov 02 12:57:38.778264 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3499/6873] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:38 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:39.802457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:39.803199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:39.805077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:39.811518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.812056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.812519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.813293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:39.813821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:39.814262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:39.959700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:39.968065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c9b7bf85-c605-4d43-94c5-0b32809f6dea tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.169499 Nov 02 12:57:39.968668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3500/6874] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:39 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:40.997904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:40.998582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:41.004881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:41.005385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:41.005845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:41.006658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:41.007107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:41.007557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:41.022660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:41.148027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:41.157020 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f488b5d-a197-4418-b37d-80890a7d09ff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.164578 Nov 02 12:57:41.157621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3501/6875] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:40 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:42.188507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:42.189239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:42.196799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.197301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.197749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.198460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:42.198962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:42.205900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:42.343887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:42.356841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-541dfd28-7c16-4f78-b6db-666c589350a2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.173378 Nov 02 12:57:42.357510 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3502/6876] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:42 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:43.380362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:43.381030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:43.392249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:43.393522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:43.394166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:43.395129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:43.395610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:43.396230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:43.543023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:43.553433 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdb17fd2-0ff8-4419-9dde-da71d9e61bfc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.176596 Nov 02 12:57:43.554529 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3503/6877] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:43 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:44.580373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:44.581058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:44.588295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.588846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.589306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:44.590030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:44.590501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:44.590942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:44.727315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:44.735824 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a673308-30b6-4ae7-89ee-c2001a3125d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.160413 Nov 02 12:57:44.736395 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3504/6878] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:44 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:45.760160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:45.760926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:45.767746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:45.768249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:45.768729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:45.769411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:45.769881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:45.770323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:45.913190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:45.923350 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c9e527d-0f50-408e-9ea1-690788696524 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.166506 Nov 02 12:57:45.924254 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3505/6879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:45 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:46.947808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:46.948519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:46.956401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:46.960813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:46.960813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:46.960813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:46.960813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:46.960813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:47.097170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:47.106251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9264e116-dd83-429c-930a-0d62060d9be6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.162372 Nov 02 12:57:47.106880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3506/6880] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:46 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:48.130641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:48.131382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:48.140064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:48.140719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:48.141231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:48.142059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:48.142532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:48.143002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:48.285403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:48.294888 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be24404c-907a-4680-91df-d15bbd64d63b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.168305 Nov 02 12:57:48.296075 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3507/6881] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:48 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:49.317975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:49.318610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:49.325704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:49.326820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:49.327323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:49.328073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:49.328545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:49.329029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:49.470566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:49.478391 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23722050-3e38-4e3d-a554-754cafe4840c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.164415 Nov 02 12:57:49.478955 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3508/6882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:49 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:50.501693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:50.513813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:50.653975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:50.663477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-835297f8-83f8-4c08-b081-39882cfda22e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.165605 Nov 02 12:57:50.664078 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3509/6883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:50 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:51.688389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:51.689076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:51.696160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:51.696665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:51.697115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:51.697860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:51.698422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:51.698863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:52.145959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:52.153873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1ed8dcbc-d48c-4ed0-b5d6-763c4dfeca19 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.470230 Nov 02 12:57:52.155070 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3510/6884] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:51 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:53.179389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:53.180022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:53.187139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:53.187639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:53.188085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:53.188791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:53.189259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:53.189745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:53.327869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:53.335635 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de237322-24dc-4e61-b1ac-585c24fc9fa7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.160574 Nov 02 12:57:53.336221 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3511/6885] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:53 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:54.359294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:54.360320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:54.367191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.367695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.368166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.368900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:54.369375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:54.369826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:54.515696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:54.523921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eae9fbbc-c99d-49f0-a270-eb21b9ba9e41 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.169269 Nov 02 12:57:54.524497 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3512/6886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:54 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:55.548201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:55.550002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:55.557763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:55.558202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:55.558653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:55.559411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:55.559882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:55.560416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:55.701343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:55.709285 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f2bae87-5dec-436f-97aa-1dbaf7495bef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.165812 Nov 02 12:57:55.710191 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3513/6887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:55 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:56.733634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:56.734288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:56.742092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:56.742624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:56.743270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:56.744026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:56.744522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:56.744961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:56.884751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:56.893129 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0a00444-5dd9-4765-b9a7-1c731f7eaf80 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.163472 Nov 02 12:57:56.893700 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3514/6888] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:56 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:57.921104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:57.921780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:57.929060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.929560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.930016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:57.930753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:57.931244 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:57.931690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:58.075304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:58.076395 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3885bbfa-7837-428c-85cc-05199089f46d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.161943 Nov 02 12:57:58.076995 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3515/6889] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:57 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:57:59.100173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:57:59.104776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:57:59.109025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:59.109535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:59.109984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:59.110697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:57:59.111200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:57:59.111640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:57:59.367694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:57:59.375761 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-99363e16-00cb-4166-96f0-44df77d2a2a7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.279652 Nov 02 12:57:59.376774 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3516/6890] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:57:59 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:00.399413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:00.400092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:00.407346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.407860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.408353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.409092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:00.409569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:00.410015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:00.545272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:00.553367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cd260cd-bc93-45f2-9d29-044bc245a4b4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.158102 Nov 02 12:58:00.553876 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3517/6891] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:00 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:01.576081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:01.576688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:01.583891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:01.584395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:01.584884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:01.585613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:01.586089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:01.586526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:01.589298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:01.737866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:01.745768 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2790d3f6-bccb-433c-b8f3-e6da4ec6b8d6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.173972 Nov 02 12:58:01.746345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3518/6892] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:01 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:02.770651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:02.771360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:02.774188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=56 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:02.780131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.780635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.781090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.781810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:02.782313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:02.782762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:02.922086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:02.929992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4df209f-c06f-4ab5-9b21-3523620a2be9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.163272 Nov 02 12:58:02.930588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3519/6893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:02 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:03.953626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:03.954321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:03.961529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.962124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.962577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:03.963323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:03.963789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:03.964225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:04.101990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:04.110419 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81f85af3-088c-4cbc-83c8-708fe35bbd8c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.161510 Nov 02 12:58:04.111024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3520/6894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:03 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:05.133995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:05.134681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:05.142227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.142724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.144593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.144593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:05.144593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:05.144868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:05.300017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:05.308706 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed5d4770-d5da-45ea-b491-d0caa7be42df tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.178828 Nov 02 12:58:05.311745 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3521/6895] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:05 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:06.334630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:06.335305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:06.343035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.343546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.344000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.344722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:06.345191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:06.345633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:06.482166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:06.490027 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66cf423d-fe7b-4fbc-8d2c-0310fb9df00f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.159152 Nov 02 12:58:06.490599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3522/6896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:06 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:07.564891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:07.568346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:07.571774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.572275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.572733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.573435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:07.573903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:07.574339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:07.712879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:07.721470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7edd079-3489-4ab9-9a79-8dd0c91bde12 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.212409 Nov 02 12:58:07.722371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3523/6897] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:07 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:08.745007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:08.745779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:08.754646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.755235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.755782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:08.756523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:08.756994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:08.757579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:08.897530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:08.905639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cb09243a-f874-44cf-9e3e-8250e0b721ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.164778 Nov 02 12:58:08.906234 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3524/6898] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:08 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:09.929673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:09.930354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:09.937395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.937892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.938374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:09.939104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:09.939573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:09.940011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:10.079379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:10.087748 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-499fd58f-ea92-4748-8e6d-0cecc1937fc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.162133 Nov 02 12:58:10.088416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3525/6899] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:09 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:11.111354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:11.111980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:11.119133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.119630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.120182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.120911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:11.121470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:11.121966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:11.261702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:11.270558 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b02cd478-7e43-44c7-a5ee-eafc9537883a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.163244 Nov 02 12:58:11.271170 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3526/6900] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:11 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:12.295733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:12.296499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:12.303972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.304478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.305007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.305846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:12.306210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:12.306652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:12.445349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:12.453407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f19407ab-62bd-498d-bd96-92d7d6ac6a82 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.161739 Nov 02 12:58:12.454016 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3527/6901] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:12 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:13.476283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:13.476963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:13.484047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.484609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.485047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.485840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:13.486316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:13.486763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:13.623023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:13.630758 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6f3b297-f95f-4c4f-888c-43e284845e23 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.158546 Nov 02 12:58:13.631433 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3528/6902] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:13 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:14.654064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:14.654770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:14.661960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.662467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.663052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.663724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:14.664199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:14.664642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:14.799353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:14.807285 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c14b4e3-aa65-484c-b241-4e26a8782ce8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.157334 Nov 02 12:58:14.808586 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3529/6903] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:14 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:15.830698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:15.831410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:15.838329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.838834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.839373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.840096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:15.840668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:15.841111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:15.979581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:15.987950 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5279aadd-cf03-44d4-90c9-71a0a86495b9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.161970 Nov 02 12:58:15.988571 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3530/6904] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:15 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:17.011977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:17.012645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:17.020326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.020826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.021286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:17.022007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:17.022472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:17.022912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:17.164338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:17.172641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-688e9a92-e27e-40e0-a9d0-26443cd17af7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.164710 Nov 02 12:58:17.173224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3531/6905] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:17 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:18.197024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:18.197813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:18.206121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.206636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.207136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.207907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:18.208391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:18.208834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:18.361808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:18.369614 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23234988-542d-4944-90aa-1c04073ac8fd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.177110 Nov 02 12:58:18.370197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3532/6906] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:18 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:19.394186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:19.394924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:19.402936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.403468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.404520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.405289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:19.405717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:19.406162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:19.554434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:19.563285 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3884c1f-ee78-4c62-b5d3-db10a1bfd704 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1342 microversion: 2.1 time: 0.173030 Nov 02 12:58:19.564000 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3533/6907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:19 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:20.587054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:20.587675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:20.595700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.596205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.596654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.597374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:20.597840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:20.598281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:20.740361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:20.742856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:20.749453 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a9ae645-2fe9-4b24-aeb1-aec8a0a9c953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1388 microversion: 2.1 time: 0.166413 Nov 02 12:58:20.749985 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3534/6908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:20 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1388 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:21.773344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:21.774043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:21.781853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:21.782347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:21.782796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:21.783529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:21.783997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:21.784468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:21.922907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:21.930953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8be67e4e-b6ba-4314-b6a1-d671046af753 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.161622 Nov 02 12:58:21.931672 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3535/6909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:21 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:22.954449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:22.955147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:22.962207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:22.962710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:22.963237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:22.963957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:22.964436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:22.964879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:23.099659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:23.108340 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e639f0b-b2bb-48bb-b1ee-672c6c7af22a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.158274 Nov 02 12:58:23.108860 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3536/6910] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:22 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:24.132178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:24.133245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:24.140548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:24.141278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:24.141752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:24.142552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:24.143135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:24.143586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:24.295339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:24.306961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-241322a9-666a-4efc-91dd-1e37a6a233c5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.178702 Nov 02 12:58:24.307610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3537/6911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:24 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:25.331261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:25.332057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:25.339865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.340368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.340890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:25.342292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:25.342717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:25.343189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:25.483403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:25.491514 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b0b8d49-5606-40b9-bddb-2ec3b9c086ef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.164704 Nov 02 12:58:25.492087 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3538/6912] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:25 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:26.515916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:26.516636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:26.524129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:26.524629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:26.525077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.525799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:26.526262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:26.526703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:26.663643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:26.672380 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-87252d79-c6b8-4747-9905-5d4e014bfc9d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.161046 Nov 02 12:58:26.673989 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3539/6913] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:26 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:27.695917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:27.696913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:27.704058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.704567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.705031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.705788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:27.706299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:27.706740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:27.903027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:27.912520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0c7e36a-a76f-4d64-9854-9f3bcaaad23c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.220535 Nov 02 12:58:27.916347 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3540/6914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:27 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:28.937910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:28.939046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:28.948067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.948636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.949114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:28.949880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:28.950341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:28.950793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:29.094058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:29.102727 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7b56d2c5-76bf-49fd-87f0-b87de31d17b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.169550 Nov 02 12:58:29.103370 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3541/6915] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:28 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:30.126361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:30.127073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:30.133791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.134319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.134785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.135539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:30.136013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:30.136455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:30.276618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:30.288064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f30b009-ad48-475f-8589-3a6d0c77ccef tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.165952 Nov 02 12:58:30.289509 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3542/6916] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:30 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:31.313487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:31.318537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:31.321845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.322347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.322796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.323541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:31.324009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:31.324450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:31.471449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:31.481798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c021ac1a-0ac7-4d44-ad28-c89fccf7338f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.172261 Nov 02 12:58:31.483512 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3543/6917] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:31 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:32.504689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:32.505346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.517453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.657475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:32.665832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-feebb6ab-1fc8-4ec6-815c-c336db617f5f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.165092 Nov 02 12:58:32.666512 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3544/6918] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:32 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:32.671986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c437d86b-ef0e-4e6e-9775-1c23610bcdf3", "name": "network-vif-plugged", "status": "completed", "tag": "9504be18-e144-4d98-98e4-172837f7e8b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:32.682370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:32.683708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:32.683708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:32.695731 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] Creating event network-vif-plugged:9504be18-e144-4d98-98e4-172837f7e8b8 for instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 on n-h2-855649-4 Nov 02 12:58:32.700929 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-27f5398f-45c3-4798-8d6e-f831dea88f9c req-26ff2807-e57d-4f40-8e75-66ded378c722 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Nov 02 12:58:32.701541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3545/6919] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:33.693378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:33.694258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:33.696232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=54 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:33.701909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.702495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.702926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.703692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:33.704171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:33.704620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:33.850368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:33.865649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-470caf72-0911-4da1-ac53-060f08749e52 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1376 microversion: 2.1 time: 0.178093 Nov 02 12:58:33.866630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3546/6920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:33 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:34.902759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:34.903501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:34.910506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.911031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.911488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:34.912207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:34.912673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:34.913111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.075632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.083978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-71524130-47c2-453d-9d33-4b2749bbfb21 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1562 microversion: 2.1 time: 0.185047 Nov 02 12:58:35.084606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3547/6921] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:34 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1562 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:35.112784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.113427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:35.120679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.127807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.127807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.127807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.127807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.127807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.273904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:35.282843 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbadb3c5-954d-48c4-a369-07dab1c50c45 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1562 microversion: 2.1 time: 0.174251 Nov 02 12:58:35.283488 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3548/6922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:35 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:35.370507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.371109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:35.377946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.378447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.378901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.379656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.380128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.380572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.412284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:35.968623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98e27de7-7344-42e0-9148-cb3d42ab7a18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 204 len: 0 microversion: 2.1 time: 0.601732 Nov 02 12:58:35.969384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3549/6923] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:35 2022] DELETE /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:58:35.979262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:35.980020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:35.987301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.987825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.988294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:35.989127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:35.989595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:35.990024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:36.008312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:36.145291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:36.154731 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c933e6d2-f86d-44f7-9c17-091e0b108c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1568 microversion: 2.1 time: 0.180367 Nov 02 12:58:36.157422 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3550/6924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:35 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:37.180961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:37.181693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:37.189110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.189550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.190004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.190727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:37.191225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:37.191672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:37.337017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:37.346634 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-de7c9758-386d-4383-8f9b-8911c5e9d4d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1568 microversion: 2.1 time: 0.170118 Nov 02 12:58:37.347262 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3551/6925] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:37 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:38.385332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:38.385332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:38.391115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.392079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.393751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.394231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.394787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.396879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.490021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:38.498379 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d4b665ec-1f3a-49d2-bc60-203b55a37090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1526 microversion: 2.1 time: 0.130060 Nov 02 12:58:38.513372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3552/6926] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:38 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1526 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:38.513372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c437d86b-ef0e-4e6e-9775-1c23610bcdf3", "name": "network-vif-deleted", "tag": "9504be18-e144-4d98-98e4-172837f7e8b8"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:38.514730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:38.515261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:38.515954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:38.529075 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] Creating event network-vif-deleted:9504be18-e144-4d98-98e4-172837f7e8b8 for instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 on n-h2-855649-4 Nov 02 12:58:38.534536 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cf65ce37-3a8f-47a9-808d-8d6ac2f19331 req-98f87ad6-c350-44ec-84d9-dcd2d47f0579 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 Nov 02 12:58:38.535413 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3553/6927] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:39.528442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:39.531692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:39.541283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.542097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.542592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.543455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:39.544626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:39.545102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:39.621478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:39.627436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1f9a967-6b74-4fce-8c9a-e69c3a81a80d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1361 microversion: 2.1 time: 0.107979 Nov 02 12:58:39.628018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3554/6928] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:39 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1361 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:40.650355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:40.651424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:40.660396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.660907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.661396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.662342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:40.662825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:40.663420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:40.740860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:40.755009 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e10e1a3f-0920-4bcc-bb08-7dcc77ea10f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1361 microversion: 2.1 time: 0.108474 Nov 02 12:58:40.756772 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3555/6929] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:40 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1361 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:41.784686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:41.785696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:41.794308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.795025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.795568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.796420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:41.796978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:41.797493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:41.890708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:41.902619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-841e2cca-467d-40e6-ad99-8e4ceb4baf27 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1361 microversion: 2.1 time: 0.125310 Nov 02 12:58:41.903114 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3556/6930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:41 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1361 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:42.926111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:42.926946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:42.935514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.936076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.937386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:42.937386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:42.937852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:42.938312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:43.036057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:43.048579 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-594b260c-16df-4869-bfec-f83ff1ccabd4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1361 microversion: 2.1 time: 0.126678 Nov 02 12:58:43.049263 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3557/6931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:42 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1361 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:44.084791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:44.085963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:44.095733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.096640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.097331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.098867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.099083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.099706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.140950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:44.141300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:44.141749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:44.142223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lazy-loading 'fault' on Instance uuid c437d86b-ef0e-4e6e-9775-1c23610bcdf3 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:44.193798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:44.214109 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e15a290-93e4-4132-a405-de8decace757 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 200 len: 1366 microversion: 2.1 time: 0.134293 Nov 02 12:58:44.218567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3558/6932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:44 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:45.245952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:45.246634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:45.254489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.255070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.255502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.256243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:45.256724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:45.257343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:45.272887 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 HTTP/1.1 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c437d86b-ef0e-4e6e-9775-1c23610bcdf3'} Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:45.274816 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:45.280034 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-441ad05e-accd-49ac-91e2-bb3f0070bb95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 404 len: 111 microversion: 2.1 time: 0.035803 Nov 02 12:58:45.281180 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3559/6933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:45 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:58:50.770691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:50.771495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:50.774029 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:58:50.774181 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 12:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba (ip 10.222.0.48) !!! Nov 02 12:58:50.781237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:50.781739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:50.782184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:50.782912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:50.783412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:50.783855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:50.819792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:58:51.239080 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d153d92-7909-4d6e-97ed-04d3164f3d9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 204 len: 0 microversion: 2.1 time: 0.472079 Nov 02 12:58:51.240104 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3560/6934] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:58:50 2022] DELETE /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:58:51.250993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:51.251764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:51.258555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:51.259095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:51.259545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.260279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:51.260744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:51.261183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:51.422010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:51.430810 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0bcf0f02-dc3f-44df-87ed-7c996c33cbfe tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1409 microversion: 2.1 time: 0.184711 Nov 02 12:58:51.433426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3561/6935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:51 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:52.455319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:52.456423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:52.464251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.464929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.465500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.466504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:52.467293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:52.468082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:52.655358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:52.663807 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43539cdd-9647-4360-9afe-4a63640bb7d8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1409 microversion: 2.1 time: 0.212963 Nov 02 12:58:52.664406 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3562/6936] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:52 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:53.468201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb49c3d-7e3f-42f2-83a4-d1722727f5ba", "name": "network-vif-deleted", "tag": "c6886f08-e85d-4c25-94a1-6adb2fa92a99"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:53.479716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.480201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.480643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.496166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] Creating event network-vif-deleted:c6886f08-e85d-4c25-94a1-6adb2fa92a99 for instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba on n-h1-855649-4 Nov 02 12:58:53.502263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b7aa9561-5ace-47da-adeb-f0832e83a8c5 req-e4e7ce71-ddaf-4866-91b6-b23024e2a82f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Nov 02 12:58:53.502932 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3563/6937] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:58:53.696625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:53.697503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:53.705765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.706223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.706685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.707476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:53.707953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:53.708397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:53.801526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:53.812322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c74f96c5-38a2-4059-838a-7cac29e370bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1201 microversion: 2.1 time: 0.119825 Nov 02 12:58:53.814055 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3564/6938] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:53 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:58:54.841994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:54.843318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:54.856580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.857509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.858341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:54.859665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:54.860529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:54.861325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:54.953611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:54.965241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4722e5c4-d2c5-494c-a937-3b783e3e07cd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1201 microversion: 2.1 time: 0.130886 Nov 02 12:58:54.965878 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3565/6939] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:54 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:55.989678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:55.990630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:55.997829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:55.998330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:55.998783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:55.999534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:56.000003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:56.000471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:56.093869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:56.103936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a734e56-ae4c-410e-a0a6-a57e1e84beb7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1201 microversion: 2.1 time: 0.118288 Nov 02 12:58:56.113584 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3566/6940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:55 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:57.129588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:57.130614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:57.140655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.141495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.142065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.143049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:57.143807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:57.144308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:57.148433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:57.222265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:57.231958 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4ea0752b-f59e-487f-81ff-8b5569e9118a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1201 microversion: 2.1 time: 0.106997 Nov 02 12:58:57.232567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3567/6941] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:57 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:58.256410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:58.256410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:58.264725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.265232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.265779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.266406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:58.266874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:58.267335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:58.342258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:58.351417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca0ab389-111b-45c4-88e6-de0768b2b29c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1201 microversion: 2.1 time: 0.099510 Nov 02 12:58:58.352294 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3568/6942] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:58 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:58:59.378621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:58:59.380106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:58:59.388152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.388659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.389110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.389833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.390301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.390818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.426662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:58:59.427201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:58:59.427795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:58:59.428307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lazy-loading 'fault' on Instance uuid dbb49c3d-7e3f-42f2-83a4-d1722727f5ba {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:58:59.475523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:58:59.484292 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-373e4971-2d04-4c43-9658-4e94594c3892 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 200 len: 1206 microversion: 2.1 time: 0.109510 Nov 02 12:58:59.484894 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3569/6943] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:58:59 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 1206 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:00.508653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:00.509820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:00.516375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:00.516884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:00.517342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:00.518084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:00.518556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:00.519029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:00.537580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba HTTP/1.1 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dbb49c3d-7e3f-42f2-83a4-d1722727f5ba'} Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:00.539377 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3cd04a1d-5cd0-4dde-9be4-0c1928b0ecc7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 404 len: 111 microversion: 2.1 time: 0.036759 Nov 02 12:59:00.545327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3570/6944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:00 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:59:02.707962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:02.708767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:02.716747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.717252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.717704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.718430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.718896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.719431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.738171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 HTTP/1.1 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c437d86b-ef0e-4e6e-9775-1c23610bcdf3'} Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:02.739865 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca2d7b1e-6ab2-4ef2-bc66-2bb3fd4702d9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 404 len: 111 microversion: 2.1 time: 0.037646 Nov 02 12:59:02.745203 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3571/6945] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:02 2022] DELETE /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:59:02.750759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:02.759589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c437d86b-ef0e-4e6e-9775-1c23610bcdf3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:02.759589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.759589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.760380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.761478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:02.762086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:02.763110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:02.780853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 HTTP/1.1 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c437d86b-ef0e-4e6e-9775-1c23610bcdf3'} Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:02.782533 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance c437d86b-ef0e-4e6e-9775-1c23610bcdf3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52125d63-fc4a-4e9d-a514-1e49172d9b57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3" status: 404 len: 111 microversion: 2.1 time: 0.037465 Nov 02 12:59:02.787158 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3572/6946] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:02 2022] GET /compute/v2.1/servers/c437d86b-ef0e-4e6e-9775-1c23610bcdf3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:59:03.886558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:03.887246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:03.890459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:03.895301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:03.895807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:03.896354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:03.897078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:03.897552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:03.897999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:03.911944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba HTTP/1.1 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dbb49c3d-7e3f-42f2-83a4-d1722727f5ba'} Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:03.913554 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29bb86bf-340f-4459-b098-e4b777736b39 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 404 len: 111 microversion: 2.1 time: 0.032444 Nov 02 12:59:03.920984 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3573/6947] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 12:59:03 2022] DELETE /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:59:03.924018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:03.924647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: dbb49c3d-7e3f-42f2-83a4-d1722727f5ba] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:03.930796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:03.931346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:03.931806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:03.932531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:03.933009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:03.933454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:03.948029 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba HTTP/1.1 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'dbb49c3d-7e3f-42f2-83a4-d1722727f5ba'} Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:03.949599 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance dbb49c3d-7e3f-42f2-83a4-d1722727f5ba could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0db4d85f-4ed9-4c36-8d2b-1d8c1026f34c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba" status: 404 len: 111 microversion: 2.1 time: 0.031470 Nov 02 12:59:03.954644 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3574/6948] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:03 2022] GET /compute/v2.1/servers/dbb49c3d-7e3f-42f2-83a4-d1722727f5ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:59:04.044420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50c4c169-1e5f-450b-8ed8-bea5f5a309d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: .version_select at 0x7ff1b2de5940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-54344281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf8MubR2LctEzbia6mMrTr4WCA44+JEclp3hkyeKLjhzeeVaSktC3nOhtWvGbpIbkd0pcCsKmITF7xrh0V/qPxJGC5QEUU46zmGiOTkaVyqJnFjB3YtvsmJGF60IsSvmg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:04.060953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-50c4c169-1e5f-450b-8ed8-bea5f5a309d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:59:04.066285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-50c4c169-1e5f-450b-8ed8-bea5f5a309d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:59:04.152549 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50c4c169-1e5f-450b-8ed8-bea5f5a309d2 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.112556 Nov 02 12:59:04.153098 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3575/6949] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 12:59:04 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:59:34.492126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=29 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:34.492986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:34.493653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:34.497875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-419877161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-54344281", "security_groups": [{"name": "tempest-secgroup-smoke-1790002814"}], "block_device_mapping_v2": [{"uuid": "c27005de-846a-43d7-8891-b7a22b3c79ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:34.658649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:59:35.097013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:59:35.097467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:59:35.098100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:59:35.098798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:59:35.099486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:59:35.111432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:35.112019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:35.112526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:35.113632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:35.114409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:35.115219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:35.137727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:59:35.144195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:59:35.221233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:59:35.223809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c27005de-846a-43d7-8891-b7a22b3c79ed',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:59:35.833872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c66e10a-265b-4286-a1e7-2dc76552e090 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.344330 Nov 02 12:59:35.834928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3576/6950] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:59:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:59:35.847136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc8daddf-674c-44f7-8090-573723814661 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:35.848043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc8daddf-674c-44f7-8090-573723814661 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:35.906298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc8daddf-674c-44f7-8090-573723814661 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:35.914587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc8daddf-674c-44f7-8090-573723814661 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1092 microversion: 2.1 time: 0.071420 Nov 02 12:59:35.916607 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3577/6951] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:35 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:36.942341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3f10b06b-b732-49b6-b095-52c6f1e1fbe9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:36.943151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3f10b06b-b732-49b6-b095-52c6f1e1fbe9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:37.005590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3f10b06b-b732-49b6-b095-52c6f1e1fbe9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:37.014192 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3f10b06b-b732-49b6-b095-52c6f1e1fbe9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1092 microversion: 2.1 time: 0.078989 Nov 02 12:59:37.014789 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3578/6952] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:36 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1092 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:38.052508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7746723-75e4-4fcb-869b-05ff4379ac57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:38.053207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7746723-75e4-4fcb-869b-05ff4379ac57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:38.108151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7746723-75e4-4fcb-869b-05ff4379ac57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:38.115959 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7746723-75e4-4fcb-869b-05ff4379ac57 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1092 microversion: 2.1 time: 0.067249 Nov 02 12:59:38.116569 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3579/6953] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:38 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:39.139922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5c8128c1-c6b8-4181-9202-aab60b6bbd59 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:39.140657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5c8128c1-c6b8-4181-9202-aab60b6bbd59 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:39.201436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5c8128c1-c6b8-4181-9202-aab60b6bbd59 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:39.208766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5c8128c1-c6b8-4181-9202-aab60b6bbd59 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1092 microversion: 2.1 time: 0.072863 Nov 02 12:59:39.209345 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3580/6954] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:39 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1092 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:40.232621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:40.233340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:40.240804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.241302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.241801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.242519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:40.242968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:40.243442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:40.310635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:40.319079 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b56bb5a8-fd24-435a-8bbf-fdfbb6d00a32 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1134 microversion: 2.1 time: 0.090537 Nov 02 12:59:40.319673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3581/6955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:40 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1134 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:41.342899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:41.343638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:41.350630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.351192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.351935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:41.352378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:41.352921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:41.353287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:41.422164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:41.439949 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13d2a743-a12a-4ecc-8759-77c0bdd8e7ab tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1208 microversion: 2.1 time: 0.099580 Nov 02 12:59:41.439949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3582/6956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:41 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:42.476505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:42.477216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:42.485353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:42.486019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:42.486563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:42.487407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:42.488010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:42.488530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:42.742791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:42.752092 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f6c896d-e8f9-4fe7-aa73-1bb104adc502 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1276 microversion: 2.1 time: 0.279526 Nov 02 12:59:42.753044 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3583/6957] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:42 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:42.971336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398200f5-691d-457f-935c-61d71867dda9", "tag": "7b96cc12-c32f-4197-b516-222377034b8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:42.985681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:42.986671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:42.987321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:42.999842 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] Creating event network-changed:7b96cc12-c32f-4197-b516-222377034b8c for instance 398200f5-691d-457f-935c-61d71867dda9 on n-h1-855649-4 Nov 02 12:59:43.005862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-085ce4e0-413b-4894-8e3e-10789017e7f0 req-e5aa6a9e-813f-4cfc-acbf-eb6ff865a2fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038511 Nov 02 12:59:43.006879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3584/6958] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:59:43.777619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:43.778588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:43.785159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.785662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.786107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:43.787037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:43.787531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:43.788209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:44.028253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:44.038486 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac0e2f08-31e2-4387-af53-9616244dff5b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1276 microversion: 2.1 time: 0.266517 Nov 02 12:59:44.040113 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3585/6959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:43 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:45.063504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:45.064160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:45.071459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.071964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.072624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:45.073356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:45.073831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:45.075029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:45.123330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:45.227949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:45.238287 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bde7cfe9-7e3b-4d9b-af72-82acedebe3b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1276 microversion: 2.1 time: 0.179422 Nov 02 12:59:45.251249 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3586/6960] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:45 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:46.263954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:46.264684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:46.272829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:46.273333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:46.273926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:46.274835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:46.275421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:46.275879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:46.422530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:46.430670 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74aa0511-cae0-4926-8fb8-4c7b1f48b439 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1276 microversion: 2.1 time: 0.170979 Nov 02 12:59:46.434933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3587/6961] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:46 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:47.455836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:47.456705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:47.463907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.464420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.464883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:47.465615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:47.466087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:47.466535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:47.623916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:47.632898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7c39725f-dbeb-4741-82f7-c701483ece9a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.180921 Nov 02 12:59:47.633505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3588/6962] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:47 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:48.657262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:48.657958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:48.665262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:48.665774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:48.666229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:48.666958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:48.667504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:48.668533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:48.814383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:48.823936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d8d21ac1-4873-48e0-bf17-835fc94a7a3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.170480 Nov 02 12:59:48.824795 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3589/6963] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:48 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:49.847052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:49.847762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:49.849632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=14 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:49.855620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.856129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.856593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:49.857318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:49.857799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:49.858246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:50.000808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:50.009005 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-982618f6-6be5-48b8-a46a-d7572039bea4 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.165900 Nov 02 12:59:50.009600 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3590/6964] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:49 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:59:51.033425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:51.034143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:51.041807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.042315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.042787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.043534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:51.044084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:51.044511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:51.187782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:51.195779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-baffd7c3-fc78-462b-97cd-3195c1603cff tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.166296 Nov 02 12:59:51.196359 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3591/6965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:51 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:51.416798 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:59:51.417671 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:59:51.420218 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:59:51.420380 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:59:51.432720 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:59:51.433002 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 12:59:52.219367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:52.219991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:52.227683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.228191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.228650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.229404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:52.229871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:52.230371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:52.375949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:52.384431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ff75051-0b4d-4e07-ac02-7ef46793015c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.169599 Nov 02 12:59:52.385018 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3592/6966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:52 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:53.407228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:53.407918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:53.415733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.416187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.417401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:53.417401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:53.417903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:53.418359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:53.566046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:53.575716 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-219988c4-3a5e-4be3-ab12-ac593786a4f8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.172451 Nov 02 12:59:53.576307 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3593/6967] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:53 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:54.599200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:54.600037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:54.607376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:54.607887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:54.608348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:54.609108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:54.609587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:54.610036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:54.765016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:54.773442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8229273-efb2-4796-a277-81378ce5a0d1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.178373 Nov 02 12:59:54.774046 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3594/6968] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:54 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:55.797697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:55.798550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:55.805566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.806073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.806535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.807289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:55.807769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:55.808216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:55.956329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:55.964566 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bce2a6fc-4cbf-4e52-9409-75777601f81e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.170799 Nov 02 12:59:55.965160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3595/6969] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:55 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:56.988058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:56.988754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:56.996038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.996544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.997002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:56.997725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:56.998194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:56.998637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:57.146154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:57.155585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c84300b0-850b-4e76-a8d4-fcad88c0fec0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.171279 Nov 02 12:59:57.156736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3596/6970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:56 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:58.032448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398200f5-691d-457f-935c-61d71867dda9", "name": "network-vif-plugged", "status": "completed", "tag": "7b96cc12-c32f-4197-b516-222377034b8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:58.044997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.045507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.045954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.059937 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] Creating event network-vif-plugged:7b96cc12-c32f-4197-b516-222377034b8c for instance 398200f5-691d-457f-935c-61d71867dda9 on n-h1-855649-4 Nov 02 12:59:58.065595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8216f930-3b3c-40e5-a8f6-0b3157584750 req-1271eb5d-9ac8-47e2-a854-4611d29c879a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036896 Nov 02 12:59:58.066129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3597/6971] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 12:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:59:58.180795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:58.181738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:58.188678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.189677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.190374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.191220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:58.192108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:58.192709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:58.214097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:58.362093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:58.371397 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bebc385a-5e90-481f-803a-f612a435597f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.194994 Nov 02 12:59:58.372021 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3598/6972] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:58 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:59:59.395131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:59.396057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:59:59.402951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.403486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.403966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.404908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:59:59.405390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:59:59.405866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:59:59.564382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:59:59.575234 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eb005868-6887-47ca-a644-32cf934d26f3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1264 microversion: 2.1 time: 0.184143 Nov 02 12:59:59.575893 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3599/6973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 12:59:59 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:00.598724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:00.599435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:00.606268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.606775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.607275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.607990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.608461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.608900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.784340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:00.794142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d42528b9-c9ab-4993-a048-00936fc0fac6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1451 microversion: 2.1 time: 0.199899 Nov 02 13:00:00.794764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3600/6974] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:00 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1451 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:00.818111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:00.818734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:00.825629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.826127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.826614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:00.827339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:00.827806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:00.828246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:01.049657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:01.059352 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c3146453-11fc-461d-bcc1-e0f60d8ca109 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1451 microversion: 2.1 time: 0.245303 Nov 02 13:00:01.059963 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3601/6975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:00 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1451 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:03.867995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398200f5-691d-457f-935c-61d71867dda9", "tag": "7b96cc12-c32f-4197-b516-222377034b8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:03.879140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:03.879540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:03.880000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:03.896585 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] Creating event network-changed:7b96cc12-c32f-4197-b516-222377034b8c for instance 398200f5-691d-457f-935c-61d71867dda9 on n-h1-855649-4 Nov 02 13:00:03.903006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3c30fa0a-7776-4094-941d-9e11629a2518 req-e5fd6562-2e5a-4501-a3dd-bd6c9ad8edf4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130885 Nov 02 13:00:03.903632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3602/6976] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:31.229574 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:02:31.230417 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:02:31.231167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:31.231945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:31.233186 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:02:31.233345 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 (ip 10.222.0.48) !!! Nov 02 13:02:31.234734 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:02:31.234856 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 (ip 10.222.0.48) !!! Nov 02 13:02:31.240445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:31.241049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:31.250677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.251212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.251658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:31.252369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.252836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.253277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:31.287917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:02:31.713002 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d85833e-510f-41b0-9c1c-2c6e93f8f0a0 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 204 len: 0 microversion: 2.1 time: 0.485019 Nov 02 13:02:31.713654 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3603/6977] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:02:31 2022] DELETE /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:02:31.722261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:31.723012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:31.729341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.729848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.730307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:31.731078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:31.731573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:31.732023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:31.887327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:31.899508 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b747f230-d667-46ef-90cd-2f8dbc743bb9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1575 microversion: 2.1 time: 0.181157 Nov 02 13:02:31.900166 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3604/6978] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:31 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:32.924667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:32.925369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:32.935026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:32.935528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:32.935978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:32.936700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:32.937170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:32.937611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:32.944879 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50060. Nov 02 13:02:32.955746 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50058. Nov 02 13:02:33.092593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:33.101414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83aaf3f8-9c88-49f9-8dfc-a7453bdfb909 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1575 microversion: 2.1 time: 0.180642 Nov 02 13:02:33.102012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3605/6979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:32 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:34.125705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:34.126368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:34.134746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:34.137866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:34.137866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:34.137866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:34.137866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:34.137866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:34.257103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:34.267251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9d0e6f2-080c-4ac0-8711-75dfdb9f1052 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1507 microversion: 2.1 time: 0.145329 Nov 02 13:02:34.267857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3606/6980] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:34 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:34.562183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398200f5-691d-457f-935c-61d71867dda9", "name": "network-vif-deleted", "tag": "7b96cc12-c32f-4197-b516-222377034b8c"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:34.572346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:34.572850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:34.573334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:34.595790 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] Creating event network-vif-deleted:7b96cc12-c32f-4197-b516-222377034b8c for instance 398200f5-691d-457f-935c-61d71867dda9 on n-h1-855649-4 Nov 02 13:02:34.601414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-79af1884-5c2f-4cfc-af5a-dd62dd45f4c8 req-d5a0049f-0a7b-428b-b55b-284865b6e2ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108550 Nov 02 13:02:34.602238 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3607/6981] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:02:35.295882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:35.297528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:35.305213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:35.306459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:35.307291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:35.308124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:35.308736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:35.309752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:35.393852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:35.406580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2391506-b016-4edf-96c9-a5be2f3fcca5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1223 microversion: 2.1 time: 0.116844 Nov 02 13:02:35.407487 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3608/6982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:35 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:36.431758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:36.432456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:36.442520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:36.443056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:36.443524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:36.444253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:36.444725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:36.445171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:36.514544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:36.523577 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e9276aae-d383-4059-a1db-f8ede679c031 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1223 microversion: 2.1 time: 0.095733 Nov 02 13:02:36.524210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3609/6983] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:36 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:37.548708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:37.549353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:37.556953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:37.558186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:37.558186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:37.558781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:37.559251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:37.559728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:37.624242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:37.632507 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b2bbd31-3908-474c-a9eb-78a745e8920e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1223 microversion: 2.1 time: 0.087934 Nov 02 13:02:37.633111 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3610/6984] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:37 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:38.656919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:38.657850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:38.664929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.665383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.665836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.666603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.667061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.667504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.730954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:38.739257 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9138f0a9-f00a-448b-9bd8-b4043e217f6f tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1223 microversion: 2.1 time: 0.086071 Nov 02 13:02:38.739850 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3611/6985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:38 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:39.762594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:39.763441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:39.770337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:39.770847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:39.771337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:39.772072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:39.772545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:39.772993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:39.812420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:39.812882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:39.813347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:39.813851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lazy-loading 'fault' on Instance uuid 398200f5-691d-457f-935c-61d71867dda9 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:02:39.861283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:39.869765 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d7fee853-8d4c-4699-a6b7-a6fab47f0248 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 200 len: 1228 microversion: 2.1 time: 0.111017 Nov 02 13:02:39.870379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3612/6986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:39 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 1228 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:40.893511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:40.894379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:40.902348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:40.902855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:40.903343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:40.904079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:40.904560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:40.905000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:40.920022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 HTTP/1.1 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '398200f5-691d-457f-935c-61d71867dda9'} Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:40.921719 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8e7c9bb-25ea-431f-a423-b7c008ca0ee1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 404 len: 111 microversion: 2.1 time: 0.033795 Nov 02 13:02:40.927011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3613/6987] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:40 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:02:40.976159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1592522804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-54344281", "security_groups": [{"name": "tempest-secgroup-smoke-1790002814"}], "block_device_mapping_v2": [{"uuid": "c27005de-846a-43d7-8891-b7a22b3c79ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:41.105911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:02:41.888682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:02:41.889163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:02:41.889664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:02:41.890113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:02:41.890580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:02:41.900948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:41.901607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:41.901895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:41.902641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:41.903153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:41.903602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:41.923245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:41.928957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:41.998260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:02:42.000705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c27005de-846a-43d7-8891-b7a22b3c79ed',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:02:42.424977 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d7cbe5a-40fe-46b8-b78e-ee13e76f8ceb tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.452701 Nov 02 13:02:42.425634 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3614/6988] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:02:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:02:42.437873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8d6503da-84df-4069-918d-062e60b79981 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:42.438502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8d6503da-84df-4069-918d-062e60b79981 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:42.498867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8d6503da-84df-4069-918d-062e60b79981 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:42.506586 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8d6503da-84df-4069-918d-062e60b79981 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1093 microversion: 2.1 time: 0.072524 Nov 02 13:02:42.507220 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3615/6989] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:42 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:43.532353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:43.533731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:43.543306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:43.544123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:43.544476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:43.545281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:43.545953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:43.546490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:43.614929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:43.624972 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2923fae1-fa3a-4608-86e5-d4d571ebefc5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1143 microversion: 2.1 time: 0.098135 Nov 02 13:02:43.625964 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3616/6990] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:43 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:44.652089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:44.652876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:44.660094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:44.661189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:44.661189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:44.661785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:44.662611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:44.662953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:44.729086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:44.737492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-512e5e4d-7607-402f-b122-c569350db42b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1209 microversion: 2.1 time: 0.089347 Nov 02 13:02:44.738498 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3617/6991] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:44 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:45.762323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:45.764203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:45.771830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:45.772474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:45.776142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:45.776142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:45.776142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:45.776142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:45.942274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:45.951885 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9e50a14e-7312-4834-a2d8-000bb8bce036 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1277 microversion: 2.1 time: 0.194000 Nov 02 13:02:45.952489 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3618/6992] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:45 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:46.407702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25ee502-db14-433f-a48f-f358e1bdd0ee", "tag": "a06189f9-f6ee-4b22-a63e-3fd9e7b556d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:46.418907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:46.419394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:46.419970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:46.433488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] Creating event network-changed:a06189f9-f6ee-4b22-a63e-3fd9e7b556d0 for instance a25ee502-db14-433f-a48f-f358e1bdd0ee on n-h1-855649-4 Nov 02 13:02:46.439766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-3c6143a8-a5d7-4e50-91ac-d5de1adea81c req-96ee38db-4c98-4c2a-a269-4cca7caf7f8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Nov 02 13:02:46.440694 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3619/6993] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:02:46.976402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:46.977841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:46.985811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:46.986466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:46.987053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:46.987894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:46.988478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:46.989054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:47.221233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:47.229871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9c502cd0-8f90-41bc-9bf0-1d30ba42e0db tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1277 microversion: 2.1 time: 0.258421 Nov 02 13:02:47.230764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3620/6994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:46 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:48.254284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:48.254917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:48.262955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:48.263496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:48.263958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:48.264690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:48.265162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:48.265606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:48.270335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:48.435293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:48.444881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6a3bf0db-dfb4-47f9-ba85-0dbfbd939a04 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1277 microversion: 2.1 time: 0.194596 Nov 02 13:02:48.455341 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3621/6995] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:48 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:49.471141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:49.471898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:49.479489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:49.480003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:49.480462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:49.481349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:49.481817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:49.482261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:49.657112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:49.667139 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4360abc6-5d8d-439e-b5f9-f9655913c06b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1277 microversion: 2.1 time: 0.199997 Nov 02 13:02:49.668146 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3622/6996] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:49 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:50.696949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:50.698113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:50.706930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:50.707464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:50.707911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:50.708630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:50.709094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:50.709542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:50.871883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:50.880302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3450f839-999d-4e02-977c-176bc0983d3c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1277 microversion: 2.1 time: 0.191257 Nov 02 13:02:50.881361 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3623/6997] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:50 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:51.906433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:51.907288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:51.913789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:51.917181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:51.918047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:51.918598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:51.919443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:51.920168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:51.920756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:52.080513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:52.089430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c65a1d6-f9d0-4e85-b4e0-13a078c7389c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.188318 Nov 02 13:02:52.090042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3624/6998] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:51 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:53.113725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:53.114440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:53.116373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:53.123246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:53.123759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:53.124328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:53.124960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:53.125433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:53.125879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:53.275928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:53.284783 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e06de4b8-e144-4b24-8831-22e456a29f46 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.175087 Nov 02 13:02:53.285385 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3625/6999] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:53 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:54.313896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:54.314596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:54.322071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:54.322594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:54.323097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:54.323843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:54.324323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:54.324776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:54.491861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:54.501236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79a2bba9-075d-44ed-88f5-f5f6506ae3e7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.194963 Nov 02 13:02:54.502124 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3626/7000] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:54 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:55.525443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:55.526139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:55.533229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:55.533734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:55.534182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:55.534901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:55.535393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:55.535829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:55.674961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:55.685365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-635d53f9-1a24-4b8a-b803-b6a3692c6365 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.164562 Nov 02 13:02:55.685981 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3627/7001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:55 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:56.709259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:56.710134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:56.717674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:56.718188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:56.718645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:56.719406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:56.719880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:56.720322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:56.868263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:56.876446 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68cb9163-338d-4654-98fa-7dd904b81fba tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.171561 Nov 02 13:02:56.877035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3628/7002] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:56 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:57.899873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:57.900604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:57.907570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:57.908078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:57.908537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:57.910054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:57.910054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:57.910254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:58.050428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:58.058936 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49720a37-2369-4c54-8ae6-eb83ea29f4ed tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.163052 Nov 02 13:02:58.059571 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3629/7003] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:57 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:59.083590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:59.084290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:59.092327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:59.092853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:59.093312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:59.094220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:59.094719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:59.095206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:59.241740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:59.250367 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e16532d-82a2-4a56-bda8-2c9549bf1ed9 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.170825 Nov 02 13:02:59.251024 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3630/7004] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:59 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:00.274546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:00.275238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:00.282414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:00.282937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:00.283417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:00.284153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:00.284639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:00.285090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:00.430492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:00.434775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbc8622f-4db2-4e9a-8011-4e45b9685df6 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.164706 Nov 02 13:03:00.435513 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3631/7005] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:00 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:00.954831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25ee502-db14-433f-a48f-f358e1bdd0ee", "name": "network-vif-plugged", "status": "completed", "tag": "a06189f9-f6ee-4b22-a63e-3fd9e7b556d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:00.964527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:00.965020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:00.965457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:00.976701 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] Creating event network-vif-plugged:a06189f9-f6ee-4b22-a63e-3fd9e7b556d0 for instance a25ee502-db14-433f-a48f-f358e1bdd0ee on n-h1-855649-4 Nov 02 13:03:00.981787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ab17e289-671b-47fb-88bf-b0b37751a0e4 req-97d0903e-9d89-49dc-9071-bf7a5ff7f15e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082261 Nov 02 13:03:00.982388 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3632/7006] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:03:01.459961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:01.460686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:01.462699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:01.467829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:01.468445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:01.468787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:01.469506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:01.470116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:01.470561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:01.613980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:01.622521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2b53755b-1c8a-43b4-97b0-fd4f0f4ae9cf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1265 microversion: 2.1 time: 0.167793 Nov 02 13:03:01.623136 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3633/7007] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:01 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:02.646556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:02.647343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:02.654302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:02.654807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:02.655365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:02.656083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:02.656551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:02.656985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:02.795934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:02.803872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dbbd9f67-54e3-4bd6-b36c-88d29bf40058 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1451 microversion: 2.1 time: 0.161817 Nov 02 13:03:02.804452 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3634/7008] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:02 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:03:02.826359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:02.827002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:03:02.833056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:02.833627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:02.834006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:02.834722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:02.835225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:02.835667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:02.982810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:03:02.991990 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-062ec767-043c-4ffb-a90b-a38506bf3f01 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1451 microversion: 2.1 time: 0.169381 Nov 02 13:03:02.994868 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3635/7009] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:03:02 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:03:05.825305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25ee502-db14-433f-a48f-f358e1bdd0ee", "tag": "a06189f9-f6ee-4b22-a63e-3fd9e7b556d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:05.838480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:05.839202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:05.839758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:05.855201 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] Creating event network-changed:a06189f9-f6ee-4b22-a63e-3fd9e7b556d0 for instance a25ee502-db14-433f-a48f-f358e1bdd0ee on n-h1-855649-4 Nov 02 13:03:05.861119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-1cc9f2d5-4303-4255-a881-9d84feb49ea3 req-71890830-1681-45df-b89c-4500209b4247 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041486 Nov 02 13:03:05.868774 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3636/7010] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:03:11.439602 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:03:11.440220 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:03:11.441686 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:03:11.441855 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:03:11.444813 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:03:11.444951 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:05:33.396181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-780428123", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-54344281", "security_groups": [{"name": "tempest-secgroup-smoke-1790002814"}], "block_device_mapping_v2": [{"uuid": "5fbc2be1-54b2-426d-974b-44d3e5a18a00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:33.407290 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:05:33.408252 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:05:33.408873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:33.409573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=86 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:33.411174 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:05:33.411348 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:05:33.412547 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:05:33.412736 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:05:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:05:33.684684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] validate_networks() for [('925a3cf1-f097-402d-b667-9c556fc94a66', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:34.094728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:05:34.095263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:05:34.095777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:05:34.096210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:05:34.096647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:05:34.107748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:34.108381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:34.108709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:34.109454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:34.110052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:34.110408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:34.128333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:34.134615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:34.196835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:05:34.199241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fbc2be1-54b2-426d-974b-44d3e5a18a00',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:05:34.417150 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50294. Nov 02 13:05:34.419582 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50296. Nov 02 13:05:34.804883 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d5d846e-7e59-4e60-86e6-6868e07b5d55 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.413647 Nov 02 13:05:34.805560 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3637/7011] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:05:34.819000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-540b190e-04d6-47a4-8bb1-f954f5c1b692 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:34.819636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-540b190e-04d6-47a4-8bb1-f954f5c1b692 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:34.877472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-540b190e-04d6-47a4-8bb1-f954f5c1b692 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:34.885525 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-540b190e-04d6-47a4-8bb1-f954f5c1b692 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1092 microversion: 2.1 time: 0.070194 Nov 02 13:05:34.887967 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3638/7012] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:34 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:35.909112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:35.909801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:35.918161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:35.918671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:35.919159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:35.919890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:35.920405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:35.920856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:35.985620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:35.994821 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5897b61e-4557-45e8-9f96-246eaa650c05 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1142 microversion: 2.1 time: 0.089671 Nov 02 13:05:35.995377 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3639/7013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:35 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:37.018123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:37.018805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:37.026787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:37.027506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:37.027840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:37.028560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:37.029150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:37.029593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:37.105127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:37.116971 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75cab66a-ca99-4fd7-bad7-4ea8ebfaad6b tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1198 microversion: 2.1 time: 0.100171 Nov 02 13:05:37.116971 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3640/7014] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:37 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:38.140118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:38.140860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:38.148774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:38.149288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:38.150803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:38.152308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:38.153019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:38.153468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:38.383136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:38.392969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-82e5e6ed-347e-4bed-990c-be5ad3a9b249 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1276 microversion: 2.1 time: 0.256753 Nov 02 13:05:38.409792 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3641/7015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:38 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:39.251224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f36226-c3ac-4fb2-9fd4-f37d899a2398", "tag": "67cfba29-01b5-4efd-a2f8-bdd99638aea3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:39.261907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:39.262403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:39.263185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:39.280083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] Creating event network-changed:67cfba29-01b5-4efd-a2f8-bdd99638aea3 for instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 on n-h2-855649-4 Nov 02 13:05:39.287523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ff692516-e1e9-4450-b713-b718af571228 req-59a9d3f2-43fb-4734-8739-fa59e0baac5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046292 Nov 02 13:05:39.289079 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3642/7016] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:39.420000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:39.421389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:39.430640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:39.431428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:39.431901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:39.433299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:39.433708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:39.434217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:39.683918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:39.693561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21b85cb8-1fe8-4369-9109-2313d198ab18 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1276 microversion: 2.1 time: 0.278776 Nov 02 13:05:39.701882 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3643/7017] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:39 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:40.717674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:40.718413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:40.731138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:40.733963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:40.733963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:40.733963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:40.733963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:40.733963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:40.890197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:40.900074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79d513b1-1591-409c-a81a-ebbdf9b15cf3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1276 microversion: 2.1 time: 0.186272 Nov 02 13:05:40.900785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3644/7018] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:40 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:41.924125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:41.924947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:41.932177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:41.932690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:41.933154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:41.933986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:41.934475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:41.934923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:42.088160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:42.097757 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4dc77662-5fc4-4468-9e9f-9e813515d354 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1276 microversion: 2.1 time: 0.177523 Nov 02 13:05:42.098358 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3645/7019] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:41 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:43.121550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:43.122219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:43.129751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:43.130155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:43.130609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:43.131369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:43.132480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:43.132921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:43.278263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:43.288189 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45907e95-3407-4719-bd48-55e69ecd8797 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1276 microversion: 2.1 time: 0.170388 Nov 02 13:05:43.288780 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3646/7020] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:43 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:44.311553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:44.312367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:44.314939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:44.321723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:44.322235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:44.322695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:44.323457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:44.323994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:44.328050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:44.473977 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:44.483838 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e0cf8ce-8393-411a-8c20-b7cf090e2e69 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.176217 Nov 02 13:05:44.484525 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3647/7021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:44 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:45.509042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:45.509760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:45.511707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:45.517859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:45.518363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:45.518811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:45.519565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:45.520033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:45.520473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:45.677449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:45.686655 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fa86dab-73c0-4344-9325-dfd0678a7953 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.181550 Nov 02 13:05:45.687287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3648/7022] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:45 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:46.709670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:46.710404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:46.717372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:46.717869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:46.718334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:46.719059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:46.719559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:46.719998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:46.861256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:46.870014 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-22b2a665-65d8-49f3-a556-44e9d1198b95 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.164259 Nov 02 13:05:46.870652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3649/7023] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:46 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:47.893810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:47.894507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:47.902118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:47.909628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:47.909628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:47.909628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:47.909628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:47.909628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:48.044192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:48.052471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6d330e2a-e750-4f84-8755-3d2f5d8e428a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.162626 Nov 02 13:05:48.053075 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3650/7024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:47 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:49.076466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:49.077237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:49.084171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:49.084670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:49.085156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:49.085862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:49.086332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:49.086807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:49.226332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:49.234540 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be21930b-d4a6-4ff4-8139-cce021b4446d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.161872 Nov 02 13:05:49.235156 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3651/7025] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:49 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:50.262917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:50.263634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:50.270584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:50.271126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:50.271576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:50.272318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:50.272787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:50.273231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:50.409726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:50.418455 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f535300-7b34-4be2-8e08-7975585f4edf tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.163141 Nov 02 13:05:50.419057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3652/7026] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:50 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:51.442411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:51.443084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:51.450530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.451070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.451525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.452242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:51.452716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:51.453163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:51.594273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:51.602346 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93aa5e21-122b-48b8-8fee-0ee7c25f23d7 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.164212 Nov 02 13:05:51.602928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3653/7027] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:51 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:52.625014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:52.625702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:52.632599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:52.635783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:52.635783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:52.635783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:52.635783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:52.635783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:52.768804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:52.777415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a7d688bb-fb90-431d-b415-59254865d29d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.156399 Nov 02 13:05:52.778062 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3654/7028] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:52 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:53.801300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:53.801984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:53.808781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:53.809275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:53.809795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:53.810481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:53.810952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:53.813832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:53.951917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:53.955424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=100 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:53.960939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-47a66ade-80d8-47b5-b916-37e1049b651c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.162716 Nov 02 13:05:53.961664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3655/7029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:53 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:54.485529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f36226-c3ac-4fb2-9fd4-f37d899a2398", "name": "network-vif-plugged", "status": "completed", "tag": "67cfba29-01b5-4efd-a2f8-bdd99638aea3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:54.495793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:54.500375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:54.500375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:54.508783 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] Creating event network-vif-plugged:67cfba29-01b5-4efd-a2f8-bdd99638aea3 for instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 on n-h2-855649-4 Nov 02 13:05:54.513924 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f7dc077e-b964-4720-9184-a93c5f9c8446 req-ea0cc77c-2ea5-428c-93ea-d60550c5ce96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Nov 02 13:05:54.514615 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3656/7030] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:54.984809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:54.985545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:54.991946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:54.992457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:54.992916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:54.993743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:54.994096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:54.994539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:55.133299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:55.141725 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fd25ab6-b034-4e3f-b79f-042f15dc9df3 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.161979 Nov 02 13:05:55.142312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3657/7031] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:54 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:56.165811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:56.166473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:56.173665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:56.174172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:56.174626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:56.175405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:56.175879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:56.176323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:56.316690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:56.325532 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b40974bb-8ac1-43d5-adbe-72063540954a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1264 microversion: 2.1 time: 0.163805 Nov 02 13:05:56.326158 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3658/7032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:56 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:57.349847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:57.351134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:57.358042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:57.358533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:57.359001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:57.359728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:57.360188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:57.360626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:57.498546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:57.507905 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-61163bb7-d551-4fce-b789-e0a24c653816 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1451 microversion: 2.1 time: 0.162323 Nov 02 13:05:57.508495 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3659/7033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:57 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:05:57.531401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:57.531956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:57.538410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:57.538920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:57.539501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:57.540264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:57.540723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:57.541168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:57.686647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:57.695719 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-164340b3-cc41-490d-a081-82d9edfb1c3e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1451 microversion: 2.1 time: 0.168189 Nov 02 13:05:57.696318 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3660/7034] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:57 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:06:00.071360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f36226-c3ac-4fb2-9fd4-f37d899a2398", "tag": "67cfba29-01b5-4efd-a2f8-bdd99638aea3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:00.082568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:06:00.083229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:06:00.086312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:06:00.097458 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] Creating event network-changed:67cfba29-01b5-4efd-a2f8-bdd99638aea3 for instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 on n-h2-855649-4 Nov 02 13:06:00.103834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-133aecdf-f219-4084-a94e-b17063419112 req-c626fb70-d7f6-44b9-89fa-af81f77f51ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036278 Nov 02 13:06:00.104739 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3661/7035] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:06:31.457548 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:06:31.457548 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:06:31.461078 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:06:31.461264 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:06:31.462254 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:06:31.462394 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:08:26.652338 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 13:08:26.653314 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 13:08:26.654040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:26.654814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=28 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:26.661179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:26.665885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:26.675184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:26.675788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:26.676313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:26.677037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:26.677502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:26.677934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:26.708554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:08:27.231738 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02bff32a-4239-40f1-86a2-8c7622a489b1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 204 len: 0 microversion: 2.1 time: 0.581336 Nov 02 13:08:27.232372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3662/7036] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:26 2022] DELETE /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:08:27.312176 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f36226-c3ac-4fb2-9fd4-f37d899a2398", "tag": "67cfba29-01b5-4efd-a2f8-bdd99638aea3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:27.322886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:27.323412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:27.323865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:27.336649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] Creating event network-changed:67cfba29-01b5-4efd-a2f8-bdd99638aea3 for instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 on n-h2-855649-4 Nov 02 13:08:27.342322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-68491c2c-66bf-456c-965c-9e83c8f26d8e req-fe15943b-e1f3-4a0e-8c57-768577515b68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108419 Nov 02 13:08:27.342972 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3663/7037] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:27.349030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:27.349880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:27.358211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:27.359873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:27.362436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:27.362436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:27.362436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:27.363522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:27.593354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:27.604705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e1ddfd7-521c-47fd-b0c0-a04338b5dea1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1575 microversion: 2.1 time: 0.260398 Nov 02 13:08:27.605442 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3664/7038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:27 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:28.656512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:28.658162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:28.669766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:28.670504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:28.671157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:28.672118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:28.672738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:28.673323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:28.682696 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50428. Nov 02 13:08:28.697430 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50426. Nov 02 13:08:28.840956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:28.852166 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49eb7f78-aa2b-4d35-9cc8-45f6bb51065e tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1575 microversion: 2.1 time: 0.210781 Nov 02 13:08:28.852914 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3665/7039] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:28 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:29.880989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:29.882411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:29.892468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:29.893702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:29.895262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:29.896395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:29.897255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:29.898077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:29.990832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:30.006879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4badce13-0cb6-43f0-8a06-126cf78e258a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1389 microversion: 2.1 time: 0.132371 Nov 02 13:08:30.008040 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3666/7040] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:29 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1389 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:30.016883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f36226-c3ac-4fb2-9fd4-f37d899a2398", "name": "network-vif-deleted", "tag": "67cfba29-01b5-4efd-a2f8-bdd99638aea3"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:30.038887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:30.039624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:30.040263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:30.061018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] Creating event network-vif-deleted:67cfba29-01b5-4efd-a2f8-bdd99638aea3 for instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 on n-h2-855649-4 Nov 02 13:08:30.070107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9dae6bf2-3a26-48d0-b546-2833a35055b3 req-fedf854f-b1f6-460d-883e-23df4dd6721f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060061 Nov 02 13:08:30.071009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3667/7041] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:31.038771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:31.039568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:31.047401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.048294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.049141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.050575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:31.051500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:31.052457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:31.148676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:31.164299 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-481d5a6f-b142-449f-a4ca-b49c31e3e997 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1223 microversion: 2.1 time: 0.131321 Nov 02 13:08:31.165432 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3668/7042] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:31 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:32.194834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:32.195986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:32.208402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:32.209245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:32.209963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:32.211240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:32.212122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:32.212810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:32.304589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:32.313790 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da6f62a0-2ac4-423f-9cdd-3e77fd8d89fc tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1223 microversion: 2.1 time: 0.126682 Nov 02 13:08:32.314401 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3669/7043] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:32 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:33.338102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:33.338880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:33.347317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:33.348108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:33.348640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:33.349581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:33.350186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:33.350818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:33.422940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:33.432205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-531199d3-dec3-40cb-9129-b1de223c66e8 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1223 microversion: 2.1 time: 0.098035 Nov 02 13:08:33.433003 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3670/7044] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:33 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:34.460614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:34.461307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:34.468964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.469581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.470232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.470929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:34.471441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:34.471908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:34.556504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:34.569505 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5ec6919b-4581-483b-b4b4-baba96c85cf1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1223 microversion: 2.1 time: 0.114272 Nov 02 13:08:34.570227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3671/7045] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:34 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:35.596100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:35.597189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:35.610401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.611379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.611654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.612363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.612852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.613413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.653061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:35.653623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:35.654107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:35.654686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lazy-loading 'fault' on Instance uuid c9f36226-c3ac-4fb2-9fd4-f37d899a2398 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:08:35.715715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:35.724538 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98e3d3c9-0c3d-4f94-b073-a3cab783d618 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 200 len: 1228 microversion: 2.1 time: 0.132688 Nov 02 13:08:35.725189 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3672/7046] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:35 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 1228 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:36.749864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:36.750614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: c9f36226-c3ac-4fb2-9fd4-f37d899a2398] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:36.758764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:36.759308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:36.759798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:36.760515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:36.761105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:36.761564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:36.778176 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 HTTP/1.1 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c9f36226-c3ac-4fb2-9fd4-f37d899a2398'} Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:36.780367 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance c9f36226-c3ac-4fb2-9fd4-f37d899a2398 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41347549-74dc-4d3a-bcfc-99b53610ceac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398" status: 404 len: 111 microversion: 2.1 time: 0.037289 Nov 02 13:08:36.786346 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3673/7047] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:36 2022] GET /compute/v2.1/servers/c9f36226-c3ac-4fb2-9fd4-f37d899a2398 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:08:46.083827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:46.084601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:46.093985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.094594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.095214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.096099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.097110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.097870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.131348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:08:46.678490 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f5fbde27-ab4f-4ba6-a54f-931e9074956d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 204 len: 0 microversion: 2.1 time: 0.599954 Nov 02 13:08:46.679197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3674/7048] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:46 2022] DELETE /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:08:46.690545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25ee502-db14-433f-a48f-f358e1bdd0ee", "tag": "a06189f9-f6ee-4b22-a63e-3fd9e7b556d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:46.702240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.703216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.703962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.726286 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] Creating event network-changed:a06189f9-f6ee-4b22-a63e-3fd9e7b556d0 for instance a25ee502-db14-433f-a48f-f358e1bdd0ee on n-h1-855649-4 Nov 02 13:08:46.735834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6c1841b6-e76f-4d60-83ae-d35ae3ac5686 req-ae38afb3-18a0-4411-9d3c-05520257ebf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054595 Nov 02 13:08:46.737984 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3675/7049] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:46.748308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:46.749497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:46.762772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.774449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.774449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:46.774449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:46.774449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:46.774449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:47.040131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:47.050928 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73e59aa1-5279-44b3-ad8d-488e15bdac0c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1576 microversion: 2.1 time: 0.310910 Nov 02 13:08:47.052225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3676/7050] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:46 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1576 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:48.090642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:48.097560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:48.100675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:48.101219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:48.101702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:48.102625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:48.103155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:48.103626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:48.130901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:48.197382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:48.212625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06c923ed-5e90-4ee6-8dde-a52556c3a9ac tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1389 microversion: 2.1 time: 0.126492 Nov 02 13:08:48.213719 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3677/7051] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:48 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1389 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:48.759355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25ee502-db14-433f-a48f-f358e1bdd0ee", "name": "network-vif-deleted", "tag": "a06189f9-f6ee-4b22-a63e-3fd9e7b556d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:48.779102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:48.780030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:48.780842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:48.798773 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] Creating event network-vif-deleted:a06189f9-f6ee-4b22-a63e-3fd9e7b556d0 for instance a25ee502-db14-433f-a48f-f358e1bdd0ee on n-h1-855649-4 Nov 02 13:08:48.806451 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6af84e43-b102-4309-8371-6df7c28150d8 req-a6b80faa-8107-4851-bdac-f4c1454fa713 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055096 Nov 02 13:08:48.807117 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3678/7052] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:08:49.260223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:49.261531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:49.273392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:49.274013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:49.274567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:49.275453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:49.276100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:49.276596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:49.375800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:49.388522 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd1ecc04-dbdf-4bcf-b5d8-4e6edcbee498 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1224 microversion: 2.1 time: 0.137937 Nov 02 13:08:49.389523 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3679/7053] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:49 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:50.433246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:50.434293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:50.447954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:50.448863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:50.449725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:50.451080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:50.451971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:50.452740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:50.560738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:50.573359 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67e69ef6-550d-4515-b6e2-c26ef093d2be tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1224 microversion: 2.1 time: 0.148336 Nov 02 13:08:50.574484 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3680/7054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:50 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:08:51.610527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:51.611821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:51.625812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:51.626664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:51.627532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:51.629060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:51.629883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:51.630784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:51.750647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:51.765084 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-749afb88-024f-4acb-bdbc-a5e7e2884164 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1224 microversion: 2.1 time: 0.161208 Nov 02 13:08:51.766155 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3681/7055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:51 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1224 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:52.796352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:52.798120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:52.807286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:52.807812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:52.808285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:52.809059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:52.809557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:52.810012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:52.904178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:52.921476 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0338ac92-e41e-4b1e-802e-6e9be5d10dc1 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1224 microversion: 2.1 time: 0.131714 Nov 02 13:08:52.922479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3682/7056] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:52 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:53.964347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:53.965862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:53.973856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:53.974772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:53.975323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:53.976085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:53.976590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:53.977209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:54.071543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:54.083901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-024de96f-1dda-4162-8ad1-0b6e9d198003 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1224 microversion: 2.1 time: 0.125579 Nov 02 13:08:54.084937 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3683/7057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:53 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:54.889933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:08:54.890646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:08:54.891469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:08:54.892176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:08:54.892983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:08:54.910470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:54.911514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:54.912335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:54.913737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:54.914621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:54.915461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:54.948143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:08:54.954806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Getting quotas for user 01e333f38c5a4820bc25f24bd99faf79 and project 2b7677b3cc1140bfbd8e29524b091b19. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:08:55.115021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:55.116229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:55.120167 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 353 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: {"server": {"name": "tempest-TestVolumeBootPattern-server-987204116", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "25843726-6c3e-495e-9777-33455aa12c39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "925a3cf1-f097-402d-b667-9c556fc94a66"}]}} Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: exception: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-987204116', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '25843726-6c3e-495e-9777-33455aa12c39'}], 'networks': [{'uuid': '925a3cf1-f097-402d-b667-9c556fc94a66'}]}}} Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. (HTTP 404) (Request-ID: req-68c2a586-ea88-44ec-9a70-9fa107530215) Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:08:55.125459 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1395, in _provision_instances Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi volumes = self._get_volumes_for_bdms(context, block_device_mapping) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1259, in _get_volumes_for_bdms Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi volumes[bdm.volume_id] = self.volume_api.get( Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. Nov 02 13:08:55.133895 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 400 to user: Volume 25843726-6c3e-495e-9777-33455aa12c39 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 107 microversion: 2.1 time: 900.764142 Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:08:55 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.48) Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: CRITICAL nova [None req-7ac8134c-d3f5-4b04-96de-0671b82dc25d tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Unhandled error: OSError: write error Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova OSError: write error Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova Nov 02 13:08:55.143673 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3375/7058] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 12:53:54 2022] POST /compute/v2.1/servers => generated 0 bytes in 900775 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Nov 02 13:08:55.148077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:55.148972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:55.150474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:55.151195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:55.152082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:55.152878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:55.214571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:55.215414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:55.216218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:55.216971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lazy-loading 'fault' on Instance uuid a25ee502-db14-433f-a48f-f358e1bdd0ee {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:08:55.278417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e333f38c5a4820bc25f24bd99faf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7677b3cc1140bfbd8e29524b091b19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:08:55.289238 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-338da725-3662-4a92-ab22-d2cb467453bd tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 200 len: 1183 microversion: 2.1 time: 0.181670 Nov 02 13:08:55.290426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3684/7059] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:55 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 1183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:08:56.326518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:56.327473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: a25ee502-db14-433f-a48f-f358e1bdd0ee] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:56.335979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:56.336479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:56.336927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:56.337807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:56.338294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:56.338731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:56.354770 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee HTTP/1.1 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'a25ee502-db14-433f-a48f-f358e1bdd0ee'} Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:56.356443 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance a25ee502-db14-433f-a48f-f358e1bdd0ee could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4252057b-6cd2-4c3e-b836-6737655ff47c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee" status: 404 len: 111 microversion: 2.1 time: 0.039524 Nov 02 13:08:56.361783 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3376/7060] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:56 2022] GET /compute/v2.1/servers/a25ee502-db14-433f-a48f-f358e1bdd0ee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:08:57.108774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:57.109721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:57.123006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.123640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.124225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.125195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.125826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.126328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.142893 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 HTTP/1.1 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '398200f5-691d-457f-935c-61d71867dda9'} Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:08:57.145544 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4dffb29-4426-4226-9351-a3c2cc259f4c tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 404 len: 111 microversion: 2.1 time: 0.046238 Nov 02 13:08:57.152603 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3685/7061] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:08:57 2022] DELETE /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:08:57.163963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:57.164945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [instance: 398200f5-691d-457f-935c-61d71867dda9] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:08:57.177141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.177935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.178590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.179891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:08:57.180815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:08:57.181573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:08:57.210049 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] HTTP exception thrown: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Request method failure captured: Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 HTTP/1.1 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmgspHXtBwtTcw30ufc1_k37LWicG_w6GIJ_bqDjTDHuDdhgJYyUSlxIsydhaXrMJaZczK4NFb2yOyF8ddszplwza89KXPOc8nGar5qHD4ySwRF79OEsktFih1eagA5_eGtv37G0-OzAvXs1QdEB6mT5LUa2OtDb-VtuR-d5lS4fbzk Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2b7677b3cc1140bfbd8e29524b091b19", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2b7677b3cc1140bfbd8e29524b091b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2b7677b3cc1140bfbd8e29524b091b19 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1040602962 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 01e333f38c5a4820bc25f24bd99faf79 Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestVolumeBootPattern-1040602962-project Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '398200f5-691d-457f-935c-61d71867dda9'} Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:57.213354 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Returning 404 to user: Instance 398200f5-691d-457f-935c-61d71867dda9 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da312ebe-9df0-4ab6-8d2b-0bca1f3b9af5 tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9" status: 404 len: 111 microversion: 2.1 time: 0.060274 Nov 02 13:08:57.217637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3377/7062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:08:57 2022] GET /compute/v2.1/servers/398200f5-691d-457f-935c-61d71867dda9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:09:02.192141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79ace398-3f6a-4db2-b58c-471ec9ca686a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] Calling method '.version_select at 0x7ff1b2e1b550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:02.197386 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79ace398-3f6a-4db2-b58c-471ec9ca686a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:09:03.208971 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-79ace398-3f6a-4db2-b58c-471ec9ca686a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50538. Nov 02 13:09:03.218762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:03.348445 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79ace398-3f6a-4db2-b58c-471ec9ca686a tempest-TestVolumeBootPattern-1040602962 tempest-TestVolumeBootPattern-1040602962-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-54344281" status: 202 len: 0 microversion: 2.1 time: 1.162355 Nov 02 13:09:03.349244 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3686/7063] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 13:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-54344281 => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:09:32.966938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:32.967801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:32.968737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:32.969617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:33.114565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-847554526", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:33.188113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] validate_networks() for None {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:09:33.679135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:09:33.679572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:09:33.680087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:09:33.680514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:09:33.680951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:09:33.694477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:33.695301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:33.695769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:33.696553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:33.697087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:33.697529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:33.719513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Getting quotas for project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:09:33.725795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Getting quotas for user 7473f81f1fbe4d55991abaa0cc59449b and project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:09:33.743060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:09:33.745464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:09:33.945200 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:09:34.954096 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50644. Nov 02 13:09:34.958251 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26a07dc0-9090-4c81-a5bd-5fa0ab57e67f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.996386 Nov 02 13:09:34.959064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3378/7064] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:09:34.973201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-027d3037-177e-4f32-b83b-588d98073bea tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:34.973866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-027d3037-177e-4f32-b83b-588d98073bea tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:34.976776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:35.050970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-027d3037-177e-4f32-b83b-588d98073bea tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:35.061263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-027d3037-177e-4f32-b83b-588d98073bea tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1221 microversion: 2.1 time: 0.091574 Nov 02 13:09:35.061820 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3687/7065] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:34 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:36.101731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74da8613-35c7-4ec4-aa7c-e46f0362f7e2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:36.102535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74da8613-35c7-4ec4-aa7c-e46f0362f7e2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:36.165064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74da8613-35c7-4ec4-aa7c-e46f0362f7e2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:36.174523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74da8613-35c7-4ec4-aa7c-e46f0362f7e2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1221 microversion: 2.1 time: 0.078197 Nov 02 13:09:36.175164 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3379/7066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:36 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:09:37.198781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:37.199482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:37.207598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:37.211724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:37.211724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:37.211724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:37.211724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:37.211724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:37.285670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:37.294862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d706b9bf-4ad4-4a34-8677-e35804de026d tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1217 microversion: 2.1 time: 0.100070 Nov 02 13:09:37.295911 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3688/7067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:37 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:38.321043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:38.325742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:38.330148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:38.330627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:38.331314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:38.332095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:38.332810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:38.333287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:38.424857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:38.434673 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9675af60-5e1e-4ced-a0b6-71aa63bcfbdf tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1279 microversion: 2.1 time: 0.116805 Nov 02 13:09:38.434966 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3380/7068] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:38 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:39.458455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:39.459216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:39.466736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:39.467308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:39.467751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:39.468723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:39.469234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:39.469657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:39.646128 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:39.659552 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f12291d-b43e-49be-ac47-5aa0e8610b3b tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.205451 Nov 02 13:09:39.660496 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3689/7069] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:39 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:40.687900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:40.688529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:40.696239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:40.696751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:40.697819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:40.698049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:40.698416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:40.699045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:40.795862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725d644a-5a56-4de2-9549-7127607c5808", "tag": "3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:40.815657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:40.816624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:40.817427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:40.839999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] Creating event network-changed:3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4 for instance 725d644a-5a56-4de2-9549-7127607c5808 on n-h1-855649-4 Nov 02 13:09:40.849028 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8194a95b-4f60-409a-868a-6a713babdefc req-7d47f91f-a638-4ed0-bc9b-22ede2034c0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061455 Nov 02 13:09:40.850501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3690/7070] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:09:40.974892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:40.989294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3fdcf94-bb56-491d-af85-be62bb25f6c4 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.305276 Nov 02 13:09:40.990523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3381/7071] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:40 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:42.029283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:42.029995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:42.037272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:42.037765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:42.038215 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:42.039052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:42.039521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:42.039963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:42.228074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:42.237613 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-929bba29-6e8e-4e8c-8286-3c319940bee2 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.213537 Nov 02 13:09:42.238107 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3691/7072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:42 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:43.275385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:43.276425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:43.284618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:43.285187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:43.285632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:43.286384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:43.286860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:43.287329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:43.460099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:43.473157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9a0213e6-5b58-4c97-9e63-955b1ab7c860 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.201679 Nov 02 13:09:43.474205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3382/7073] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:43 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:44.509061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:44.509691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:44.517284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:44.518290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:44.518740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:44.519513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:44.519974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:44.520414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:44.678002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:44.692664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8914ae7c-359d-44bc-969f-bcdbbff66032 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.187072 Nov 02 13:09:44.693766 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3692/7074] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:44 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:45.729593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:45.730831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:45.733622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:45.743662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:45.744539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:45.745336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:45.748102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:45.748102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:45.748354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:45.908071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:45.916916 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d73630e3-e37b-4c76-9e5c-0212038b3fef tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.194907 Nov 02 13:09:45.917535 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3383/7075] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:45 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:46.946647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:46.947971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:46.953046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:46.962730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:46.963649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:46.964466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:46.965809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:46.966697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:46.967593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:46.989350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:47.061775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725d644a-5a56-4de2-9549-7127607c5808", "name": "network-vif-plugged", "status": "completed", "tag": "3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:47.074330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:47.074820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:47.075294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:47.093367 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] Creating event network-vif-plugged:3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4 for instance 725d644a-5a56-4de2-9549-7127607c5808 on n-h1-855649-4 Nov 02 13:09:47.098625 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] [7e1d812c-0ebb-46c7-a8bc-9ed007a3cf0a] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:09:47.151339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:47.161710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-52f6775a-0eba-436f-9644-cfa1d07a6d99 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.222904 Nov 02 13:09:47.162775 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3693/7076] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:46 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:48.106971 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] [7e1d812c-0ebb-46c7-a8bc-9ed007a3cf0a] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50688. Nov 02 13:09:48.111953 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8c69be3e-dd5f-48c3-a12d-6455b8650f84 req-d02dde77-9810-4407-9f16-76abc5d40e2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.129200 Nov 02 13:09:48.112605 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3384/7077] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:48.188384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:48.189800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:48.197099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:48.197612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:48.198074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:48.198821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:48.199332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:48.199782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:48.380326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:48.396382 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed2d754b-10a6-41bf-a662-15097c2c0e43 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.212595 Nov 02 13:09:48.397511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3694/7078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:48 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:49.438671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:49.440277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:49.447739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:49.448310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:49.448792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:49.449603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:49.450080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:49.450519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:49.665749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:49.675854 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f87ae73d-de9f-4a8e-942a-b8ab53041057 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1321 microversion: 2.1 time: 0.245273 Nov 02 13:09:49.689025 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3385/7079] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:49 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:50.700001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:50.700870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:50.709970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:50.710571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:50.711255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:50.712371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:50.712919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:50.713413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:50.895538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:50.904412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b487346-5020-4e28-ba98-2f68b337ef15 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1471 microversion: 2.1 time: 0.208558 Nov 02 13:09:50.905017 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3695/7080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:50 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:51.001212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01e9682a-0974-4c63-b1e4-e81396245aa3 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '.version_select at 0x7ff1b35ef040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:51.090749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01e9682a-0974-4c63-b1e4-e81396245aa3 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/2ef0f22730c248a09e49fac7c1284349" status: 200 len: 371 microversion: 2.1 time: 0.162713 Nov 02 13:09:51.091791 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3386/7081] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 13:09:50 2022] GET /compute/v2.1/os-quota-sets/2ef0f22730c248a09e49fac7c1284349 => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:51.110297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee959b03-941d-4666-bb68-52527ff3e69d tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-804620548", "id": 1478445479, "os-flavor-access:is_public": "True"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:51.282276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee959b03-941d-4666-bb68-52527ff3e69d tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.175560 Nov 02 13:09:51.283371 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3696/7082] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:09:51 2022] POST /compute/v2.1/flavors => generated 437 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:09:51.297467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1478445479"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:51.300532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:51.307002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:51.307591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:51.308035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:51.308759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:51.309221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:51.309650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:51.405926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9446df391426441faa3fd7cbd77b8492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef0f22730c248a09e49fac7c1284349', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:51.414640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-804620548 {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:09:51.424612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:51.425099 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:51.425628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:51.426659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:51.427363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:51.428105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:51.455954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Getting quotas for project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:09:51.461968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Getting quotas for user 7473f81f1fbe4d55991abaa0cc59449b and project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:09:51.474566 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:09:51.474892 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action (ip 10.222.0.48) !!! Nov 02 13:09:51.482157 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] ram quota exceeded for 2ef0f22730c248a09e49fac7c1284349, tried to resize instance. Nov 02 13:09:51.482760 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Request method failure captured: Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action HTTP/1.1 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 39 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmwMI7j01t8GpxHi0LHMw9l6HnC9Fu5dfm59R1wv4s9B0cP0kDFDJR46KdP2MSrYiK7zyITgDKiUjMbVKAxn6hbeXyCMDNa8ZsDka6QE9Q2YvwGBgZfAqfTbr6HtrvJtFVKBiyWh0uxazECF6kpPcX2XIWsfxt1WjXH_j3qta69tT1I Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 2ef0f22730c248a09e49fac7c1284349 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member,admin Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member,admin Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ef0f22730c248a09e49fac7c1284349", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 2ef0f22730c248a09e49fac7c1284349 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersAdminNegativeTestJSON-48826598-project-admin Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 9446df391426441faa3fd7cbd77b8492 Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-48826598-project-admin Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: {"resize": {"flavorRef": "1478445479"}} Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '725d644a-5a56-4de2-9549-7127607c5808', 'body': {'resize': {'flavorRef': '1478445479'}}} Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:51.484994 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1bf07361-63c8-492a-ae99-57f4314cbf5f tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action" status: 403 len: 118 microversion: 2.1 time: 0.194308 Nov 02 13:09:51.490396 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3387/7083] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:09:51 2022] POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action => generated 118 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:09:51.497679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d223a9f-d113-4bfb-8461-7ecf76a3294d tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:51.630283 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d223a9f-d113-4bfb-8461-7ecf76a3294d tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1478445479" status: 202 len: 0 microversion: 2.1 time: 0.137299 Nov 02 13:09:51.630884 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3697/7084] 10.222.0.48 () {58 vars in 1161 bytes} [Wed Nov 2 13:09:51 2022] DELETE /compute/v2.1/flavors/1478445479 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:09:51.640249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-241bac45-d184-4a9f-aa3f-94928f94702a tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:51.682831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-241bac45-d184-4a9f-aa3f-94928f94702a tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046845 Nov 02 13:09:51.683483 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3388/7085] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 13:09:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:51.726466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bccab5f9-1b28-407e-b2b9-10111ea628f2 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '.version_select at 0x7ff1b3700160>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:51.820908 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bccab5f9-1b28-407e-b2b9-10111ea628f2 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/2ef0f22730c248a09e49fac7c1284349" status: 200 len: 371 microversion: 2.1 time: 0.101289 Nov 02 13:09:51.821412 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3698/7086] 10.222.0.48 () {58 vars in 1242 bytes} [Wed Nov 2 13:09:51 2022] GET /compute/v2.1/os-quota-sets/2ef0f22730c248a09e49fac7c1284349 => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:51.834196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1441984c-a356-49f9-b508-ccc17041a1ca tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-326869369", "id": 537418553, "os-flavor-access:is_public": "True"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:52.003280 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1441984c-a356-49f9-b508-ccc17041a1ca tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.172924 Nov 02 13:09:52.004186 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3389/7087] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:09:51 2022] POST /compute/v2.1/flavors => generated 433 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:09:52.019421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "537418553"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:52.023595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:52.030742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.031273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.032134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.033728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.034216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.034674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.185414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9446df391426441faa3fd7cbd77b8492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef0f22730c248a09e49fac7c1284349', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:52.192826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-326869369 {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:09:52.200321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.200831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.201293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.202056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.202535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.203004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.226290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Getting quotas for project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:09:52.232164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Getting quotas for user 7473f81f1fbe4d55991abaa0cc59449b and project d3e8ab8c22384224a56f3341fccb64d1. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:09:52.245873 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.compute.api [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] cores quota exceeded for 2ef0f22730c248a09e49fac7c1284349, tried to resize instance. Nov 02 13:09:52.246417 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Request method failure captured: Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action HTTP/1.1 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 38 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmwMI7j01t8GpxHi0LHMw9l6HnC9Fu5dfm59R1wv4s9B0cP0kDFDJR46KdP2MSrYiK7zyITgDKiUjMbVKAxn6hbeXyCMDNa8ZsDka6QE9Q2YvwGBgZfAqfTbr6HtrvJtFVKBiyWh0uxazECF6kpPcX2XIWsfxt1WjXH_j3qta69tT1I Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 2ef0f22730c248a09e49fac7c1284349 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member,admin Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member,admin Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ef0f22730c248a09e49fac7c1284349", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ef0f22730c248a09e49fac7c1284349"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 2ef0f22730c248a09e49fac7c1284349 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-48826598 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-48826598-project-admin Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 9446df391426441faa3fd7cbd77b8492 Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-48826598-project-admin Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: {"resize": {"flavorRef": "537418553"}} Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '725d644a-5a56-4de2-9549-7127607c5808', 'body': {'resize': {'flavorRef': '537418553'}}} Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:52.248524 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d5f286eb-2c8a-4b3f-88ae-eac0634202ee tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action" status: 403 len: 113 microversion: 2.1 time: 0.235891 Nov 02 13:09:52.253881 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3699/7088] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:09:52 2022] POST /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808/action => generated 113 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:09:52.261892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1833095b-926b-409f-ae91-1e4cfc9126f5 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:52.384437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1833095b-926b-409f-ae91-1e4cfc9126f5 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/537418553" status: 202 len: 0 microversion: 2.1 time: 0.126383 Nov 02 13:09:52.385090 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3390/7089] 10.222.0.48 () {58 vars in 1158 bytes} [Wed Nov 2 13:09:52 2022] DELETE /compute/v2.1/flavors/537418553 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:09:52.394837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be0bc05d-c43b-4bc8-8962-2e2ed46ecc20 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:52.419318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be0bc05d-c43b-4bc8-8962-2e2ed46ecc20 tempest-ServersAdminNegativeTestJSON-48826598 tempest-ServersAdminNegativeTestJSON-48826598-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028672 Nov 02 13:09:52.420209 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3700/7090] 10.222.0.48 () {58 vars in 1146 bytes} [Wed Nov 2 13:09:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:52.442694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:52.443274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:52.450744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.451286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.451736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.452454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.452922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.453365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.480351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:09:52.944875 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a0e7ef6-63d5-4f6d-860b-83768ee6bc77 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 204 len: 0 microversion: 2.1 time: 0.506325 Nov 02 13:09:52.945766 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3391/7091] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:09:52 2022] DELETE /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:09:52.956222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:52.956854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:52.964068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.964567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.965026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:52.965756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:52.966228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:52.966673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:53.127041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:53.136339 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eda5fcfd-0e21-4c46-9919-15420417bd1f tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1477 microversion: 2.1 time: 0.183769 Nov 02 13:09:53.136923 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3701/7092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:52 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:54.170786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:54.171586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:54.179896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:54.180393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:54.180843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:54.181553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:54.182019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:54.182472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:54.762478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:54.773374 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c067fcb0-69b7-4cbc-a4b2-a36801ed9d16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1477 microversion: 2.1 time: 0.606469 Nov 02 13:09:54.774359 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3392/7093] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:54 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:09:55.223724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725d644a-5a56-4de2-9549-7127607c5808", "name": "network-vif-deleted", "tag": "3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:09:55.235433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:55.236001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:55.236426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:55.249717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] Creating event network-vif-deleted:3cada16d-7ce7-4472-b5bb-3ab56c6bd8b4 for instance 725d644a-5a56-4de2-9549-7127607c5808 on n-h1-855649-4 Nov 02 13:09:55.257725 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ed4ca0ba-78e3-4d79-bd11-93accba571b6 req-285152cd-175a-451d-bf8f-f1e71c0b6684 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037706 Nov 02 13:09:55.258626 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3702/7094] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:09:55.799087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:55.799777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:55.807124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:55.807621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:55.808063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:55.808775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:55.809232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:55.809663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:55.843548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:55.844032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:55.844472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:55.844925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lazy-loading 'fault' on Instance uuid 725d644a-5a56-4de2-9549-7127607c5808 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:09:55.891969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7473f81f1fbe4d55991abaa0cc59449b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e8ab8c22384224a56f3341fccb64d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:09:55.900465 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ee0c32e2-4b28-4b66-9177-d586ac790303 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 200 len: 1311 microversion: 2.1 time: 0.105719 Nov 02 13:09:55.901051 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3393/7095] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:55 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:09:56.926936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:09:56.927692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] [instance: 725d644a-5a56-4de2-9549-7127607c5808] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:09:56.934605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:56.935243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:56.935700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:56.936503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:09:56.936983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:09:56.937433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:09:56.952899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] HTTP exception thrown: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Request method failure captured: Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 HTTP/1.1 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmwLlYuNJXjs5Dj5aaS3G1uhPU8PlwiN2ntN_RHkTFUxXBump6qScCQiwOUQnr-GazYsIJ6vKz9_6AofK58xnlElToBnuF1YUs6GCK64ib8BQL6BeSOKGGJbWpazEwV-pyt-cuSY5wHk4g2WVOaE6VOJU_Olj-8kNt5IKjjdNeOvQ6s Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: d3e8ab8c22384224a56f3341fccb64d1 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2108723014 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d3e8ab8c22384224a56f3341fccb64d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d3e8ab8c22384224a56f3341fccb64d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d3e8ab8c22384224a56f3341fccb64d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d3e8ab8c22384224a56f3341fccb64d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2108723014 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: d3e8ab8c22384224a56f3341fccb64d1 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2108723014 Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersAdminNegativeTestJSON-2108723014-project Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7473f81f1fbe4d55991abaa0cc59449b Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2108723014-project Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '725d644a-5a56-4de2-9549-7127607c5808'} Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:56.955303 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] Returning 404 to user: Instance 725d644a-5a56-4de2-9549-7127607c5808 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2907a3c6-e781-4b06-8c6c-96e46cd39a16 tempest-ServersAdminNegativeTestJSON-2108723014 tempest-ServersAdminNegativeTestJSON-2108723014-project] 10.222.0.48 "GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808" status: 404 len: 111 microversion: 2.1 time: 0.035843 Nov 02 13:09:56.964318 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3703/7096] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:09:56 2022] GET /compute/v2.1/servers/725d644a-5a56-4de2-9549-7127607c5808 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:08.735496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:08.736903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:08.737679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:08.738358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:08.862901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1112980716", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "e1a92075-662e-43e4-a96d-6fb400138a26"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:08.922665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] validate_networks() for [('e1a92075-662e-43e4-a96d-6fb400138a26', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:10:09.546380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:10:09.551309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:10:09.552893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:10:09.553944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:10:09.554409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:10:09.572863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:09.574159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:09.574964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:09.576371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:09.577252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:09.578106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:09.608484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Getting quotas for project 3b9a5ee66ca24dff810b321883964569. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:10:09.620495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Getting quotas for user bffb64c7b68b491298ca3f35794d6cc7 and project 3b9a5ee66ca24dff810b321883964569. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:10:09.645819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:10:09.650171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:10:09.885339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d4f0a065-21bc-4ba8-bc54-dc17c51344c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155032 Nov 02 13:10:09.888124 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3394/7097] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:10:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:10:09.907004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8518d152-f72c-4b5a-b3fd-74cfe199feda tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:09.908763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8518d152-f72c-4b5a-b3fd-74cfe199feda tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:09.912544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:09.913491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:09.915687 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:10:09.915962 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:10:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 (ip 10.222.0.48) !!! Nov 02 13:10:09.917172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:09.918632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=67 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:10.027463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8518d152-f72c-4b5a-b3fd-74cfe199feda tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:10.047639 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8518d152-f72c-4b5a-b3fd-74cfe199feda tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1215 microversion: 2.1 time: 0.144762 Nov 02 13:10:10.067275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3704/7098] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:09 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:11.091634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bede6f6e-007a-456a-986a-7550906defcf tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:11.091634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bede6f6e-007a-456a-986a-7550906defcf tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:11.148542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bede6f6e-007a-456a-986a-7550906defcf tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:11.155910 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bede6f6e-007a-456a-986a-7550906defcf tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1215 microversion: 2.1 time: 0.085960 Nov 02 13:10:11.156761 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3395/7099] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:11 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:12.178890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-577b6750-4258-434f-8afb-47f0d7928202 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:12.179537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-577b6750-4258-434f-8afb-47f0d7928202 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:12.249234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-577b6750-4258-434f-8afb-47f0d7928202 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:12.252689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-577b6750-4258-434f-8afb-47f0d7928202 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1215 microversion: 2.1 time: 0.077691 Nov 02 13:10:12.253285 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3705/7100] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:12 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:13.281075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:13.282934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:13.303887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:13.304632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:13.305458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:13.306711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:13.311266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:13.312720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:13.403297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:13.414779 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-178d1367-4fb7-4c9b-bd27-4f1be5084f15 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1267 microversion: 2.1 time: 0.141278 Nov 02 13:10:13.419150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3396/7101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:13 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:14.443177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:14.444136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:14.454940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:14.455768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:14.456401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:14.457281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:14.457856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:14.458386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:14.545232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:14.561445 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4cbdb9ee-f68c-44d1-b5ed-5a19e4056243 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1285 microversion: 2.1 time: 0.124450 Nov 02 13:10:14.562520 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3706/7102] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:14 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:15.592034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:15.593345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:15.604927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:15.605877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:15.606854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:15.607721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:15.608371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:15.609033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:15.886705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:15.900121 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-516d2b31-308e-4a4d-961b-6a15b1ce3d1e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.312320 Nov 02 13:10:15.901122 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3397/7103] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:15 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:16.541467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:16.555270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:16.555820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:16.556261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:16.569778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] Creating event network-changed:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h1-855649-4 Nov 02 13:10:16.575899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-38cd479e-3be4-4faa-ae43-19e7c8ca8d16 req-67556993-6718-4b84-ae0e-eb03a46f624a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039118 Nov 02 13:10:16.577171 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3707/7104] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:16.930854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:16.931761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:16.941975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:16.943265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:16.943818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:16.944782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:16.945402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:16.945938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:17.196926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:17.207166 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1115f53f-f16a-4aab-a735-dffc87c60b5d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.280437 Nov 02 13:10:17.207776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3398/7105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:16 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:18.232704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:18.233437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:18.240082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.240579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.241030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.241752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:18.242223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:18.242667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:18.718428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:18.733067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-13e3c25a-0b64-4ac4-815d-bf16c4ee135e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.505098 Nov 02 13:10:18.734170 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3708/7106] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:18 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:19.758424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:19.759086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:19.761589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:19.766821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.767356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.767808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.768537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:19.769004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:19.769501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:19.911651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:19.919702 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-14c77b1b-241a-4788-9560-04e68b81ed0a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.165442 Nov 02 13:10:19.920284 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3399/7107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:19 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:20.943324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:20.943963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:20.951164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:20.951739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:20.952117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:20.952837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:20.953324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:20.954457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:21.099273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:21.114293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f1569874-fd02-4537-8beb-adcd19b419ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.169013 Nov 02 13:10:21.114293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3709/7108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:20 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:21.122155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "name": "network-vif-plugged", "status": "completed", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:21.133239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:21.133717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:21.134148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:21.146729 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] Creating event network-vif-plugged:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h1-855649-4 Nov 02 13:10:21.153177 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c1efc4e1-eaed-4a2d-86e1-e3c027aab108 req-6d331de1-a01a-415e-9789-4ce4f5d2dc43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044203 Nov 02 13:10:21.159531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3400/7109] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:10:22.133025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:22.133755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:22.141763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:22.142325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:22.142782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:22.143628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:22.144136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:22.144642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:22.250198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:22.305441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:22.317219 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5da88699-2fa7-4388-b5b5-a37b91588b91 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1315 microversion: 2.1 time: 0.188209 Nov 02 13:10:22.317968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3710/7110] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:22 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:23.337961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:23.343092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:23.343807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:23.350757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.351435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.351990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.352942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.353519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.354057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.501852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.511220 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a266a20-1b42-42cb-80a3-c63b2f6a008c tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1501 microversion: 2.1 time: 0.174172 Nov 02 13:10:23.511826 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3401/7111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:23 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:23.534905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:23.537321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:23.546915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.547610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.548738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.549813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.550302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.550869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.582319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.588382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Old instance type m1.heat2, new instance type m1.heat {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:10:23.597057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:10:23.597489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:10:23.597978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:10:23.598455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:10:23.598884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:10:23.795856 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16912db9-da2a-41a2-94df-8b5d3bcfaa49 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "POST /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771/action" status: 202 len: 0 microversion: 2.1 time: 0.265914 Nov 02 13:10:23.799749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3711/7112] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:10:23 2022] POST /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:10:23.807668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:23.809329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:23.816686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.817374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.818052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.818996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:23.819564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:23.820128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:23.971396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:23.980100 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9fe52cfb-353b-43d7-9da4-9e165cf20561 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1510 microversion: 2.1 time: 0.177876 Nov 02 13:10:23.980708 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3402/7113] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:23 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:25.004288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:25.005092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:25.012619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:25.013127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:25.013794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:25.017049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:25.017049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:25.017049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:25.216111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:25.226726 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-58238aea-f6f8-4cb9-ac87-3a2f9b24a409 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1510 microversion: 2.1 time: 0.227593 Nov 02 13:10:25.227304 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3712/7114] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:24 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:26.250608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:26.251255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:26.258280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:26.258770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:26.259236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:26.259947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:26.260399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:26.260827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:26.420005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:26.429028 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1a18ef1-193f-4d95-b283-69b4f7e80a1a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1510 microversion: 2.1 time: 0.182533 Nov 02 13:10:26.429625 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3403/7115] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:26 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:27.453363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:27.454103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:27.461879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:27.462314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:27.462878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:27.463924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:27.464420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:27.464844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:27.652964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:27.664594 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e92b99f-712f-46f4-99f3-6a60c503df6d tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1510 microversion: 2.1 time: 0.215412 Nov 02 13:10:27.665197 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3713/7116] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:27 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:28.689436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:28.690062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:28.697164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.697655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.698096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.698804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:28.699309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:28.699735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:28.842234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:28.853063 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65c342d2-3bb0-40a4-a974-f34cfc6ca920 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.168222 Nov 02 13:10:28.853838 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3404/7117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:28 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:29.877961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:29.880804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:29.885841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:29.886354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:29.886806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:29.887568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:29.888036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:29.890568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:30.049349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:30.058696 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-19597495-b67a-40b6-abd1-ee4078bad4de tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.185076 Nov 02 13:10:30.059530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3714/7118] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:29 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:31.084381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:31.085002 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:31.092247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:31.092987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:31.093175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:31.093896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:31.094361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:31.095364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:31.229425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:31.238643 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5a9d650-0956-4ed8-84a5-f9ba32743e92 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.158219 Nov 02 13:10:31.239269 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3405/7119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:31 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:32.261980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:32.262597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:32.269320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.269813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.270263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.270965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:32.271450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:32.271885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:32.411184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:32.419372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-301f2f25-82fb-44d0-8305-fe2f94053a23 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.161220 Nov 02 13:10:32.419959 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3715/7120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:32 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:33.443351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:33.444001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:33.451248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:33.451741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:33.452180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:33.452884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:33.453346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:33.454328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:33.596454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:33.604733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19dd7b74-ba83-4a41-83fd-d75e9ae6f3ce tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.165307 Nov 02 13:10:33.605329 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3406/7121] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:33 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:34.628860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:34.629540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:34.637460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:34.638027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:34.638481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:34.639241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:34.639704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:34.640148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:34.841081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:34.849922 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a4a4ded-79a5-4706-bb96-174d16e9f66e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.225463 Nov 02 13:10:34.850652 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3716/7122] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:34 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:35.878661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:35.879306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:35.886176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.886673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.887162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:35.887879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:35.888341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:35.888770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:36.039247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:36.047549 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-357c6fd9-ba23-4169-868c-a4f92ab27ce8 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.173377 Nov 02 13:10:36.048165 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3407/7123] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:35 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:37.069998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:37.070758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:37.078193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:37.079246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:37.079893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:37.080624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:37.081092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:37.081532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:37.240861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:37.255229 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0890523d-8c5b-4c64-a80d-16abd4f8f3c6 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.188654 Nov 02 13:10:37.256405 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3717/7124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:37 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:38.296977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:38.298636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:38.311326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:38.312216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:38.313041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:38.314828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:38.315698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:38.316486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:38.475763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:38.484424 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52e278b0-c276-4eb4-93ff-e989990af295 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.194306 Nov 02 13:10:38.485566 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3408/7125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:38 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:39.513832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:39.514673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:39.522705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:39.523294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:39.523756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:39.524476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:39.524939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:39.525380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:39.688545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:39.697298 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dff2fd29-b2bf-45e5-93b1-d50c13ec08ea tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.187376 Nov 02 13:10:39.697903 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3718/7126] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:39 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:40.721797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:40.722417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:40.725509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:40.730730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:40.731255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:40.731702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:40.732417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:40.732872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:40.733300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:40.736955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=77 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:40.885855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:40.894339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-37b94a46-49d9-4988-aeb3-7980065fa499 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.176656 Nov 02 13:10:40.894948 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3409/7127] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:40 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:41.922593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:41.923270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:41.930335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:41.930832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:41.931307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:41.932020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:41.932491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:41.932925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:42.073338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:42.081591 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ce12c33-11c1-4cdf-b4cf-8554f40bb59b tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.167733 Nov 02 13:10:42.082193 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3719/7128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:41 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:43.107172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:43.108044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:43.115739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:43.116223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:43.116662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:43.117366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:43.117818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:43.118238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:43.284246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:43.291008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b81a9406-e53c-4b90-9c63-a6adc9be59ab tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.188203 Nov 02 13:10:43.291626 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3410/7129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:43 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:44.327605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:44.328313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:44.336443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:44.336959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:44.337407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:44.338133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:44.338603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:44.339074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:44.341997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:44.494770 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:44.503386 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e70d9da-1744-4c37-b646-dd6b89d5d027 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1515 microversion: 2.1 time: 0.179576 Nov 02 13:10:44.503991 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3720/7130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:44 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:45.532830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:45.533467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:45.541358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:45.541922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:45.542432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:45.543214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:45.543678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:45.544108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:46.111159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:46.120437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0ab722a-0837-4c47-ab27-89a17702c010 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1514 microversion: 2.1 time: 0.591980 Nov 02 13:10:46.121052 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3411/7131] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:45 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1514 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:46.315789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "name": "network-vif-unplugged", "status": "completed", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:46.327681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:46.328173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:46.329338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:46.341951 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Creating event network-vif-unplugged:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h2-855649-4 Nov 02 13:10:46.348090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] Instance ad14396f-4059-423a-8859-b0e4dfb71771 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:10:46.361531 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ad5f9b75-25c2-4739-88f8-a9a428608cc1 req-2013aa50-eaa0-483b-b302-a206f81b1425 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051268 Nov 02 13:10:46.362172 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3721/7132] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:47.147052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:47.148510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:47.157568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:47.162562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:47.162562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:47.162562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:47.162562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:47.162562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:47.394610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:47.410643 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a4f802e-7600-4d8c-94e7-399e1a39b45a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1514 microversion: 2.1 time: 0.267551 Nov 02 13:10:47.411855 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3412/7133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:47 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:48.379015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:48.385006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=45 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:10:48.392223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:48.398415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:48.398415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:48.406719 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Creating event network-changed:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h2-855649-4 Nov 02 13:10:48.412877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] Instance ad14396f-4059-423a-8859-b0e4dfb71771 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:10:48.425102 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d3283afa-0d6e-40f1-923b-0621a29c6051 req-ef04f6f7-9c48-45fe-bc88-094e362b9438 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051569 Nov 02 13:10:48.426324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3722/7134] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:48.451876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:48.452531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:48.460690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:48.461230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:48.461867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:48.462592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:48.463361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:48.463808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:48.739939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:48.749604 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d994e049-0d6f-4f4d-bca9-e0d1fbabaec5 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1512 microversion: 2.1 time: 0.301524 Nov 02 13:10:48.750274 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3413/7135] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:48 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:49.788900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:49.789661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:49.798205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:49.802781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:49.802781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:49.802781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:49.802781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:49.802781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:49.961038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:49.970101 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f744ae2b-db34-4837-b2c4-55fc04c6d0af tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1512 microversion: 2.1 time: 0.185605 Nov 02 13:10:49.970695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3723/7136] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:49 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:50.993895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:50.995381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:51.003018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:51.003597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:51.004078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:51.005160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:51.005287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:51.005671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:51.244072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:51.253478 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-29abd4cd-f4a7-4cdf-9fd0-4ab136f66861 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1512 microversion: 2.1 time: 0.263422 Nov 02 13:10:51.254097 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3414/7137] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:50 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:52.279524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:52.280256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:52.293699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:52.300471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:52.300956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:52.302337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:52.303043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:52.303509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:52.459685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:52.468488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfaacc3c-2140-4577-a49c-c98cab09a92f tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1509 microversion: 2.1 time: 0.192955 Nov 02 13:10:52.469997 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3724/7138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:52 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:10:52.493111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:52.493718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:52.501888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:52.502391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:52.502854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:52.503640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:52.504118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:52.504563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:52.540615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:10:52.668856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 13:10:53.674513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "name": "network-vif-plugged", "status": "completed", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:53.688382 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:53.688999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:53.689538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:53.704000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Creating event network-vif-plugged:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h2-855649-4 Nov 02 13:10:53.710835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] Instance ad14396f-4059-423a-8859-b0e4dfb71771 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:10:53.725975 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-81659fa5-25e6-4b3b-a044-653c21e5d096 req-af150bbe-ce16-4142-8950-06af0dbdc2d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057610 Nov 02 13:10:53.726800 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3725/7139] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:10:55.362187 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ca674d4-85f2-4fc2-9907-0061eb0d8778 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 204 len: 0 microversion: 2.1 time: 2.871901 Nov 02 13:10:55.363067 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3415/7140] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:10:52 2022] DELETE /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 0 bytes in 2875 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:10:55.374701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:55.375994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:55.383028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:55.383645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:55.384050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:55.384790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:55.385257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:55.385694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:55.593155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:55.602399 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3475d614-3834-4a4a-8ff3-4124413fe63e tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1501 microversion: 2.1 time: 0.234088 Nov 02 13:10:55.603044 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3726/7141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:55 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:56.628916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:56.629629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:56.637963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:56.638464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:56.638900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:56.639739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:56.640198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:56.640655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:56.808726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:56.818068 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f625ac9-0a33-499e-be90-521dd9d6a776 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1501 microversion: 2.1 time: 0.194140 Nov 02 13:10:56.818682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3416/7142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:56 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:57.617068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad14396f-4059-423a-8859-b0e4dfb71771", "name": "network-vif-deleted", "tag": "0dfe171e-26ab-4173-9cac-dc21b36ee052"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:10:57.617068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:57.617068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:57.617068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:57.627298 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] Creating event network-vif-deleted:0dfe171e-26ab-4173-9cac-dc21b36ee052 for instance ad14396f-4059-423a-8859-b0e4dfb71771 on n-h2-855649-4 Nov 02 13:10:57.632889 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0b84d1f4-b87c-4a81-8d1f-6d9c83a914bf req-3890d005-0d77-4726-8c53-acca49a19dfd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 Nov 02 13:10:57.633892 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3727/7143] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:10:57.847905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:57.848823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:57.855605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:57.856095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:57.856537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:57.857270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:57.857730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:57.858136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:57.926769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bffb64c7b68b491298ca3f35794d6cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9a5ee66ca24dff810b321883964569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:10:57.936085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1feb4e8c-1999-4c83-8b4b-537137d6051a tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 200 len: 1294 microversion: 2.1 time: 0.096402 Nov 02 13:10:57.936752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3417/7144] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:57 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:10:58.966404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:58.967229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:58.977334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:58.977334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:58.977681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:58.978154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:58.978847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:58.979321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:59.004723 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] HTTP exception thrown: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Request method failure captured: Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 HTTP/1.1 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmwwr-WH1CIoRit0sTdlfLfL5t2n19j7YvvvYy3pejEGbW_pVTsEdEOX2wlk5JhZbbyyGWpgBEBL4xjgrgPFo7uBpZj74RhN4QC2lgMhS4ZIKAEK-89ymdkelod7fdQKFkIRq5o-tyKj5zSbe6Iu1RhQ3XyO7NbhKcruuAHJ2rmEccs Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b9a5ee66ca24dff810b321883964569", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bffb64c7b68b491298ca3f35794d6cc7 Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ad14396f-4059-423a-8859-b0e4dfb71771'} Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.007538 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Returning 404 to user: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ff7c1924-e404-49eb-a13a-6e66c48fd4ca tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 404 len: 111 microversion: 2.1 time: 0.051624 Nov 02 13:10:59.015246 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3728/7145] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:58 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:59.027909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:59.028476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:59.037704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:59.038216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:59.038666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:59.039562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:59.040034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:59.040468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:59.057294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] HTTP exception thrown: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Request method failure captured: Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 HTTP/1.1 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmwwr-WH1CIoRit0sTdlfLfL5t2n19j7YvvvYy3pejEGbW_pVTsEdEOX2wlk5JhZbbyyGWpgBEBL4xjgrgPFo7uBpZj74RhN4QC2lgMhS4ZIKAEK-89ymdkelod7fdQKFkIRq5o-tyKj5zSbe6Iu1RhQ3XyO7NbhKcruuAHJ2rmEccs Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b9a5ee66ca24dff810b321883964569", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: bffb64c7b68b491298ca3f35794d6cc7 Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ad14396f-4059-423a-8859-b0e4dfb71771'} Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:59.059066 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Returning 404 to user: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e890e09f-0dc0-45b7-abc6-e4715a9d4e47 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 404 len: 111 microversion: 2.1 time: 0.037077 Nov 02 13:10:59.067207 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3418/7146] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:10:59 2022] DELETE /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:10:59.070120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:10:59.070761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] [instance: ad14396f-4059-423a-8859-b0e4dfb71771] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:10:59.080314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:59.081208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:59.081993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:59.083367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:10:59.084237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:10:59.085051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:10:59.120362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] HTTP exception thrown: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Request method failure captured: Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 HTTP/1.1 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmwwr-WH1CIoRit0sTdlfLfL5t2n19j7YvvvYy3pejEGbW_pVTsEdEOX2wlk5JhZbbyyGWpgBEBL4xjgrgPFo7uBpZj74RhN4QC2lgMhS4ZIKAEK-89ymdkelod7fdQKFkIRq5o-tyKj5zSbe6Iu1RhQ3XyO7NbhKcruuAHJ2rmEccs Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b9a5ee66ca24dff810b321883964569", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b9a5ee66ca24dff810b321883964569"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3b9a5ee66ca24dff810b321883964569 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-DeleteServersTestJSON-280540517 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: bffb64c7b68b491298ca3f35794d6cc7 Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-DeleteServersTestJSON-280540517-project Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ad14396f-4059-423a-8859-b0e4dfb71771'} Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:10:59.123543 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] Returning 404 to user: Instance ad14396f-4059-423a-8859-b0e4dfb71771 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-beccb3e3-6de8-4485-a932-2db93abc2d20 tempest-DeleteServersTestJSON-280540517 tempest-DeleteServersTestJSON-280540517-project] 10.222.0.48 "GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771" status: 404 len: 111 microversion: 2.1 time: 0.059895 Nov 02 13:10:59.131149 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3729/7147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:10:59 2022] GET /compute/v2.1/servers/ad14396f-4059-423a-8859-b0e4dfb71771 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:11:13.605460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:13.606229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:13.750118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-397061036", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "ced32eb1-478f-4df5-95fb-30c0abc3ff6f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:13.810728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] validate_networks() for [('ced32eb1-478f-4df5-95fb-30c0abc3ff6f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:11:14.245974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:11:14.246401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:11:14.246946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:11:14.247392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:11:14.247815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:11:14.259826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:14.260375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:14.260928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:14.261709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:14.262172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:14.262602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:14.285723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for project a6072e7dca4247c0bd9d17117c486f49. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:11:14.294005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for user b37ade7c399c435d86ebaae2963cd22d and project a6072e7dca4247c0bd9d17117c486f49. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:11:14.308608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:11:14.312261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:11:14.457070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b8c1e9e9-bec5-406c-9597-c4bff6ccfc25 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857293 Nov 02 13:11:14.457741 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3419/7148] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:11:14.470502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9f2d134-4538-44cc-934e-49ef7ee042ec tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:14.471280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9f2d134-4538-44cc-934e-49ef7ee042ec tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:14.476658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=15 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:14.478026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=41 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:14.539928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9f2d134-4538-44cc-934e-49ef7ee042ec tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:14.547529 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9f2d134-4538-44cc-934e-49ef7ee042ec tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1217 microversion: 2.1 time: 0.082004 Nov 02 13:11:14.554501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3730/7149] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:14 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:15.577862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62654cf6-d238-4f9e-8067-c2ab289e9093 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:15.579004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62654cf6-d238-4f9e-8067-c2ab289e9093 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:15.657181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62654cf6-d238-4f9e-8067-c2ab289e9093 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:15.665489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62654cf6-d238-4f9e-8067-c2ab289e9093 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1217 microversion: 2.1 time: 0.093275 Nov 02 13:11:15.667522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3420/7150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:15 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:16.707541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:16.708679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:16.717780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:16.718366 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:16.719158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:16.720283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:16.720760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:16.721223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:16.808046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:16.819683 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b792064d-fd59-4e69-8d36-028962c10514 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1213 microversion: 2.1 time: 0.118208 Nov 02 13:11:16.820659 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3731/7151] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:16 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:17.852208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:17.853235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:17.869711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:17.870798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:17.871968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:17.873343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:17.874277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:17.875578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:18.001822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:18.010760 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd3263d4-9101-48b1-b4b8-f0025ce68ee4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1277 microversion: 2.1 time: 0.169200 Nov 02 13:11:18.011561 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3421/7152] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:17 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:19.043902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:19.044616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:19.052571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:19.053091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:19.053546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:19.054275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:19.054780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:19.055270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:19.204322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:19.212242 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-68a7d1ba-3bd3-4870-bf8a-dd5614356bfd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.173243 Nov 02 13:11:19.212750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3732/7153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:19 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:19.988173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:19.999417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:20.000455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:20.000866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:20.017368 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] Creating event network-changed:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h2-855649-4 Nov 02 13:11:20.021803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-432b6901-6858-4003-be37-b049836a95d2 req-94749b03-b5d5-4a0c-917f-4c14f825d2fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037621 Nov 02 13:11:20.022438 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3422/7154] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:20.237553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:20.238303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:20.246711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:20.247427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:20.248005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:20.248753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:20.249219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:20.250209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:20.409481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:20.417993 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3bddf630-767b-4da3-b68f-bb40012fa2ae tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.184833 Nov 02 13:11:20.418599 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3733/7155] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:20 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:21.442437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:21.443703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:21.454460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:21.455221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:21.455641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:21.456406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:21.456873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:21.457326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:21.612755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:21.621651 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8628694d-5458-4a34-82ff-3b63c80d7309 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.184445 Nov 02 13:11:21.622766 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3423/7156] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:21 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:22.647131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:22.647820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:22.654889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:22.655771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:22.656147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:22.656888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:22.657364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:22.657810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:22.792040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:22.800521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-18028cf6-1e96-4b8c-bea3-ce3dee1d275d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.157344 Nov 02 13:11:22.801095 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3734/7157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:22 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:23.823959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:23.824594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:23.832545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:23.833040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:23.833569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:23.834266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:23.834866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:23.835225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:23.977442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:23.985928 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a206f3dd-dcfa-405c-ac09-b4eba906561e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.166132 Nov 02 13:11:23.986509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3424/7158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:23 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:25.011084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:25.011719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:25.014551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:25.020154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:25.020662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:25.026997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:25.026997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:25.026997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:25.026997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:25.166125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:25.174626 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5a7a2499-87ec-41af-b73f-190cbf0bdea0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.167591 Nov 02 13:11:25.175243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3735/7159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:25 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:25.800799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "name": "network-vif-plugged", "status": "completed", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:25.806924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:25.808764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:25.815005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:25.815492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:25.815929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:25.828015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] Creating event network-vif-plugged:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h2-855649-4 Nov 02 13:11:25.833307 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-76635321-41f9-4c7f-96a7-e3e0bdc669e3 req-7c7c3081-ef7e-44b1-8259-f5aeecaac92c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037756 Nov 02 13:11:25.835211 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3425/7160] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:26.198136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:26.198771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:26.206943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:26.207698 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:26.208271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:26.209022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:26.209501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:26.209948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:26.365762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:26.377146 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f741c67d-d4d1-4b88-b5d2-ecb5b2ac2087 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.182792 Nov 02 13:11:26.377930 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3736/7161] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:26 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:27.402728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:27.403473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:27.412730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:27.413484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:27.414112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:27.415077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:27.419587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:27.419587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:27.571303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:27.582810 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42236145-818a-42df-9bbf-d6cd41993779 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1317 microversion: 2.1 time: 0.185223 Nov 02 13:11:27.583445 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3426/7162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:27 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:28.606873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:28.607558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:28.615457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.615954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.616413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:28.617136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.617607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.618102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:28.756718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:28.764853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1577286-5465-4278-8779-5dffd7e0b25a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1507 microversion: 2.1 time: 0.162008 Nov 02 13:11:28.765465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3737/7163] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:28 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:28.791678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:28.792291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:28.800074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.800559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.800999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:28.801710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.802162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.802585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:28.946303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:28.954717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4df29c82-39c9-4ab0-8a7a-e4821c689fa1 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1507 microversion: 2.1 time: 0.166926 Nov 02 13:11:28.955366 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3427/7164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:28 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:28.977440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:28.980109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:28.987016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.987532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.987996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:28.988733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:28.989241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:28.989660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.124971 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c975a07-ae99-46d3-a756-043762e23633 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "PUT /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1079 microversion: 2.1 time: 0.150972 Nov 02 13:11:29.125634 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3738/7165] 10.222.0.48 () {60 vars in 1256 bytes} [Wed Nov 2 13:11:28 2022] PUT /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1079 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:29.148452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:29.148992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:29.155854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.156321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.156845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.157572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.158028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.158460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.613312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:29.621699 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6775856c-77b5-4717-9de5-1096c71f4c80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1505 microversion: 2.1 time: 0.478091 Nov 02 13:11:29.622306 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3428/7166] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:29 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:29.648626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:29.649452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:29.657343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.657857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.658313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.659124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.659604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.660045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.814792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:29.822870 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c4063403-cbdb-46d2-89bb-fb681f7feb20 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1505 microversion: 2.1 time: 0.178982 Nov 02 13:11:29.823478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3739/7167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:29 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:29.846673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:29.849013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:29.856016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.856498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.857156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.857638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:29.858097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:29.858607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:29.893843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:29.900435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:11:29.908919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:11:29.909349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:11:29.909821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:11:29.910299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:11:29.910804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:11:30.171389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6a4de6c-6722-4a12-b979-cb5967a80c24 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.328726 Nov 02 13:11:30.172341 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3429/7168] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:11:29 2022] POST /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:11:30.181750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:30.182205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:30.188760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:30.189508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:30.189976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:30.190724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:30.191226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:30.191665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:30.351879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:30.360740 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be9cdf5d-f793-48ce-86ec-43ad57337b37 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1516 microversion: 2.1 time: 0.183526 Nov 02 13:11:30.361366 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3740/7169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:30 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:31.386876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:31.387542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:31.396034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:31.396537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:31.397077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:31.397815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:31.398275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:31.399328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:31.544801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:31.553809 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5fe7f6e7-38ee-4b6e-97c4-2c24d4887636 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1516 microversion: 2.1 time: 0.172876 Nov 02 13:11:31.554403 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3430/7170] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:31 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:32.577926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:32.578482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:32.585577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:32.586083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:32.586580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:32.587287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:32.592746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:32.592746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:32.730939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:32.739058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a1297d8-5e0c-4fc2-8cda-a4336b668cca tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1516 microversion: 2.1 time: 0.165187 Nov 02 13:11:32.739648 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3741/7171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:32 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:33.763754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:33.764572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:33.772277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:33.773131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:33.773267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:33.773902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:33.774365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:33.774849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:34.016566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:34.024885 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-be4469c5-b2ec-412f-a30d-799f7df92e5c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1516 microversion: 2.1 time: 0.264939 Nov 02 13:11:34.025539 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3431/7172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:33 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:35.049484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:35.050209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:35.057369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:35.057881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:35.058328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:35.059315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:35.059790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:35.060234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:35.213878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:35.223436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88609087-16a0-42a9-a636-302895877f4b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.178360 Nov 02 13:11:35.224038 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3742/7173] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:35 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:36.256373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:36.257029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:36.264300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:36.264794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:36.265241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:36.265958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:36.266419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:36.266855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:36.420894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:36.430163 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-10a63cdc-681d-415c-9be8-691a9ec56b27 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.177710 Nov 02 13:11:36.430896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3432/7174] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:36 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:37.455761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:37.456386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:37.463510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:37.464006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:37.464453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:37.465171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:37.465635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:37.466070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:37.870252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:37.878299 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05376cb4-4dcd-4197-bc43-4228b7d2fde9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.426933 Nov 02 13:11:37.878802 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3743/7175] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:37 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:38.902479 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:38.903243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:38.911738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:38.912221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:38.912657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:38.913363 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:38.913810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:38.914234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:39.054436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:39.062428 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bbf7888e-dc75-4533-98c8-b75e220ac57d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.164190 Nov 02 13:11:39.063035 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3433/7176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:38 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:40.086774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:40.087419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:40.095523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:40.097498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:40.097498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:40.097498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:40.097498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:40.097904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:40.243175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:40.251786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7ae89d7a-2993-4ada-adb2-648a7d317b0f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.169034 Nov 02 13:11:40.252351 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3744/7177] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:40 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:41.275929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:41.276528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:41.284182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:41.284681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:41.285139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:41.285851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:41.286310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:41.286744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:41.452388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:41.460635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-293356de-72e5-4c03-a7c0-cb688fcc75b8 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.188564 Nov 02 13:11:41.461221 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3434/7178] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:41 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:42.485159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:42.485832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:42.493153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.493690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.494150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.494865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:42.495371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:42.495815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:42.644329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:42.652876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7bffd3ba-b09d-4321-97e8-fe752faaa46f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.171878 Nov 02 13:11:42.653461 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3745/7179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:42 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:43.677406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:43.678268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:43.686696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:43.687238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:43.687683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:43.688416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:43.688872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:43.689301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:43.865152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:43.875030 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0ab372f5-f7be-4b4d-9d86-8731903f17d6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.201930 Nov 02 13:11:43.875633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3435/7180] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:43 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:44.898989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:44.899656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:44.907457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:44.907989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:44.908440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:44.909149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:44.909615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:44.910055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:45.050029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:45.053617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:45.058361 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28a07cfc-c7ea-4255-bfc8-08496f84b285 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.163400 Nov 02 13:11:45.058927 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3746/7181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:44 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:46.091816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:46.092368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:46.095812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:46.100877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:46.101370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:46.101809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:46.102512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:46.102964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:46.103421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:46.106218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:46.244231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:46.252680 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c0fbfd97-f1ce-413c-ab70-1d336267b03c tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.165170 Nov 02 13:11:46.253258 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3436/7182] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:46 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:47.279139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:47.279901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:47.283847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=37 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:47.289390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:47.290136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:47.290645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:47.291611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:47.292196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:47.292861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:47.432658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:47.440631 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-290b99f4-3b2c-4fe2-bdbf-0986f7d91ad0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.165620 Nov 02 13:11:47.441208 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3747/7183] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:47 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:48.464887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:48.465544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:48.473257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:48.473751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:48.474195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:48.474897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:48.475382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:48.475823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:48.621857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:48.630768 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-063f6839-4905-414d-97d7-665c45d1d8a7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.170188 Nov 02 13:11:48.631613 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3437/7184] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:48 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:49.658463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:49.659337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:49.666767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:49.669303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:49.669303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:49.669303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:49.669303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:49.669752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:49.829297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:49.837798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5454462f-e3c9-41a4-a3ff-111d813fa428 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.183835 Nov 02 13:11:49.838390 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3748/7185] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:49 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:50.863692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:50.864327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:50.872229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:50.872745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:50.873196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:50.874458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:50.874903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:50.875379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:51.043737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:51.050749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a4663d9-7c7e-4887-9e44-efe5a31d72f5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1521 microversion: 2.1 time: 0.191072 Nov 02 13:11:51.051205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3438/7186] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:50 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:51.663251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "name": "network-vif-unplugged", "status": "completed", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:51.675281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:51.675557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:51.676008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:51.688559 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Creating event network-vif-unplugged:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h1-855649-4 Nov 02 13:11:51.694072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:11:51.705853 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-209ef9a0-1fb7-4378-a43b-18da754f1c8d req-959e3ec4-b94c-4cda-a6c7-61f0ef9d2ab4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046341 Nov 02 13:11:51.706534 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3749/7187] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:52.074808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:52.075455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:52.084448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:52.084861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:52.085304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:52.086060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:52.086517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:52.086951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:52.242497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:52.253932 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6fd70a72-9d02-4569-9622-9451801e1feb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1520 microversion: 2.1 time: 0.182900 Nov 02 13:11:52.254541 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3439/7188] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:52 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:53.281866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:53.282638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:53.289154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:53.289675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:53.290136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:53.290864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:53.291371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:53.291818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:53.426853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:53.434800 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a44fb837-df9e-4371-a857-264279f8a48d tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1518 microversion: 2.1 time: 0.158457 Nov 02 13:11:53.435409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3750/7189] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:53 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:53.720688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:53.731377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:53.731866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:53.732312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:53.744443 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Creating event network-changed:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h1-855649-4 Nov 02 13:11:53.750599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:11:53.761847 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-95806990-dcc4-451e-bd43-944cca69a326 req-98d62fd6-2aa8-4807-9d15-a476a78a08df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044820 Nov 02 13:11:53.762451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3440/7190] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:54.458305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:54.459628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:54.466810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:54.468530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:54.469274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:54.470020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:54.470618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:54.471260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:54.625880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:54.635371 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7fefa4b-d40c-4fff-83fe-78851cd925f6 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1518 microversion: 2.1 time: 0.180871 Nov 02 13:11:54.636142 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3751/7191] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:54 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:55.661114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:55.661864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:55.668143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:55.668634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:55.669075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:55.669781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:55.670239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:55.671202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:55.817699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:55.826635 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df6d2111-a953-45d3-a677-a561992ae407 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1515 microversion: 2.1 time: 0.170627 Nov 02 13:11:55.839007 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3441/7192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:55 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:55.850216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:55.853866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:55.860170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:55.860785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:55.861267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:55.862091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:55.862563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:55.863058 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:56.149485 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c9ed1d4-78b4-4cdf-ac94-95cecb1280d7 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3/action" status: 204 len: 0 microversion: 2.1 time: 0.303183 Nov 02 13:11:56.150130 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3752/7193] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:11:55 2022] POST /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3/action => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:11:56.158563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:56.159219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:56.167064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:56.167562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:56.177736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:56.177736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:56.177736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:56.177736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:56.311980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:56.320240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35030c75-bec3-4379-80c6-61f2a295a993 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1515 microversion: 2.1 time: 0.165773 Nov 02 13:11:56.320878 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3442/7194] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:56 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:57.348621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:57.349355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:57.359548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:57.360429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:57.361188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:57.362381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:57.363151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:57.363722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:57.518180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:57.526272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2178b746-64cf-4c5d-8bff-96b4be44381b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1515 microversion: 2.1 time: 0.184792 Nov 02 13:11:57.526852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3753/7195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:57 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:57.587997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "name": "network-vif-plugged", "status": "completed", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:57.598725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:57.599966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:57.599966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:57.612036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] Creating event network-vif-plugged:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h1-855649-4 Nov 02 13:11:57.617277 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e12d2270-a418-4468-8b52-42215acee1d7 req-00dc0c43-52e4-4229-8e3d-e715fbead6eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036456 Nov 02 13:11:57.617901 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3443/7196] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:58.554846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:58.555995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:58.565251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:58.565752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:58.566224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:58.566922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:58.567417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:58.567852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:58.723623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:58.737843 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6301730-f63e-4904-a32d-636eaf5eb133 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1507 microversion: 2.1 time: 0.190245 Nov 02 13:11:58.738947 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3754/7197] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:58 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:58.769013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:58.774533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:58.776346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:58.776833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:58.777312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:58.777992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:58.778448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:58.778875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:58.923768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:58.932016 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-394eee5d-6f3e-4e3d-9eca-322ecb95c645 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1507 microversion: 2.1 time: 0.168930 Nov 02 13:11:58.932614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3444/7198] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:58 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:11:58.959515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8cd82dd5-bf9a-4a4c-98ae-560d4947e4cd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'create', calling method: .version_select at 0x7ff1b05aa8b0>, body: {"keypair": {"name": "tempest-keypair-445611874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqc+88zlaimfDEOrle6RN2I1AEYzj98MZSYSPxtPxaVWAZt1sOUi2qNuSMiffPGBie8xmOvzrshsXz6toYSEh0qFBZanGOwPaPEUR27LEyx2+zwPySNPUajN25hay6i3g=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:58.975607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8cd82dd5-bf9a-4a4c-98ae-560d4947e4cd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for project a6072e7dca4247c0bd9d17117c486f49. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:11:58.981096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8cd82dd5-bf9a-4a4c-98ae-560d4947e4cd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for user b37ade7c399c435d86ebaae2963cd22d and project a6072e7dca4247c0bd9d17117c486f49. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:11:59.075634 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8cd82dd5-bf9a-4a4c-98ae-560d4947e4cd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120113 Nov 02 13:11:59.076470 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3755/7199] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:11:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:02.176548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:02.177296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:02.185342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.185853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.190186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.190186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.190186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.190186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.353589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:02.364077 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-deb3c3f6-b3f2-43c0-bd7d-38890c5dbed5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 200 len: 1507 microversion: 2.1 time: 0.191429 Nov 02 13:12:02.364679 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3445/7200] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:02 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:02.387935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:02.388534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:02.399279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.399782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.400235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.400962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.401430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.401975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.431925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:12:02.896490 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f69d6762-c817-4d8c-9240-58c47ed7561f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 204 len: 0 microversion: 2.1 time: 0.513266 Nov 02 13:12:02.897106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3756/7201] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:02 2022] DELETE /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:02.968957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1613675546", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "ced32eb1-478f-4df5-95fb-30c0abc3ff6f"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:03.027152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] validate_networks() for [('ced32eb1-478f-4df5-95fb-30c0abc3ff6f', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:03.526350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:12:03.527406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:12:03.527406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:12:03.527775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:12:03.528161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:12:03.539177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.539692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.540133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.540868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.541327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.541760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.570444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for project a6072e7dca4247c0bd9d17117c486f49. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:12:03.580246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Getting quotas for user b37ade7c399c435d86ebaae2963cd22d and project a6072e7dca4247c0bd9d17117c486f49. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:12:03.593842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:12:03.596331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:12:03.846688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f85ae0fe-701b-4c06-8584-7544d4bd2384 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882120 Nov 02 13:12:03.847280 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3446/7202] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:12:03.860396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72117c1c-bc43-44b0-9add-940576eb1b09 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:03.861123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72117c1c-bc43-44b0-9add-940576eb1b09 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:03.938181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72117c1c-bc43-44b0-9add-940576eb1b09 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:03.951895 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72117c1c-bc43-44b0-9add-940576eb1b09 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1218 microversion: 2.1 time: 0.095992 Nov 02 13:12:03.953012 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3757/7203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:03 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:04.983048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:04.984643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:04.996085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:04.996902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:04.997592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:04.999119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:04.999749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.000435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:05.137103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f71c3c69-5337-4988-b8ef-e3a0be5a5ad3", "name": "network-vif-deleted", "tag": "4022c370-95f6-46eb-a6ec-5b1c653c1cd9"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:05.156780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:05.157656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.158299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:05.168042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:05.173478 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] Creating event network-vif-deleted:4022c370-95f6-46eb-a6ec-5b1c653c1cd9 for instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 on n-h1-855649-4 Nov 02 13:12:05.180255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4aa9f16a-f389-4504-85b8-c2e24344cf57 req-5ba0b137-9c70-4938-aa6f-d76bdc3744d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056557 Nov 02 13:12:05.181949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3758/7204] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:05.189184 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cbdc6424-ee0f-4ea9-bd5b-dbe43405bb26 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1222 microversion: 2.1 time: 0.211419 Nov 02 13:12:05.191636 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3447/7205] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:04 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:06.221280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:06.223676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:06.240383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:06.241636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:06.243008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.244640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:06.245982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:06.247062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.371947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:06.381212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6586ac8-cc3a-4c0a-a157-03a4eadfb7cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1270 microversion: 2.1 time: 0.169193 Nov 02 13:12:06.382159 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3759/7206] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:06 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:07.408619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:07.409461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:07.417342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.418608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.418608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.419686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.419823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.420292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.521229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:07.532562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-642192b2-bfef-46e7-8e64-7523b4ad81e9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1276 microversion: 2.1 time: 0.127852 Nov 02 13:12:07.533688 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3448/7207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:07 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:08.571684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:08.572495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:08.579999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.580533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.581064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:08.582093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.582638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.583388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:08.729225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:08.738351 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fcdcda59-6f0a-4dbb-8c18-b73959f71203 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.172122 Nov 02 13:12:08.739254 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3760/7208] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:08 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:09.190564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:09.201877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:09.202364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:09.202795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.215286 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] Creating event network-changed:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h1-855649-4 Nov 02 13:12:09.220807 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-814e3cd8-faa5-4505-94c3-4257937e4bd0 req-d1f3af4f-09f2-4d3a-a1ac-fc6c629e7ddb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035147 Nov 02 13:12:09.221460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3449/7209] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:12:09.762175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:09.762821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:09.770461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:09.771363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:09.771823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.772557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:09.773032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:09.773542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.917278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:09.925682 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8fab5af-7154-4421-95c1-c086a8160b80 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.167457 Nov 02 13:12:09.928570 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3761/7210] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:09 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:10.950006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:10.950728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:10.958632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.959168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.959634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.960337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.960801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.961236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:11.102169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:11.110714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-663d3b10-5543-458f-9ab5-f2fbe7f985fd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.164968 Nov 02 13:12:11.111360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3450/7211] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:10 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:12.136649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:12.137395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:12.149830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.150480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.151256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.152239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.152950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.153639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.302368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:12.309930 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd7133fe-2d15-4811-be07-28f2ff3c1a19 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.178495 Nov 02 13:12:12.310540 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3762/7212] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:12 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:13.334208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.334820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:13.344754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.345275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.345804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.346525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.347008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.347442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.491517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:13.500146 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-601c48bf-24d9-46ff-a2f1-4045bce5a90e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.169971 Nov 02 13:12:13.500735 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3451/7213] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:13 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:13.765959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "name": "network-vif-plugged", "status": "completed", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:13.778512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.779203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.779586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.797066 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] Creating event network-vif-plugged:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h1-855649-4 Nov 02 13:12:13.802608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-36ba7d0f-02a7-4470-a7aa-a1b2b66ed34c req-d01f7387-20af-498f-9b9a-84c85158668a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042271 Nov 02 13:12:13.803556 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3763/7214] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:14.523735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:14.524331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:14.526321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:14.527205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:14.534021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.534514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.540235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.540235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.540235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.540235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.676326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:14.684207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff6f1268-7872-4e30-8fa5-1243995b7bba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1318 microversion: 2.1 time: 0.164406 Nov 02 13:12:14.689358 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3452/7215] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:14 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:15.709566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:15.710296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:15.712423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:15.718515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.719041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.719506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.720228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.720699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.721221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.737883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:15.867780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:15.874730 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9da3f4bc-28d3-4e62-a39f-46e1bb7de95e tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1507 microversion: 2.1 time: 0.169417 Nov 02 13:12:15.875356 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3764/7216] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:15 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:15.899766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:15.900534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:15.909346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.909928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.910289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.911031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.911498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.911930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.079747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:16.089398 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abe3f05b-996d-473d-9e33-76ea158977d5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1507 microversion: 2.1 time: 0.193604 Nov 02 13:12:16.090030 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3453/7217] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:15 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:16.115314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:16.117760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:16.127085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.140443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.140443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.140443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.140443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.140443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.162701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:16.169325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Old instance type m1.heat2, new instance type m1.heat {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:12:16.178491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:12:16.179079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:12:16.179628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:12:16.180126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:12:16.180860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:12:16.471798 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7e6b4d88-c920-42c3-b477-f52d1883b104 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4/action" status: 202 len: 0 microversion: 2.1 time: 0.360826 Nov 02 13:12:16.472348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3765/7218] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:16 2022] POST /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:16.480750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:16.481656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:16.484110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:16.491832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.492721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.493506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.494782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:16.495656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:16.496423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.673808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:16.683558 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3953d9b1-5908-4041-bf7c-3dfea859421a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1514 microversion: 2.1 time: 0.206606 Nov 02 13:12:16.684283 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3454/7219] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:16 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:17.710381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:17.711164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:17.713224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:17.720373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:17.720947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:17.721333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:17.722080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:17.722543 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:17.723158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:17.913211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:17.927710 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d115597b-0fb5-4b4e-9077-abadf4903f51 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1514 microversion: 2.1 time: 0.222381 Nov 02 13:12:17.928654 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3766/7220] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:17 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:18.954510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:18.955241 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:18.963633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:18.970119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=100 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:19.197845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:19.208701 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2774b019-f90d-4cee-82d3-72d063ce30b4 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1514 microversion: 2.1 time: 0.259290 Nov 02 13:12:19.209212 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3455/7221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:18 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:20.234435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:20.235052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:20.242565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:20.243237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:20.243693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:20.244580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:20.245187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:20.245632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:20.397751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:20.408518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b54b7a54-6951-437c-b896-0d81b61a67cf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1514 microversion: 2.1 time: 0.179118 Nov 02 13:12:20.412930 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3767/7222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:20 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:21.434969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:21.436444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:21.443770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.444278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.444714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.445434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:21.445900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:21.446335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:21.593048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:21.601506 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-44cd21e0-2298-43b1-953f-9f6aa7c8e4a5 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.170630 Nov 02 13:12:21.602110 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3456/7223] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:21 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:22.626202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:22.627069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:22.635143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:22.635558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:22.636016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:22.636766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:22.637226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:22.637674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:22.794866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:22.804205 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0185677d-eaa6-40c0-ba81-bf3be81bd2f2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.181916 Nov 02 13:12:22.812194 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3768/7224] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:22 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:23.836093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:23.836822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:23.845609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:23.849121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:23.849121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:23.849121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:23.849121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:23.849121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:24.003850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:24.011600 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff0b3aec-2082-44e8-aa23-ff02cd2992cc tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.179843 Nov 02 13:12:24.012192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3457/7225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:23 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:25.036368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:25.036915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:25.044458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:25.045460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:25.045916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:25.046636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:25.047147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:25.047590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:25.207284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:25.217629 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-624b241e-abff-458c-9cb2-4f62f488e242 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.184629 Nov 02 13:12:25.218379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3769/7226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:25 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:26.241338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:26.241985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:26.249564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:26.250053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:26.250498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:26.251236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:26.251699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:26.252147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:26.395090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:26.403591 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18fa6bd3-d7bd-421c-8ae6-4f4cad0f6e4f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.166046 Nov 02 13:12:26.404962 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3458/7227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:26 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:27.427662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:27.428331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:27.436762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:27.437213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:27.437682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:27.438391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:27.438928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:27.439350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:27.602715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:27.619600 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e2e4060-cfaa-4183-8729-b870d42c7893 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.195808 Nov 02 13:12:27.620207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3770/7228] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:27 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:28.644400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:28.645020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:28.652382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:28.653228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:28.653784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:28.658711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:28.658711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:28.658711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:28.845026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:28.853608 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8481fad8-9b4c-4690-a59b-812f70d2befb tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.213035 Nov 02 13:12:28.854206 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3459/7229] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:28 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:29.877231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:29.877920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:29.884943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:29.885521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:29.886131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:29.887080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:29.887660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:29.888146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:30.058440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:30.066847 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3e9dfc1-fbe8-48c3-8ce9-fb7285750967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.193576 Nov 02 13:12:30.067479 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3771/7230] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:29 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:31.096416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:31.097576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:31.110764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:31.111734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:31.112419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:31.113334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:31.113993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:31.114554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:31.288193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:31.299369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9ba64dc4-dd83-4efc-bdbf-12ad36e32d92 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.210603 Nov 02 13:12:31.305288 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3460/7231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:31 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:32.325609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:32.326936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:32.336134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:32.336717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:32.337190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:32.338144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:32.338627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:32.339087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:32.485868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:32.493966 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-20059501-28c2-4a66-ab78-a376373e4073 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.172947 Nov 02 13:12:32.494546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3772/7232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:32 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:33.518584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:33.519260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:33.526464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:33.527305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:33.527523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:33.528256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:33.528721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:33.529162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:33.674438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:33.683272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d07ca981-0b45-4a51-9c03-f145e23202aa tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.169069 Nov 02 13:12:33.683841 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3461/7233] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:33 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:34.708798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:34.709704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:34.716789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:34.717292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:34.717763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:34.718483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:34.718948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:34.719500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:34.873127 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:34.882143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-294e05ff-ea0b-4d51-a30f-336cddd0b8c3 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.177125 Nov 02 13:12:34.882699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3773/7234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:34 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:35.907327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:35.907987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:35.916540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:35.916949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:35.917394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:35.918113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:35.918579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:35.919040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:36.079526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:36.088480 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc30383a-a3b4-48e0-827c-89801c1c3967 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.185644 Nov 02 13:12:36.089093 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3462/7235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:35 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:37.113335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:37.114047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:37.121475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:37.121983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:37.122435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:37.123878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:37.124356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:37.124829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:37.270923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:37.280144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfc1c8b8-f111-4669-8c39-cff55a5e4c31 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1519 microversion: 2.1 time: 0.171072 Nov 02 13:12:37.280755 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3774/7236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:37 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:38.305194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:38.305829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:38.313783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:38.314292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:38.314741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:38.315512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:38.315974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:38.316416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:38.766459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:38.775213 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c0dff75-5c76-47f4-aa65-4bef7f3fa603 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1518 microversion: 2.1 time: 0.474249 Nov 02 13:12:38.775828 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3463/7237] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:38 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:38.926099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "name": "network-vif-unplugged", "status": "completed", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:38.938214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:38.938713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:38.939207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:38.957882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Creating event network-vif-unplugged:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h2-855649-4 Nov 02 13:12:38.964348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:12:38.978812 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bbab0185-a572-4c49-aa45-06a2a1a43d46 req-b80364e2-d2f3-44ac-a3be-f49aef80a40a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055330 Nov 02 13:12:38.978812 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3775/7238] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:39.800162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:39.801392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:39.808314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:39.808811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:39.809259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:39.809978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:39.810501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:39.810940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:40.032179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:40.040995 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b9443c3-cd9a-4e58-9f27-a4e198e5f8bf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1518 microversion: 2.1 time: 0.244726 Nov 02 13:12:40.041657 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3464/7239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:39 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1518 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:40.995701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:41.005789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:41.006277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:41.006718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:41.019781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Creating event network-changed:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h2-855649-4 Nov 02 13:12:41.025290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:12:41.037382 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ed26f7f1-a709-4c74-8dba-6b0ca674bf40 req-160c12f2-0411-4375-bda6-353886e95d48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046763 Nov 02 13:12:41.038016 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3776/7240] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:41.064755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:41.065502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:41.073473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:41.073970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:41.074419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:41.075167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:41.075826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:41.076295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:41.327281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:41.336523 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b97f92e2-1db0-4737-b77e-6e61c3759298 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1516 microversion: 2.1 time: 0.275764 Nov 02 13:12:41.337160 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3465/7241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:41 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:42.363979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:42.364681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:42.371349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:42.371792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:42.372250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:42.372963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:42.373457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:42.373890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:42.537278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:42.546387 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6fc8f0c9-b498-412f-a89c-975997d494c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1516 microversion: 2.1 time: 0.186855 Nov 02 13:12:42.547026 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3777/7242] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:42 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:43.570446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:43.571392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:43.579646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:43.580688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:43.580688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:43.581920 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:43.582429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:43.584357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:43.833783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:43.852833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64cf4eff-0e71-43f9-8f6a-b0c2b1398f61 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1516 microversion: 2.1 time: 0.287087 Nov 02 13:12:43.853567 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3466/7243] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:43 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:44.881585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:44.882227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:44.890123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:44.890635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:44.891130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:44.891861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:44.892339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:44.892843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:45.048709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:45.056755 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b1ca7bd-92c8-42cd-be84-90b19b8d06f9 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1513 microversion: 2.1 time: 0.179162 Nov 02 13:12:45.057348 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3778/7244] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:44 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:45.079996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:45.080605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:45.087695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:45.088190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:45.088638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:45.089358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:45.089821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:45.090259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:45.350192 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8b36efc7-f3e0-4f6c-9390-a9ae2aa8c81b tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "POST /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4/action" status: 204 len: 0 microversion: 2.1 time: 0.272535 Nov 02 13:12:45.350192 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3467/7245] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:45 2022] POST /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4/action => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:45.360330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:45.360970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:45.367823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:45.368408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:45.368880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:45.369602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:45.370075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:45.370516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:45.518861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:45.527299 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dd2ac35c-355e-4854-877a-dd62dc6e4218 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1513 microversion: 2.1 time: 0.171766 Nov 02 13:12:45.527890 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3779/7246] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:45 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:46.251693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "name": "network-vif-plugged", "status": "completed", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:46.261771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:46.262256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:46.262695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:46.275457 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Creating event network-vif-plugged:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h2-855649-4 Nov 02 13:12:46.281578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:12:46.294489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3385d4ac-5358-441d-9369-383f2afb7d54 req-0873d367-9170-4142-a231-02eb8ad4e4f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048134 Nov 02 13:12:46.299607 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3468/7247] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:46.552278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:46.552912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:46.560137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:46.561209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:46.561661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:46.562377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:46.562849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:46.563326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:46.566159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:46.727241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:46.736038 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1aadb306-722c-4ec7-a967-00c3f21f834f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1513 microversion: 2.1 time: 0.187609 Nov 02 13:12:46.736635 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3780/7248] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:46 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:47.763269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:47.764595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:47.771311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.771814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.772285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.772979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.773440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.773879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.923035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:47.931917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e85a937-0c7d-4d0d-9558-11641a7328c2 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1505 microversion: 2.1 time: 0.174668 Nov 02 13:12:47.932583 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3469/7249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:47 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:47.956688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:47.957298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:47.965135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.965641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.966099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.967276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.967400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.967844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.116958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:48.125780 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-91d8f751-f0c2-4085-8992-f5f3963ab454 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1505 microversion: 2.1 time: 0.172976 Nov 02 13:12:48.126968 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3781/7250] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:47 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:48.150569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:48.151224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:48.158139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.158630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.159279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.160114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.160580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.161011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.306274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:48.310267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:48.315711 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-66724d2a-476e-40fd-bae7-c0d1445a50d0 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1505 microversion: 2.1 time: 0.169124 Nov 02 13:12:48.316306 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3470/7251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:48 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:48.339106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:48.339621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:48.346573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.347119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.347579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.348314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.348793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.349237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.380940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:12:48.747493 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93bdb1a3-1e01-439c-8f91-bd8234de63bd tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 204 len: 0 microversion: 2.1 time: 0.412078 Nov 02 13:12:48.748707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3782/7252] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:48 2022] DELETE /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:48.769647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:48.770286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:48.780275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.780842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.781325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.782103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:48.782660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:48.783187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:48.814184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:12:48.985953 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.compute.api [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Instance is already in deleting state, ignoring this request Nov 02 13:12:48.986917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae220a27-949d-430c-83bb-527baf7bd803 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 204 len: 0 microversion: 2.1 time: 0.221960 Nov 02 13:12:48.987541 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3471/7253] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:48 2022] DELETE /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:12:48.997427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:48.998959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:49.008815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:49.009214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:49.009687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:49.010736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:49.011425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:49.011935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:49.158903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:49.167833 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e655cd5-67b7-4553-8278-54cdbacd821f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1511 microversion: 2.1 time: 0.175148 Nov 02 13:12:49.168440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3783/7254] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:48 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:50.193325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:50.193877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:50.196370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=36 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:50.201831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:50.202323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:50.202765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:50.203511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:50.203969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:50.207953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:50.446008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:50.454808 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4827a4b9-4f3b-4dfc-8af5-983b283c3fba tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1511 microversion: 2.1 time: 0.265772 Nov 02 13:12:50.455451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3472/7255] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:50 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:50.937859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1ef2f7-5f03-4886-8f34-f1891eecf6a4", "name": "network-vif-deleted", "tag": "becab302-55db-4943-b3e9-7008f73a461f"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:50.944010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:50.949635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:50.952184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:50.952184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:50.964134 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] Creating event network-vif-deleted:becab302-55db-4943-b3e9-7008f73a461f for instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 on n-h2-855649-4 Nov 02 13:12:50.970353 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-56cf7f59-7598-4402-bcdf-f3170241c492 req-9b3d6fe9-4d02-4ac4-8406-c862b00b0fe1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036083 Nov 02 13:12:50.970740 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3784/7256] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:12:51.477286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:51.477980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:51.485334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:51.485818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:51.486256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:51.487108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:51.487568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:51.487994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:51.524113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:51.524596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:51.525030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:51.525478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lazy-loading 'fault' on Instance uuid ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:12:51.570034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b37ade7c399c435d86ebaae2963cd22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6072e7dca4247c0bd9d17117c486f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:51.579940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88a3bdb3-718d-4192-bdc5-aedc7744266f tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 200 len: 1306 microversion: 2.1 time: 0.106517 Nov 02 13:12:51.580531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3473/7257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:51 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:52.604732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:52.605654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: ba1ef2f7-5f03-4886-8f34-f1891eecf6a4] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:52.613079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:52.613580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:52.614030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:52.614752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:52.615248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:52.615685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:52.632042 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] HTTP exception thrown: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Request method failure captured: Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 HTTP/1.1 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmxxk-KgU-ijUZLEMJtFUXGKhtjKjCqLxxpEOdtYQyXoD_DHTpp282ZNv6erOIaZLOalSHDYJgPM6VDmI4b69KYD6hzJndfLP_tlotcJ0maXe_nt_Hqqia-PrgEcYk7rxRRaGU6nSNnkiL4w6-Rezl3AlvtgaVo14UoZpjSksfQwu3c Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6072e7dca4247c0bd9d17117c486f49", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b37ade7c399c435d86ebaae2963cd22d Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'ba1ef2f7-5f03-4886-8f34-f1891eecf6a4'} Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:52.633734 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Returning 404 to user: Instance ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-049541da-cace-4a02-8c48-42cde6241b8a tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4" status: 404 len: 111 microversion: 2.1 time: 0.036171 Nov 02 13:12:52.640409 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3785/7258] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:52 2022] GET /compute/v2.1/servers/ba1ef2f7-5f03-4886-8f34-f1891eecf6a4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:52.645087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4ac2278-1102-4b2f-9132-c8f37c7a5cbf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '.version_select at 0x7ff1b21d7c10>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:52.649482 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4ac2278-1102-4b2f-9132-c8f37c7a5cbf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:12:53.659247 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4ac2278-1102-4b2f-9132-c8f37c7a5cbf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51316. Nov 02 13:12:53.776999 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4ac2278-1102-4b2f-9132-c8f37c7a5cbf tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445611874" status: 202 len: 0 microversion: 2.1 time: 1.135890 Nov 02 13:12:53.777723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3474/7259] 10.222.0.48 () {58 vars in 1218 bytes} [Wed Nov 2 13:12:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445611874 => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:54.766157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:54.768375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:54.774747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:54.775288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:54.775741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:54.776488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:54.776982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:54.777452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:54.794938 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] HTTP exception thrown: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Request method failure captured: Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 HTTP/1.1 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmxxk-KgU-ijUZLEMJtFUXGKhtjKjCqLxxpEOdtYQyXoD_DHTpp282ZNv6erOIaZLOalSHDYJgPM6VDmI4b69KYD6hzJndfLP_tlotcJ0maXe_nt_Hqqia-PrgEcYk7rxRRaGU6nSNnkiL4w6-Rezl3AlvtgaVo14UoZpjSksfQwu3c Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6072e7dca4247c0bd9d17117c486f49", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: b37ade7c399c435d86ebaae2963cd22d Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'f71c3c69-5337-4988-b8ef-e3a0be5a5ad3'} Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:12:54.796600 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Returning 404 to user: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6e3ba888-fbd4-4abd-9246-729660495e74 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 404 len: 111 microversion: 2.1 time: 0.038761 Nov 02 13:12:54.801469 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3786/7260] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:54 2022] DELETE /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:54.810783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:54.811448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] [instance: f71c3c69-5337-4988-b8ef-e3a0be5a5ad3] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:54.821579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:54.825762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:54.825762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:54.825762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:54.825762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:54.825762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:54.839455 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] HTTP exception thrown: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Request method failure captured: Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 HTTP/1.1 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmxxk-KgU-ijUZLEMJtFUXGKhtjKjCqLxxpEOdtYQyXoD_DHTpp282ZNv6erOIaZLOalSHDYJgPM6VDmI4b69KYD6hzJndfLP_tlotcJ0maXe_nt_Hqqia-PrgEcYk7rxRRaGU6nSNnkiL4w6-Rezl3AlvtgaVo14UoZpjSksfQwu3c Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6072e7dca4247c0bd9d17117c486f49", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6072e7dca4247c0bd9d17117c486f49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: a6072e7dca4247c0bd9d17117c486f49 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-508319914 Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: b37ade7c399c435d86ebaae2963cd22d Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerDiskConfigTestJSON-508319914-project Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'f71c3c69-5337-4988-b8ef-e3a0be5a5ad3'} Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:54.841210 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] Returning 404 to user: Instance f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d319ec5-f4dd-420a-b05c-54949e5dcb47 tempest-ServerDiskConfigTestJSON-508319914 tempest-ServerDiskConfigTestJSON-508319914-project] 10.222.0.48 "GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3" status: 404 len: 111 microversion: 2.1 time: 0.038809 Nov 02 13:12:54.850957 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3475/7261] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:54 2022] GET /compute/v2.1/servers/f71c3c69-5337-4988-b8ef-e3a0be5a5ad3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:08.872053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=5 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:08.874426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:09.016972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f59a38e-e473-44d7-9b61-c229086ef3d0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: .version_select at 0x7ff1b8047430>, body: {"keypair": {"name": "tempest-keypair-1762491920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMj+eidgYxK/G+OTSU0F1X+cPkDPIwNW5xcGWFW+Wa8o0WdOldSzDsSaJ9lI6JnZPlVHZ/i5lShT/1eLMMVSttZ/SCFcCF9nT3KzFrZYfLjUsmzQEw8BT0/8RzITv7oDA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:09.037225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6f59a38e-e473-44d7-9b61-c229086ef3d0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:09.041301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-6f59a38e-e473-44d7-9b61-c229086ef3d0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:09.153491 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f59a38e-e473-44d7-9b61-c229086ef3d0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287547 Nov 02 13:13:09.155215 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3787/7262] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:13:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:11.911231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-847685506", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "befcd6c7-25ed-4ea2-adc7-25a0f21a13f8"}], "security_groups": [{"name": "tempest-securitygroup--851510662"}], "key_name": "tempest-keypair-1762491920", "user_data": "}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:11.925787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:11.925787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:12.087430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] validate_networks() for [('befcd6c7-25ed-4ea2-adc7-25a0f21a13f8', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:12.604522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:12.605244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:12.605950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:12.606771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:12.608060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:12.620588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:12.621080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:12.621524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:12.622264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:12.622763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:12.623269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:12.643525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:12.650418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:12.665676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:12.668180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:12.801474 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47b787a8-d311-4d31-949c-fe2336eef7eb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.894664 Nov 02 13:13:12.802568 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3476/7263] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:13:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:13:12.820649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8af67ee3-d425-4055-a8b2-10780a916222 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:12.821512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8af67ee3-d425-4055-a8b2-10780a916222 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:12.922009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8af67ee3-d425-4055-a8b2-10780a916222 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:12.936521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8af67ee3-d425-4055-a8b2-10780a916222 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1238 microversion: 2.1 time: 0.124583 Nov 02 13:13:12.938044 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3788/7264] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:12 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:13.963208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-083d4589-4b8a-4929-8323-a44a1b2a8865 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:13.967737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-083d4589-4b8a-4929-8323-a44a1b2a8865 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:14.027300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-083d4589-4b8a-4929-8323-a44a1b2a8865 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:14.035698 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-083d4589-4b8a-4929-8323-a44a1b2a8865 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1238 microversion: 2.1 time: 0.079114 Nov 02 13:13:14.036289 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3477/7265] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:13 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:15.063195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:15.063841 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:15.072377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:15.073124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:15.073592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:15.076353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:15.076782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:15.077293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:15.160088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:15.168859 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33c94a48-ef7f-481e-b022-33a7ce7de281 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1290 microversion: 2.1 time: 0.110861 Nov 02 13:13:15.169514 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3789/7266] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:15 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:16.192924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:16.193550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:16.201353 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:16.201829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:16.202279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:16.203026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:16.203500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:16.203936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:16.450367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:16.460190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4a6c2376-a353-4216-89db-d9879138cf46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.271183 Nov 02 13:13:16.460813 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3478/7267] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:16 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:17.471919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:17.485007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:17.485520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:17.486104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:17.488705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:17.489551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:17.497043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:17.498278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:17.498764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:17.499550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:17.500542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:17.501190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:17.502310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] Creating event network-changed:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h2-855649-4 Nov 02 13:13:17.508602 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e3a6f200-5fa4-4aa7-9121-560cf6156083 req-cc9234ce-3b0c-4d40-a171-98dd8ccf468e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040365 Nov 02 13:13:17.509260 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3790/7268] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:17.765195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:17.774745 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87774c37-ca9d-4300-a526-0d89800e7ddc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.292879 Nov 02 13:13:17.775647 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3479/7269] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:17 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:18.800196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:18.800958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:18.808703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:18.817896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:18.817896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:18.817896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:18.817896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:18.817896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:18.959470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:18.968561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-90dd137c-5b5a-41d9-94b2-59f05cbd4e0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.171939 Nov 02 13:13:18.968561 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3791/7270] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:18 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:19.992088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:19.992700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:20.000766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:20.001279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:20.002006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:20.002768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:20.003304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:20.003974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:20.148009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:20.162917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7edf13ab-cd7b-44e3-b886-9dc55d9f6938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.175322 Nov 02 13:13:20.164039 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3480/7271] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:19 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:21.188473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:21.189426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:21.197696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:21.205032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:21.205032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:21.205032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:21.205032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:21.205032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:21.380964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:21.390207 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afd4d291-3154-439c-a759-75f86f754e3e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.206827 Nov 02 13:13:21.390857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3792/7272] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:21 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:22.417238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:22.417930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:22.426233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:22.426816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:22.427370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:22.428172 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:22.428861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:22.429367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:22.630286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:22.649631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:22.658568 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f1dd4c8-7e8f-422a-a589-7e0f980ba004 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.245313 Nov 02 13:13:22.659205 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3481/7273] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:22 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:23.684147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:23.685175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:23.689370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:23.693556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:23.694084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:23.694540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:23.695373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:23.696104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:23.696291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:23.872194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:23.880723 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d414f683-abf7-4463-a1ba-954b0ebc3eae tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.201023 Nov 02 13:13:23.881312 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3793/7274] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:23 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:24.250428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "name": "network-vif-plugged", "status": "completed", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:24.257137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:24.263390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.263892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.264341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:24.276754 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] Creating event network-vif-plugged:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h2-855649-4 Nov 02 13:13:24.282864 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a9dbc695-de57-4a9f-b987-d9e8d2478dda req-9f7bba17-72d5-4daf-a597-cd23d87c0cd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Nov 02 13:13:24.283525 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3482/7275] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:24.904406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:24.905082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:24.912532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.916464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.916464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:24.916464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:24.916464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:24.916464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:25.067887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:25.076216 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c99ce985-fdcd-47ff-a7d6-d2934fe66d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1363 microversion: 2.1 time: 0.176134 Nov 02 13:13:25.076818 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3794/7276] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:24 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:26.101069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:26.101732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:26.108762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.109260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.109704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.110425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.110884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.111341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.256470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:26.264871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91a03239-db8d-411a-9f17-071498c6264f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1549 microversion: 2.1 time: 0.169512 Nov 02 13:13:26.265470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3483/7277] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:13:26 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:26.288381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:26.288925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:26.296658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.297267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.297631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.298369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:26.298847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:26.299328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:26.381251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f66ff9e-7bcd-48b1-b013-f7c3a9140972 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096969 Nov 02 13:13:26.381869 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3795/7278] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 13:13:26 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:27.896028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:27.906474 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:27.906960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:27.907418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:27.919720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] Creating event network-changed:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h2-855649-4 Nov 02 13:13:27.924978 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5205a13a-689a-4355-8e5a-301d7eb9d87c req-8d8849af-81ca-43c9-83b2-e21d4c58872a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104324 Nov 02 13:13:27.926463 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3484/7279] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:42.946390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:42.947317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:42.951937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:42.952648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:42.958427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.958915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.959414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.960118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.960580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.961017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.096822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:43.104689 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4f725d38-9e61-48c4-865f-47778c1a1307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.161773 Nov 02 13:14:43.105261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3796/7280] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:42 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:43.126331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:43.127117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=36 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:43.131473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:43.132192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:43.138640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.145729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.145729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.145729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.145729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.145729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.336640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:43.344767 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2b5083e9-dd45-49c3-a12a-6b671a3dc37d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.221070 Nov 02 13:14:43.345369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3485/7281] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:43 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:43.367750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:43.368384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:43.374790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.375331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.375908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.377126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.377595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.378037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.517007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:43.525212 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6ecf6021-3c05-4c3d-a1c7-ef337953f687 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.161545 Nov 02 13:14:43.525797 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3797/7282] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:43 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:43.549320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:43.551124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:43.557322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.557851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.558251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.558962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.559448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.559882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.590185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:43.596188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:14:43.602927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:43.603382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:43.603864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:43.604275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:43.604691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:43.816791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d0b87de-c470-4b3d-a8b4-43cd4fc1d22c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/action" status: 202 len: 0 microversion: 2.1 time: 0.272513 Nov 02 13:14:43.817408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3486/7283] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:14:43 2022] POST /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:43.825955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:43.826584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:43.833042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.833553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.834039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.834764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:43.835275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:43.835735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:43.989659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:43.998439 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b9a90202-cf6c-480c-80d8-3c603b107e9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1677 microversion: 2.1 time: 0.176525 Nov 02 13:14:43.999274 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3798/7284] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:43 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:45.022696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:45.023380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:45.031207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:45.031710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:45.032202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:45.032925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:45.033525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:45.033829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:45.185945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:45.195282 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6d5b0792-b5be-4584-8c38-6e76371ec873 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1677 microversion: 2.1 time: 0.177536 Nov 02 13:14:45.195880 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3487/7285] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:45 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:46.218507 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.219247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.226419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.227133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.227807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.228697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.229271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.229850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.698092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.706296 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35fb4a17-3ad2-4149-a065-23907478f969 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1677 microversion: 2.1 time: 0.491772 Nov 02 13:14:46.706896 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3799/7286] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1677 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:47.732112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.732757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.739631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.740174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.740623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.741348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.741815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.742406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.886881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:47.895117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-560a8da0-a6dc-4079-b602-631fc3d3ff65 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.167809 Nov 02 13:14:47.895735 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3488/7287] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:48.919651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.920267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:48.927944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.928443 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.928895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.929661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.930125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.930562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.069446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:49.077984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a658cbda-3004-43cd-a89e-e55abb0b251a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.162283 Nov 02 13:14:49.078663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3800/7288] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:50.102558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:50.103122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:50.109928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.110406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.111444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.112154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.112918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.113352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.258767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.267151 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9391d23-adab-49a6-916b-e12deeac4e7f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.168691 Nov 02 13:14:50.267739 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3489/7289] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:50 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:51.291795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:51.292481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:51.299888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.300392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.301333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.301680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.302152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.302597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.450948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:51.459878 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-467c2227-b190-4c02-9c22-44b8b2e5f0d8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.172399 Nov 02 13:14:51.460478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3801/7290] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:51 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:52.484388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:52.485008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:52.493187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.493679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.494126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.494837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.495328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.495769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.644820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.653226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3ef6fc8-e2d8-4037-a1c9-524092dcec67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.172802 Nov 02 13:14:52.653811 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3490/7291] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:52 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:53.677104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:53.677798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:53.685022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.685523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.686033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.686706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.687213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.687661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.837887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.847309 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-989b6ae9-f03f-48da-bf73-1f1f1e62c2c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.174277 Nov 02 13:14:53.847918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3802/7292] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:53 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:54.871566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:54.872194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:54.879871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.880373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.880816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:54.881541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.882043 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.882501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.029350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.037857 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ab06ccc-5e84-4d2a-aefc-671cb984094e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.170287 Nov 02 13:14:55.038530 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3491/7293] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:54 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:56.062199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.062816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:56.070753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.071303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.071764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.072492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.072969 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.073412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.216010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.224466 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2e508fd2-4c28-4e9c-aa81-de17ec0840b3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.166429 Nov 02 13:14:56.225049 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3803/7294] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:57.250877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.252545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:57.259889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.260416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.260866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.261590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.262070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.262488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.406675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.415759 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b5dbe94-496f-482d-8cc0-4059520b5d95 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.170877 Nov 02 13:14:57.416339 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3492/7295] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:58.442420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:58.443029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:58.449773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.450369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.450832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.451586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.452070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.452518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.590834 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.599574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1b6aff55-f463-4031-990d-71180d782302 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.161707 Nov 02 13:14:58.600178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3804/7296] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:58 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:59.622637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.623406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.633160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.633667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.634220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.634881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.635382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.635824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.785498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.793526 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69f932ac-4f24-4af5-96f2-94d96edf4b5e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1682 microversion: 2.1 time: 0.175018 Nov 02 13:14:59.794114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3493/7297] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:00.485971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "name": "network-vif-unplugged", "status": "completed", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:00.497170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.497673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.498123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.511074 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Creating event network-vif-unplugged:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h1-855649-4 Nov 02 13:15:00.517527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] Instance c83e7ed0-a105-4e97-829f-ac59c464797f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:15:00.530250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cc3c527d-07f9-4158-9ffe-50f48984d549 req-b9d998ff-f2ea-4093-91e5-ac3e749aa183 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049326 Nov 02 13:15:00.531180 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3805/7298] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:00.818095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:00.818722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:00.826209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.826713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.827196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.827938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.828400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.828839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.264407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.273566 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1b192c0-1966-4cc1-9743-9af3816e1bb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1681 microversion: 2.1 time: 0.459328 Nov 02 13:15:01.274327 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3494/7299] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:00 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1681 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:02.298833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.299742 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.306259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.306824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.307322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.308036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.308508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.308950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.453246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.461994 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96339353-ede7-419a-98e0-f6e74fe55765 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1681 microversion: 2.1 time: 0.168420 Nov 02 13:15:02.462587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3806/7300] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:02.545694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:02.556102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.556586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.557088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.569533 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Creating event network-changed:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h1-855649-4 Nov 02 13:15:02.575087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] Instance c83e7ed0-a105-4e97-829f-ac59c464797f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:15:02.586769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-74d95e0a-fdab-4c8a-8586-7395d50cc84a req-58f1a4cc-8c9a-4af5-8fd3-b0b803309896 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044754 Nov 02 13:15:02.587429 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3495/7301] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:03.485803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:03.486440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:03.494131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.494640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.495126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.495848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.496325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.496769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.636173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.644513 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d73db8d0-fbef-4cdb-8421-7ad9ddd96095 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1679 microversion: 2.1 time: 0.162454 Nov 02 13:15:03.645758 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3807/7302] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:03 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:04.671300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:04.671998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.679056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.679544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.680075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.680845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.681303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.681732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.820041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.828644 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d6eb22a-ad8d-4a7e-9a92-92c274282e69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1676 microversion: 2.1 time: 0.162752 Nov 02 13:15:04.829246 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3496/7303] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:04 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:04.852870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:04.853658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.860989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.861533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.861990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.862716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.863865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.864313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.095245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e09dacf-50cb-484b-8a5a-57da14f9d857 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/action" status: 204 len: 0 microversion: 2.1 time: 0.245710 Nov 02 13:15:05.095984 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3808/7304] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:15:04 2022] POST /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:05.105466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:05.106293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:05.113825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.122845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.122845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.122845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.122845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.122845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.267337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:05.277726 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ab4d4ed-4e13-49c2-81a9-757636b65d3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1676 microversion: 2.1 time: 0.175358 Nov 02 13:15:05.278150 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3497/7305] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:05 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:06.305802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:06.306508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:06.314793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.315344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.315810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.317209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.318195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.318369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.485537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.496132 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-faa01088-2bce-4c53-aaa5-35b51bb72b00 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1676 microversion: 2.1 time: 0.195012 Nov 02 13:15:06.496999 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3809/7306] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:06 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:07.524393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.524991 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:07.532576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.533065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.533616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.534331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.534789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.535276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.688944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:07.698207 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-048b2089-dd6d-4e0b-a4f4-24a1916f9336 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.177632 Nov 02 13:15:07.698799 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3498/7307] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:07.722253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.723333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:07.731452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.731956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.732413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.733151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.733879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.734330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.879471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:07.889207 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-57a4792f-fff2-4daa-b848-dcca3dc4ae8e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.170428 Nov 02 13:15:07.890037 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3810/7308] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:07.914307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.914918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:07.921290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.921776 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.922249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.922996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.923462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.923890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.063293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.071855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c1a02c47-0043-4298-9f3f-b8c5be56ea3c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1668 microversion: 2.1 time: 0.161618 Nov 02 13:15:08.072439 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3499/7309] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:08.095395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.096044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.102217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.102720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.103199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.103917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.104386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.104830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.135356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:15:08.137309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.504279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9999ba47-b0c6-4aaf-a575-f5c04da8c060 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 204 len: 0 microversion: 2.1 time: 0.412825 Nov 02 13:15:08.504918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3811/7310] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:15:08 2022] DELETE /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:08.513696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.514326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.520888 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.522376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.522376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.522653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.523146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.523582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.544186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.674399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.687014 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e69b3759-4141-4386-9af4-27a12c43b535 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1674 microversion: 2.1 time: 0.175160 Nov 02 13:15:08.687014 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3500/7311] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:08.708539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "name": "network-vif-plugged", "status": "completed", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:08.719723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.720219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.720661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.742435 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] Creating event network-vif-plugged:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h1-855649-4 Nov 02 13:15:08.752068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-bce4fbe8-b50a-41e9-a7b0-003e487bc688 req-918c426b-1301-4ad3-859c-ec063f644ca7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132426 Nov 02 13:15:08.756893 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3812/7312] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:09.708753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.709652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.716885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.717379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.717822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.718536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.719019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.719457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.948795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.957956 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d505cff5-17f9-4c68-9ddd-798f72673daa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1674 microversion: 2.1 time: 0.253785 Nov 02 13:15:09.960909 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3501/7313] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:10.922228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83e7ed0-a105-4e97-829f-ac59c464797f", "name": "network-vif-deleted", "tag": "12f0fb41-20d7-403a-ad34-ebd3e26b3316"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:10.934121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.934621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.935097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.947201 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] Creating event network-vif-deleted:12f0fb41-20d7-403a-ad34-ebd3e26b3316 for instance c83e7ed0-a105-4e97-829f-ac59c464797f on n-h1-855649-4 Nov 02 13:15:10.952473 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-0c817b46-33ad-46ba-bf23-a34e30ac1713 req-683d9c29-aa71-4a99-9083-ca7b5d20c866 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Nov 02 13:15:10.953295 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3813/7314] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:10.982218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.982856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.991051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.991554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.991999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.992725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.993210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.993646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.063698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.072761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-87db05b7-1683-4c4c-be8b-02c2cd2919d7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 200 len: 1607 microversion: 2.1 time: 0.094699 Nov 02 13:15:11.073377 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3502/7315] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 1607 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:12.100135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.100774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.108544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.109162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.109624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.110345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.111079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.111289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.127158 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f HTTP/1.1 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c83e7ed0-a105-4e97-829f-ac59c464797f'} Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:12.128889 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fca8612b-f70a-4bcd-b904-b780140eeac6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 404 len: 111 microversion: 2.1 time: 0.036232 Nov 02 13:15:12.134521 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3814/7316] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:12.143239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.147983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.151585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.152349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.153328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.154064 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.154561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.155013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.171237 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f HTTP/1.1 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c83e7ed0-a105-4e97-829f-ac59c464797f'} Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:12.173201 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:15:12.178804 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:15:12.179348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:12.180209 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b397ae70-145e-4ea9-9860-5e464d437fe8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 404 len: 111 microversion: 2.1 time: 0.041198 Nov 02 13:15:12.180801 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3503/7317] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:12.230678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-622753513", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "befcd6c7-25ed-4ea2-adc7-25a0f21a13f8"}], "security_groups": [{"name": "tempest-securitygroup--851510662"}], "key_name": "tempest-keypair-1762491920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:12.344087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] validate_networks() for [('befcd6c7-25ed-4ea2-adc7-25a0f21a13f8', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:12.789442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:12.789879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:12.790375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:12.790807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:12.791267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:12.800877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.801410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.801865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.802619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.803131 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.803579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.821552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:12.827186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:12.841981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:12.844498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:13.041287 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [a86afada-22b6-4d03-adf6-147c3860d733] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:15:14.050032 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [a86afada-22b6-4d03-adf6-147c3860d733] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51594. Nov 02 13:15:14.056184 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-390d317d-becc-4452-b141-9ad274bcdfe7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.829453 Nov 02 13:15:14.057515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3815/7318] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:15:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:15:14.070874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed6f03e-82cc-41d6-865c-db1fc6c9b52d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:14.071673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ed6f03e-82cc-41d6-865c-db1fc6c9b52d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:14.074546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=43 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:14.150122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed6f03e-82cc-41d6-865c-db1fc6c9b52d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.158306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed6f03e-82cc-41d6-865c-db1fc6c9b52d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1238 microversion: 2.1 time: 0.093037 Nov 02 13:15:14.159128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3504/7319] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:14 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:15.183736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.184477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.186630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:15.192189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.193574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.194377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.195242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.196021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.201503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.278422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.288826 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d1984eca-0f18-4bbe-9ead-49c6675b0888 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1242 microversion: 2.1 time: 0.109949 Nov 02 13:15:15.289874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3816/7320] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:16.319500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.321628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.329781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.330419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.330867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.331617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.332706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.333023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.424151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:16.432795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3502aaa3-a96e-414c-a016-831ad848ebd5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1298 microversion: 2.1 time: 0.118534 Nov 02 13:15:16.433403 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3505/7321] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:17.457185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.458332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:17.466888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.468311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.468311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.468630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.469083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.470051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.643400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.653154 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a699312-e6e7-4e20-a618-e6b976df6170 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.199855 Nov 02 13:15:17.653891 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3817/7322] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:18.326596 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:18.337117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.337602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.338370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.350361 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] Creating event network-changed:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h2-855649-4 Nov 02 13:15:18.355502 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5a58e1ae-3766-414d-8f02-653dc5ff89ba req-25c54bc7-d9fa-4b0b-8a82-a161db8c35ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Nov 02 13:15:18.356580 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3506/7323] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:18.681341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:18.682767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:18.690860 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.691452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.691935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.692739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.693513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.694194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.838523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.847276 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa0a10b1-92aa-4f7f-b852-3eab64cd1584 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.169762 Nov 02 13:15:18.847965 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3818/7324] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:18 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:19.873454 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:19.874165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:19.881240 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.881734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.882211 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.882923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.883413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.883845 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.044339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.053304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-028ceaa3-4a31-4d6d-8576-e1c645024821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.184959 Nov 02 13:15:20.067251 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3507/7325] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:19 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:21.080144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.080765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.088420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.088923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.089372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.090090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.090558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.091021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.234355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.242694 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-867e7946-3c9b-4389-81dd-7ffa3cade6c3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.166579 Nov 02 13:15:21.243314 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3819/7326] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:22.266941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:22.267369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:22.274859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.276264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.276264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.276560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.277222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.277652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.433376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.441677 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f1fad1b-0c0c-4acf-96ee-6f2f97c273a6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.178953 Nov 02 13:15:22.442372 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3508/7327] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:22 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.466251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.466897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.469783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:23.470509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:23.476485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.480368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.480368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.480368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.480368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.480368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.648890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.660053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d728f5fe-f984-46b5-8c09-e1ad912f5696 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.197701 Nov 02 13:15:23.661546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3820/7328] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:24.685692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.686355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.689152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:24.694603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.695154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.695598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.696312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.696774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.697206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.861258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.870861 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8024c291-f6d1-4189-84d4-5e77e7de0f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.188991 Nov 02 13:15:24.871501 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3509/7329] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.895324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.896077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.903420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.903922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.904376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.905086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.905556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.905998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.045056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:26.054182 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-25546aca-3f17-430f-a39b-40faf908737b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.162763 Nov 02 13:15:26.054785 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3821/7330] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:26.786314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "name": "network-vif-plugged", "status": "completed", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:26.797063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.797549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.797986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.810743 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] Creating event network-vif-plugged:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h2-855649-4 Nov 02 13:15:26.815524 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c8cf5b52-d3ea-4c61-9514-5481fc89f269 req-75d60595-0f69-4d21-9f8c-b9bceb7c6e71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Nov 02 13:15:26.816133 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3510/7331] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:27.077771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.078361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.086816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.087364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.087856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.088594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.089158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.089636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.241355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.251774 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-525dcb69-6a2b-4b28-a485-66fbb93d16c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.178171 Nov 02 13:15:27.252382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3822/7332] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:28.284942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:28.285689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:28.292871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.293505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.293826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.294571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.295159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.295645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.444527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:28.453405 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eab63850-598c-4927-9cc5-9f401f1cd3fd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1363 microversion: 2.1 time: 0.173427 Nov 02 13:15:28.453912 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3511/7333] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:28 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:29.478949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.480025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.487986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.488521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.489004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.489788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.490551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.491387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.639255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.647984 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5442fd0c-9e7d-4e8f-aca5-a8c9e9428fb9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1548 microversion: 2.1 time: 0.173657 Nov 02 13:15:29.648577 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3823/7334] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:29.673224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.683032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.683659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.773516 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-41baa33a-220d-4e4b-86b4-7c138b317bd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104279 Nov 02 13:15:29.774145 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3512/7335] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:30.909183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:30.920264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.920764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.921217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.933506 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] Creating event network-changed:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h2-855649-4 Nov 02 13:15:30.939023 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c83e135a-4749-49ae-b706-41fab97f7fb9 req-4883dd32-56ae-4ea5-9bf0-4d7221b21868 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033288 Nov 02 13:15:30.939543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3824/7336] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:44.945283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:44.946057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=54 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:44.951469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:44.959496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.961070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.961070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.987498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Going to try to stop instance {{(pid=127568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:16:45.266602 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f1c01d1d-ecac-4ab9-9def-02b43c9d2483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action" status: 202 len: 0 microversion: 2.1 time: 0.322870 Nov 02 13:16:45.267143 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3513/7337] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:16:44 2022] POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:45.277626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=17 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:45.279331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:45.280082 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:16:45.280285 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb (ip 10.222.0.48) !!! Nov 02 13:16:45.288180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.289012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.303703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.307042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.307042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.307713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.308271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.308814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.584776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.594138 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9db3d8ce-3238-4fed-8962-f70f16a3b4f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.319690 Nov 02 13:16:45.594769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3825/7338] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:46.619518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:46.620328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:46.627096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.627598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.628115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.629661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.629661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.629931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.782799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:46.791563 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ad33b301-9738-418f-b1ab-dca954b9de07 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.177536 Nov 02 13:16:46.792158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3514/7339] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:46 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:47.815691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.816347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:47.823602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.824111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.824577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.825302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.825774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.826243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.981498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.989961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ba5fbab0-d266-4471-8597-a7b5f2f7a46b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.178268 Nov 02 13:16:47.990609 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3826/7340] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:49.013821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:49.014416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:49.022019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.022517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.022948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.023678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.024136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.024566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.167266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.177968 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ed9c716-f62c-4b46-adcb-a0b6ee2e660f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.167861 Nov 02 13:16:49.178490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3515/7341] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:49 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:50.202034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:50.202675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:50.209730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.210243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.210700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.211529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.211999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.212448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.355714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:50.364545 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-916a48c8-7acf-4517-a616-3039cb21fa8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.166530 Nov 02 13:16:50.365150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3827/7342] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:50 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:51.388915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.389533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:51.397221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.397711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.398153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.398859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.399351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.399777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.534509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.543158 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1fd83573-2051-4bcf-a822-76c8841d5fd1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.158183 Nov 02 13:16:51.543749 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3516/7343] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:52.567255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:52.567817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:52.574766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.575377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.575831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.576677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.577143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.578105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.714109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:52.722431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09f58652-06e4-4b52-a200-d07db9b37f4b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.159167 Nov 02 13:16:52.723041 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3828/7344] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:52 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:53.745935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.746566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:53.753678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.754171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.754610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.755357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.755816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.756244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.894461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.903106 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cab00796-758a-445c-b98d-b8590ef61236 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.161066 Nov 02 13:16:53.903718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3517/7345] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:54.928004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.928744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.936341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.937661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.938161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.939066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.939591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.940114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.084849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.094416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97778945-e36a-4384-95e9-9e545ee4bb83 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.169172 Nov 02 13:16:55.095152 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3829/7346] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:56.121056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.121697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.128828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.140497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.140497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.140497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.140497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.140497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.276688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.284907 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-26328d97-a507-4f83-9c02-d43b7136c383 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.168780 Nov 02 13:16:56.285492 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3518/7347] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:57.310253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:57.313979 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.318964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.319511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.319972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.320708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.321211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.321759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.462038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.470502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0633d2d7-0bef-4282-b898-f53ea1fb8648 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.164406 Nov 02 13:16:57.471110 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3830/7348] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:57 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:58.494227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.494906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.503047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.503540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.503985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.504691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.505149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.505583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.653842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:58.663190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b524668f-424a-42f2-908c-960578e65f88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.172989 Nov 02 13:16:58.665752 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3519/7349] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:59.688528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:59.692401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:59.695967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.696506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.696964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.697696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.698170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.698611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.846829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.855165 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8077cbd3-bdea-4720-9244-93fdc9950272 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.171694 Nov 02 13:16:59.855764 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3831/7350] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:59 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:00.881643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.882464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.890696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.891355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.891848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.892651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.893197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.893790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.067183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.075920 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d068f04-5246-4a0a-8d69-73e94f6854c4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1654 microversion: 2.1 time: 0.198642 Nov 02 13:17:01.076533 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3520/7351] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1654 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:01.100529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:01.103061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:01.111269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.111895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.112472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.113303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.113885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.114504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.148900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.155813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=127567) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:17:01.163736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:01.164172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:01.166074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:01.166074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:01.166074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:01.412623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8763d094-3fda-409e-8d2c-e4de875259f3 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action" status: 202 len: 0 microversion: 2.1 time: 0.316042 Nov 02 13:17:01.413426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3832/7352] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:17:01 2022] POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:17:01.423847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:01.424722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:01.432392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.433156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.433870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.435181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.435994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.436771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.599073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.607902 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abaa862f-6f9d-4f14-8abd-1bd2e0f5e03a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.189571 Nov 02 13:17:01.613873 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3521/7353] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:01 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:02.636743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:02.638271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:02.648317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.648948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.649927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.651135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.651693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.652330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.814317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.823055 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3bae5b9-1cc0-4997-81f1-68b094445f67 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.193397 Nov 02 13:17:02.827251 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3833/7354] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:02 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:03.862737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.863414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.870576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.871122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.871571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.872283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.872746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.873179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.435664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:04.444264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e81d328-a064-4790-8b73-29e43bb62007 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1677 microversion: 2.1 time: 0.585892 Nov 02 13:17:04.444864 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3522/7355] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1677 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:05.471572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:05.472653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:05.482741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.483291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.483725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.485132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.485630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.486093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.629904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.638359 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-135be7af-cb77-436f-8a74-723ff480d611 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1682 microversion: 2.1 time: 0.172409 Nov 02 13:17:05.638946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3834/7356] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:05 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:06.663518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.664170 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.671470 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.671969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.672434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.673158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.673623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.674063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.814992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.823507 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e028460b-8f27-4fc4-b40b-2c3dae7d2917 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1682 microversion: 2.1 time: 0.163917 Nov 02 13:17:06.824098 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3523/7357] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:07.848401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.849045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.856298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.856733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.857196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.857925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.858403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.858848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.002799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.012438 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-896f114f-8174-423f-9d32-f4ddfe24871c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1681 microversion: 2.1 time: 0.167931 Nov 02 13:17:08.013035 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3835/7358] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:07 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:08.172884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "name": "network-vif-unplugged", "status": "completed", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:08.191775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.192637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.193425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.217694 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Creating event network-vif-unplugged:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h1-855649-4 Nov 02 13:17:08.228609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:17:08.249044 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-577eb77a-c913-4d22-9133-754935b8f810 req-cd354d1e-348a-4956-9d8b-6e0c4b078d3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083197 Nov 02 13:17:08.250778 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3524/7359] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:09.038620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:09.039376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:09.047467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.048130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.048461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.049283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.049791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.050323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.227342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.236544 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-398310b9-80c0-40a9-96be-dda724c73f0d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1681 microversion: 2.1 time: 0.201873 Nov 02 13:17:09.237387 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3836/7360] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:09 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:10.266581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.267722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.271457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:10.276488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.277133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.277674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.278490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.279121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.279648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.291876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.292732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.293243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.313280 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Creating event network-changed:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h1-855649-4 Nov 02 13:17:10.324776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:17:10.342440 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-42514818-f59e-4d8c-a5b6-0a60eec0d3b8 req-505c4772-7ee1-4af5-944f-fdd505bd2110 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075065 Nov 02 13:17:10.342440 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3837/7361] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:10.513906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.524498 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f4f80a10-9671-44bc-adcf-9227f3ad3f70 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1679 microversion: 2.1 time: 0.265850 Nov 02 13:17:10.525106 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3525/7362] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:11.552467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:11.553153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:11.561700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.563048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.563709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.564519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.565016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.565476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.721458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:11.729956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d149964f-3329-4c83-8382-c1c6167419ed tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1675 microversion: 2.1 time: 0.183290 Nov 02 13:17:11.730550 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3838/7363] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:11 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:11.753541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:11.754265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:11.761218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.761708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.762145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.762855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.763347 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.763771 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.044645 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-97d7ba74-b852-45cd-a3ba-250db1fdaebe tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action" status: 204 len: 0 microversion: 2.1 time: 0.295385 Nov 02 13:17:12.045648 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3526/7364] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:17:11 2022] POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:17:12.056133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:12.057646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:12.064784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.065170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.065621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.067386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.067867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.068319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.261242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.269851 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed29424a-8e72-45af-81a3-08b18b10fca0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1675 microversion: 2.1 time: 0.217933 Nov 02 13:17:12.270463 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3839/7365] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:12 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:13.299837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:13.300264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:13.307453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.307953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.308401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.309117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.309582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.310024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.466906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.470558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:13.481164 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c8033c9-0ede-4505-a0b1-8fa48f2a899e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1675 microversion: 2.1 time: 0.183316 Nov 02 13:17:13.481164 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3527/7366] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:13 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:14.513119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.514064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.522114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.522626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.523171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.523912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.524394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.524843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.545283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:14.669874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.679345 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88c2a30a-5a1f-4ed6-822a-5b117dc44c1d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1654 microversion: 2.1 time: 0.171381 Nov 02 13:17:14.679941 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3840/7367] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:14.703327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.703960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.712225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.712754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.713204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.713931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.714396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.714832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.875325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.883284 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c255707-212b-4c60-943a-dfafa5a23a87 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1654 microversion: 2.1 time: 0.184598 Nov 02 13:17:14.884004 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3528/7368] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1654 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:14.907893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:14.915201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.915559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.916024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.939692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Going to try to start instance {{(pid=127567) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:17:15.118914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "name": "network-vif-plugged", "status": "completed", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:15.124895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:15.131871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.132370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.132800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.146774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] Creating event network-vif-plugged:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h1-855649-4 Nov 02 13:17:15.153303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-72e03bac-d40a-4e2d-a8e7-07db8241b14a req-a57e89a7-93ae-4e85-a672-46dd6bfb5605 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 Nov 02 13:17:15.154117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3529/7369] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:17:15.213584 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05c1f31b-9666-40bc-a200-c47cf1b2037f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action" status: 202 len: 0 microversion: 2.1 time: 0.310239 Nov 02 13:17:15.214261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3841/7370] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:17:14 2022] POST /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:15.224017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:15.224890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:15.232016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.232565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.233010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.233980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.234232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.234666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.385857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:15.395029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ab2ee34f-0f1f-4f20-9e01-78f3011ca1b0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1663 microversion: 2.1 time: 0.175221 Nov 02 13:17:15.395803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3530/7371] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:15 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:16.424076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:16.425937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:16.428248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:16.433983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.434735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.434955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.435822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.436298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.437319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.607032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.620588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d109080-2962-41fb-a33a-8b949fc3dda6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1663 microversion: 2.1 time: 0.203788 Nov 02 13:17:16.621202 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3842/7372] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:16 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1663 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:17.648389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:17.649032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:17.657265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.657747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.658185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.658885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.659368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.659793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.799565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.807514 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a85ff060-f4ee-4686-9540-04e5519227ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1667 microversion: 2.1 time: 0.162968 Nov 02 13:17:17.808086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3531/7373] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:17 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:17.831212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:17.831727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:17.838823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.839372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.839838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.840574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.841057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.841541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.872604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:17:18.250567 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8bad0be0-2760-4778-9880-30cbe106ad8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 204 len: 0 microversion: 2.1 time: 0.423006 Nov 02 13:17:18.251227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3843/7374] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:17:17 2022] DELETE /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:17:18.260227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:18.260996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:18.267760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.268246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.268690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.269546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.270031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.270633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.412130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.420428 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-164c494f-c3e9-4a7e-a4e3-7f480a4b028f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1673 microversion: 2.1 time: 0.164155 Nov 02 13:17:18.421242 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3532/7375] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:18 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:19.445351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:19.446112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:19.454608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.455214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.455679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.456420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.456897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.457343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.603610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.613242 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eac4defd-a39c-477e-a5e3-0e719b8f4564 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1673 microversion: 2.1 time: 0.172138 Nov 02 13:17:19.614091 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3844/7376] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:19 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:20.638349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:20.639586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:20.647014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.647523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.648149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.649045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.649818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.650722 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.721665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27cb003d-78fa-4a43-a21c-4295fc0cf8cb", "name": "network-vif-deleted", "tag": "69d5a63f-98ca-414f-9540-c65d89c5f0a5"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:20.735917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.736445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.736756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:20.736921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.745613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-30c6fa0f-b42f-4818-bcd6-53e7b1b1538d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 200 len: 1606 microversion: 2.1 time: 0.111465 Nov 02 13:17:20.746214 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3533/7377] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:20 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 1606 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:20.750494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] Creating event network-vif-deleted:69d5a63f-98ca-414f-9540-c65d89c5f0a5 for instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb on n-h1-855649-4 Nov 02 13:17:20.756427 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67fe3184-5cfc-40a7-88a7-c9013510d2be req-bf81b3db-4dcb-44ba-ab52-25ddbd8edf96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038515 Nov 02 13:17:20.757038 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3845/7378] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:21.774916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:21.777402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.799401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.821026 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb HTTP/1.1 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '27cb003d-78fa-4a43-a21c-4295fc0cf8cb'} Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:21.822913 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e7a04e0-0d39-4ec9-8570-a8428b83a7c7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 404 len: 111 microversion: 2.1 time: 0.057172 Nov 02 13:17:21.829787 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3534/7379] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:21 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:21.852071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:21.852071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:21.859614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.859614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.860090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.860950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.861571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.861953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.877788 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb HTTP/1.1 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '27cb003d-78fa-4a43-a21c-4295fc0cf8cb'} Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:21.879585 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec16a76b-e7b0-4147-94cb-e58578c48b40 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 404 len: 111 microversion: 2.1 time: 0.036565 Nov 02 13:17:21.884904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3846/7380] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:21 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:21.934421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1530370402", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "befcd6c7-25ed-4ea2-adc7-25a0f21a13f8"}], "security_groups": [{"name": "tempest-securitygroup--851510662"}], "key_name": "tempest-keypair-1762491920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:22.055083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] validate_networks() for [('befcd6c7-25ed-4ea2-adc7-25a0f21a13f8', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:22.849608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:22.850258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:22.850508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:22.850924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:22.851389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:22.861553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.863954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.863954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.863954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.863954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.864388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.883785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:22.891368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:22.906215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:17:22.908669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:17:23.134727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a524852c-ef7b-4e4a-9505-7f872c63fb88 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.204282 Nov 02 13:17:23.138920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3535/7381] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:17:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:17:23.149197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-317fe7d2-ac31-4a55-9f21-78a78bfc5c80 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:23.149883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-317fe7d2-ac31-4a55-9f21-78a78bfc5c80 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:23.211082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-317fe7d2-ac31-4a55-9f21-78a78bfc5c80 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:23.220684 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-317fe7d2-ac31-4a55-9f21-78a78bfc5c80 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1239 microversion: 2.1 time: 0.075576 Nov 02 13:17:23.221276 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3847/7382] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:23 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:24.249108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-55df61e2-5d55-41b3-85d9-2c17c0d7ce18 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:24.250262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-55df61e2-5d55-41b3-85d9-2c17c0d7ce18 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:24.305661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-55df61e2-5d55-41b3-85d9-2c17c0d7ce18 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.313581 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-55df61e2-5d55-41b3-85d9-2c17c0d7ce18 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1239 microversion: 2.1 time: 0.072577 Nov 02 13:17:24.314097 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3536/7383] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:24 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:25.338235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:25.338862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:25.347019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.347511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.347958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.348689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.349198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.349641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.425264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.433863 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ef74714-7484-465b-8f51-2b3f644bbf5d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1291 microversion: 2.1 time: 0.099708 Nov 02 13:17:25.434490 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3848/7384] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:25 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1291 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:26.458516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.459158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.467496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.468001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.468652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.469891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.470358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.470793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.559735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:26.567923 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f863d8f8-3f2e-4e27-ae6d-c31167f3adf0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1299 microversion: 2.1 time: 0.113391 Nov 02 13:17:26.568519 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3537/7385] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:26 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:27.593196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:27.593753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:27.601829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.602231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.602923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.603891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.604369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.604857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.747214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:27.755489 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec993bfd-2972-4916-82ac-44edf6f9e40b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.167025 Nov 02 13:17:27.756090 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3849/7386] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:27 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:28.496851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:28.509063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.509655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.510029 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.521638 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] Creating event network-changed:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:17:28.529720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-676d0861-421f-4863-ba29-9983d312af22 req-fd1561d4-58f4-4e22-a982-c21b79459e21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 Nov 02 13:17:28.529720 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3538/7387] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:28.782823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.783754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.791049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.791744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.792223 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.792963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.793444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.793885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.962886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:28.972262 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-805480ee-a507-4761-8c14-3f3f2f7ce20d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.194629 Nov 02 13:17:28.972880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3850/7388] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:29.999464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.010025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.010639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.172994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.181441 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64babb40-7a9c-4d38-aa8b-3c63ad8a907f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.187658 Nov 02 13:17:30.182036 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3539/7389] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:29 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:31.205852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:31.206478 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:31.213794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.214360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.214856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.215618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.216086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.216527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.359217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.368748 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b969759a-a19f-4563-8ac0-77a1d8a81821 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.167508 Nov 02 13:17:31.369355 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3851/7390] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:31 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:32.392912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:32.393558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:32.400723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.401215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.401658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.402365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.402833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.403308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.540948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:32.549420 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-237bff3e-988c-432c-b90d-8644e1ed79d1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.160471 Nov 02 13:17:32.549997 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3540/7391] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:32 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:33.574033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:33.574650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:33.577491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:33.582817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.583274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.583757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.584459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.584931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.585369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.724206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.733372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-31865e9f-fbe4-458b-9971-501f7fbdd7cf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.163495 Nov 02 13:17:33.733950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3852/7392] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:33 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:34.757650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.758223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:34.760310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:34.761486 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:34.766506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.772569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.772569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.772569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.772569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.772569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.909447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.918178 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dce8c36f-ed9e-4110-8bb8-95b70978ac4a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.164600 Nov 02 13:17:34.918781 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3541/7393] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:34 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:35.397380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-plugged", "status": "completed", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:35.410134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.410630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.411241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.424183 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] Creating event network-vif-plugged:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:17:35.430126 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-75660d06-8246-4f93-8698-e05ccbea27af req-e8870b9d-bb71-4943-bd0e-7dbf2a383b38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Nov 02 13:17:35.430752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3853/7394] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:35.941997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.942617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.949807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.950293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.951477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.951477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.951932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.952357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.104017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.112518 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-303fa31c-1c58-453e-90e6-cef0893f4d53 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1364 microversion: 2.1 time: 0.174421 Nov 02 13:17:36.113189 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3542/7395] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:37.136925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.137710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.145933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.146456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.146923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.147663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.148129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.148569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.295828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.304974 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-688d537b-6cd3-41b5-bb25-d3657ed54aaa tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1550 microversion: 2.1 time: 0.172449 Nov 02 13:17:37.305576 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3854/7396] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:37.328879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.329496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.336365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.336852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.337295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.338090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.338459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.338891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.426532 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9bb712a-30b5-4461-86a9-be2db7fdc8b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101505 Nov 02 13:17:37.427190 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3543/7397] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:38.473235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:38.484490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.485056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.486656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.498155 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] Creating event network-changed:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:17:38.505274 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6fbbb6d2-ab16-4a7a-9db8-cf8b8db3d10a req-5da2ec44-0d8a-4443-95be-6cb1468e2a24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035613 Nov 02 13:17:38.505925 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3855/7398] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:50.515181 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:18:50.515798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.516420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=73 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.517656 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:18:50.517798 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/action (ip 10.222.0.48) !!! Nov 02 13:18:50.588749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:50.591201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.598226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.598730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.599293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.600223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.600796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.601314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.634059 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:50.640574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:18:50.649148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:50.649577 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:50.650058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:50.650634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:50.651055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:50.887079 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33baf311-0070-4d5d-92ad-4a2e41aa6203 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/action" status: 202 len: 0 microversion: 2.1 time: 0.374530 Nov 02 13:18:50.889442 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3544/7399] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:18:50 2022] POST /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:50.895258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.896093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.902808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.902808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.909933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.910441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.910913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.911674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.912153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.912597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:51.076832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:51.085077 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d89f317e-dd58-4afd-909b-32213a6b31b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1678 microversion: 2.1 time: 0.192607 Nov 02 13:18:51.085683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3856/7400] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:52.111658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.112421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.121296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.121793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.122229 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.123160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.123644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.124050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.131159 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51910. Nov 02 13:18:52.268118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:52.277497 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d379eb6-437a-4e35-bc88-9e84a1495f0e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1678 microversion: 2.1 time: 0.171126 Nov 02 13:18:52.278203 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3545/7401] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:53.303196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:53.307272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:53.316527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.317826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.318342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.319226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.319775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.320319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.474089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:53.484372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-083d54a2-2198-4e7e-bb66-e92bdb36f489 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1678 microversion: 2.1 time: 0.185744 Nov 02 13:18:53.484969 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3857/7402] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:53 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:54.508847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:54.509515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:54.516392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.516881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.517385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.518016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.518473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.518898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.677122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:54.686008 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f6bb199-9993-4dcf-ab05-46ee770404bb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1678 microversion: 2.1 time: 0.181849 Nov 02 13:18:54.686604 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3546/7403] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:54 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:55.709498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.710115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.717985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.718527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.719002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.719723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.720230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.720633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.861377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:55.869934 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b3e36a92-d7ea-4b03-9960-989f2ecf6541 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.164443 Nov 02 13:18:55.870542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3858/7404] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:56.894754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:56.895386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:56.903494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.903987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.904423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.905144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.905598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.906026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:57.050402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:57.058950 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-47205ce5-29c5-4a36-a89e-3ef36725e104 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.168124 Nov 02 13:18:57.059601 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3547/7405] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:56 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:58.091529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:58.092179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:58.099346 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.099870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.100314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.101045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.101583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.101967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.256827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:58.265830 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f636f06-fd0a-49ca-b80a-ce84b901296d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.179747 Nov 02 13:18:58.266426 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3859/7406] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:58 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:59.289571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:59.290194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:59.297464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.297958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.298405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.299140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.299615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.300045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.444976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:59.453124 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cf62b553-26c9-424e-94b0-8f1172238525 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.167475 Nov 02 13:18:59.453715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3548/7407] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:18:59 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:00.477474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:00.478106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:00.484433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:00.484929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:00.485383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:00.486097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:00.486565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:00.487034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:00.627950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:00.637025 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c8dcdce-992d-4347-972e-9624a3c3bc6d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.163915 Nov 02 13:19:00.637625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3860/7408] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:00 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:01.662583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:01.663232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:01.670314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.670796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.671422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.671976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.672435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.672895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.823820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:01.832531 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7ffa724d-ba3d-4ae2-9f9b-47f6d18b12fb tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.174327 Nov 02 13:19:01.833139 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3549/7409] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:01 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:02.857492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:02.858056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:02.865787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:02.866328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:02.866836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:02.868272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:02.868814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:02.869376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:03.022393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:03.034811 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6b888c4-1fd1-40b8-9331-fde1cfc36ee6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.180917 Nov 02 13:19:03.036160 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3861/7410] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:02 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:04.063592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:04.064216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:04.071494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.071987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.072495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.073216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.073680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.074104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.237632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:04.247190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d8e28fd-a9a3-4518-b4d0-f18d64933440 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.187411 Nov 02 13:19:04.247929 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3550/7411] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:04 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:05.277059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:05.277699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:05.289341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.291118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.291769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.292976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.293984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.294480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.473204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:05.485534 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-157dd9c5-9d28-4c21-9eda-2ae0ce6a5801 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.213019 Nov 02 13:19:05.486166 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3862/7412] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:05 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:06.522213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.522832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:06.529751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.530238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.530682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.531418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.531879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.532317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.675007 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:06.684077 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da3c25c1-2724-4fb1-aa0d-f7c28715b483 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.166206 Nov 02 13:19:06.684760 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3551/7413] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:06 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:07.708772 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:07.709664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:07.717704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:07.718255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:07.718726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:07.719559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:07.720041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:07.720500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:07.864281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:07.872690 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b6ee7d9a-2308-4af9-8fee-6429cd10a8fc tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.167947 Nov 02 13:19:07.873501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3863/7414] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:07 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:08.895775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:08.896426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:08.904341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.904830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.905273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.905985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.906440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.906971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:09.043419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:09.052347 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-18610d89-71fb-485f-9fc4-31aeecaa2b04 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.160286 Nov 02 13:19:09.052938 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3552/7415] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:08 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:10.077811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.078480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:10.085744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.086247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.086703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.087505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.087986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.088434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.240806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:10.250416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a78cc2b-154a-4e64-9ba5-27ca07c98977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.176579 Nov 02 13:19:10.251743 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3864/7416] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:10 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:11.275660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.276293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.284157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.284679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.285084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.285710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.286175 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.286609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.426296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:11.435181 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e249eb6d-ad70-4957-b05a-acce816d3356 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1683 microversion: 2.1 time: 0.163635 Nov 02 13:19:11.435731 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3553/7417] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:11 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:12.459450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:12.460088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:12.467631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.468169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.468595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.469354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.469788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.470232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.607995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:12.615931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72500a22-772c-48a4-af4f-f73d01c0f1ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1682 microversion: 2.1 time: 0.160346 Nov 02 13:19:12.616483 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3865/7418] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:12 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:12.790497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-unplugged", "status": "completed", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:12.800877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.801357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.801804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.815126 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Creating event network-vif-unplugged:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h1-855649-4 Nov 02 13:19:12.821004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:12.832230 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a7667858-db2a-4438-bf0a-7265fc9fcfae req-aa4f5eca-bc45-400e-85f7-25e6de480e6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128765 Nov 02 13:19:12.832919 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3554/7419] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:13.640309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:13.640943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:13.648125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.648905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.649364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:13.650083 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.650605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.651597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:13.796874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:13.805010 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ad43305-cca8-4837-b42c-fb6efcedc197 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1682 microversion: 2.1 time: 0.168536 Nov 02 13:19:13.812252 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3866/7420] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:13 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:14.830875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:14.831636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:14.837918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.838411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.838971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.840001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.840464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.840901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.847192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:14.858463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.858958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.859438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.872885 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Creating event network-changed:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h1-855649-4 Nov 02 13:19:14.878456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:14.890038 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-722305a6-2f33-4405-93de-8b54335933d7 req-4e0e0ede-5ac0-411e-ab42-7231b1f9c8a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046478 Nov 02 13:19:14.890813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3867/7421] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:15.069851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:15.078841 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c1895ab-4895-4a91-be31-b7580bf97417 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1680 microversion: 2.1 time: 0.252879 Nov 02 13:19:15.079779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3555/7422] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:14 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:16.105424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:16.106112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.119799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.255486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:16.264404 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1694cb0e-d476-4866-82e9-d1c9c3a4333b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1680 microversion: 2.1 time: 0.164142 Nov 02 13:19:16.264992 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3868/7423] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:16 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:17.287406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:17.288040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:17.296216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.296706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.297201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.297863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.298319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.298875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.456899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:17.466127 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb4a0b98-53bb-4189-b9cf-b86607f81c86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1677 microversion: 2.1 time: 0.182801 Nov 02 13:19:17.466718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3556/7424] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:17 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:17.490438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:17.491060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:17.502225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.502745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.503567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.504317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.504791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.505722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.548381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.556026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.556026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.556026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.556026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.556026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.572746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:17.578627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:17.950953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:18.076746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ad2f0bc-8f04-4231-9c5d-bb4bd718ac41 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/action" status: 202 len: 0 microversion: 2.1 time: 0.589900 Nov 02 13:19:18.077372 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3869/7425] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:19:17 2022] POST /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:18.085909 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.086580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.093434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.093930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.094380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.095128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.095593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.096097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.308917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:18.316946 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b6f381a-1db0-4084-a014-b14038081d13 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.235190 Nov 02 13:19:18.317549 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3557/7426] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:19.342575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:19.343330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:19.352615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.353116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.353574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.354291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.354788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.355303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.497435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:19.505373 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-deb77c9f-df93-4da5-898b-fa4ee38fa9b1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.167799 Nov 02 13:19:19.506001 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3870/7427] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:19 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:19.658465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-plugged", "status": "completed", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:19.669428 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.669917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.670356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.682580 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Creating event network-vif-plugged:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h1-855649-4 Nov 02 13:19:19.688186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:19.700082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-ec995825-862e-4e98-b623-117a83a1fe49 req-e61f1563-892b-4b8b-b924-611513c935f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Nov 02 13:19:19.700699 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3558/7428] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:20.531203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:20.531836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:20.539779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.539779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.540143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.540879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.541351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.541796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.684332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:20.692732 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55833569-9d97-4e38-b316-782ea679ee19 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.165978 Nov 02 13:19:20.693327 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3871/7429] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:20 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:21.717095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:21.717805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:21.720822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=35 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:21.725889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.726367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.726807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.727727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.727997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.728566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.731948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:21.956009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:21.964690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-495f580a-fb4e-4251-b599-1f785b8679e5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.251428 Nov 02 13:19:21.968890 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3559/7430] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:21 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:22.020243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-unplugged", "status": "completed", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:22.031418 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.031913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.032390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.045403 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Creating event network-vif-unplugged:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:19:22.051266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:22.065150 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a03c9837-b281-4b07-8229-2d244fcf79a9 req-5b1bcaa8-12c3-45fe-a9e4-b32bb6f2939f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048473 Nov 02 13:19:22.065749 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3872/7431] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:22.989020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:22.989732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:22.997707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.998127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.998636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.999382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.999838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.000262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.225040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:23.234453 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3e308788-e743-47eb-9ddb-6118f23f6410 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.249418 Nov 02 13:19:23.235060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3560/7432] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:22 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:24.082667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:24.087614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:24.093911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.094408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.094858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.107133 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Creating event network-changed:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:19:24.112619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:19:24.123280 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c35a6f53-69f6-4100-8b03-664e2bb52a1d req-dd7a81db-1d2a-4fcc-8562-562a9b97ab38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045588 Nov 02 13:19:24.123886 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3873/7433] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:24.258301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:24.258900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.266322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.266812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.267295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.268006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.268465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.268953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.484993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:24.493234 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d1a339c2-3d2a-48e0-96ed-7adb9092b69a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.238896 Nov 02 13:19:24.493821 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3561/7434] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:24 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:25.519866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:25.520586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:25.528006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.528503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.528957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.529666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.530134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.530571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.668775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:25.677340 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f62b9d75-5416-46ed-94d2-37724ec91ca8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.163154 Nov 02 13:19:25.677954 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3874/7435] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:25 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:26.701590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:26.702857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:26.709778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:26.710270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:26.710746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:26.711495 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:26.711951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:26.712380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:26.873673 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:26.881773 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e834806-1c30-4c64-948b-389a188adcd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1676 microversion: 2.1 time: 0.184220 Nov 02 13:19:26.882353 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3562/7436] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:26 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:27.907266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:27.907915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:27.910836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:27.916646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.917152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.917609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:27.918341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.918809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.919292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.077945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.080087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-551b4611-87ff-4e21-b647-262574ad373e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1669 microversion: 2.1 time: 0.178230 Nov 02 13:19:28.080686 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3875/7437] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:27 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:28.103135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.103751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.110919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.111444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.111896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.112611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.113077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.113513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.256817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.265799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-74886e1f-1639-4fae-8459-72f73b146c7a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1669 microversion: 2.1 time: 0.167000 Nov 02 13:19:28.266398 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3563/7438] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:28.289851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.290812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.301991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.302620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.302897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.303518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.303896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.304364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.445338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.453518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4a83baa2-9457-4758-8bea-773d64532e57 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1669 microversion: 2.1 time: 0.167744 Nov 02 13:19:28.454089 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3876/7439] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:28.476118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.476647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.490905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.491455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.491900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.492625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.493118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.493551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.522137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:28.955567 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5102d362-da6a-47ca-9495-597f101bc88e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 204 len: 0 microversion: 2.1 time: 0.483260 Nov 02 13:19:28.956114 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3564/7440] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:19:28 2022] DELETE /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:28.965350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.966197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.972768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.973273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.973718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.974433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.974902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.975372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.119601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:29.127641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76617d76-2f01-4747-afd8-469f68dcc8ff tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1675 microversion: 2.1 time: 0.166908 Nov 02 13:19:29.128240 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3877/7441] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:30.013414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-plugged", "status": "completed", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:30.023898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.024389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.024823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.036664 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] Creating event network-vif-plugged:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:19:30.041826 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-7d2ac1aa-8942-4074-be1e-27d94aa2a076 req-fa4bf194-85bb-4bab-a70f-d2abd49aa319 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Nov 02 13:19:30.042186 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3565/7442] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:30.153084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:30.153835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:30.161596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.162388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.168831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.168831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.168831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.168831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.314786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:30.323248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94c98711-d763-4c99-8055-2d8cc918b0b8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1675 microversion: 2.1 time: 0.174416 Nov 02 13:19:30.323855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3878/7443] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:30 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:31.349431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:31.350788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:31.362037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.362543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.363239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.364202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.365054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.365664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.377138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e8ac24-82e5-42c0-86b2-705316a3f392", "name": "network-vif-deleted", "tag": "a6a8022a-4f10-4889-9b9c-4683cbce16ec"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:31.389914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.390685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.392049 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.404479 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] Creating event network-vif-deleted:a6a8022a-4f10-4889-9b9c-4683cbce16ec for instance c1e8ac24-82e5-42c0-86b2-705316a3f392 on n-h2-855649-4 Nov 02 13:19:31.410418 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-95b10085-218c-441c-a487-335f61e3a7ad req-02e4da95-59bc-466a-b471-6ae0ee5e8f88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039139 Nov 02 13:19:31.411064 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3879/7444] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:31.440003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:31.458556 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce7b3ccd-4d41-4abb-895c-e9e194c045de tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 200 len: 1608 microversion: 2.1 time: 0.114607 Nov 02 13:19:31.459461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3566/7445] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:31 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 1608 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:32.484830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:32.485482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.491941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.492445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.492904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.493626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.494105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.494613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.509852 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 HTTP/1.1 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c1e8ac24-82e5-42c0-86b2-705316a3f392'} Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:32.511601 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:32.517668 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db673f7b-ca4f-4c06-b398-d8e1b895c8df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 404 len: 111 microversion: 2.1 time: 0.036168 Nov 02 13:19:32.519554 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3880/7446] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:32 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:32.534848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:32.535494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:32.542420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.542912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.543383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.544083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:32.544702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:32.545137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:32.559449 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 HTTP/1.1 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c1e8ac24-82e5-42c0-86b2-705316a3f392'} Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:32.561109 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9921f59e-6394-4eab-a579-4b083140e167 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 404 len: 111 microversion: 2.1 time: 0.031545 Nov 02 13:19:32.565518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3567/7447] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:32 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:32.624025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-143609486", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "befcd6c7-25ed-4ea2-adc7-25a0f21a13f8"}], "security_groups": [{"name": "tempest-securitygroup--851510662"}], "key_name": "tempest-keypair-1762491920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:32.750352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] validate_networks() for [('befcd6c7-25ed-4ea2-adc7-25a0f21a13f8', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:19:33.146369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:33.146815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:33.147335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:33.147768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:33.148202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:33.158111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.158616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.159112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.159871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.160352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.160823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.179309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:33.185484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:33.199618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:19:33.202134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:19:33.327382 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [a86afada-22b6-4d03-adf6-147c3860d733] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:19:34.336818 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [a86afada-22b6-4d03-adf6-147c3860d733] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52030. Nov 02 13:19:34.341500 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3b739c7f-1612-4f07-9bf2-d5cea5de7bf9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.722481 Nov 02 13:19:34.342164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3881/7448] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:19:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:19:34.353842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-28568c8a-5970-467e-b7d2-385c5814d0ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:34.354565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-28568c8a-5970-467e-b7d2-385c5814d0ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:34.411846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-28568c8a-5970-467e-b7d2-385c5814d0ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:34.420940 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-28568c8a-5970-467e-b7d2-385c5814d0ee tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1238 microversion: 2.1 time: 0.071038 Nov 02 13:19:34.421658 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3568/7449] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:34 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:35.446479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:35.447248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:35.454550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.455146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.455654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.456383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.456864 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.457315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.536686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:35.545436 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78ef1c86-5386-45cd-baa3-6450f18c6dfd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1242 microversion: 2.1 time: 0.103892 Nov 02 13:19:35.546093 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3882/7450] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:35 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:36.572351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:36.572971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:36.580847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.580847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.581395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.582140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.582604 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.583067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.677367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:36.689362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fd8981f4-639c-461c-b092-015695026c5a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1298 microversion: 2.1 time: 0.122776 Nov 02 13:19:36.689979 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3569/7451] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:36 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:37.714166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:37.714789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:37.722039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.722848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.723350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.724102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.724580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.725029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.874929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:37.883365 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-369bbc40-0fa8-44d8-9caa-9b153c5f8581 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.173320 Nov 02 13:19:37.884145 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3883/7452] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:37 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:38.464041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:38.475371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.475868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.476299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.487882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] Creating event network-changed:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:19:38.493043 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-228a1198-9661-4f74-ae28-009fb6224251 req-6420eb3b-f07d-4f65-adb6-84103f0a84db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 Nov 02 13:19:38.493751 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3570/7453] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:38.909833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:38.910454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:38.917530 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.919136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.919136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.919872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.920274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.920735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.073005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.081502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dc6f08b4-79e4-4aa9-9302-ad0d46640935 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.175722 Nov 02 13:19:39.082134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3884/7454] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:38 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:40.106534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:40.107305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:40.113884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.114376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.114824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.115572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.116030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.116463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.266204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:40.274869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-525c6779-5260-40c1-a90b-d09a815ceb86 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.173400 Nov 02 13:19:40.275499 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3571/7455] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:40 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:41.300034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:41.300922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.308919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.310353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.310353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.310635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.311160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.311609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.482883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.497592 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93e06648-0d41-4436-98a8-94338f30d1be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.201344 Nov 02 13:19:41.498696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3885/7456] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:41 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:42.526733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:42.527962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:42.535025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.535562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.536011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.536713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.537163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.537590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.719004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:42.727210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a1142b7-249e-41c1-9a5d-0a6b2480b90d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.205420 Nov 02 13:19:42.727818 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3572/7457] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:42 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:43.754056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:43.754719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:43.757690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:43.758390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:43.763754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.764266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.764723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.765516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.765933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.766384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.766527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-plugged", "status": "completed", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:43.778437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.778913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.779396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.791107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] Creating event network-vif-plugged:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:19:43.797080 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-13260ba6-5f25-4b72-a538-770e87317af1 req-17216d05-08fc-465b-ba83-6fd8438600b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Nov 02 13:19:43.797966 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3573/7458] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:43.964916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:43.974377 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2c66e60-11a0-4d29-8f97-cea06e4d10b6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.226363 Nov 02 13:19:43.975148 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3886/7459] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:43 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:45.006607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:45.012608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:45.013434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:45.020176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.020669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.021113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.021823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.022279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.022707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.593153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:45.602224 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9b157967-701b-4f0b-a376-aa9785a734c1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1363 microversion: 2.1 time: 0.599218 Nov 02 13:19:45.602821 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3574/7460] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:45 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:46.626752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:46.627532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:46.634547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.635090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.635550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.636273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.637264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.637706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.783308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.791563 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4c0b8981-ecbe-4566-a371-a7a25fa1a938 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1549 microversion: 2.1 time: 0.168765 Nov 02 13:19:46.792149 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3887/7461] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:19:46 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:46.815396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:46.816380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.828956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.904930 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2962120c-bfce-4136-8abb-81406db38968 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093500 Nov 02 13:19:46.905526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3575/7462] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 13:19:46 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:48.059627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:48.071023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.071521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.072190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.085407 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] Creating event network-changed:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:19:48.093477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-06908deb-1839-4401-aa7c-c6a74455c87c req-279d83e4-a39a-4620-b689-c126f51871fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038114 Nov 02 13:19:48.094106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3888/7463] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:20:28.066618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:28.067424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:28.071341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:28.075762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:28.077998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.078487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.078923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:28.079647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.080614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.081036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:28.217423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:28.225765 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fce3b1a1-cd8d-435a-aa69-2087341ab8b4 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1668 microversion: 2.1 time: 0.161921 Nov 02 13:20:28.226418 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3576/7464] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:28 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:28.247642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:28.248410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:28.253323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5553a928-6d8f-471e-abbf-9ca6a9d267ef"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:28.256155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:28.262485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.263000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.263476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:28.264187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:28.264755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:28.265202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.194903 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07797905-2084-4da2-bf24-382a19b0770c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949506 Nov 02 13:20:29.195551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3889/7465] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:20:28 2022] POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:41.072222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:41.074589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:41.077919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:41.086899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.087461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.087907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.088632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.089098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.089535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.133483 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.140632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:20:41.148690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:41.150882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:41.150882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:41.150882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:41.150882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:41.449190 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5e52e1fa-76f8-4afd-8434-71e9ab3d3b7d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/action" status: 202 len: 0 microversion: 2.1 time: 0.381648 Nov 02 13:20:41.449858 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3577/7466] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:20:41 2022] POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:41.459849 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:20:41.460468 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 (ip 10.222.0.48) !!! Nov 02 13:20:41.464201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:41.465153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:41.470193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:41.471990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:41.484017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.484529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.484991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.485725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.486205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.486848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.641032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.651479 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c263e7e-97e0-4779-baf2-542f37ce8a42 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1723 microversion: 2.1 time: 0.196126 Nov 02 13:20:41.652106 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3890/7467] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:41 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:42.679680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:42.680302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:42.687253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:42.687751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:42.691362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.691362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:42.691362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:42.691362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.831548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:42.840204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-835f9b0f-28c5-4337-9330-843aa088f548 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1723 microversion: 2.1 time: 0.167654 Nov 02 13:20:42.840788 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3578/7468] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:42 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:43.865576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:43.866229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:43.874213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.874492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.874795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:43.875587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.876069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.876550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.018545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:44.027657 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e080112-9cb3-4193-882b-3cbe5149c977 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1723 microversion: 2.1 time: 0.167124 Nov 02 13:20:44.028154 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3891/7469] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:43 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:45.059709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.060308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:45.067856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.068342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.068783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.069526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.069989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.070426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.207278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.215883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c5662e9-400e-4dbd-a0d6-96d9b34d6540 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.160101 Nov 02 13:20:45.216470 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3579/7470] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:46.240265 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:46.240931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:46.248043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.248551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.249063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:46.249806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.250227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.250681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:46.401894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:46.411279 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f088f51e-4a8a-4914-9634-e051852c15ec tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.175134 Nov 02 13:20:46.411879 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3892/7471] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:46 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:47.435717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:47.436437 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:47.444609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.445109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.445586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.446419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.446766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.447343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.590135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.599000 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc8c3413-0d2b-4de7-a942-30198b49ab16 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.167145 Nov 02 13:20:47.599628 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3580/7472] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:47 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:48.623637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:48.624266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:48.632239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.632745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.633200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.633917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.634391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.634829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.787070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.796608 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9302455d-6b9c-4dfd-a826-d189f222fb27 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.176822 Nov 02 13:20:48.797226 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3893/7473] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:48 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:49.819444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:49.820117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:49.826922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.827434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.827870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.828562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.829016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.829440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.984998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:49.994856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b86f9705-f8b7-4e8f-bf5b-d04d62b98a06 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.179227 Nov 02 13:20:49.995509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3581/7474] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:49 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:51.020788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:51.021409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:51.028623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.030882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.030882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.030882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.030882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.031600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.179692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:51.187245 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4fc3dbdf-38cd-4268-81b3-eb2e7d4ca87c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.170970 Nov 02 13:20:51.187874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3894/7475] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:51 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:52.213106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:52.213887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:52.220823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.221316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.221759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:52.222472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.222930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.223438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:52.375434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:52.384070 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-807698b1-47cb-4444-a34e-241241f7152b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.175284 Nov 02 13:20:52.384660 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3582/7476] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:52 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:53.409136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:53.409780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:53.417062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:53.417595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:53.418042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.418775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:53.419268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:53.419709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.555784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:53.565142 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e32f1040-6b29-4944-a7c1-1aeeaaa9238e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.160585 Nov 02 13:20:53.565733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3895/7477] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:53 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:54.588922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:54.589494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:54.597313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.597833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.598279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.599024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.599489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.599926 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.740506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:54.749758 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-afd3b735-976f-441d-a9ae-bf34a15b8d35 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.164760 Nov 02 13:20:54.750357 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3583/7478] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:54 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:55.774504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.775167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:55.782474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:55.783005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:55.783582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:55.784876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:55.785352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:55.785807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:55.927341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.936030 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6b0bb8b1-21f7-4895-86e8-deaaa898d459 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.165810 Nov 02 13:20:55.940588 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3896/7479] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:56.964396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:56.965543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:56.978801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.979594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.980461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.981794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.982562 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.983386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.161779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.171218 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d5aa21f2-370a-454c-940c-9cfc31ca26e7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.213760 Nov 02 13:20:57.171828 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3584/7480] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:56 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:58.206452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:58.207056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:58.214387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.214897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.215391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.216138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.216618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.217070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.376497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:58.386409 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75e393dd-9ca7-4bc4-974a-989b5b8dea51 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.184691 Nov 02 13:20:58.387051 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3897/7481] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:58 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:59.411424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.412033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.419442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.419982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.420462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.421212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.421774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.422250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.583929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.592781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bde7a4c-a782-45ca-a063-184cc7b18ae9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.185840 Nov 02 13:20:59.593360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3585/7482] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:00.617614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:00.618288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:00.625689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.626189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.626642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.628046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.628582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.629085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.774191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.782911 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-55ebba37-532a-4e01-9686-d37bb6d7424d tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.169459 Nov 02 13:21:00.783551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3898/7483] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:00 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:01.807595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:01.808266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:01.815813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.816301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.816747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.817469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.817929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.818362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.953519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:01.962761 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-906ee5f9-42c7-414d-8369-1fee88234389 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.159156 Nov 02 13:21:01.963370 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3586/7484] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:01 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:02.986482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:02.987729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:02.994796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.995323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.995776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.996498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.996962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.997406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.149142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:03.160065 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4de2d90e-9490-47a5-9af6-bd5597d2b0df tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.177338 Nov 02 13:21:03.160958 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3899/7485] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:02 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:04.184316 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:04.185072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:04.192522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.192929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.193365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.194075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.194530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.194954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.343732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.354389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-61bcdeb7-9252-4174-8bae-cc249a0bb14b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.174110 Nov 02 13:21:04.355008 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3587/7486] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:04 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:05.382801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:05.383462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:05.391082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.391609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.392052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.392822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.393465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.393896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.570769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:05.580555 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2cb864a4-2ca0-4dfe-bf13-fcffe423ac2b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.201643 Nov 02 13:21:05.581542 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3900/7487] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:05 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:06.605810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:06.606525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:06.614824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.615354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.615792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.616545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.617035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.617450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.785763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:06.795382 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-78ee6472-a6d3-4089-ab78-49f3224e5afd tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.193645 Nov 02 13:21:06.796142 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3588/7488] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:06 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:07.825946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:07.827193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:07.840655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.841578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.843486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.844187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.845096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.845917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.027998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.037707 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bdfc9401-da40-4a81-98ef-33fd92a937ab tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.219276 Nov 02 13:21:08.038500 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3901/7489] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:07 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:09.062115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.062758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.071104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.071610 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.072061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.072800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.073332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.073778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.233135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.243739 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8be5adcc-b692-42ba-ba29-f2490d86098a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.185548 Nov 02 13:21:09.244400 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3589/7490] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:10.286968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:10.287626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:10.298546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.299922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.300403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.301161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.301638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.302099 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.455302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.464471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a73bc871-80f9-4358-91d1-0fb13476d874 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.183804 Nov 02 13:21:10.465074 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3902/7491] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:10 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:11.491127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:11.491763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:11.494659 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=31 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:11.500245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.500943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.501326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.502526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.502526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.502954 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.506247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:11.653412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:11.662534 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2ff62742-f123-4258-83a9-a4270d082142 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.175327 Nov 02 13:21:11.663195 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3590/7492] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:11 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.687402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.688774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.694110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=27 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:12.703456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.704348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.708986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.708986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.708986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.708986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.933401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.950412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a27cdfb1-aca2-471a-8943-917864368eca tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.267076 Nov 02 13:21:12.951573 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3903/7493] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:13.991540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.992165 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.000423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.001021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.001464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.002180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.003355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.003735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.218555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-unplugged", "status": "completed", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:14.229350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.230095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.230752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.231243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.235753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=85 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:14.245882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Creating event network-vif-unplugged:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:21:14.252341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] Instance 685a7e41-ea38-4204-adae-409b601936e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:14.253517 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-77cf89c9-71cb-47c5-8692-8d969edfcfb8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1728 microversion: 2.1 time: 0.266389 Nov 02 13:21:14.255184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3591/7494] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1728 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:14.274107 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-985db016-2ff4-401c-be14-6feb6d1921c5 req-d7feec45-e6a1-4ce4-9635-b39eed4ce72d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128038 Nov 02 13:21:14.275340 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3904/7495] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:15.283824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.285171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.293757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.294288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.294745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.295515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.295984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.296419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.454354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.464505 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-adbbd2a3-4f4e-4043-be99-ce6c38a91ed5 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1727 microversion: 2.1 time: 0.187524 Nov 02 13:21:15.465144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3592/7496] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:16.491370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.492093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.498956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.499491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.499943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.500675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.501450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.501904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.587296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:16.605280 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.605869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.606375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.619592 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Creating event network-changed:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h2-855649-4 Nov 02 13:21:16.626228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] Instance 685a7e41-ea38-4204-adae-409b601936e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:16.638727 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-39b3796e-b3a7-4ce4-a393-1ce2de8dd782 req-3f839f1b-19b2-42c0-a650-2a70b91d09d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055610 Nov 02 13:21:16.639620 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3593/7497] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:16.654267 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.667834 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1233f2aa-2799-469f-acaa-560c7b2f3251 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1727 microversion: 2.1 time: 0.178548 Nov 02 13:21:16.667834 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3905/7498] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:17.689318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:17.690618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.697323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.697835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.698637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.699038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.699503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.699938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.929998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.936800 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a3e85e7b-e680-4596-b6da-a43c2d6f69b9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1727 microversion: 2.1 time: 0.252792 Nov 02 13:21:17.937386 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3594/7499] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:17 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:18.960567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:18.961326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:18.968610 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.969130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.969585 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.970328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.970806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.971287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.158546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:19.168251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-be4636a5-b68b-460e-8a62-fb2c1565719e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.211730 Nov 02 13:21:19.169174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3906/7500] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:18 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:20.195376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:20.196547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:20.204197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.204605 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.205044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.205894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.206812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.207267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.364783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.374292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6aad0946-20a8-4bb0-b4fa-244aa463df8c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.182712 Nov 02 13:21:20.374900 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3595/7501] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:20 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:21.401106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:21.402068 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:21.411484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.411484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.411484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.411484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.411986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.412355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.561822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.572362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-564e4d00-12de-4234-a1e8-045786a8cc8a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.175643 Nov 02 13:21:21.572977 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3907/7502] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:21 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:22.597914 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.598492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.605178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.605671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.606177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.606823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.607321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.607750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.748368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:22.757859 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bae282d-0c4a-40c9-8b0d-3b6c5930ce90 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.164646 Nov 02 13:21:22.758451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3596/7503] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:23.782361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:23.783342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:23.790827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.791367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.791819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.792545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.793012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.793472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.933484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:23.942558 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-88142059-7f85-4e5f-81dc-b164e8ead846 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.164328 Nov 02 13:21:23.943214 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3908/7504] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:23 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:24.967311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:24.968010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:24.975754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.976258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.976709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.977434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.977908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.978352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.134646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.150709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-62eeb6ce-c37f-4a89-9a92-bb9718d1cbc7 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.187935 Nov 02 13:21:25.151912 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3597/7505] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:24 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:26.178039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.178671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.185727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.186235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.186729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.187479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.187952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.188397 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.337718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.346300 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-678c4e48-4920-4d12-a8a0-61d7072dd2db tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.172261 Nov 02 13:21:26.346918 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3909/7506] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:27.370162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.371279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.379356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.385647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.385647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.385647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.385647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.385647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.526164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.535870 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7dc758e-ac89-4f67-9074-a524050164ba tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.169819 Nov 02 13:21:27.536519 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3598/7507] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:28.561656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.562228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.568671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.569179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.569638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.570376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.570857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.571373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.732909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.743705 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-10f40cd4-ed98-4c08-986d-6377840712c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.187288 Nov 02 13:21:28.744304 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3910/7508] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:29.828191 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.828862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.836641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.837142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.837593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.838658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.838780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.839233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.005936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:30.034770 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6574629c-7b25-4ac7-be96-6bcdb774252a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.209687 Nov 02 13:21:30.035958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3599/7509] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:31.059109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.059728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.067434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.067935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.068392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.069110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.069609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.070054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.212457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.221668 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-97a5ae9e-e673-457b-a666-80b7c2ea8dd8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.166078 Nov 02 13:21:31.222267 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3911/7510] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:32.246341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:32.247207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:32.254008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.254498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.254943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:32.255764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.256226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.256658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:32.414397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:32.423802 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33a8ac7a-3b0f-4eb3-bbe8-38399c7641be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1725 microversion: 2.1 time: 0.181424 Nov 02 13:21:32.424546 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3600/7511] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:32 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:33.448588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:33.449157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:33.456089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.456591 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.457048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.457791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.458262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.458709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.597839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.606542 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fc83876-2d09-48c9-928b-65165ced76a8 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1722 microversion: 2.1 time: 0.161979 Nov 02 13:21:33.607157 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3912/7512] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:33 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:33.630593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:33.631511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:33.638332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.638825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.639296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.640016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.640482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.640916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.682904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.683413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.683854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.684585 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.685045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.685478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.706484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:33.712306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Getting quotas for user 2208cc3702604f2e925f87dd2341758e and project 6421874737434cb183791ac64eb9c975. Resources: {'ram', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:34.243796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9f7bf2bf-0715-4360-b275-02cda2274f9e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/action" status: 202 len: 0 microversion: 2.1 time: 0.616798 Nov 02 13:21:34.244608 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3601/7513] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:21:33 2022] POST /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:34.253531 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:34.254865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:34.261454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.262109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.262652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.263539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.264925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.264925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.418962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.435978 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-db427752-282b-4aed-8d79-4d4819d53ee1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.186181 Nov 02 13:21:34.437262 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3913/7514] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:34 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:35.463822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.464732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:35.472415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.473554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.474006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.474738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.475238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.475676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.625891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:35.635562 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8c83bb3e-e20b-47e2-b474-48c8309f9a37 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.177189 Nov 02 13:21:35.636173 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3602/7515] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:36.663314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:36.665144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:36.671843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.672352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.672811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.673555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.674061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.674609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.728103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-plugged", "status": "completed", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:36.740564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.740564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.740564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.754300 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Creating event network-vif-plugged:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h2-855649-4 Nov 02 13:21:36.760440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] Instance 685a7e41-ea38-4204-adae-409b601936e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:36.774306 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-69a56fb0-0a6c-4743-ab86-37c0010b8775 req-f63876a6-548e-41e4-936c-27c5dc69b03f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049945 Nov 02 13:21:36.775154 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3603/7516] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:21:36.835378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.844778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9329291-27e8-46fc-87e3-25af41cb903a tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.186285 Nov 02 13:21:36.845670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3914/7517] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:36 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:37.871311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:37.872150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:37.879512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.880125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.880465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.881205 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.881706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.882196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.900885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:38.048697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.057595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-028ac527-6cc8-4ab8-a74d-70eba6d4fbd0 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.191642 Nov 02 13:21:38.058191 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3604/7518] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:37 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:39.083371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:39.083946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:39.091583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.092098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.092559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.093351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.093838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.094302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.242832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:39.257580 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0297246a-3473-4df1-b137-c8ff9762b727 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.178287 Nov 02 13:21:39.258563 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3915/7519] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:39 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:40.286203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.286874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.296635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.296635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.296635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.303974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.303974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.303974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.388312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-unplugged", "status": "completed", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:40.401194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.401689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.402136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.418794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Creating event network-vif-unplugged:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:21:40.424827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] Instance 685a7e41-ea38-4204-adae-409b601936e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:40.438988 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-a1dae37c-42ff-4cc3-aa15-217db0c94216 req-dd19f46c-6b63-45f8-919f-373a07d0097c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055253 Nov 02 13:21:40.439610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3916/7520] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:40.545930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.556392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-634e1ff0-23d5-4c82-ad61-a6f92b4f4381 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.274208 Nov 02 13:21:40.556991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3605/7521] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:41.442153 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:41.460963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.461940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.466282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.487698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Creating event network-changed:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:21:41.498248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] Instance 685a7e41-ea38-4204-adae-409b601936e7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-855649-4', 'n-h1-855649-4'} {{(pid=127567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:21:41.511879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-06fcb5cf-ef79-4fdc-aaed-bf1b7169fbf1 req-f147fc72-95ac-45fc-87d9-3594d94b0c03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079839 Nov 02 13:21:41.512515 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3917/7522] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:41.583020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:41.584258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:41.588473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:41.597265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.598030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.598745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.600118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.600746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.601461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.946614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:41.960988 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6245e195-de9d-4433-a273-2df6f821328e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.383714 Nov 02 13:21:41.961755 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3606/7523] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:41 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:42.987024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:42.987749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:42.991485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:42.997185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.997709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.998173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.998925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.999461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.999909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.162563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.174377 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a8caded7-f135-4257-b278-a4c29e4958c2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.191674 Nov 02 13:21:43.175471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3918/7524] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:42 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:44.200537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:44.201090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.204450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:44.210196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.210680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.211203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.211993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.212421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.212804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.404855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.419159 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-33286be9-352c-417c-883f-5a122886bccf tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.222550 Nov 02 13:21:44.419904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3607/7525] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:44 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:45.444242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:45.444878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:45.452806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.453313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.453774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.454513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.455008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.455474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.667863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:45.679322 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-251576c5-bb89-4ef0-a79d-a5b80dc1ef97 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.238488 Nov 02 13:21:45.679664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3919/7526] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:45 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:46.703276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:46.703900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:46.712832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.713333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.713785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.714512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.714965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.715505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.864136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.874386 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-454f8ebd-dac0-44db-a099-25f6d50e8219 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.175851 Nov 02 13:21:46.874962 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3608/7527] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:46 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:47.899710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:47.900396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:47.907681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.908175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.908653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.909377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.909971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.910388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.913385 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=90 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:48.053859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.062918 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9688d31c-f49f-4c8a-99b5-8885d5204179 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.168177 Nov 02 13:21:48.063621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3920/7528] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:47 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:49.088109 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.088945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.095612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.096102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.096548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.097319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.097785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.098219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.234752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.243301 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b25120e7-545b-40c7-a5eb-da6baa18c31c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.159051 Nov 02 13:21:49.243892 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3609/7529] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:50.267897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.268517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.276378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.276886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.277343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.278066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.278571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.279070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.424423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.433442 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5240fe20-fd9a-4e70-937d-6871b269a60e tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.169434 Nov 02 13:21:50.434027 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3921/7530] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:51.458732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:51.459404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:51.466555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.467028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.467662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.468225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.468666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.469093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.611424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:51.620681 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-56115368-9e42-4fab-a5e7-c91bedd39b0c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.166465 Nov 02 13:21:51.621486 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3610/7531] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:51 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:52.645768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:52.646705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:52.653769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.654270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.654724 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.655484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.655959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.656406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.788436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.797145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7b3e94e-34cd-4bd3-a458-687d71b42526 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.155843 Nov 02 13:21:52.797750 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3922/7532] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:52 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:53.821290 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:53.821931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:53.828666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.829162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.829613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.830401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.830866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.831372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.974997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.983696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7e88ea4-cb53-4827-b3fa-c36633ffac9b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.166578 Nov 02 13:21:53.984298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3611/7533] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:53 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:55.012861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.013542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.020675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.021435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.021892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.022621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.023124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.023614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.170270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.180035 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad78bdd7-eb05-405b-8caa-0b386e733859 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1721 microversion: 2.1 time: 0.171059 Nov 02 13:21:55.180641 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3923/7534] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.203645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.204263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.211398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.211891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.212335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.213053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.213507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.213937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.354633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:56.363613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7a62dda-8ec1-4095-9222-ead5062f3550 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1714 microversion: 2.1 time: 0.163661 Nov 02 13:21:56.364145 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3612/7535] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.388570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.389298 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.396619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.399704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.399704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.399704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.399704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.399704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.535628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:56.545320 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d93e938-412f-4a27-bb46-8db2c2b61f69 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1714 microversion: 2.1 time: 0.160374 Nov 02 13:21:56.545633 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3924/7536] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.569242 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.570034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.576534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.577020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.577491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.578190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.578670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.579122 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.717823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:56.727535 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8588341-b958-42dc-ad00-881627bb9327 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1714 microversion: 2.1 time: 0.162665 Nov 02 13:21:56.728135 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3613/7537] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.750866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.751422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.758784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.759328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.759789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.760520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.760991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.761437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.790018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:57.164338 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1c2086c3-15b8-4e85-b375-1abd128f8351 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 204 len: 0 microversion: 2.1 time: 0.417196 Nov 02 13:21:57.164950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3925/7538] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:21:56 2022] DELETE /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:21:57.173320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:57.177867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:57.180990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.181489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.181963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.182747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.183238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.183680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.330516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:57.339746 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-67859aae-219d-4dc4-b580-bcced3e9ffc2 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1720 microversion: 2.1 time: 0.170286 Nov 02 13:21:57.340349 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3614/7539] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:57 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:58.366379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.367693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.374329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.374839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.375320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.376045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.376514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.377016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.465865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-plugged", "status": "completed", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:58.478021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.478021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.478425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.493119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] Creating event network-vif-plugged:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:21:58.499107 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-38844ba4-067e-4679-81fa-3493d91b873a req-03b35009-9bc7-4690-a4a5-0f8f02e526d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 Nov 02 13:21:58.499729 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3615/7540] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:21:58.570181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.580091 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c7ef9e23-c83e-45fc-ad59-a093263a3348 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1720 microversion: 2.1 time: 0.218946 Nov 02 13:21:58.580695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3926/7541] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:59.610441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.611997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.621966 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.622352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.622810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.623778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.624247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.626420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.755543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:59.765359 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-51fbe980-87a1-405c-af19-bf41ff83a6f9 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1653 microversion: 2.1 time: 0.161870 Nov 02 13:21:59.766131 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3616/7542] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:59.838737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685a7e41-ea38-4204-adae-409b601936e7", "name": "network-vif-deleted", "tag": "602f3cb6-2d99-4941-aa19-990692f39a0e"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:59.848364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.859261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.859261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.862116 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] Creating event network-vif-deleted:602f3cb6-2d99-4941-aa19-990692f39a0e for instance 685a7e41-ea38-4204-adae-409b601936e7 on n-h1-855649-4 Nov 02 13:21:59.868108 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-67e2c2b3-0443-462f-8676-b6a612163de8 req-5ff848a5-735a-4c85-8941-8f17e48ef033 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Nov 02 13:21:59.868730 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3927/7543] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:00.793384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:00.794018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:00.808948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.809448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.809921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.810702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.811141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.811802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.890478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:00.901256 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f6550a22-900e-415a-ad53-f959c43e5078 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1369 microversion: 2.1 time: 0.113264 Nov 02 13:22:00.901856 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3617/7544] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:00 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1369 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:01.928345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:01.929209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:01.936628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.937150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.937631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.938450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.938924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.939403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.011786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:02.021588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3ac846c0-4209-46bc-a5ea-58c94cc0738f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1369 microversion: 2.1 time: 0.099071 Nov 02 13:22:02.031669 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3928/7545] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:01 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:03.058556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:03.059425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:03.071542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.072465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.073100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.073963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.074480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.075035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.164980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.173540 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b1427589-3ec9-4ed2-8452-84b367b536e6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1369 microversion: 2.1 time: 0.120270 Nov 02 13:22:03.174128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3618/7546] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:03 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1369 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:04.198019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:04.198726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.206057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.206562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.207041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.207784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.208261 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.209250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.281978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2208cc3702604f2e925f87dd2341758e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6421874737434cb183791ac64eb9c975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:04.295923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ddf81031-a872-419c-8b44-bc931d4421a1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 200 len: 1369 microversion: 2.1 time: 0.101861 Nov 02 13:22:04.301036 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3929/7547] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:04 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:05.322404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.323253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.330332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.330834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.331326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.332037 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.332504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.332965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.349625 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 HTTP/1.1 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '685a7e41-ea38-4204-adae-409b601936e7'} Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:05.351710 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b7d2c8e6-9c98-4e55-af9a-36c895beb64f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 404 len: 111 microversion: 2.1 time: 0.036375 Nov 02 13:22:05.357981 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3619/7548] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:05 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:05.423264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.425694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.434175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.434684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.435190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.435923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.436395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.436893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.452103 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-volume_attachments HTTP/1.1 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '685a7e41-ea38-4204-adae-409b601936e7'} Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:05.453855 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f3fff0ca-ff31-4554-9d07-ba4d28836c46 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036284 Nov 02 13:22:05.463871 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3930/7549] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:22:05 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:22:08.981869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:08.982383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:08.989815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.990306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.990746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.991800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.992145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.992650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.995529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=86 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:09.008890 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 HTTP/1.1 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '685a7e41-ea38-4204-adae-409b601936e7'} Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.010572 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dddfdcfe-8853-4d2b-929b-61fe06870b44 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 404 len: 111 microversion: 2.1 time: 0.034546 Nov 02 13:22:09.014963 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3620/7550] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:22:08 2022] DELETE /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.022045 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.022774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 685a7e41-ea38-4204-adae-409b601936e7] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.030137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.030794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.031284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.032013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.032488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.032929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.048632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 HTTP/1.1 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '685a7e41-ea38-4204-adae-409b601936e7'} Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.050605 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 685a7e41-ea38-4204-adae-409b601936e7 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-220af6f0-8eff-4d81-a957-4542fb28fad6 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7" status: 404 len: 111 microversion: 2.1 time: 0.036566 Nov 02 13:22:09.057869 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3931/7551] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/685a7e41-ea38-4204-adae-409b601936e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.063291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.063801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.071152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.071644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.072094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.073378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.073378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.073741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.089651 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 HTTP/1.1 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c1e8ac24-82e5-42c0-86b2-705316a3f392'} Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.091275 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58f268c2-14c8-456a-8f6d-69bc29132a4f tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 404 len: 111 microversion: 2.1 time: 0.033659 Nov 02 13:22:09.097136 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3621/7552] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.102607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.103365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c1e8ac24-82e5-42c0-86b2-705316a3f392] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.110162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.110586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.111104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.111853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.112340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.112793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.129146 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 HTTP/1.1 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c1e8ac24-82e5-42c0-86b2-705316a3f392'} Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.130826 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c1e8ac24-82e5-42c0-86b2-705316a3f392 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f22f147-f5d1-40ae-b1b3-a89d2d98e2be tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392" status: 404 len: 111 microversion: 2.1 time: 0.034677 Nov 02 13:22:09.136421 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3932/7553] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/c1e8ac24-82e5-42c0-86b2-705316a3f392 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.141444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.141948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.148684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.149185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.149634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.150355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.150847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.151368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.169104 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb HTTP/1.1 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '27cb003d-78fa-4a43-a21c-4295fc0cf8cb'} Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.170685 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1c5b406b-acdc-4bd3-8268-1fe296b3507b tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 404 len: 111 microversion: 2.1 time: 0.034738 Nov 02 13:22:09.174835 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3622/7554] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.181927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.182673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: 27cb003d-78fa-4a43-a21c-4295fc0cf8cb] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.189765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.190288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.190754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.191572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.192061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.192539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.208213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb HTTP/1.1 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '27cb003d-78fa-4a43-a21c-4295fc0cf8cb'} Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.209794 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance 27cb003d-78fa-4a43-a21c-4295fc0cf8cb could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03eebe6f-e3de-4b7d-91ab-fc66c3fd9c9c tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb" status: 404 len: 111 microversion: 2.1 time: 0.034135 Nov 02 13:22:09.215511 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3933/7555] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/27cb003d-78fa-4a43-a21c-4295fc0cf8cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.220115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.220632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.227534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.228031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.228477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.229189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.229712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.230184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.245249 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f HTTP/1.1 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c83e7ed0-a105-4e97-829f-ac59c464797f'} Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.246904 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1cd2fdca-7caf-4aee-a09b-0cc9399ea307 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 404 len: 111 microversion: 2.1 time: 0.032299 Nov 02 13:22:09.251784 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3623/7556] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:09.257148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.257781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [instance: c83e7ed0-a105-4e97-829f-ac59c464797f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.264248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.264762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.265222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.265958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.266434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.266949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.285185 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] HTTP exception thrown: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Request method failure captured: Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f HTTP/1.1 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYmzkTBVvkv03VdE2260C2DTLsNdrkGDNNmbnb9ENP9kx1MvwgEkBvReUaKn-aSSpKQfvA98rX0idalIvpRg5rPq6au1rQ1apsTqf68mzFdG0qkDnx0Y8AYIgwTIqTCd0N6quO9o2zXEGQW9QcN-gDhwUYtbWsY_wtfuZXlPOX8sYO6s Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6421874737434cb183791ac64eb9c975", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6421874737434cb183791ac64eb9c975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6421874737434cb183791ac64eb9c975"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 6421874737434cb183791ac64eb9c975 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServerActionsTestJSON-975185396 Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 2208cc3702604f2e925f87dd2341758e Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServerActionsTestJSON-975185396-project Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'c83e7ed0-a105-4e97-829f-ac59c464797f'} Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:09.288096 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Returning 404 to user: Instance c83e7ed0-a105-4e97-829f-ac59c464797f could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5e6cf5fb-6960-491a-a4eb-8767c8e3f662 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f" status: 404 len: 111 microversion: 2.1 time: 0.035749 Nov 02 13:22:09.294384 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3934/7557] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/c83e7ed0-a105-4e97-829f-ac59c464797f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:22:09.300364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cc9e1721-c834-4212-be3f-fd564fa754f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] Calling method '.version_select at 0x7ff1b20eddc0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.305422 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc9e1721-c834-4212-be3f-fd564fa754f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:22:10.314496 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc9e1721-c834-4212-be3f-fd564fa754f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52370. Nov 02 13:22:10.406381 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cc9e1721-c834-4212-be3f-fd564fa754f1 tempest-ServerActionsTestJSON-975185396 tempest-ServerActionsTestJSON-975185396-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762491920" status: 202 len: 0 microversion: 2.1 time: 1.109684 Nov 02 13:22:10.407031 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3624/7558] 10.222.0.48 () {58 vars in 1221 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762491920 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:22:25.487289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:25.488249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:25.638862 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-28505939", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "2833db4e-a726-460d-96d7-a7e88d9dfece"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:25.703927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] validate_networks() for [('2833db4e-a726-460d-96d7-a7e88d9dfece', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:26.291684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:26.292245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:26.295102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:26.296198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:26.296888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:26.307447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.307945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.308394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.309209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.309681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.310121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.330293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Getting quotas for project e0ac3350f1424f2a855b74e64eaba325. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:26.337158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Getting quotas for user 4282043d358748b8843104895f83ceb7 and project e0ac3350f1424f2a855b74e64eaba325. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:26.354173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:26.356913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:26.473875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14dc5fa2-5c19-47e2-a677-83088a452464 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988517 Nov 02 13:22:26.474678 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3935/7559] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:22:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:22:26.488097 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3b59a778-a126-497f-acc9-84f8e0b64a41 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:26.488820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3b59a778-a126-497f-acc9-84f8e0b64a41 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:26.491704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:26.492552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:26.632902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3b59a778-a126-497f-acc9-84f8e0b64a41 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:26.640741 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3b59a778-a126-497f-acc9-84f8e0b64a41 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1215 microversion: 2.1 time: 0.156942 Nov 02 13:22:26.641261 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3625/7560] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:26 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:27.666824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-031de79b-6b02-4f2b-a116-854b8e661399 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:27.667714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-031de79b-6b02-4f2b-a116-854b8e661399 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:27.735534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-031de79b-6b02-4f2b-a116-854b8e661399 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:27.744835 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-031de79b-6b02-4f2b-a116-854b8e661399 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1215 microversion: 2.1 time: 0.083525 Nov 02 13:22:27.747577 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3936/7561] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:27 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:28.775062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.775773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.783967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.784465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.784925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.785648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.786854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.787526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.897390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.906315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-426b4909-bb4b-4684-9b3e-4e6d2994b836 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1211 microversion: 2.1 time: 0.140118 Nov 02 13:22:28.906933 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3626/7562] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:29.930451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.931115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.938406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.938953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.939451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.940191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.940684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.941170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.018450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.029941 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-230ccbc0-1e5a-4510-a864-52ef4d4b7136 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1285 microversion: 2.1 time: 0.103641 Nov 02 13:22:30.043565 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3937/7563] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:31.056086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.056716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.064147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.064644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.065092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.065818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.066281 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.066721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.325409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.335708 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b03070b8-1b13-4590-af54-f24694486655 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.284302 Nov 02 13:22:31.336655 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3627/7564] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:32.241256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96700399-860e-4422-8102-81413a501562", "tag": "9cce19c9-ba2b-4f89-b862-79a4c4e36354"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:32.259181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.260031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.260825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.280504 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] Creating event network-changed:9cce19c9-ba2b-4f89-b862-79a4c4e36354 for instance 96700399-860e-4422-8102-81413a501562 on n-h2-855649-4 Nov 02 13:22:32.290877 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-16ec5ce7-db1b-445b-9284-a058a71d2cbe req-6524f29a-cd10-48d6-b5d8-6357c81db7fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058615 Nov 02 13:22:32.292611 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3938/7565] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:32.363744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:32.365806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:32.374916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.375636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.376077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.376799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.377266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.377709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.998591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.011586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dd0f38c7-be9f-4bbe-bd46-ece498b3d7e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.652865 Nov 02 13:22:33.012216 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3628/7566] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:32 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:34.039972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.040695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.048060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.048560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.049009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.049737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.050210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.050650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.208769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:34.219013 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ed5aa812-f7c1-4e21-ae41-ae75b8c383e0 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.183059 Nov 02 13:22:34.220705 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3939/7567] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:35.245501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:35.246096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:35.252908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.253396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.253836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.257536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.257536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.257536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.405345 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.414302 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0a2c4be8-1dd6-42bd-94b2-01da398ef752 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.172985 Nov 02 13:22:35.415127 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3629/7568] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:35 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:36.438808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:36.439525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:36.442621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:36.447814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.448317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.448774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.449522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.449985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.450424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.603885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.612970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f077b109-597b-42f4-89f0-4e3fb4aa8be9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.178720 Nov 02 13:22:36.613584 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3940/7569] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:36 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:37.638401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.639071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.641907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:37.647509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.648010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.648554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.649169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.655856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.655856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.793011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:37.800883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6964ba03-adf1-478b-997e-a0c0f3b4830b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.167102 Nov 02 13:22:37.801460 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3630/7570] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:38.763521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96700399-860e-4422-8102-81413a501562", "name": "network-vif-plugged", "status": "completed", "tag": "9cce19c9-ba2b-4f89-b862-79a4c4e36354"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:38.771026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:38.775162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.775654 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.776104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.794094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] Creating event network-vif-plugged:9cce19c9-ba2b-4f89-b862-79a4c4e36354 for instance 96700399-860e-4422-8102-81413a501562 on n-h2-855649-4 Nov 02 13:22:38.794094 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-be353e6e-a1bd-4889-9633-bf879a501f4f req-18c97d61-2dcc-44c8-be2b-b1ffeac344c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Nov 02 13:22:38.794094 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3941/7571] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:38.825831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:38.826455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:38.833706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.834197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.834661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.835477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.835905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.837637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.048650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:39.057200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cca8c233-78f6-4849-8e18-be0c9e90d507 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.235493 Nov 02 13:22:39.057782 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3631/7572] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:38 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:40.081648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:40.082501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:40.091893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.092494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.092951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.093694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.094162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.094642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.247053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.255513 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aeaba0df-ee68-44c6-88a5-80bb6992e828 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1315 microversion: 2.1 time: 0.178497 Nov 02 13:22:40.256029 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3942/7573] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:40 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:41.285775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:41.286443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.297499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.298462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.299327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.300778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.301765 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.302161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.460311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.470085 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e6e76913-6692-4b21-859e-8a87eeeeded3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.188312 Nov 02 13:22:41.470698 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3632/7574] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:41 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:41.546715 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-952259306", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "2833db4e-a726-460d-96d7-a7e88d9dfece"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:41.603968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] validate_networks() for [('2833db4e-a726-460d-96d7-a7e88d9dfece', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:42.034020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:42.034526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:42.035048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:42.035506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:42.035968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:42.045992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.046493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.046942 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.047725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.048257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.048703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.072384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Getting quotas for project e0ac3350f1424f2a855b74e64eaba325. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:42.082537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Getting quotas for user 4282043d358748b8843104895f83ceb7 and project e0ac3350f1424f2a855b74e64eaba325. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:42.103948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:42.108619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:42.246832 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e05bfcf0-1f4a-4b07-b89e-134df5d43fa1 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708527 Nov 02 13:22:42.247548 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3943/7575] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:22:42.259873 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e387b56-f27e-4164-b0c4-9ccd7db7c062 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:42.260841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e387b56-f27e-4164-b0c4-9ccd7db7c062 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:42.325978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e387b56-f27e-4164-b0c4-9ccd7db7c062 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.342237 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e387b56-f27e-4164-b0c4-9ccd7db7c062 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1216 microversion: 2.1 time: 0.087018 Nov 02 13:22:42.342881 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3633/7576] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:42 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:43.366533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:43.367185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:43.374994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.375647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.376269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.377101 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.377655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.378071 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.443855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.452281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f69ba749-d3fa-4962-aad4-6f722dea0d00 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1220 microversion: 2.1 time: 0.090701 Nov 02 13:22:43.452948 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3944/7577] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:43 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:44.476697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.477350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.487009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.487593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.488050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.489231 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.489701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.490143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.591334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.600964 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-24305895-9c6d-4d50-aa04-1778de2a4864 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1276 microversion: 2.1 time: 0.128354 Nov 02 13:22:44.605746 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3634/7578] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:45.624736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:45.625411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:45.635881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.636593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.637434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.638567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.639515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.640189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.825016 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.834026 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c8deef3f-71ef-4350-8829-554f43587986 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.213165 Nov 02 13:22:45.834810 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3945/7579] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:45 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:46.672670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4db90f2-888e-47ce-8d98-e631991ea9a8", "tag": "92ef07c1-4336-41be-b148-1224c34728d0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:46.685628 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.686356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.686840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.700329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] Creating event network-changed:92ef07c1-4336-41be-b148-1224c34728d0 for instance f4db90f2-888e-47ce-8d98-e631991ea9a8 on n-h1-855649-4 Nov 02 13:22:46.706945 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e13274a9-8765-4c69-9ac6-e1df46b6d8fc req-c84896ed-941c-46d0-8869-1a7818c273b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037917 Nov 02 13:22:46.707614 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3635/7580] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:46.861845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:46.862915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:46.874022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.874928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.875753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.876728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.877572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.878365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.040230 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.050327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f92a023-a836-4df9-a1f0-76d50efea69d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.195307 Nov 02 13:22:47.051218 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3946/7581] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:46 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:48.077977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.078725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:48.088018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.088512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.088972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.089693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.090158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.090601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.234860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.243210 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e01a3b52-f8c6-4d9b-b333-518a498dc2c3 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.169555 Nov 02 13:22:48.243805 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3636/7582] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:48 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:49.266467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:49.267281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:49.274964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.275495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.275951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.276690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.277157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.277593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.424333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.432970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb8ed8b3-c8c7-4136-ba21-2eb014a8f74d tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.170566 Nov 02 13:22:49.433575 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3947/7583] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:49 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:50.456329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.456956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.463850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.464335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.464772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.465778 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.465932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.466358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.618629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.627527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c900412-91fc-48fc-a25f-c7f9e900c67f tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.175335 Nov 02 13:22:50.628134 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3637/7584] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:50 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:51.652197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.652893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:51.660296 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.660796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.661250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.662033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.662510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.662950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.800350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.808974 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40d0033d-4d00-49cb-859f-bc90b2d35cf7 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.161391 Nov 02 13:22:51.809568 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3948/7585] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:52.673143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db90f2-888e-47ce-8d98-e631991ea9a8", "name": "network-vif-plugged", "status": "completed", "tag": "92ef07c1-4336-41be-b148-1224c34728d0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:52.679272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:52.685830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.686319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.686760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.703631 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] Creating event network-vif-plugged:92ef07c1-4336-41be-b148-1224c34728d0 for instance f4db90f2-888e-47ce-8d98-e631991ea9a8 on n-h1-855649-4 Nov 02 13:22:52.709048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-87ef289d-c989-4dcb-a8ef-888951635607 req-2f63f15b-d21b-4869-8a32-1142d8b350d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040422 Nov 02 13:22:52.709704 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3638/7586] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:52.832892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:52.838952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:52.838952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:52.838952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:52.844634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.844634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.844634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.845222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.846024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.846389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.985891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.994128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67efc3f5-0675-47f0-9001-833670d81c83 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.165208 Nov 02 13:22:52.994728 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3949/7587] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:52 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:54.020004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.020983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.027626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.028115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.028559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.029261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.029728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.030168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.188038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.196476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c07e5b4-5cda-4041-bfc8-f65cb97300c5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1316 microversion: 2.1 time: 0.182178 Nov 02 13:22:54.197624 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3639/7588] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:54 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:55.223395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.224030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.232629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.233156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.233623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.234384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.234911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.235393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.384577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.392794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5009a132-557e-459b-99dc-bc547b899a47 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1506 microversion: 2.1 time: 0.173441 Nov 02 13:22:55.393401 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3950/7589] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:55.422054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.422839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.433372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.433861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.434302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.435262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.435491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.435916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.467408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:55.780738 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4cc79cc4-c16e-436f-9db1-7e36086a6638 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 204 len: 0 microversion: 2.1 time: 0.365592 Nov 02 13:22:55.781250 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3640/7590] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:22:55 2022] DELETE /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:55.789521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.790705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.792615 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:55.798138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.798677 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.799333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.800116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.800608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.801034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.946300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.948616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=79 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:55.955093 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-79199dc2-ac37-414d-a538-7b7551e823b9 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1512 microversion: 2.1 time: 0.169482 Nov 02 13:22:55.960129 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3951/7591] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:56.979913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:56.980616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:56.987498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.987980 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.988419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.989183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.989844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.990276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.993921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:57.142223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.151317 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-610b8a63-5246-4805-b7b8-6d7ee40184da tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1512 microversion: 2.1 time: 0.176224 Nov 02 13:22:57.151927 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3641/7592] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:56 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:57.721821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db90f2-888e-47ce-8d98-e631991ea9a8", "name": "network-vif-deleted", "tag": "92ef07c1-4336-41be-b148-1224c34728d0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:57.734958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.735370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.735820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.750430 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] Creating event network-vif-deleted:92ef07c1-4336-41be-b148-1224c34728d0 for instance f4db90f2-888e-47ce-8d98-e631991ea9a8 on n-h1-855649-4 Nov 02 13:22:57.756267 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5a5ac47c-39ca-4692-b982-039eb841a529 req-86e0bb84-268d-49ae-ad33-915f68e5c6bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038381 Nov 02 13:22:57.757540 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3952/7593] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:58.174850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.175530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.182813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.183327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.183772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.184484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.184986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.185423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.219552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.220039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.220478 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.220932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lazy-loading 'fault' on Instance uuid f4db90f2-888e-47ce-8d98-e631991ea9a8 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:58.263323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.271717 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7901486-28d4-4bfb-a201-acb1b56fcf0b tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 200 len: 1306 microversion: 2.1 time: 0.100706 Nov 02 13:22:58.272302 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3642/7594] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.297556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.298285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.304694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.305199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.305656 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.306380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.306850 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.307351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.321777 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 HTTP/1.1 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'f4db90f2-888e-47ce-8d98-e631991ea9a8'} Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:59.323415 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 404 to user: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d9d6350-7207-467f-885d-8bfc0cf156de tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 404 len: 111 microversion: 2.1 time: 0.032602 Nov 02 13:22:59.329151 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3953/7595] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:59.335320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.335965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.339465 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:59.344869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.345395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.356900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.356900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.356900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.356900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.494085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.502384 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8019d096-9089-4cdc-adaa-21412cb5d347 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.171350 Nov 02 13:22:59.502943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3643/7596] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.526818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:59.529500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: de609fb7-2ce4-4741-9c15-f01171eb485a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.535414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/de609fb7-2ce4-4741-9c15-f01171eb485a/action HTTP/1.1 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 32 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: {"resize": {"flavorRef": "452"}} Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'de609fb7-2ce4-4741-9c15-f01171eb485a', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:59.537020 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 404 to user: Instance de609fb7-2ce4-4741-9c15-f01171eb485a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f8ba47d4-53ee-429e-9c2d-01f051402674 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "POST /compute/v2.1/servers/de609fb7-2ce4-4741-9c15-f01171eb485a/action" status: 404 len: 111 microversion: 2.1 time: 0.017042 Nov 02 13:22:59.542414 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3954/7597] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:22:59 2022] POST /compute/v2.1/servers/de609fb7-2ce4-4741-9c15-f01171eb485a/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:59.548395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.549033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.555832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.556329 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.556777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.557490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.557950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.558381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.709041 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.718236 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-58a526ce-587b-4a65-9dd1-881cc54b1077 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.173704 Nov 02 13:22:59.718823 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3644/7598] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.744472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.745112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.755519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.756021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.756473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.757193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.757665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.758110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.923502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.933547 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1fc315a6-95b8-4cb5-91bb-e8d76a367405 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.192901 Nov 02 13:22:59.934164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3955/7599] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.960500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "43c2c64f-c977-463a-ae52-bc22b3e7e863"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:59.962812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.970328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.970565 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.970877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.971723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.972123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.972582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.284130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.289349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: request: POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action HTTP/1.1 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 65 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: {"resize": {"flavorRef": "43c2c64f-c977-463a-ae52-bc22b3e7e863"}} Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: exception: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '96700399-860e-4422-8102-81413a501562', 'body': {'resize': {'flavorRef': '43c2c64f-c977-463a-ae52-bc22b3e7e863'}}} Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:00.292049 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 400 to user: Flavor 43c2c64f-c977-463a-ae52-bc22b3e7e863 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3db80bb3-7348-4e05-b834-880adf18aaec tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action" status: 400 len: 107 microversion: 2.1 time: 0.340554 Nov 02 13:23:00.298490 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3645/7600] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:22:59 2022] POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action => generated 107 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:00.304534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.304943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.315925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.316609 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.317445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.318783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.319736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.320345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.469157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.478132 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41038a83-7f51-4198-9fb1-032fa57cf354 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.178579 Nov 02 13:23:00.479290 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3956/7601] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.508972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.511504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.523689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.524545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.525414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.526666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.527551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.528356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.681284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.689882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-854bac92-af1b-43a0-98d2-de87e5363377 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.189698 Nov 02 13:23:00.690462 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3646/7602] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.714452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21047d31-961a-4cdc-ae69-7a777bc631a5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21047d31-961a-4cdc-ae69-7a777bc631a5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: request: POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action HTTP/1.1 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 29 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: {"resize": {"flavorRef": ""}} Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '96700399-860e-4422-8102-81413a501562', 'body': {'resize': {'flavorRef': ''}}} Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi '' Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.718171 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-21047d31-961a-4cdc-ae69-7a777bc631a5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-21047d31-961a-4cdc-ae69-7a777bc631a5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action" status: 400 len: 113 microversion: 2.1 time: 0.010209 Nov 02 13:23:00.727432 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3957/7603] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:23:00 2022] POST /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:00.734179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.734802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.741139 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.741635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.742079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.742798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.743293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.743730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.888850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.897114 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2967deec-ee0f-44bb-ad6c-861424871b45 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1505 microversion: 2.1 time: 0.166839 Nov 02 13:23:00.897666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3647/7604] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.924997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.925540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.933439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.933992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.934450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.935235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.935746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.936195 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.950641 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 HTTP/1.1 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'f4db90f2-888e-47ce-8d98-e631991ea9a8'} Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:00.956490 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 404 to user: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c41d82f-6606-4845-a459-fce5ca25acd2 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 404 len: 111 microversion: 2.1 time: 0.032731 Nov 02 13:23:00.962688 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3958/7605] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:23:00 2022] DELETE /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:00.964354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.964354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: f4db90f2-888e-47ce-8d98-e631991ea9a8] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.970455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.970955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.971432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.972154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.972616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.973051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.988613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 HTTP/1.1 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'f4db90f2-888e-47ce-8d98-e631991ea9a8'} Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:00.990583 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 404 to user: Instance f4db90f2-888e-47ce-8d98-e631991ea9a8 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c2bb8d04-14af-4c70-a85b-d5633d9e9fae tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8" status: 404 len: 111 microversion: 2.1 time: 0.032839 Nov 02 13:23:00.995992 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3648/7606] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/f4db90f2-888e-47ce-8d98-e631991ea9a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:01.001299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.001810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.008076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.008580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.009027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.009743 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.010216 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.010651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.042192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:01.403919 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1e5e601-e389-43b4-9847-c8c91eff3298 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 204 len: 0 microversion: 2.1 time: 0.406164 Nov 02 13:23:01.404640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3959/7607] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:23:00 2022] DELETE /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:01.414287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.414941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.423293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.424212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.424972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.426332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.427255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.428477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.606301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.614716 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d7be9e0-b6d4-48f0-8ebb-73643bbc2151 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1511 microversion: 2.1 time: 0.205009 Nov 02 13:23:01.615319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3649/7608] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:02.641810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:02.642703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:02.652246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.652764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.653222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.653953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.654423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.654865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.809700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.818472 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1616af4d-cc1b-4812-8ee1-07bcf849f8f5 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1511 microversion: 2.1 time: 0.181126 Nov 02 13:23:02.819077 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3960/7609] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:02 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:03.571462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96700399-860e-4422-8102-81413a501562", "name": "network-vif-deleted", "tag": "9cce19c9-ba2b-4f89-b862-79a4c4e36354"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:03.583775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.584423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.584693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.599153 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] Creating event network-vif-deleted:9cce19c9-ba2b-4f89-b862-79a4c4e36354 for instance 96700399-860e-4422-8102-81413a501562 on n-h2-855649-4 Nov 02 13:23:03.607350 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-b84d2755-4f42-409a-bb9b-a0957e044449 req-c3bab261-b231-4ae3-86b4-8c2ca9fc3458 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039590 Nov 02 13:23:03.608389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3650/7610] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:03.844513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.845361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.853028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.853580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.854534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.855302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.855762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.856237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.894283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.894901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.895825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.896325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lazy-loading 'fault' on Instance uuid 96700399-860e-4422-8102-81413a501562 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:03.940332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4282043d358748b8843104895f83ceb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ac3350f1424f2a855b74e64eaba325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.948737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-192a8287-1f3c-43ce-919f-0d6d9a780c02 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 200 len: 1305 microversion: 2.1 time: 0.109019 Nov 02 13:23:03.949324 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3961/7611] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:04.976048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:04.976746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] [instance: 96700399-860e-4422-8102-81413a501562] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:04.984053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.984567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.985352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.985736 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.986199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.986635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.003830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] HTTP exception thrown: Instance 96700399-860e-4422-8102-81413a501562 could not be found. Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Request method failure captured: Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 HTTP/1.1 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm8RY_GjkR0sAvqldTkCo2DTySqFOj87D8wxL0ZHyUPhbhwjR6pV35dn2R1pvFJiuRAjDUSl1eekUf1G5zb0Tz0VWCY8-k5l1mEF38vRfUSeofboTI8fi2TdnJ6ElYqXInQE5VO2lfpIe-hBh-paK5jEOuuxspH2uj5vYqpe8xZXIho Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e0ac3350f1424f2a855b74e64eaba325", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e0ac3350f1424f2a855b74e64eaba325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: e0ac3350f1424f2a855b74e64eaba325 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1569075473 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 4282043d358748b8843104895f83ceb7 Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-ServersNegativeTestJSON-1569075473-project Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 96700399-860e-4422-8102-81413a501562 could not be found. Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '96700399-860e-4422-8102-81413a501562'} Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96700399-860e-4422-8102-81413a501562 could not be found. Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96700399-860e-4422-8102-81413a501562 could not be found. Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:05.005555 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96700399-860e-4422-8102-81413a501562 could not be found. Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] Returning 404 to user: Instance 96700399-860e-4422-8102-81413a501562 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-21b19714-62d6-427c-a6b2-57aa8edce384 tempest-ServersNegativeTestJSON-1569075473 tempest-ServersNegativeTestJSON-1569075473-project] 10.222.0.48 "GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562" status: 404 len: 111 microversion: 2.1 time: 0.037754 Nov 02 13:23:05.012423 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3651/7612] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:23:04 2022] GET /compute/v2.1/servers/96700399-860e-4422-8102-81413a501562 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:58.249735 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:58.251449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:58.478555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: .version_select at 0x7ff1b2c35310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1891225256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm2NChevKg7I3sQGavETl3mSs7aNyS3bqcatSU0GKZKxHAj5xTXUOpfOsRbJFxKlH2L8KBSZbPTYyyQBl+WWcDB64Qf6Rwlm+4swhrTj6Lu+xO98rAQ30SYzBTEmf7URA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:58.505247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:58.512240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:58.530759 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:23:59.538851 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52848. Nov 02 13:23:59.655323 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5b4a4a72-a855-46c8-9670-19d9a5e82a3b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.410866 Nov 02 13:23:59.655960 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3962/7613] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:23:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:59.716197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-227407289", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1891225256", "networks": [{"uuid": "2972dd31-48e7-454d-9edd-e1e89c546a3c"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:59.726671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:59.727682 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=53 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:59.779348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] validate_networks() for [('2972dd31-48e7-454d-9edd-e1e89c546a3c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:24:00.445261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:24:00.446092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:24:00.447065 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:24:00.448398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:24:00.449162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:24:00.465394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:00.466198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:00.467129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:00.468498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:00.469323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:00.469990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:00.494100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:24:00.505609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:24:00.523611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:24:00.526350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:24:00.688293 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:24:01.699345 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52868. Nov 02 13:24:01.703898 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b903e4f5-bb5a-49bc-addb-0bf03dd5aea8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994861 Nov 02 13:24:01.709826 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3652/7614] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:24:01.718161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ab2a52f-fe0f-4ea5-81b3-6d9a2bd899e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:01.719340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ab2a52f-fe0f-4ea5-81b3-6d9a2bd899e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:01.781210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ab2a52f-fe0f-4ea5-81b3-6d9a2bd899e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:01.790004 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ab2a52f-fe0f-4ea5-81b3-6d9a2bd899e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1262 microversion: 2.1 time: 0.077744 Nov 02 13:24:01.805374 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3963/7615] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:01 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:02.816405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fbf94480-a25d-4d03-a37b-dfdac834a97f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:02.817095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fbf94480-a25d-4d03-a37b-dfdac834a97f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:02.874221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fbf94480-a25d-4d03-a37b-dfdac834a97f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:02.881874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fbf94480-a25d-4d03-a37b-dfdac834a97f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1262 microversion: 2.1 time: 0.070445 Nov 02 13:24:02.882496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3653/7616] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:02 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:03.908725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:03.909876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:03.920464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.921111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.921885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.923241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.923811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.924307 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:04.026692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:04.037879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3613e1ba-a79a-422b-9b71-839ffdf3daba tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1314 microversion: 2.1 time: 0.135257 Nov 02 13:24:04.038505 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3964/7617] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:03 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:05.070075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:05.070939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:05.079398 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.079781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.090959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:05.090959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.090959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.090959 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:05.159615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:05.171355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9480d5bb-6b63-421c-989a-ece3a1a5941f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1320 microversion: 2.1 time: 0.105318 Nov 02 13:24:05.172298 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3654/7618] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:05 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1320 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:06.214377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:06.216720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:06.232328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.233896 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.235077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.236747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.238057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.239269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.475109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:06.483236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7dbb7241-dc82-4698-b95f-08637502f462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.276023 Nov 02 13:24:06.484125 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3965/7619] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:06 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:06.734157 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd49000-8b8b-4349-a981-b39f349e0263", "tag": "c4972199-86b8-4095-8df8-6962718af70e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:06.750318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.750789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.751301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.762952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] Creating event network-changed:c4972199-86b8-4095-8df8-6962718af70e for instance ddd49000-8b8b-4349-a981-b39f349e0263 on n-h1-855649-4 Nov 02 13:24:06.768731 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-79875f59-869b-4085-b9a1-8a1ebe4d3bc0 req-39fd8065-4d55-4f68-bbf5-8456a4245020 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042439 Nov 02 13:24:06.769666 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3655/7620] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:24:07.513004 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:07.514093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:07.527659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:07.528370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:07.529003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:07.530097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:07.530869 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:07.531576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:07.688642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:07.703799 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-156bc5d3-3395-497a-9aa5-399cc7ba0861 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.196407 Nov 02 13:24:07.704735 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3966/7621] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:07 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:08.732291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:08.733309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:08.740921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:08.741421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:08.741864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:08.742587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:08.743292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:08.743739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:08.894613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:08.910036 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1002c110-874f-446b-b621-4e41f5ef6188 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.183071 Nov 02 13:24:08.911430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3656/7622] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:08 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:09.948351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:09.948937 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:09.956519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.957034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.957499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:09.958245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.958720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.959213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.122943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.131991 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ab12c12e-4ae0-4fb1-bc03-30fcfcd0b353 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.188213 Nov 02 13:24:10.132625 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3967/7623] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:09 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:11.156779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:11.157423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:11.162182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:11.168528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.169245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.169700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.170423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.170889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.171501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.334140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.342682 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1630813d-795b-4835-86ad-27d04aa330b5 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.189770 Nov 02 13:24:11.343333 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3657/7624] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:11 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:12.370730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:12.371391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:12.374169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:12.379439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.379952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.380627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.381157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.381634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.382082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.558203 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:12.570119 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-49410b6c-c7b3-4f86-9099-cce18476e462 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.203585 Nov 02 13:24:12.570830 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3968/7625] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:12 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:13.022077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd49000-8b8b-4349-a981-b39f349e0263", "name": "network-vif-plugged", "status": "completed", "tag": "c4972199-86b8-4095-8df8-6962718af70e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:13.028823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:13.034371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.034852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.035613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.048362 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] Creating event network-vif-plugged:c4972199-86b8-4095-8df8-6962718af70e for instance ddd49000-8b8b-4349-a981-b39f349e0263 on n-h1-855649-4 Nov 02 13:24:13.053609 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-60783ff7-7f47-4755-b9a8-0753b3069583 req-d53c49f3-d1db-4390-91e2-e4b20d09151a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Nov 02 13:24:13.057725 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3658/7626] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:13.594473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:13.595197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:13.602081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.602584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.603061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.604403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.604403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.604710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.755308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:13.765482 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2569d92-04b7-4e96-af3a-1cdf2c209dcf tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1362 microversion: 2.1 time: 0.175087 Nov 02 13:24:13.766336 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3969/7627] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:13 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:14.791723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:14.792426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:14.799563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.800056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.800498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.801200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.801656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.802083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.944440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:14.953743 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79efc49d-2ba3-4672-98a1-d8710c3de86a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1554 microversion: 2.1 time: 0.167536 Nov 02 13:24:14.954508 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3659/7628] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:14 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:14.977492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:14.978122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:14.985350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.985848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.986330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.987072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.987540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.987986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.137171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.146903 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebf47836-fa61-4cc6-96dc-212475e31a12 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1554 microversion: 2.1 time: 0.173349 Nov 02 13:24:15.147544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3970/7629] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:14 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:18.547578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18bc5f07-423b-419f-bc24-538f7cc7d164"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:18.550583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:18.558671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.559202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.559644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.560375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.561549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.562077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:19.365860 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d65b4712-f20b-4e55-aa37-80830096ef5d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824635 Nov 02 13:24:19.366640 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3660/7630] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:24:18 2022] POST /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:31.280527 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:31.281146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:31.283468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:31.284245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:31.289081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.289587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.290056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.290785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.291289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.291774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.383059 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lazy-loading 'services' on Instance uuid ddd49000-8b8b-4349-a981-b39f349e0263 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:31.651327 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fc8333d2-28ab-4eba-ba45-01cb230051cb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments/18bc5f07-423b-419f-bc24-538f7cc7d164" status: 202 len: 0 microversion: 2.1 time: 0.374565 Nov 02 13:24:31.651946 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3971/7631] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:24:31 2022] DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments/18bc5f07-423b-419f-bc24-538f7cc7d164 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:24:31.659401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:31.660158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:31.665354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:31.668162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:31.676283 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.676785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.677234 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.677960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.678420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.678856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.715955 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-df1eaa6f-d3a9-49c6-a96b-e64edb7bc0ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059170 Nov 02 13:24:31.716745 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3661/7632] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:31 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:32.730172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:32.732861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:32.741632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.742141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.742597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.743442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.743843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.744278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.777282 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4383b687-084a-401e-8b72-53e5bb0d56d4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051504 Nov 02 13:24:32.778237 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3972/7633] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:32 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:33.790686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:33.792825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:33.801757 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.802256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.802704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.803445 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.803918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.804351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.842766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-685d6291-bdbd-4c26-a7b3-2818386303fa tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056720 Nov 02 13:24:33.843384 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3662/7634] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:33 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:34.855992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:34.858322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:34.866053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.866556 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.867047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.867781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.868250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.868692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.900261 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-93957b08-fdcc-4368-b65d-def5898aed3f tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Nov 02 13:24:34.900905 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3973/7635] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:34 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:35.914131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:35.917046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:35.926529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.927056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.927514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.928247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.928715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.929154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.974057 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d065677-d362-4fdd-ad7d-85a0dab4d3a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064676 Nov 02 13:24:35.975144 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3663/7636] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:35 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:36.986789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:36.988951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:36.995932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:36.996430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:36.996909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:36.997662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:36.998138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:36.998572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.030258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1f9968cb-a41b-424e-8ee4-5f4408599fb1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047580 Nov 02 13:24:37.031210 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3974/7637] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:24:36 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:24:37.042221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:37.042835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:37.050505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.051033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.051480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.052201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.052658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.053091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.134574 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance ddd49000-8b8b-4349-a981-b39f349e0263 is not attached to volume 18bc5f07-423b-419f-bc24-538f7cc7d164 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments/18bc5f07-423b-419f-bc24-538f7cc7d164 HTTP/1.1 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ddd49000-8b8b-4349-a981-b39f349e0263 is not attached to volume 18bc5f07-423b-419f-bc24-538f7cc7d164 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': 'ddd49000-8b8b-4349-a981-b39f349e0263', 'id': '18bc5f07-423b-419f-bc24-538f7cc7d164'} Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 18bc5f07-423b-419f-bc24-538f7cc7d164. Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd49000-8b8b-4349-a981-b39f349e0263 is not attached to volume 18bc5f07-423b-419f-bc24-538f7cc7d164 Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:37.144282 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd49000-8b8b-4349-a981-b39f349e0263 is not attached to volume 18bc5f07-423b-419f-bc24-538f7cc7d164 Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance ddd49000-8b8b-4349-a981-b39f349e0263 is not attached to volume 18bc5f07-423b-419f-bc24-538f7cc7d164 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-853ec995-c722-4acb-916d-5f3380c2bd3e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments/18bc5f07-423b-419f-bc24-538f7cc7d164" status: 404 len: 154 microversion: 2.1 time: 0.108347 Nov 02 13:24:37.149573 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3664/7638] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:24:37 2022] DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263/os-volume_attachments/18bc5f07-423b-419f-bc24-538f7cc7d164 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:40.787430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:40.787430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:40.793839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:40.794398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:40.794792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:40.795639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:40.796109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:40.796547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:40.826491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:41.114921 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80cfaaec-5a16-4778-a6b3-59348f8228b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 204 len: 0 microversion: 2.1 time: 0.333210 Nov 02 13:24:41.115655 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3975/7639] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:24:40 2022] DELETE /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:24:41.124846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:41.127627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:41.139106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.139613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.140070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.140811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.141284 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.141792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.305548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:41.316292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04ddc701-6004-4739-a7c6-a5ea89718db2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1560 microversion: 2.1 time: 0.195764 Nov 02 13:24:41.317065 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3665/7640] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:41 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:42.342829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:42.343787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:42.352446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:42.360956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:42.360956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:42.360956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:42.360956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:42.360956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:42.515987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:42.527358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bd4b5248-463a-48b6-9647-48ade7cd3ceb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1560 microversion: 2.1 time: 0.189931 Nov 02 13:24:42.528186 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3976/7641] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:42 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:43.442455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd49000-8b8b-4349-a981-b39f349e0263", "name": "network-vif-deleted", "tag": "c4972199-86b8-4095-8df8-6962718af70e"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:43.452956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.453468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.453985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.466852 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] Creating event network-vif-deleted:c4972199-86b8-4095-8df8-6962718af70e for instance ddd49000-8b8b-4349-a981-b39f349e0263 on n-h1-855649-4 Nov 02 13:24:43.472534 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3f02a51a-eb0d-456d-bd47-fdf3137dfd13 req-4e2f09ee-c653-4992-ab5c-b8d4f603f9a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130648 Nov 02 13:24:43.473168 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3666/7642] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:43.556904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:43.557476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:43.566843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.567403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.567845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.568586 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.569050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.569491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.642149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:43.652071 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0eb0d06f-0f31-4d34-b0d6-04fe5d765d71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 200 len: 1347 microversion: 2.1 time: 0.099397 Nov 02 13:24:43.654544 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3977/7643] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:43 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:44.678142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:44.678850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: ddd49000-8b8b-4349-a981-b39f349e0263] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:44.685427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.685916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.686361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:44.687094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.687583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.688011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:44.704082 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 HTTP/1.1 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'ddd49000-8b8b-4349-a981-b39f349e0263'} Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:44.706319 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance ddd49000-8b8b-4349-a981-b39f349e0263 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0defff1-70fb-4e11-81df-1f3eef705670 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263" status: 404 len: 111 microversion: 2.1 time: 0.034851 Nov 02 13:24:44.715321 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3667/7644] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:44 2022] GET /compute/v2.1/servers/ddd49000-8b8b-4349-a981-b39f349e0263 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:44.721491 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b11efef8-5010-4414-b3bc-dbc0654eca14 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '.version_select at 0x7ff1b3a10a60>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:44.803186 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b11efef8-5010-4414-b3bc-dbc0654eca14 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1891225256" status: 202 len: 0 microversion: 2.1 time: 0.087861 Nov 02 13:24:44.803838 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3978/7645] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 13:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1891225256 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:24:44.824066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-439e4ebf-7a52-4d0b-8a56-9e489b7be57b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: .version_select at 0x7ff1b20cc5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1656345504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOGowR6lc1ADdYbzmni4mldy9RCjp0SPrgnLAZSKrbKwYBcdY8nYRC1PZIqjlPJvrSgu+5vCM/KEv31AmOTK5zjoBCMnBMq/TwBVaxGFdCph7KTB7+8wsIuIjWO0qm2qg=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:44.843274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-439e4ebf-7a52-4d0b-8a56-9e489b7be57b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:24:44.849491 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-439e4ebf-7a52-4d0b-8a56-9e489b7be57b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:24:44.949874 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-439e4ebf-7a52-4d0b-8a56-9e489b7be57b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.129507 Nov 02 13:24:44.950669 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3668/7646] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:24:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:45.005734 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-892149720", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1656345504", "networks": [{"uuid": "2972dd31-48e7-454d-9edd-e1e89c546a3c"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:45.072931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] validate_networks() for [('2972dd31-48e7-454d-9edd-e1e89c546a3c', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:24:45.545509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:24:45.545949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:24:45.546512 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:24:45.547025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:24:45.547581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:24:45.558611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.559147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.559603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.560356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.560825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.561268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.588294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:24:45.598168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:24:45.614837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:24:45.617325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:24:45.787095 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ca172b42-dc68-48f5-bfb5-398f88f283a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786024 Nov 02 13:24:45.787841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3979/7647] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:24:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:24:45.801531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e6ea4f4-6c0a-4c6d-9530-a152b5426b7c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.802218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e6ea4f4-6c0a-4c6d-9530-a152b5426b7c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.920481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e6ea4f4-6c0a-4c6d-9530-a152b5426b7c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:45.923500 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e6ea4f4-6c0a-4c6d-9530-a152b5426b7c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1262 microversion: 2.1 time: 0.127825 Nov 02 13:24:45.924083 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3669/7648] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:45 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1262 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:46.951154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:46.951807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:46.960801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.961288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.961740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:46.962481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.962960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.963432 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:47.400317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:47.416358 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06e7d5de-6c68-46d8-8188-2b931bbd98b2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1266 microversion: 2.1 time: 0.469719 Nov 02 13:24:47.417339 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3980/7649] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:46 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:48.462621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:48.463767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:48.473485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:48.473988 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:48.474699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:48.475480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:48.476220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:48.476922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:48.577192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:48.586914 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91c5451b-f8ac-46d8-b2a8-e357583683f6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1322 microversion: 2.1 time: 0.134711 Nov 02 13:24:48.587593 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3670/7650] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:48 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1322 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:49.611566 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:49.613839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:49.628759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.629187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.629648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.630490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.631034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.631581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.816393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:49.825000 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da21e59e-9717-499b-b8bd-f00fc5395edd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.218687 Nov 02 13:24:49.826115 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3981/7651] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:49 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:50.833128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcf315b-f44c-446c-a234-eee7d8560865", "tag": "f5443f87-b9d2-4f8c-b22c-dd466093410b"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:50.854747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:50.855542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:50.856504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.857041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:50.857836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:50.869336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:50.870391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:50.874622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.874622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:50.874622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:50.874622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.875587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] Creating event network-changed:f5443f87-b9d2-4f8c-b22c-dd466093410b for instance 1dcf315b-f44c-446c-a234-eee7d8560865 on n-h1-855649-4 Nov 02 13:24:50.883117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-26820e06-02f6-40e7-935b-d4833a26d507 req-d0910f92-125e-47c0-a83d-0ace7e3b2233 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057496 Nov 02 13:24:50.884048 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3671/7652] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:51.089367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:51.103210 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-995ff4c3-4259-4753-ac56-59f0f7f3d5fd tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.252331 Nov 02 13:24:51.103855 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3982/7653] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:50 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:52.131800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:52.132761 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:52.141335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.142074 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.143230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.144331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.144912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.145446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.309650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:52.323905 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd70a59d-0702-49a6-9cb1-cab4bd394365 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.199100 Nov 02 13:24:52.324529 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3672/7654] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:52 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:53.364540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:53.364540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:53.372493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:53.373143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:53.373898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:53.374899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:53.375680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:53.376183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:53.523096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:53.531649 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-642f9d3f-79bd-461a-9b48-be41e77c80f1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.176647 Nov 02 13:24:53.532247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3983/7655] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:53 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:54.556919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:54.557661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:54.568977 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.569477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.569928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.570924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.571648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.572079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.737277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:54.746444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7aeb7b85-bf4a-4f74-93c4-e3e6ffced33d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.193385 Nov 02 13:24:54.747034 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3673/7656] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:54 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:55.771910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:55.772601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:55.775653 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:55.776437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:55.781775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:55.782282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:55.782758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:55.783536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:55.784007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:55.784487 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:55.929985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:55.938175 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-692c3632-2db2-4dfb-a98e-1e19d492e109 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.171238 Nov 02 13:24:55.938778 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3984/7657] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:55 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:56.962824 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:56.963489 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:56.966504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:56.971747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:56.972245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:56.972697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:56.973422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:56.973887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:56.974330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.131384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:57.139728 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f0f545b7-6b4a-485e-a0dc-2de66c503d25 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.180815 Nov 02 13:24:57.140360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3674/7658] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:56 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:57.156909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcf315b-f44c-446c-a234-eee7d8560865", "name": "network-vif-plugged", "status": "completed", "tag": "f5443f87-b9d2-4f8c-b22c-dd466093410b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:57.169124 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:57.169629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:57.170080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.184258 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] Creating event network-vif-plugged:f5443f87-b9d2-4f8c-b22c-dd466093410b for instance 1dcf315b-f44c-446c-a234-eee7d8560865 on n-h1-855649-4 Nov 02 13:24:57.189481 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b92ff46f-5ec0-458b-be62-f618c18798c9 req-26214406-61f9-413e-a7c0-b153fa0e28c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037061 Nov 02 13:24:57.190097 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3985/7659] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:58.165326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:58.165955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:58.173063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:58.173531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:58.173979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:58.174689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:58.175180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:58.175615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:58.319451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:58.327586 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-54751b50-2256-433b-a49a-e8a0f91c75e6 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1362 microversion: 2.1 time: 0.166386 Nov 02 13:24:58.328185 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3675/7660] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:58 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:59.353300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:59.353919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:59.360651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.361779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.362233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.363082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.363563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.364005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.502889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:59.510779 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f0b96c2-8340-4785-a107-1353da001a71 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1555 microversion: 2.1 time: 0.163140 Nov 02 13:24:59.511484 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3986/7661] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:59 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:59.533622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:59.534246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:59.541223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.541752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.542206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.542917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.543418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.543859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.683048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:59.691795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f3847efb-564d-400d-8f9e-80830e5e2e26 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1555 microversion: 2.1 time: 0.162579 Nov 02 13:24:59.692401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3676/7662] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:24:59 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:03.050073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "697094a1-542a-43ab-9d10-e5f1001e3a90"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:03.053009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:03.056078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.061386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.061998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.062564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.063550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.064838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.071976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.071976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:04.017167 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7707f04c-8f0b-4e5a-b11c-3375e8aa223e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.970744 Nov 02 13:25:04.017888 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3987/7663] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:25:03 2022] POST /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:17.023477 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:17.024090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:17.026917 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:17.027629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=72 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:17.033193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:17.035088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:17.035088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.035088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:17.035396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:17.035898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.123684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lazy-loading 'services' on Instance uuid 1dcf315b-f44c-446c-a234-eee7d8560865 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:25:17.328234 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01ae2b18-da7e-422b-b060-a35ee653f6d8 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments/697094a1-542a-43ab-9d10-e5f1001e3a90" status: 202 len: 0 microversion: 2.1 time: 0.308776 Nov 02 13:25:17.328851 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3677/7664] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:25:17 2022] DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments/697094a1-542a-43ab-9d10-e5f1001e3a90 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:17.336126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:17.336911 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:17.341271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:17.343888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:17.350902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:17.351547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:17.351980 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.352717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:17.353193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:17.353643 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.388862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6c6a4b4-a021-4eef-8575-bc871ad2f585 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054770 Nov 02 13:25:17.389465 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3988/7665] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:17 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:18.405713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:18.408896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:18.415808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.416395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.416934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.417625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.418086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.418534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.452140 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-70865676-8da3-49a1-afd9-583fddb2a517 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051659 Nov 02 13:25:18.452718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3678/7666] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:18 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:19.467130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:19.469546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:19.479536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:19.479536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:19.479791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.480495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:19.481173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:19.481646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.517414 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-eff490b8-2c89-4542-855f-65425b2c8a0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054677 Nov 02 13:25:19.521137 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3989/7667] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:19 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:20.530129 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:20.532303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:20.540040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.540527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.540978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.541693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.542152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.542576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.576281 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-19fab7c3-59ad-4a6e-903e-12eb1e7fec91 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050173 Nov 02 13:25:20.577155 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3679/7668] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:20 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:21.589970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:21.592328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:21.600266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.600781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.601246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.601982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.602457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.603043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.636925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5716c646-6b62-4865-9b5f-12dc2fcc30c4 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051060 Nov 02 13:25:21.637533 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3990/7669] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:21 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:22.649257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:22.651579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:22.659091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.659583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.660083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.660766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.661218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.661646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.696536 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32f69238-4f72-444b-b817-7c50c1096673 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051377 Nov 02 13:25:22.697130 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3680/7670] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:25:22 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:25:22.708245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:22.708824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:22.715903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.716405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.716856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.717574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.718036 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.718472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.794519 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 is not attached to volume 697094a1-542a-43ab-9d10-e5f1001e3a90 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments/697094a1-542a-43ab-9d10-e5f1001e3a90 HTTP/1.1 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 is not attached to volume 697094a1-542a-43ab-9d10-e5f1001e3a90 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '1dcf315b-f44c-446c-a234-eee7d8560865', 'id': '697094a1-542a-43ab-9d10-e5f1001e3a90'} Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 697094a1-542a-43ab-9d10-e5f1001e3a90. Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 is not attached to volume 697094a1-542a-43ab-9d10-e5f1001e3a90 Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:22.796493 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 is not attached to volume 697094a1-542a-43ab-9d10-e5f1001e3a90 Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 is not attached to volume 697094a1-542a-43ab-9d10-e5f1001e3a90 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0fbfe419-de96-4e30-9a7d-445e1f737f1c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments/697094a1-542a-43ab-9d10-e5f1001e3a90" status: 404 len: 154 microversion: 2.1 time: 0.093980 Nov 02 13:25:22.802143 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3991/7671] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:25:22 2022] DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865/os-volume_attachments/697094a1-542a-43ab-9d10-e5f1001e3a90 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:25:26.545681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:26.549768 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:26.554014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.554512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.554956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.555762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.556199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.556627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.585802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:25:26.885605 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c01f4c0-74e5-489c-ad74-bb490b1067eb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 204 len: 0 microversion: 2.1 time: 0.343529 Nov 02 13:25:26.887328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3681/7672] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:25:26 2022] DELETE /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:25:26.895384 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:26.896021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:26.904184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.904700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.905210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.906105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.906581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.907154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.051725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.060155 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81178ec3-8906-4294-9b18-6bf39625add3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1561 microversion: 2.1 time: 0.169248 Nov 02 13:25:27.060738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3992/7673] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:26 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:28.084713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:28.085420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:28.092631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.093111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.093548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.094394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.095710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.096149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.232448 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:28.240435 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9dca39d4-5328-4a79-9627-2649b9888b28 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1561 microversion: 2.1 time: 0.160095 Nov 02 13:25:28.241023 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3682/7674] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:28 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:28.990151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcf315b-f44c-446c-a234-eee7d8560865", "name": "network-vif-deleted", "tag": "f5443f87-b9d2-4f8c-b22c-dd466093410b"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:29.001674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.002187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.002683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.015992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] Creating event network-vif-deleted:f5443f87-b9d2-4f8c-b22c-dd466093410b for instance 1dcf315b-f44c-446c-a234-eee7d8560865 on n-h1-855649-4 Nov 02 13:25:29.021565 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-47797fe9-00bc-4f7d-8a6f-92bdb046a6b6 req-740ab532-b147-40ee-ba40-97bb02f1cad2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038130 Nov 02 13:25:29.022216 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3993/7675] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:29.264151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:29.265026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:29.272655 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.273159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.273611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.274334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.274835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.275297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.357658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:29.385303 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9379e78d-23c0-4950-838f-862a22944d8b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 200 len: 1347 microversion: 2.1 time: 0.114724 Nov 02 13:25:29.386715 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3683/7676] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:29 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 1347 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:30.403433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.404163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 1dcf315b-f44c-446c-a234-eee7d8560865] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:30.413919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.414820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.415671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.416927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.417832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.418674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.438344 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 HTTP/1.1 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '1dcf315b-f44c-446c-a234-eee7d8560865'} Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:30.440103 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance 1dcf315b-f44c-446c-a234-eee7d8560865 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1324f9aa-786f-4541-ba33-b95c4b762f0d tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865" status: 404 len: 111 microversion: 2.1 time: 0.043537 Nov 02 13:25:30.445174 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3994/7677] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:30 2022] GET /compute/v2.1/servers/1dcf315b-f44c-446c-a234-eee7d8560865 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:25:30.450599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa4e6028-ace2-4aab-a9a8-61a54b50a195 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '.version_select at 0x7ff1b35ef430>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.538366 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa4e6028-ace2-4aab-a9a8-61a54b50a195 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1656345504" status: 202 len: 0 microversion: 2.1 time: 0.091435 Nov 02 13:25:30.539064 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3684/7678] 10.222.0.48 () {58 vars in 1278 bytes} [Wed Nov 2 13:25:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1656345504 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:30.559425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a3c41904-abfe-4c73-b310-3d9ccaac20e1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: .version_select at 0x7ff1b3a10b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-665848721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm1HtZsufL5hRfcJ87HVpDSwsRSKJha+tLC7W3YUQuk6T4IWWiS/5clg0ygsU28dvRW9FNY4WYuf57NlsODm8YTYuj0tjSfPFoC1A+FQ0C1EzTK44CFBWqsIFFw+JXsHw=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:30.575442 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a3c41904-abfe-4c73-b310-3d9ccaac20e1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:30.585283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-a3c41904-abfe-4c73-b310-3d9ccaac20e1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:30.681044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a3c41904-abfe-4c73-b310-3d9ccaac20e1 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.125774 Nov 02 13:25:30.681666 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3995/7679] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:25:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:30.739128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1373652461", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-665848721", "networks": [{"uuid": "2972dd31-48e7-454d-9edd-e1e89c546a3c"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:30.792860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] validate_networks() for [('2972dd31-48e7-454d-9edd-e1e89c546a3c', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:31.499622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:31.500288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:31.500514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:31.501715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:31.502162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:31.511717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.512213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.512613 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.513344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.513817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.514225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.532081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:31.537695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Getting quotas for user 685cbde6c34247efbcda79ff90dd0005 and project c561afe3f43244e799be6876135fcc43. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:31.551227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:31.553581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:31.672696 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c8153f0-3477-46ff-af48-9f56ddf611b0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937452 Nov 02 13:25:31.674075 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3685/7680] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:25:31.686294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0c6cf58a-2910-4c7d-9c89-b0efe28bc890 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:31.687756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0c6cf58a-2910-4c7d-9c89-b0efe28bc890 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:31.748220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0c6cf58a-2910-4c7d-9c89-b0efe28bc890 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:31.756116 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0c6cf58a-2910-4c7d-9c89-b0efe28bc890 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1262 microversion: 2.1 time: 0.074627 Nov 02 13:25:31.756735 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3996/7681] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:31 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:32.779198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:32.779946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:32.787664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.788148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.788684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.789388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.789848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.790277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.855273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:32.864098 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e0f255af-0441-4f5a-a83a-387e67a5ba61 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1266 microversion: 2.1 time: 0.088777 Nov 02 13:25:32.864572 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3686/7682] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:32 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:33.887777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:33.888477 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:33.896726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.897242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.897703 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.898438 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.898912 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.899390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.967853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:33.977117 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94015fb5-ea92-41f0-a94f-da84a1650552 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1314 microversion: 2.1 time: 0.093442 Nov 02 13:25:33.977718 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3997/7683] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:33 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1314 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:35.004087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:35.005434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:35.014135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.014815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.015308 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.016045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.016549 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.017050 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.223181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:35.232383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5971e90e-a22c-4d9b-8901-e2b989a65803 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.234136 Nov 02 13:25:35.233033 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3687/7684] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:34 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:36.256982 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:36.257686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:36.265005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.265517 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.266023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.267323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.267805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.268511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.295668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf", "tag": "8b6dcce1-0dc9-4918-946b-1fa405631fac"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:36.315221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.315716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.316163 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.345221 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] Creating event network-changed:8b6dcce1-0dc9-4918-946b-1fa405631fac for instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf on n-h1-855649-4 Nov 02 13:25:36.357165 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f008d51d-ae88-4001-b0a4-5f0e5b8affa0 req-de46e2d3-e558-4422-b899-9caeddf7f3a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066632 Nov 02 13:25:36.358794 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3688/7685] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:36.440831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:36.452935 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a1e6ca14-f730-4c78-b75d-6834141dc4c3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.199739 Nov 02 13:25:36.457057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3998/7686] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:36 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:37.478602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:37.479346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:37.486190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.486677 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.487146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.487852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.488306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.488729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.635615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:37.650838 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-158c157a-026f-4116-a896-2bd8177cad80 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.177021 Nov 02 13:25:37.651896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3689/7687] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:37 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:38.674422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:38.675097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:38.682884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.683431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.683893 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.684627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.685107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.685553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.830592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:38.838575 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e34b32f9-825f-443b-b793-ef058c0ab5d0 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.168305 Nov 02 13:25:38.839188 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 3999/7688] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:38 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:39.861726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:39.862292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:39.869261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.869752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.870197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.870904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.871397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.871828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.008054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.015976 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bf5173ca-bd7a-4030-bd51-5c5757c85f85 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.158247 Nov 02 13:25:40.017198 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3690/7689] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:39 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.039746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:41.040315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:41.047837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.048335 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.048790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.049504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.049967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.050408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.195358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:41.205431 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-92b92e10-0e02-4d16-a626-78df4c680460 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.169590 Nov 02 13:25:41.206034 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4000/7690] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:41 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.346451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf", "name": "network-vif-plugged", "status": "completed", "tag": "8b6dcce1-0dc9-4918-946b-1fa405631fac"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:41.358884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.366106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.366106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.372402 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] Creating event network-vif-plugged:8b6dcce1-0dc9-4918-946b-1fa405631fac for instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf on n-h1-855649-4 Nov 02 13:25:41.381525 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-03beb6ad-ce05-49a8-9f2b-8a1ebb8b9f13 req-0b8b952b-1334-4086-931d-7a619ba255c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039162 Nov 02 13:25:41.382158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3691/7691] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:42.231283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:42.231921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:42.234205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:42.240349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.240852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.241311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.242026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.242511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.242950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.375939 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:42.383828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76df6fac-7a10-4426-84e2-9825ef7f7b0c tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1362 microversion: 2.1 time: 0.156495 Nov 02 13:25:42.384630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4001/7692] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:42 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:43.404844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:43.405675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:43.410814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:43.411548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:43.418660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.422427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.422427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.422427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.422427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.422427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.561321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:43.570089 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e1d13c87-cfc4-40cf-8cc7-c713fde693a2 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1555 microversion: 2.1 time: 0.166117 Nov 02 13:25:43.570686 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3692/7693] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:43 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:43.592970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:43.593595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:43.601688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.602191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.602687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.603481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.603954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.604400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.747100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:43.755588 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54e700c9-bd9b-43b5-8892-0158326598d7 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1555 microversion: 2.1 time: 0.166803 Nov 02 13:25:43.756205 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4002/7694] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:25:43 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:46.943656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:46.946135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.953671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.954154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.954598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.955350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.956322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.956749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.188443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:47.809456 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b1c1fec-b6b2-4e1d-9991-c05d81b3b6ca tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "POST /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869879 Nov 02 13:25:47.810152 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3693/7695] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:25:46 2022] POST /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:59.668373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.669076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:59.671925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:59.672641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=70 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:59.678588 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.679205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.687339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.687339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.687339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.687339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.781084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lazy-loading 'services' on Instance uuid 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:00.021728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2084619-af48-41f3-96ee-f2605e37545e tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments/5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411" status: 202 len: 0 microversion: 2.1 time: 0.357636 Nov 02 13:26:00.022403 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4003/7696] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:25:59 2022] DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments/5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:26:00.029194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:00.030121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:00.034670 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:00.038263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:00.049036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.060996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.060996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.060996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.060996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.060996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.091791 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fc6f9f87-115b-4866-a182-0a485e3d7755 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064632 Nov 02 13:26:00.092452 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3694/7697] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:00 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:01.118067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:01.122242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:01.134644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.136428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.136428 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.137575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.138110 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.138569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.177437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4bf2a45a-2a46-4531-88ed-d24eccb7bd5b tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069716 Nov 02 13:26:01.178255 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4004/7698] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:01 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:02.190645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:02.192993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:02.201409 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.201900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.202338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.203087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.203541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.203968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.238274 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ff4cfec5-b007-47f0-a036-4233a8bd20d9 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052100 Nov 02 13:26:02.238872 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3695/7699] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:02 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:03.252687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:03.255313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:03.263269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.263801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.264274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.265067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.265562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.266014 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.314572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f52110bc-4b9f-41be-8d97-bda96629526a tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065907 Nov 02 13:26:03.315724 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4005/7700] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:03 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:04.329639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:04.332403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:04.342106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.342625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.343173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.345095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.345582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.346031 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.385052 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6af6741-bdd6-4cb6-90f2-4278317738bb tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060010 Nov 02 13:26:04.385585 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3696/7701] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:04 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:05.397950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:05.400614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.412919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.445270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07464f52-2834-4548-beaf-bb4f77f53593 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051548 Nov 02 13:26:05.445912 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4006/7702] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:26:05 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:05.457322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:05.457907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.465915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.470232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.470232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.470232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.470232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.470232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.561475 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf is not attached to volume 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: request: DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments/5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 HTTP/1.1 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf is not attached to volume 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'server_id': '0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf', 'id': '5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411'} Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411. Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf is not attached to volume 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:05.564617 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf is not attached to volume 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf is not attached to volume 5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:05.571536 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35946db4-0e5d-4aba-99a9-05b8051fce92 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments/5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411" status: 404 len: 154 microversion: 2.1 time: 0.114127 Nov 02 13:26:05.577595 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3697/7703] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:26:05 2022] DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf/os-volume_attachments/5b7a0a65-dd3f-4268-b57a-f1c7b0f2b411 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:09.269921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:09.270595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:09.277753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.278410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.278731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.279587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.280063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.280515 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.320699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:09.694678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05b15b0a-82ff-401d-a0b2-7c0a5559ba86 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 204 len: 0 microversion: 2.1 time: 0.428879 Nov 02 13:26:09.695316 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4007/7704] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:26:09 2022] DELETE /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:09.704245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:09.709063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:09.713423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.713919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.714368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.715171 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.715639 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.716082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.864668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:09.873407 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9d2d71ea-449d-42db-becd-5419a39acf90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1561 microversion: 2.1 time: 0.173602 Nov 02 13:26:09.887011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3698/7705] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:09 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:10.899754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:10.900474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:10.907363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.907857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.908301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.909009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.909475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.909914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.048291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:11.056315 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0f1912c1-f3ee-4bc4-879e-58aa175a3b90 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1561 microversion: 2.1 time: 0.161364 Nov 02 13:26:11.056901 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4008/7706] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:10 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:11.775971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf", "name": "network-vif-deleted", "tag": "8b6dcce1-0dc9-4918-946b-1fa405631fac"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:11.787705 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.794750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.794750 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.802499 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] Creating event network-vif-deleted:8b6dcce1-0dc9-4918-946b-1fa405631fac for instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf on n-h1-855649-4 Nov 02 13:26:11.808062 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a3f57764-841f-4e7a-a0e0-9fb178be67ae req-18223582-7110-4642-b8e0-928c604ab5d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036244 Nov 02 13:26:11.808682 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3699/7707] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:12.079679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:12.080493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:12.088305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.088900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.089429 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.090234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.090930 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.091538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.175494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '685cbde6c34247efbcda79ff90dd0005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c561afe3f43244e799be6876135fcc43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:12.187394 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-76604d39-8b32-4f35-95a7-a5081914cf30 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 200 len: 1347 microversion: 2.1 time: 0.109737 Nov 02 13:26:12.195334 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4009/7708] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:12 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 1347 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:13.210958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:13.211688 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] [instance: 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:13.218697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.219222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.219663 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.220358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.220846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.221271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.235713 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] HTTP exception thrown: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Request method failure captured: Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf HTTP/1.1 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYm9lAx649lvNFjTWzm3AEP6nimlH-mVtCueEc8gN3az_QZNGrJHAoGIWp5Lt-NQqF74X3RkqxgKynyhEaXucKSc_zlOfmlipiYjNJeDVi9rTLu9EWzC6mf5di4mPZq7EC-Ny8YOMZZy2IH9vAEx3A2el7omtulhcsZxUKNdscbpQbkM Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c561afe3f43244e799be6876135fcc43", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c561afe3f43244e799be6876135fcc43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c561afe3f43244e799be6876135fcc43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: c561afe3f43244e799be6876135fcc43 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-392047821 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 685cbde6c34247efbcda79ff90dd0005 Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestEncryptedCinderVolumes-392047821-project Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf'} Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:13.237422 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Returning 404 to user: Instance 0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b691552-4c76-4dbe-a06f-5f855c106ce3 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf" status: 404 len: 111 microversion: 2.1 time: 0.033655 Nov 02 13:26:13.243035 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3700/7709] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:13 2022] GET /compute/v2.1/servers/0ab93c5a-6e9b-4a88-a54d-7a38e11f06bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:13.248076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-84ee424f-c494-47a0-a7dc-2de1df692714 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] Calling method '.version_select at 0x7ff1b3815430>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:13.326477 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-84ee424f-c494-47a0-a7dc-2de1df692714 tempest-TestEncryptedCinderVolumes-392047821 tempest-TestEncryptedCinderVolumes-392047821-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-665848721" status: 202 len: 0 microversion: 2.1 time: 0.082288 Nov 02 13:26:13.327089 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4010/7710] 10.222.0.48 () {58 vars in 1275 bytes} [Wed Nov 2 13:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-665848721 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:26:52.552721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63d5f4c2-3db7-43aa-ae87-d10ca20204f0 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: .version_select at 0x7ff1b35efca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1262238111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOKo+jKoWGYKh0yHpFmBx2YwInHYI2ZRRh+YQQUhjMnEx401/JV0X1A8oV5JaUx9KO+/998KWtYzdu/B7YoTqv/7ho0levvmizlkMdIU4nMA3EWiU2vL6iu5M4mNPDeyw=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:52.558559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:52.559186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=34 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:52.572559 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-63d5f4c2-3db7-43aa-ae87-d10ca20204f0 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for project 789f7e293a4f477392effa85f9f6c44b. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:52.582881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-63d5f4c2-3db7-43aa-ae87-d10ca20204f0 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for user d4136aa2d1d9487dbf329a94a5cea9c1 and project 789f7e293a4f477392effa85f9f6c44b. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:52.732663 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63d5f4c2-3db7-43aa-ae87-d10ca20204f0 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.184223 Nov 02 13:26:52.733360 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3701/7711] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:26:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:52.792314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1326700935", "imageRef": "61c96544-0d28-49aa-a709-933342134db4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1262238111", "networks": [{"uuid": "0e880d86-c2a1-4103-9733-ea225f99bd7e"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:52.802696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:52.803426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:53.038899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] validate_networks() for [('0e880d86-c2a1-4103-9733-ea225f99bd7e', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:53.521843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:53.522324 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:53.522837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:53.523315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:53.523786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:53.534164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.534671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.535807 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.536746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.537377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.537965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.559865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for project 789f7e293a4f477392effa85f9f6c44b. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:53.566518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for user d4136aa2d1d9487dbf329a94a5cea9c1 and project 789f7e293a4f477392effa85f9f6c44b. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:53.582056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:26:53.584580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='61c96544-0d28-49aa-a709-933342134db4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:26:53.736523 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-660f20c9-41fd-4d6e-9ba1-8c22869646ec tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948831 Nov 02 13:26:53.739480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4011/7712] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:26:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:26:53.757951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-804df000-15d1-4279-b014-ae6096aa1166 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:53.759256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-804df000-15d1-4279-b014-ae6096aa1166 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:53.845732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-804df000-15d1-4279-b014-ae6096aa1166 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:53.856489 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-804df000-15d1-4279-b014-ae6096aa1166 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1259 microversion: 2.1 time: 0.109157 Nov 02 13:26:53.857814 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3702/7713] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:53 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1259 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:54.895876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf744db2-e957-4919-8b6e-e08f4016b1dc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:54.896797 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf744db2-e957-4919-8b6e-e08f4016b1dc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:54.963688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf744db2-e957-4919-8b6e-e08f4016b1dc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:54.974060 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf744db2-e957-4919-8b6e-e08f4016b1dc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1259 microversion: 2.1 time: 0.082527 Nov 02 13:26:54.974683 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4012/7714] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:54 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:56.000745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:56.001389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:56.011822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:56.012444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:56.012928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:56.013729 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:56.014246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:56.014654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:56.081827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:56.090886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cd2b8033-d4b7-4f22-b198-d8ac4e156205 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1311 microversion: 2.1 time: 0.094041 Nov 02 13:26:56.091515 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3703/7715] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:55 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:57.115206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:57.115853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:57.123888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.124407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.124861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.125613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.126085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.126528 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.203792 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:57.214237 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-884c8fa1-41bd-48b5-b874-2c969c25fce7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1329 microversion: 2.1 time: 0.103493 Nov 02 13:26:57.219050 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4013/7716] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:57 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:58.245371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:58.247687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:58.257580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.258538 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.259386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.260341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.260974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.261581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.583190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:58.599898 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0a2522e-0ee0-4cda-84c3-3d890aa0b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.361322 Nov 02 13:26:58.601918 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3704/7717] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:58 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:58.867642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.879873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.880717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.881488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.897578 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] Creating event network-changed:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:26:58.903785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2e05f32d-c2eb-47f8-a5af-e54757f425e3 req-7c86463e-78b2-4a4c-b2b8-b03e55e9fd33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040386 Nov 02 13:26:58.905225 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4014/7718] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:59.624951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:59.625731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:59.633812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:59.634620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:59.635100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:59.636080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:59.636936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:59.637166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:59.828589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:59.842907 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71870db5-36a4-4f2e-bd17-8a43be9f45b2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.221415 Nov 02 13:26:59.844523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3705/7719] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:26:59 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:00.871113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:00.871845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:00.879319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.880027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.880551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.881349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.881892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.882455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:01.079422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:01.094545 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5267c868-b8d3-41ac-b087-e53b84f9869d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.229732 Nov 02 13:27:01.113869 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4015/7720] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:00 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:02.120960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:02.121716 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:02.130686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:02.132001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:02.133047 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:02.134119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:02.134929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:02.135846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:02.332168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:02.345539 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6fa0b2d-8855-4526-b1e3-00a2f23398c9 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.229144 Nov 02 13:27:02.346197 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3706/7721] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:02 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:03.378104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:03.379371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:03.386904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.387546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.388780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:03.390301 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.390878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.391922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:03.547689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:03.583309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:03.594241 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c2582148-e959-4b6e-b88d-8d91f530ed4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.219976 Nov 02 13:27:03.595366 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4016/7722] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:03 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:04.620386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:04.621119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:04.623500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:04.630543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.631085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.631546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.632287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.632744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.633181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.810389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:04.820023 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e3c589a0-d080-42f2-a0c4-cf7e98b05fa8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.205040 Nov 02 13:27:04.820624 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3707/7723] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:04 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:05.851540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:05.852362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:05.856272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:05.864046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.864675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.865832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.867163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.867923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.868329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.073191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:06.083302 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ef4c8e5b-ce5f-48c1-b3ff-3c65d7d40d23 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.238210 Nov 02 13:27:06.084218 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4017/7724] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:05 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:07.107791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:07.108414 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:07.117091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.117648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.118145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.118949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.119591 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.120108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.281333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:07.294697 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ec1ebc3-97b1-4710-9fdb-33a34810b287 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.190746 Nov 02 13:27:07.295718 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3708/7725] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:07 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:08.318447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:08.319125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:08.326213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:08.326725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:08.327202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.327926 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:08.328396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:08.328844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.478520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:08.486965 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-11da6239-1bf3-4e85-ab60-2c020296e028 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.172366 Nov 02 13:27:08.487668 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4018/7726] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:08 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:09.510878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:09.511520 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:09.518794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.519317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.519758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.520476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.520937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.521375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.676579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:09.685803 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-22361159-86fb-4fd5-8c7c-857087537551 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.178896 Nov 02 13:27:09.686678 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3709/7727] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:09 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:09.917148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "name": "network-vif-plugged", "status": "completed", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.927858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.928392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.928842 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.940828 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] Creating event network-vif-plugged:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:27:09.946096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c6948267-e870-48e1-856b-5e7d613ae34c req-0d7b8c08-488c-4b23-99cf-3576bd52b071 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110824 Nov 02 13:27:09.946878 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4019/7728] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:10.712071 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:10.712635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:10.720557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.721073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.721579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.722435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.723092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.723466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.882823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:10.893550 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64677e67-1e57-464b-8896-a7fe631dba35 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1359 microversion: 2.1 time: 0.186454 Nov 02 13:27:10.894037 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3710/7729] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:10 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:11.918635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:11.919393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:11.925832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.926332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.926787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:11.927533 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.928001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.928444 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.069170 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.077613 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7fec6c98-39cb-4201-9d8a-00ee718fff08 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1549 microversion: 2.1 time: 0.164143 Nov 02 13:27:12.078224 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4020/7730] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:11 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:12.102024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:12.102622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:12.110149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.110656 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.111140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.111853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.112362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.112812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.256601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.265690 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e504bde-1fd4-441e-8ab9-53b729064759 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1549 microversion: 2.1 time: 0.167652 Nov 02 13:27:12.266293 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3711/7731] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:12 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:12.289562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:12.294679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.295519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Searching by: {'deleted': False, 'project_id': '789f7e293a4f477392effa85f9f6c44b'} {{(pid=127567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:27:12.301305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.301761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.302214 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.302947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.303441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.303878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.330612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.multi_cell_list [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:27:12.361087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-45031438-dede-4dc9-abe1-700589f544f8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075906 Nov 02 13:27:12.361682 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4021/7732] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 13:27:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:12.377517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:12.378145 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:12.385496 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.386001 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.386453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.387215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.387685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.388125 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.527865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.535865 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f7459e87-03ce-41e3-95ac-668bcd6124cf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1549 microversion: 2.1 time: 0.162296 Nov 02 13:27:12.536455 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3712/7733] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:12 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:15.577818 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d5df989-202c-497d-aed3-b86839408e3b"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:15.580257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:15.587470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.587966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.588416 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.589133 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.589604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.590042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:16.333931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d66e4502-ce68-4370-81c5-78b1220be350 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759930 Nov 02 13:27:16.334821 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4022/7734] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:27:15 2022] POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:31.881939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:31.882597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:31.885227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:31.885930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=60 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:31.891570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.897279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.897279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.897279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.897279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.897279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.031787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:32.040810 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5875d644-f93e-49c4-a1a4-86dc56299418 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1595 microversion: 2.1 time: 0.163426 Nov 02 13:27:32.041393 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3713/7735] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:31 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:34.778063 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:34.779641 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:34.781542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:34.844764 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:34.858065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:34.858618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:34.859125 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:34.874474 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] Creating event network-changed:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:27:34.881876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f827a9bd-1aad-44fd-ab46-0c5b91b2094f req-fc60b330-7c9e-45c5-a899-a2299c46ec21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117031 Nov 02 13:27:34.882538 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4023/7736] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:37.911423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1423385561"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:37.914633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:37.919452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.919951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.920532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.921259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.921721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.922153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.061239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Adding security group c006b615-c6e6-4531-ba3c-cae67b6b5c02 to port 5ba7fd3d-3dc4-4682-a8a5-5da282cab335 Nov 02 13:27:38.482169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-88c8f1d5-8248-4bda-99d8-cf3a33d85b19 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action" status: 202 len: 0 microversion: 2.1 time: 0.573744 Nov 02 13:27:38.483046 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3714/7737] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:27:37 2022] POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:38.497092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:38.497715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:38.499546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:38.515251 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.515747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.516410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.520608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.521989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.522443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.523246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.523687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.524441 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.532746 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] Creating event network-changed:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:27:38.537356 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-14492bc6-bc12-4b71-9a2e-76aa039aefe3 req-a664a609-66f9-4941-ad1d-ec21e87e6d6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050482 Nov 02 13:27:38.539212 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4024/7738] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:38.800874 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:38.812749 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-95c95f1a-17fa-4a75-9794-ee600a1a6b5a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1760 microversion: 2.1 time: 0.319551 Nov 02 13:27:38.813525 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3715/7739] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:27:38 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1760 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:06.990880 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:29:06.991538 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action (ip 10.222.0.48) !!! Nov 02 13:29:06.996704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:06.999146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:07.008194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.008704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.009159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.009897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.010375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.011373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.304055 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a1f7265-0f8a-4f76-a94b-37f9d29e29c1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action" status: 202 len: 0 microversion: 2.1 time: 0.316364 Nov 02 13:29:07.304752 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4025/7740] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:29:06 2022] POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:07.311777 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:07.312554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:07.316702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:07.317332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:07.325500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.326061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.326452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.327218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.327694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.328118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.547228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:07.556796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d543388c-57db-441e-bdc9-e080b713075f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1762 microversion: 2.1 time: 0.246793 Nov 02 13:29:07.557325 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3716/7741] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:07 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1762 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:08.581152 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:08.581822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:08.589467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.589974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.590430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.591563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.592179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.592630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.752035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:08.761206 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fcb8ccf-5c45-415d-b3e7-6afc98b785d3 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1767 microversion: 2.1 time: 0.184472 Nov 02 13:29:08.761810 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4026/7742] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:08 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1767 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:09.792005 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:09.793273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:09.800764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:09.801253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:09.801691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:09.802407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:09.802863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:09.803338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:09.991374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:10.005490 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91fe7b7b-5272-41a0-ac55-e0b66006b218 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1760 microversion: 2.1 time: 0.217386 Nov 02 13:29:10.006349 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3717/7743] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:29:09 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1760 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:20.029709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:20.030481 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:20.034627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1423385561"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:20.035222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:20.041493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:20.045041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:20.045041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.045041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:20.045041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:20.045041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.181444 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Removing security group c006b615-c6e6-4531-ba3c-cae67b6b5c02 from port 5ba7fd3d-3dc4-4682-a8a5-5da282cab335 Nov 02 13:30:20.572207 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-167da8ef-83b2-4b12-9faf-fe90a497b932 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action" status: 202 len: 0 microversion: 2.1 time: 0.542937 Nov 02 13:30:20.572207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4027/7744] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:30:20 2022] POST /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:30:20.579263 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:30:20.580112 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:30:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:30:20.585081 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:30:20.585350 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:30:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:30:20.592235 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:30:20.592802 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:30:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:30:20.594305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:20.595897 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:20.601583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:20.622510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:20.623323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:20.624011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.647404 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] Creating event network-changed:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:30:20.656351 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-6b4f89f9-892b-4f8c-a6cf-71e465cab4ab req-d3e90ff7-3b2d-4a56-84b8-622582a10bf3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081369 Nov 02 13:30:20.657943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3718/7745] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:22.007755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:22.008363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:22.014648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.015476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.015933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.016663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.017137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.017580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.113081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lazy-loading 'services' on Instance uuid 71948bcf-cccc-4539-9e66-aa366568439a {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:30:22.376737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-15b00d9f-1bb6-4e12-8af5-eafb9bc71a04 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments/8d5df989-202c-497d-aed3-b86839408e3b" status: 202 len: 0 microversion: 2.1 time: 0.374550 Nov 02 13:30:22.377391 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4028/7746] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:30:22 2022] DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments/8d5df989-202c-497d-aed3-b86839408e3b => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:30:22.389178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:22.394142 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:22.398995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.399488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.399929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.400644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.401100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.401525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.438737 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dc3311e6-5075-4458-9603-650b68df7059 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055764 Nov 02 13:30:22.439484 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3719/7747] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:22 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:22.677918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:22.688624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.689238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.689602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.705122 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] Creating event network-changed:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:30:22.713432 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-85860f70-a350-4738-8f61-df3b77d669ef req-31d5346e-a965-4cde-8a07-3fcdd4aebe12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038558 Nov 02 13:30:22.714220 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4029/7748] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:23.452105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:23.454337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:23.462114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.471978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.471978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.471978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.471978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.471978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.498197 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-69875ae0-7906-4e48-a9f7-39af40abb132 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050276 Nov 02 13:30:23.498896 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3720/7749] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:23 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:24.513492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:24.516542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:24.523388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.523898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.524348 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.525092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.525534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.525966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.558281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f627cbda-cba6-4396-bc54-63285387b1eb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050120 Nov 02 13:30:24.558859 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4030/7750] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:24 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:25.571149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:25.573597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:25.581418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.582010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.582461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.583214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.583681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.584153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.627009 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8323836b-e794-465a-a99d-e971c21f6a4e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059674 Nov 02 13:30:25.627009 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3721/7751] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:25 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:26.639336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:26.641851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:26.649651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:26.650148 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:26.650603 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:26.651447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:26.651968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:26.652410 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:26.682785 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c5035471-ba5d-42c1-a456-c289f3baad3c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047554 Nov 02 13:30:26.683402 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4031/7752] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:26 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:27.695521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.697719 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.704932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.705951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.706488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.707261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.707720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.708216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.743795 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc3516b1-99e5-49dc-95c6-75e027c173bc tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052352 Nov 02 13:30:27.744364 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3722/7753] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:30:27.755489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.756103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.763042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.763562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.764019 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.764741 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.765484 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.765932 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.846676 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] HTTP exception thrown: Instance 71948bcf-cccc-4539-9e66-aa366568439a is not attached to volume 8d5df989-202c-497d-aed3-b86839408e3b Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Request method failure captured: Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments/8d5df989-202c-497d-aed3-b86839408e3b HTTP/1.1 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnAHRzrxygkEYC-GV_qTZMihIMbgcM5Y3ntbvWfoHvt0EdXojObCQ9kGbPrIEQlJVevNML-tXQrji0DtNcDhjPWTe0FUf8bTS00GWfzSaxqiD6sJV5uH7Zu5bim3Nj5fJtHSaIRDMjGl0wZG7zqz45w4lOIftZZsbIGTtKfo3FdoTJc Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_789f7e293a4f477392effa85f9f6c44b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d4136aa2d1d9487dbf329a94a5cea9c1 Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 71948bcf-cccc-4539-9e66-aa366568439a is not attached to volume 8d5df989-202c-497d-aed3-b86839408e3b Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '71948bcf-cccc-4539-9e66-aa366568439a', 'id': '8d5df989-202c-497d-aed3-b86839408e3b'} Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8d5df989-202c-497d-aed3-b86839408e3b. Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71948bcf-cccc-4539-9e66-aa366568439a is not attached to volume 8d5df989-202c-497d-aed3-b86839408e3b Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:27.848508 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71948bcf-cccc-4539-9e66-aa366568439a is not attached to volume 8d5df989-202c-497d-aed3-b86839408e3b Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Returning 404 to user: Instance 71948bcf-cccc-4539-9e66-aa366568439a is not attached to volume 8d5df989-202c-497d-aed3-b86839408e3b {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-995800f1-4c75-481d-9ce6-141f174c19bf tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments/8d5df989-202c-497d-aed3-b86839408e3b" status: 404 len: 154 microversion: 2.1 time: 0.098885 Nov 02 13:30:27.853874 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4032/7754] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:30:27 2022] DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a/os-volume_attachments/8d5df989-202c-497d-aed3-b86839408e3b => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:31.294077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:31.294868 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:31.302173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.302573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.303060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.303842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.304250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.304686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.332550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:30:31.631119 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e959e84c-1b65-439c-a34f-a9932037b667 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 204 len: 0 microversion: 2.1 time: 0.341503 Nov 02 13:30:31.637300 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3723/7755] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:30:31 2022] DELETE /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:30:31.641687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:31.642920 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:31.649941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.650452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.650919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.651692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:31.652173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:31.652622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:31.812973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:31.821934 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9ef680a9-2be6-40ec-9001-4aab92d20bc4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1555 microversion: 2.1 time: 0.184932 Nov 02 13:30:31.822530 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4033/7756] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:31 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:32.846643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:32.847263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:32.854115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:32.854657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:32.855138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:32.855835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:32.856292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:32.856720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.468443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:33.477219 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bb5c734d-0f65-4f3d-a1ba-789f0a6159bd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1555 microversion: 2.1 time: 0.635453 Nov 02 13:30:33.477840 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3724/7757] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:32 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1555 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:34.099739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71948bcf-cccc-4539-9e66-aa366568439a", "name": "network-vif-deleted", "tag": "5ba7fd3d-3dc4-4682-a8a5-5da282cab335"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:34.109602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.110121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.110596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.123211 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] Creating event network-vif-deleted:5ba7fd3d-3dc4-4682-a8a5-5da282cab335 for instance 71948bcf-cccc-4539-9e66-aa366568439a on n-h1-855649-4 Nov 02 13:30:34.128775 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-8021abad-be73-4884-8fb7-09f6f722ed9f req-bbc5a730-d38a-4a88-8042-3f4493b863b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144671 Nov 02 13:30:34.129408 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4034/7758] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:34.501841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:34.502533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:34.509233 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.509732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.510181 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.510898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.511395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.511829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.545304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.545708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.546152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.546614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lazy-loading 'fault' on Instance uuid 71948bcf-cccc-4539-9e66-aa366568439a {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:30:34.589564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:34.598769 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8fd8f0e3-bff5-4e72-8c2e-111863a90c53 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 200 len: 1349 microversion: 2.1 time: 0.100712 Nov 02 13:30:34.599842 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3725/7759] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:34 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:35.623659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.624546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 71948bcf-cccc-4539-9e66-aa366568439a] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:35.630902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.631451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.632043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.632898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.633258 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.633774 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.649434 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] HTTP exception thrown: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Request method failure captured: Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a HTTP/1.1 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnAHRzrxygkEYC-GV_qTZMihIMbgcM5Y3ntbvWfoHvt0EdXojObCQ9kGbPrIEQlJVevNML-tXQrji0DtNcDhjPWTe0FUf8bTS00GWfzSaxqiD6sJV5uH7Zu5bim3Nj5fJtHSaIRDMjGl0wZG7zqz45w4lOIftZZsbIGTtKfo3FdoTJc Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_789f7e293a4f477392effa85f9f6c44b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d4136aa2d1d9487dbf329a94a5cea9c1 Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '71948bcf-cccc-4539-9e66-aa366568439a'} Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:35.651198 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Returning 404 to user: Instance 71948bcf-cccc-4539-9e66-aa366568439a could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-41b489f5-34fa-4971-9fb2-5142865da1e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a" status: 404 len: 111 microversion: 2.1 time: 0.034525 Nov 02 13:30:35.660009 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4035/7760] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/servers/71948bcf-cccc-4539-9e66-aa366568439a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:35.662300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-129c6053-2495-48eb-9a5b-ecdf1931459d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '.version_select at 0x7ff1b22b20d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.802437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-129c6053-2495-48eb-9a5b-ecdf1931459d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1262238111" status: 202 len: 0 microversion: 2.1 time: 0.144566 Nov 02 13:30:35.803053 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3726/7761] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 13:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1262238111 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:30:47.782297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-67be270c-316a-4f23-ad8a-ea548273d4a8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: .version_select at 0x7ff1b271e1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1749638486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO0F5WBNwJkBnrSPa4P56OBSspgq9D9F2jO6XlgHNdmMMkb/34tf0sZmcnqWOJi71MT/imcij1Y+ZF7t7C0VCU6Y1HX6nnAF+S1xKzvkAS0xer0Jgq061V949HjkXPFtA=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:47.788761 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:47.789441 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:47.791256 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:30:47.796844 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.48) !!! Nov 02 13:30:47.809590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-67be270c-316a-4f23-ad8a-ea548273d4a8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for project 789f7e293a4f477392effa85f9f6c44b. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:47.815055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-67be270c-316a-4f23-ad8a-ea548273d4a8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for user d4136aa2d1d9487dbf329a94a5cea9c1 and project 789f7e293a4f477392effa85f9f6c44b. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:47.996058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-67be270c-316a-4f23-ad8a-ea548273d4a8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.217825 Nov 02 13:30:47.996672 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4036/7762] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:30:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:48.045180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:48.061649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:48.061649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-287980435", "imageRef": "20fbc258-6fcc-44da-8bc4-aec66f0d0162", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1749638486", "networks": [{"uuid": "0e880d86-c2a1-4103-9733-ea225f99bd7e"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:48.105372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] validate_networks() for [('0e880d86-c2a1-4103-9733-ea225f99bd7e', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:48.543579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:48.546100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:48.546100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:48.546100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:48.546100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:48.555082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.555561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.556008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.556746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.557232 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.557671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.575786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for project 789f7e293a4f477392effa85f9f6c44b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:48.581178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Getting quotas for user d4136aa2d1d9487dbf329a94a5cea9c1 and project 789f7e293a4f477392effa85f9f6c44b. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:48.594365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:48.596866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='20fbc258-6fcc-44da-8bc4-aec66f0d0162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:48.740234 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1ff19a83-404c-41db-81a2-7011d19ef058 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697011 Nov 02 13:30:48.740893 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3727/7763] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:30:48.751968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05584b5c-0bd2-43fd-8ca9-0a516cee90d2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:48.752601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05584b5c-0bd2-43fd-8ca9-0a516cee90d2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.811308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05584b5c-0bd2-43fd-8ca9-0a516cee90d2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.819363 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05584b5c-0bd2-43fd-8ca9-0a516cee90d2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1258 microversion: 2.1 time: 0.071311 Nov 02 13:30:48.819950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4037/7764] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:48 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:49.844469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-73b3361c-1194-47aa-9544-ff5194ba3c13 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:49.845137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-73b3361c-1194-47aa-9544-ff5194ba3c13 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:49.903662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-73b3361c-1194-47aa-9544-ff5194ba3c13 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:49.911782 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-73b3361c-1194-47aa-9544-ff5194ba3c13 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1258 microversion: 2.1 time: 0.072411 Nov 02 13:30:49.912378 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3728/7765] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:49 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:50.937468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:50.938232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:50.945684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.946246 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.946635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.947393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.947891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.948337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.015917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.026382 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abc25da8-5f20-4f25-abfa-f60666f7ff48 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1310 microversion: 2.1 time: 0.094390 Nov 02 13:30:51.026999 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4038/7766] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:50 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:52.052621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.056177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:52.069326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.069326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.069743 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.070153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.070621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.071127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.421210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:52.430892 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a6eb088f-9541-4746-8901-bedcc94130c7 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.384710 Nov 02 13:30:52.447408 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3729/7767] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:53.462604 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:53.463236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:53.470708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.471274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.471705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.472446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.473779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.474548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.637749 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.648271 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8a2cc070-4dac-42f3-a667-9f1ebe68cec8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.189662 Nov 02 13:30:53.648895 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4039/7768] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:53 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:54.675401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:54.676809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:54.684439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.685103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.685551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.686291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.686751 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.687351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.874009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:54.883892 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c695dce7-87cc-4fa0-bbbe-ce0a623a6567 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.213070 Nov 02 13:30:54.888081 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3730/7769] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:54 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:55.928361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:55.929452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:55.940602 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.942196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.943274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.944637 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.945882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.946805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.115471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.126163 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-09bf3a1e-0b3d-4e9a-8f5e-47b41bdaaa8e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.204400 Nov 02 13:30:56.134291 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4040/7770] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:55 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:57.151210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.151935 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.160812 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.161763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.162456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.163392 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.163890 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.164327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.348149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.357871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7f95e3d6-25f0-438f-ac4f-357423905078 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.210873 Nov 02 13:30:57.374650 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3731/7771] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:58.393121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:58.398078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:58.406497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.406497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.406944 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.407706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.408185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.408651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.606547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:58.619787 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d0a4ec56-0f18-49f8-aeed-1eb126d3b893 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.240616 Nov 02 13:30:58.623243 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4041/7772] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:59.680597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.681311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:59.684315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:59.690475 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.690929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.691955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.692720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.693334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.693781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.908603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:59.931908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.940188 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-900832eb-d2ef-41c3-87bc-bc908cc3f041 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.263598 Nov 02 13:30:59.940904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3732/7773] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:30:59 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:00.481519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:00.487827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:00.492855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.493356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.493804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.506018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] Creating event network-changed:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:31:00.511149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-891dbc1a-dbe3-42ba-85bc-dc4a3f7772ae req-2c614bbd-9917-4716-9a95-a0c5847d2817 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034583 Nov 02 13:31:00.511857 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4042/7774] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:00.966018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:00.966862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:00.974853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.975395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.975847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.976609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.977076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.977514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.194510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.203208 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-253573c4-d743-4771-a35d-7fb9f9b152ea tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.241417 Nov 02 13:31:01.204387 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3733/7775] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:00 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:02.229901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:02.230522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:02.237571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.238092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.239175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.239836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.240300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.240744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.380399 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.388968 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f226dd9b-d806-4b05-ae6c-cd92d848fc4a tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.164701 Nov 02 13:31:02.389543 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4043/7776] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:03.413511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.414339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.421945 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.422450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.423072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.423878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.424352 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.424794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.570678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:03.579294 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e990a9e6-a4d7-4c3e-b95f-ed278b779dde tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.170669 Nov 02 13:31:03.579904 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3734/7777] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:04.604143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.604968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.612025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.612559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.612916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.615117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.615117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.615475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.765392 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.778033 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cd180d1a-821c-4592-983e-df1479afbbfa tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.177928 Nov 02 13:31:04.778802 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4044/7778] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:05.183438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "name": "network-vif-plugged", "status": "completed", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:05.195220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.197848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.197848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.209228 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] Creating event network-vif-plugged:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:31:05.214796 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-55cd334f-7cc4-48c7-ac56-b18b5f9295f9 req-c1dccedf-ebe8-47a0-b074-2d27dd036eb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035146 Nov 02 13:31:05.215571 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3735/7779] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:05.804659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.805311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:05.813362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.814266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.814788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.815950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.817052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.817502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.013479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.022123 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e6a2fe3-f3b9-4557-8ce4-46794aecf64b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1358 microversion: 2.1 time: 0.222011 Nov 02 13:31:06.022733 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4045/7780] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:05 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.057132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.057922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.064835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.065396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.065902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.067614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.068302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.068783 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.219216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.228116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1574f4f4-0332-4977-887f-327548c46e7d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1548 microversion: 2.1 time: 0.176454 Nov 02 13:31:07.228717 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3736/7781] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.250951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.261605 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.404197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.417699 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da0b99da-9426-4c2d-b7f3-eb05fa895c36 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1548 microversion: 2.1 time: 0.170616 Nov 02 13:31:07.418305 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4046/7782] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.439782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.445406 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.446152 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Searching by: {'deleted': False, 'project_id': '789f7e293a4f477392effa85f9f6c44b'} {{(pid=127568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:31:07.451744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.452200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.452638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.453447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.453843 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.454247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.481326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.multi_cell_list [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:31:07.514058 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-59426a25-d26c-4d74-9bec-af5fbfa7666f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.078112 Nov 02 13:31:07.514915 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3737/7783] 10.222.0.48 () {58 vars in 1125 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:07.527645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.528311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.534672 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.535202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.535660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.536498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.536857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.537300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.689075 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.698064 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cf7574a6-5430-4007-82ac-44cde48d1b5e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1548 microversion: 2.1 time: 0.174423 Nov 02 13:31:07.698721 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4047/7784] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:10.620268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48934f26-be29-4938-bbc6-3f8074d5f416"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:10.623348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:10.632045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:10.632539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:10.632979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:10.633727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:10.634155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:10.634584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:11.463200 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ce200a3c-a9a7-4ab3-a4f8-c876f5546b03 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847168 Nov 02 13:31:11.463919 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3738/7785] 10.222.0.48 () {60 vars in 1323 bytes} [Wed Nov 2 13:31:10 2022] POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:23.506798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:23.507552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:23.510701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:23.511427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=56 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:23.516780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.520390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.520390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.520390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.520390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.520390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.671783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:23.686246 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2fe4985a-b8c1-461c-a0ff-31ecd32b2cc1 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1594 microversion: 2.1 time: 0.184173 Nov 02 13:31:23.686868 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4048/7786] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:23 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1594 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:26.544256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:26.547894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:26.548816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:26.553178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:26.569531 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:26.570450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:26.570800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:26.584237 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] Creating event network-changed:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:31:26.589904 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f66f9192-cafe-47c0-8843-26fbd45cda70 req-93a613e9-d263-42c4-9371-5c8e5d8797a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047489 Nov 02 13:31:26.593528 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3739/7787] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:29.706290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-813967040"}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:29.706998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:29.713757 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.714269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.714728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:29.715501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.715974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.716449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:29.853879 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.network.security_group_api [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Adding security group 1035bc03-c814-43fe-bb91-770e352c60db to port a66f0296-a016-4575-9113-6ff92faf51a6 Nov 02 13:31:30.335925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c35ef938-a6fc-4b7c-af46-5b79b4fc00e2 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action" status: 202 len: 0 microversion: 2.1 time: 0.633873 Nov 02 13:31:30.340593 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4049/7788] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:31:29 2022] POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:31:30.353576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:30.359177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:30.360184 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:30.370822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:30.371681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:30.372337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:30.372736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:30.373308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:30.374658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:30.375793 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:30.376411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:30.377924 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:30.396482 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] Creating event network-changed:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:31:30.403305 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-40e1933a-254b-4ff6-925b-8b33795e258d req-d6e18130-93ef-46a7-bd77-7c70fd8057ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061039 Nov 02 13:31:30.404324 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3740/7789] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:30.560021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:30.576551 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80eaa398-4b37-4b0e-b4f4-4f5eefa0a21c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1759 microversion: 2.1 time: 0.231185 Nov 02 13:31:30.577679 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4050/7790] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:30 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1759 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:38.045326 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:38.047704 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:38.056048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.056551 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.056998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.057725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.058186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.058617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.255871 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-347c4e51-e0bb-42d3-a5ed-4ec9a1d7426f tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action" status: 202 len: 0 microversion: 2.1 time: 0.216007 Nov 02 13:31:38.256756 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3741/7791] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:31:38 2022] POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:31:38.265765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:38.266692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:38.274614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.275163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.275623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.276349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.276848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.277292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.472659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:38.484914 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-df2b6d93-7c7c-4276-98a9-f1bb5f188244 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1751 microversion: 2.1 time: 0.223528 Nov 02 13:31:38.485663 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4051/7792] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:38 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:39.512815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:39.512815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:39.518838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.519430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.519869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.520570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.521063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.521498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.794161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:39.806015 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-17ea0670-4766-4bdd-973b-39456a1685a6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.299845 Nov 02 13:31:39.807222 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3742/7793] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:39 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:40.880762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:40.881430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:40.887645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.888146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.888600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.889593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.890074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.890513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:41.045023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:41.054416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-39145223-bd71-43a0-b0b5-7a7e128cc39b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.227684 Nov 02 13:31:41.055056 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4052/7794] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:40 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:42.078053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:42.078709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:42.085856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:42.086394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:42.086816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:42.087575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:42.088061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:42.088501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:42.249987 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:42.259832 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96f1732c-7764-4495-b11a-7a10731c046c tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.185681 Nov 02 13:31:42.260531 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3743/7795] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:42 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:43.284767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:43.285337 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:43.292380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:43.292886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:43.293344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:43.294070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:43.294540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:43.295003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:43.453393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:43.462259 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c454be92-6418-4b7d-a84d-22354d83cf67 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.181534 Nov 02 13:31:43.462859 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4053/7796] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:43 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:44.486269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:44.486933 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:44.497552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:44.498053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:44.498498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:44.499247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:44.499714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:44.500148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:44.657017 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:44.665669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-307ec101-72be-4317-8d52-5b6502140230 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.183445 Nov 02 13:31:44.666253 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3744/7797] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:44 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:45.689472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:45.690113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:45.697282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:45.697785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:45.698278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:45.698966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:45.699461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:45.699901 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:45.870069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:45.884272 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3e1bc200-0862-4193-99b2-ed583ec4b39e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.198686 Nov 02 13:31:45.884897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4054/7798] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:45 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:46.909369 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:46.909979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:46.917268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:46.917764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:46.918216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:46.918937 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:46.919431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:46.919867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:47.080532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:47.090263 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-85ee35be-1fa0-430b-aab1-0567683400e4 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.184879 Nov 02 13:31:47.091099 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3745/7799] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:46 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:48.115400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:48.116321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:48.124816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.125503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.126091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.127078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.127502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.134476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.303747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:48.312956 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b1442486-2e0c-4063-a3f2-37891f6364f5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.201985 Nov 02 13:31:48.313551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4055/7800] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:48 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:49.338243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:49.338885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:49.346669 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:49.347209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:49.347667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:49.348440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:49.348916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:49.349376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:49.547048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:49.559815 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-84c03809-476b-42c9-ab1d-a4d72274a41b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1756 microversion: 2.1 time: 0.225428 Nov 02 13:31:49.560328 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3746/7801] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:49 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:50.585180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:50.585763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:50.593129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:50.593870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:50.594030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:50.594738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:50.595245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:50.595688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:50.749582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:50.758399 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-73134c0f-29c9-443e-ae14-541042036d59 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1759 microversion: 2.1 time: 0.177391 Nov 02 13:31:50.759022 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4056/7802] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:50 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:23.130418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-813967040"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:23.131094 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:23.133530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:23.134199 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:23.140219 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.146313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.146313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.146313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.146313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.146313 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.276311 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.network.security_group_api [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Removing security group 1035bc03-c814-43fe-bb91-770e352c60db from port a66f0296-a016-4575-9113-6ff92faf51a6 Nov 02 13:32:23.658712 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-07ef2f09-d717-47c0-aa5c-279a4f77dd2b tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action" status: 202 len: 0 microversion: 2.1 time: 0.532208 Nov 02 13:32:23.659759 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3747/7803] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:32:23 2022] POST /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:23.670113 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:23.680120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:23.681224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=52 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:23.683621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.684538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.685225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.698770 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] Creating event network-changed:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:32:23.705451 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-be520ec2-8a9f-4959-82c3-16fc9d503735 req-2687c06c-0f3c-4c81-a405-d5f0b8d1016d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039619 Nov 02 13:32:23.707397 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4057/7804] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:24.949918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:24.950512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:24.958159 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:24.964660 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:24.965282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:24.966189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.966642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:24.967309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:24.968271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.968408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:24.968650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:24.969097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.982252 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] Creating event network-changed:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:32:24.988177 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4b043adc-d115-4596-bf8d-b54e620d96a4 req-3356f7db-acb0-4540-acfd-9424e135eb8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Nov 02 13:32:24.988995 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4058/7805] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:25.062517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lazy-loading 'services' on Instance uuid 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:25.329854 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-05cbcd9f-5e3a-4325-b7ec-0efc9d86e6b5 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments/48934f26-be29-4938-bbc6-3f8074d5f416" status: 202 len: 0 microversion: 2.1 time: 0.385693 Nov 02 13:32:25.334241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3748/7806] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:32:24 2022] DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments/48934f26-be29-4938-bbc6-3f8074d5f416 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:25.340310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:25.342684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:25.351304 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:25.351826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:25.352540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:25.353619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:25.353983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:25.354601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:25.386882 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-02673f49-2a97-44aa-b5b4-925eb783cddd tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050964 Nov 02 13:32:25.387852 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4059/7807] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:25 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:26.401844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:26.404416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:26.413848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:26.416131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:26.416708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:26.419902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:26.420393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:26.420835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:26.456870 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6b77557-55d2-42bd-8b77-f29c5fc45681 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060119 Nov 02 13:32:26.457456 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3749/7808] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:26 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:27.470456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:27.472789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:27.481061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.481577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.482048 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.482790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.483299 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.483747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.517850 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6e2d8d2-8ef8-438a-85ff-db8e587830b8 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051628 Nov 02 13:32:27.518382 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4060/7809] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:27 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:28.530067 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:28.532417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:28.539588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.540070 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.540512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.541760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.541760 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.542200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.575376 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7e60414e-72ef-477f-bf98-5c2dec42444e tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049428 Nov 02 13:32:28.575964 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3750/7810] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:28 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:29.589448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:29.591790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:29.598614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.599460 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.600199 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.601640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.602126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.602562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.640931 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d39463ad-0e4b-405f-9fa7-fc7f9258aaa6 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056709 Nov 02 13:32:29.641519 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4061/7811] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:29 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:30.654294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.656593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.667593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.668397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.668855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.669588 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.670048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.670492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.701145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-20debb0a-0b80-4bba-8de6-d4ec63c89916 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050969 Nov 02 13:32:30.701742 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3751/7812] 10.222.0.48 () {58 vars in 1302 bytes} [Wed Nov 2 13:32:30 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:30.714026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.714608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.721600 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.722103 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.722563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.723319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.723796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.724243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.907599 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] HTTP exception thrown: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 is not attached to volume 48934f26-be29-4938-bbc6-3f8074d5f416 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Request method failure captured: Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: request: DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments/48934f26-be29-4938-bbc6-3f8074d5f416 HTTP/1.1 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnAHRzrxygkEYC-GV_qTZMihIMbgcM5Y3ntbvWfoHvt0EdXojObCQ9kGbPrIEQlJVevNML-tXQrji0DtNcDhjPWTe0FUf8bTS00GWfzSaxqiD6sJV5uH7Zu5bim3Nj5fJtHSaIRDMjGl0wZG7zqz45w4lOIftZZsbIGTtKfo3FdoTJc Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_789f7e293a4f477392effa85f9f6c44b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d4136aa2d1d9487dbf329a94a5cea9c1 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 is not attached to volume 48934f26-be29-4938-bbc6-3f8074d5f416 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'server_id': '9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0', 'id': '48934f26-be29-4938-bbc6-3f8074d5f416'} Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 48934f26-be29-4938-bbc6-3f8074d5f416. Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 is not attached to volume 48934f26-be29-4938-bbc6-3f8074d5f416 Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:30.909156 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 is not attached to volume 48934f26-be29-4938-bbc6-3f8074d5f416 Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Returning 404 to user: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 is not attached to volume 48934f26-be29-4938-bbc6-3f8074d5f416 {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ec36a9f-9c05-4ba7-8de4-7b962e9c4328 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments/48934f26-be29-4938-bbc6-3f8074d5f416" status: 404 len: 154 microversion: 2.1 time: 0.201866 Nov 02 13:32:30.914647 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4062/7813] 10.222.0.48 () {58 vars in 1416 bytes} [Wed Nov 2 13:32:30 2022] DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0/os-volume_attachments/48934f26-be29-4938-bbc6-3f8074d5f416 => generated 154 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:34.312912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:34.313885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:34.321404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.321948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.322612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.325829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.325829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.325829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.356508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:34.689632 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bc07219d-5ab6-4846-9308-17489bd1a849 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 204 len: 0 microversion: 2.1 time: 0.380879 Nov 02 13:32:34.690241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3752/7814] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:32:34 2022] DELETE /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:34.705333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:34.705956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:34.713682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.714179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.714624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.715369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.715824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.718917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.858390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:34.867331 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e3a65571-9f36-4d4f-be87-5392570dab61 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1554 microversion: 2.1 time: 0.166195 Nov 02 13:32:34.867931 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4063/7815] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:34 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:35.891863 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:35.892580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:35.899708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.900203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.900647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.901361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.901827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.902261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.038004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:36.045896 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2eed32f-e1d1-4622-aea4-09285bfb1859 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1554 microversion: 2.1 time: 0.158741 Nov 02 13:32:36.046479 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3753/7816] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:35 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:36.981087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0", "name": "network-vif-deleted", "tag": "a66f0296-a016-4575-9113-6ff92faf51a6"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:36.991753 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.992255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.992707 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.004618 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] Creating event network-vif-deleted:a66f0296-a016-4575-9113-6ff92faf51a6 for instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 on n-h1-855649-4 Nov 02 13:32:37.010494 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-4fc7ee68-624f-4f6c-a163-dcf5e8ca803e req-a52deaf2-647c-427a-89ef-3f13272d95a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033259 Nov 02 13:32:37.011121 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4064/7817] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:37.070571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:37.071197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:37.078567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.079203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.079648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.080358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.080819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.081246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.148173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4136aa2d1d9487dbf329a94a5cea9c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f7e293a4f477392effa85f9f6c44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.156404 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-720b7905-9165-4876-818a-3d856e4a18bb tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 200 len: 1512 microversion: 2.1 time: 0.090487 Nov 02 13:32:37.156995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3754/7818] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:37 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:38.181963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.182716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] [instance: 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:38.189253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.189803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.190206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.190915 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.191408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.191847 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.206213 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] HTTP exception thrown: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Request method failure captured: Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 HTTP/1.1 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnAHRzrxygkEYC-GV_qTZMihIMbgcM5Y3ntbvWfoHvt0EdXojObCQ9kGbPrIEQlJVevNML-tXQrji0DtNcDhjPWTe0FUf8bTS00GWfzSaxqiD6sJV5uH7Zu5bim3Nj5fJtHSaIRDMjGl0wZG7zqz45w4lOIftZZsbIGTtKfo3FdoTJc Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_789f7e293a4f477392effa85f9f6c44b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/789f7e293a4f477392effa85f9f6c44b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 789f7e293a4f477392effa85f9f6c44b Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-514740320 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: d4136aa2d1d9487dbf329a94a5cea9c1 Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestMinimumBasicScenario-514740320-project Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0'} Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:38.207918 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Returning 404 to user: Instance 9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b761d81-5976-4309-83d0-4d6ca7433985 tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0" status: 404 len: 111 microversion: 2.1 time: 0.032671 Nov 02 13:32:38.213923 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4065/7819] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:32:38 2022] GET /compute/v2.1/servers/9a94a6b9-7c6e-432e-9b9a-28d240f0ddf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:38.218904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6a0f9515-4167-4818-87e6-eb51d61dff0d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] Calling method '.version_select at 0x7ff1bbb11160>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.342356 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6a0f9515-4167-4818-87e6-eb51d61dff0d tempest-TestMinimumBasicScenario-514740320 tempest-TestMinimumBasicScenario-514740320-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1749638486" status: 202 len: 0 microversion: 2.1 time: 0.127450 Nov 02 13:32:38.343011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3755/7820] 10.222.0.48 () {58 vars in 1272 bytes} [Wed Nov 2 13:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1749638486 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:51.258379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:51.259164 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=38 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:51.423905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8dc00cfe-22e9-4ed4-a933-63f47e20a490 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: .version_select at 0x7ff1b26d53a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1057470104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLxcxFisu/Q2sOl85cGJ6C0GTA3LD3ZMwtTjG4oV/72nbtPVmRDF6o3aBmN7MS7BceD8QHAuHfUWr9yLL5PLpUg/BoKrAfSg2kV1wsw2jH4R0VChF1Zp7DWrP9fa2RfzQ=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:51.441017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8dc00cfe-22e9-4ed4-a933-63f47e20a490 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:51.446514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8dc00cfe-22e9-4ed4-a933-63f47e20a490 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:51.531006 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8dc00cfe-22e9-4ed4-a933-63f47e20a490 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.278472 Nov 02 13:32:51.531622 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4066/7821] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:32:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:01.027390 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1075063157", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "4d2ec2fa-fe0f-49d9-bd7a-16180b6dffa1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1057470104", "security_groups": [{"name": "tempest-secgroup-smoke-1608259153"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:01.041208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:01.042967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:01.163332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] validate_networks() for [('4d2ec2fa-fe0f-49d9-bd7a-16180b6dffa1', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:33:01.636693 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:01.637144 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:01.637637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:01.638620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:01.639318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:01.649735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.650238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.650828 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.652013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.652492 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.653243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.677052 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:01.683085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:01.699992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:01.702456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:01.835883 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5cfd49fd-4882-49c1-9fc9-45558c42c979 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813026 Nov 02 13:33:01.836870 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3756/7822] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:33:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:33:01.848095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:01.848733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:01.852676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-56aac48f-fa20-4362-9a62-2c5961f24ce3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:01.853319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-56aac48f-fa20-4362-9a62-2c5961f24ce3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:01.922166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-56aac48f-fa20-4362-9a62-2c5961f24ce3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:01.934606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-56aac48f-fa20-4362-9a62-2c5961f24ce3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1267 microversion: 2.1 time: 0.088506 Nov 02 13:33:01.947861 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4067/7823] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:01 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:02.958879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cade2d83-a491-4308-8d05-76896749b70a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:02.960213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cade2d83-a491-4308-8d05-76896749b70a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:03.021408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cade2d83-a491-4308-8d05-76896749b70a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:03.028946 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cade2d83-a491-4308-8d05-76896749b70a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1267 microversion: 2.1 time: 0.074885 Nov 02 13:33:03.029551 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3757/7824] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:04.053077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:04.053739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:04.062182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.062705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.063240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.063978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.064459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.064908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.131005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:04.140632 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-532b35b8-24e6-4171-92fa-75691e844e43 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1319 microversion: 2.1 time: 0.091841 Nov 02 13:33:04.141269 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4068/7825] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:04 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:05.164575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.165200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:05.172811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.173304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.173754 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.174476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.174951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.175421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.240350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:05.250618 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe2460a3-38a9-4d66-9f25-a2abbf020f52 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1325 microversion: 2.1 time: 0.088792 Nov 02 13:33:05.257125 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3758/7826] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1325 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:06.273802 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.274607 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.282568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.283250 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.283785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.284648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.285091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.285569 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.362870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24adef95-9b70-4140-b0f0-c389bd8d1789", "tag": "f94a5db7-184b-4caa-8bfe-4a0d1801d084"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:06.373961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.374514 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.374851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.387987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] Creating event network-changed:f94a5db7-184b-4caa-8bfe-4a0d1801d084 for instance 24adef95-9b70-4140-b0f0-c389bd8d1789 on n-h1-855649-4 Nov 02 13:33:06.397805 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2bd75325-7fa8-48f1-9214-36ed35c535b6 req-d51707b4-c1e2-4a0c-a780-4b987e21a9d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034854 Nov 02 13:33:06.398473 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3759/7827] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:06.447923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:06.465188 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-81a0cffd-ac69-4c4e-812e-e658e3177cfe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.192634 Nov 02 13:33:06.477631 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4069/7828] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:07.492938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:07.493689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:07.501081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.501568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.502063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.502785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.503320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.503806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.648807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:07.657226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d43502bd-ace9-445d-a46b-580a8a0b2999 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.169556 Nov 02 13:33:07.657809 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3760/7829] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:07 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:08.681066 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.681723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:08.689158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.689660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.690116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.690838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.691339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.691889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.836367 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:08.844933 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f2d1e3b9-77e7-4a82-a10a-eadc5ed31332 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.167819 Nov 02 13:33:08.845535 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4070/7830] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:09.868021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.868691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:09.876200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.876685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.877127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.877835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.878294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.878726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.014896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:10.022789 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c124745a-8c5d-4723-a39a-1e66e54c9368 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.158802 Nov 02 13:33:10.023480 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3761/7831] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:11.047117 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:11.047750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:11.054642 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.055169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.055630 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.056354 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.056827 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.057274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.192333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:11.200991 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-023b9b22-c45e-4d93-b482-2022b9c76e49 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.157737 Nov 02 13:33:11.201602 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4071/7832] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:11 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:12.225105 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.225725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:12.228547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:12.234257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.234741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.235213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.236137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.236707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.237138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.387423 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:12.398578 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-00f140d3-ed5b-4e7a-a0fd-ce748c838f36 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.177135 Nov 02 13:33:12.399142 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3762/7833] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:12 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:13.423916 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:13.424562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:13.426448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:13.432158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.432660 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.433107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.433811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.434274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.434712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.576252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.584255 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-06f9e227-dcc0-4916-9d07-e5271c8b959b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.164233 Nov 02 13:33:13.584858 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4072/7834] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:13 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:13.607263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:13.667841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24adef95-9b70-4140-b0f0-c389bd8d1789", "name": "network-vif-plugged", "status": "completed", "tag": "f94a5db7-184b-4caa-8bfe-4a0d1801d084"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:13.677832 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.678332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.678787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.691401 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] Creating event network-vif-plugged:f94a5db7-184b-4caa-8bfe-4a0d1801d084 for instance 24adef95-9b70-4140-b0f0-c389bd8d1789 on n-h1-855649-4 Nov 02 13:33:13.696461 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c87069ef-3e3d-4fbf-a8ff-cec4b0657aa2 req-7552e17c-91c9-489d-a50d-3b8c7a45aff3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094484 Nov 02 13:33:13.697126 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3763/7835] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:14.608406 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:14.608992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:14.616583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.617082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.617534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.618242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.618702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.619175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.752096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:14.759961 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e4fdda67-ea88-4909-adf0-b7230372af0a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1393 microversion: 2.1 time: 0.155758 Nov 02 13:33:14.760541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4073/7836] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:14 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:15.785706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.786446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.793294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.793781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.794225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.794932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.795421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.795855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.936382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:15.944334 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8bf2d563-937a-4fda-a266-ba78ba25523b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1566 microversion: 2.1 time: 0.163822 Nov 02 13:33:15.944920 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3764/7837] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:15.967984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.968737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.975754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.976255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.976708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.977414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.977884 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.978355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:16.115380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:16.123620 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d9fa6344-f353-4326-9e15-522ee5f57544 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1566 microversion: 2.1 time: 0.160242 Nov 02 13:33:16.124211 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4074/7838] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:18.519164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:18.519882 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:18.522488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24adef95-9b70-4140-b0f0-c389bd8d1789", "tag": "f94a5db7-184b-4caa-8bfe-4a0d1801d084"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:18.527816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.528397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.528993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.529794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.530331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.530836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.535269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.535759 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.536470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.549572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] Creating event network-changed:f94a5db7-184b-4caa-8bfe-4a0d1801d084 for instance 24adef95-9b70-4140-b0f0-c389bd8d1789 on n-h1-855649-4 Nov 02 13:33:18.555069 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6d4855c4-fee3-4314-a136-79a51a81a1a3 req-83729b36-effe-4653-ac90-72fafde171b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Nov 02 13:33:18.558844 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4075/7839] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:18.767689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:18.778429 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-284ba558-b032-481e-90de-5f0559d5453c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1566 microversion: 2.1 time: 0.263659 Nov 02 13:33:18.779305 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3765/7840] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:18 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1566 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:40.104504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:40.105293 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:40.109686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:40.115226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:40.119162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:40.119673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:40.120132 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:40.120858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:40.121333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:40.121780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:40.179953 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-585d03ce-92be-4964-a0b5-7b311b18aa98 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action" status: 200 len: 24574 microversion: 2.1 time: 0.077204 Nov 02 13:33:40.180685 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4076/7841] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:33:40 2022] POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action => generated 24574 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:46.622480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:46.623192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:46.625617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:46.626300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=42 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:46.631272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.631769 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.632227 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.632943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.633393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.633822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.886595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-874ae002-f5c7-478b-8178-5239b38d381d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action" status: 202 len: 0 microversion: 2.1 time: 0.267735 Nov 02 13:33:46.887184 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3766/7842] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:33:46 2022] POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:46.896891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:46.897646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:46.906158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.906668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.907166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.907898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.908378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.908830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:47.047411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:47.055576 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-95bf84df-ec68-4a34-b54c-bc79419cf082 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1690 microversion: 2.1 time: 0.163329 Nov 02 13:33:47.056091 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4077/7843] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:46 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:48.080857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:48.081575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:48.087891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.088385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.088844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.089537 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.089996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.090430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.230300 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:48.238466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-43d69999-a053-4938-b2a7-5b3a5da39571 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1670 microversion: 2.1 time: 0.162952 Nov 02 13:33:48.239078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3767/7844] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:48 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:49.344067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:49.346302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.354582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.354949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.355431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.356182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.356650 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.357092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.408168 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-33877cc9-aaf0-49cd-82b2-a5db23af24df tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action" status: 200 len: 32649 microversion: 2.1 time: 0.068273 Nov 02 13:33:49.408841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4078/7845] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:33:49 2022] POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action => generated 32649 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:49.421267 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:49.421883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.429813 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.430309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.430753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.431500 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.431953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.432383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.684434 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9f28f42-2e2a-45f1-a81c-c4367f263bbf tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action" status: 202 len: 0 microversion: 2.1 time: 0.266919 Nov 02 13:33:49.685116 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3768/7846] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:33:49 2022] POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:49.694185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.694934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.703580 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.704096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.704559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.705302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.705787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.706253 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.849430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:49.857971 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b073152f-e958-4da3-b202-cfdf21247963 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1677 microversion: 2.1 time: 0.168146 Nov 02 13:33:49.867071 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4079/7847] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:49 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:50.883640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:50.884357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:50.891004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.891532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.891972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.892679 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.893140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.893576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.035416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:51.043967 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d264f59-3156-49da-ad71-71e889123de8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1685 microversion: 2.1 time: 0.166120 Nov 02 13:33:51.044555 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3769/7848] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:50 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:51.143021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:51.145224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:51.153270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.153775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.154233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.154967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:51.155459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:51.155898 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.207206 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-676f976a-63b4-447a-bdca-45c4806aad8f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action" status: 200 len: 36503 microversion: 2.1 time: 0.068165 Nov 02 13:33:51.207880 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4080/7849] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:33:51 2022] POST /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789/action => generated 36503 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:33:52.384410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:52.384967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:52.389825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24adef95-9b70-4140-b0f0-c389bd8d1789", "tag": "f94a5db7-184b-4caa-8bfe-4a0d1801d084"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:52.392804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.393295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.393735 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.394443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.394898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.395606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.402219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.402995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.403467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.415836 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] Creating event network-changed:f94a5db7-184b-4caa-8bfe-4a0d1801d084 for instance 24adef95-9b70-4140-b0f0-c389bd8d1789 on n-h1-855649-4 Nov 02 13:33:52.421737 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-775687cc-cae3-4010-b105-9760a212b403 req-5ba4c9b5-5201-422c-942c-d462c3f390d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036483 Nov 02 13:33:52.422564 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4081/7850] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:52.427925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:52.752333 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9054716e-260e-469c-a68f-1bb891b5d861 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 204 len: 0 microversion: 2.1 time: 0.371947 Nov 02 13:33:52.752861 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3770/7851] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:33:52 2022] DELETE /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:52.768868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:52.768868 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:52.771350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.771972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.772560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.773383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.773929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.774675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.932629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:52.941176 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0498c6e1-9f9b-4414-90d9-64a2c70752ca tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1691 microversion: 2.1 time: 0.182916 Nov 02 13:33:52.942364 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4082/7852] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:52 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:53.967871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:53.968499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:53.976021 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:53.976515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:53.976962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:53.977675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:53.978135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:53.978567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:54.196546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.205034 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cdf16ee-0aee-4ac1-923a-d9f78fb39857 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1691 microversion: 2.1 time: 0.241616 Nov 02 13:33:54.205743 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3771/7853] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:53 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:54.943801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24adef95-9b70-4140-b0f0-c389bd8d1789", "name": "network-vif-deleted", "tag": "f94a5db7-184b-4caa-8bfe-4a0d1801d084"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:54.954291 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:54.956454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:54.956454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:54.970629 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] Creating event network-vif-deleted:f94a5db7-184b-4caa-8bfe-4a0d1801d084 for instance 24adef95-9b70-4140-b0f0-c389bd8d1789 on n-h1-855649-4 Nov 02 13:33:54.976390 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-20fb4490-21be-4b78-825c-c6c34911360a req-910fb30c-003d-40c8-8fec-d738ca5cd572 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Nov 02 13:33:54.977039 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4083/7854] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:55.229814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.230440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.238411 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.239079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.239624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.241132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.241706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.242260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.279090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.279707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.280063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.280524 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lazy-loading 'fault' on Instance uuid 24adef95-9b70-4140-b0f0-c389bd8d1789 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:55.327822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:55.336780 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7637298b-2cf1-4250-9a7b-d7e9ae2b4164 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 200 len: 1357 microversion: 2.1 time: 0.111262 Nov 02 13:33:55.337793 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3772/7855] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 1357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:56.360994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:56.362141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 24adef95-9b70-4140-b0f0-c389bd8d1789] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:56.369067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:56.369550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:56.370011 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:56.370739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:56.371292 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:56.371747 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:56.386626 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] HTTP exception thrown: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Request method failure captured: Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 HTTP/1.1 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnGCmhHHeEa5edewNdrBm-Ml4j7CZ86tsInqrZ_02u7_P7i_Acx9w9HRvapQYEGgZs7XqBYOlAD2OjI4BkR8X3eMhrfJHDF0lqL8Y48-giABr1iX9X33FkgZjTf2Cx6BHGl6JdAUiWBidvFWi8eOQH-t3jYaEwhtJTWJvTf6t0Vp3qs Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc1a0a3d0dd24bdead6edbede9d003d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7563337be85c4779beff3350ad1e1f23 Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '24adef95-9b70-4140-b0f0-c389bd8d1789'} Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:33:56.388639 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Returning 404 to user: Instance 24adef95-9b70-4140-b0f0-c389bd8d1789 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dfc14bee-cc99-45f6-aa93-d5e061cd0b0f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789" status: 404 len: 111 microversion: 2.1 time: 0.033470 Nov 02 13:33:56.394248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4084/7856] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:33:56 2022] GET /compute/v2.1/servers/24adef95-9b70-4140-b0f0-c389bd8d1789 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:34:00.773297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9667f1a-b32a-45a4-b772-ffe84744c917 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '.version_select at 0x7ff1b344d040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:00.867041 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9667f1a-b32a-45a4-b772-ffe84744c917 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1057470104" status: 202 len: 0 microversion: 2.1 time: 0.097951 Nov 02 13:34:00.867796 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3773/7857] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 13:34:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1057470104 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:34:00.897371 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42ebc3b9-08e5-4662-a9da-3b7a423a4eed tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: .version_select at 0x7ff1b2c35d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1937368720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXF5Lv1JLinbYnIU7vpshuCYBRXODGbNdHCv4+6ylIf++JAWp9C4kRcUtTw6F30WRo1A7KQ43pgc6KxGDNrC6Vh9ncdG8EErdPJCdIIFkkDDCfnQxlLTEiGkLEwDlF/Ag=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:00.913459 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-42ebc3b9-08e5-4662-a9da-3b7a423a4eed tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:00.918833 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-42ebc3b9-08e5-4662-a9da-3b7a423a4eed tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:01.073263 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42ebc3b9-08e5-4662-a9da-3b7a423a4eed tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.180274 Nov 02 13:34:01.073823 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4085/7858] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:34:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:10.661599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-847508780", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "972ed572-a279-4836-8854-c428160610ad"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1937368720", "security_groups": [{"name": "tempest-secgroup-smoke-438774342"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:10.689572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:10.817644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] validate_networks() for [('972ed572-a279-4836-8854-c428160610ad', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:11.277416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:11.277850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:11.278473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:11.278971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:11.279452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:11.290274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:11.290772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:11.291261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:11.292028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:11.292490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:11.292922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:11.314609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:11.321279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:11.335143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:11.338337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:11.468464 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f050e20b-89a7-4181-8ec2-30c7cbf18b45 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.810619 Nov 02 13:34:11.469137 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3774/7859] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:34:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:34:11.479738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:11.481033 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:34:11.481184 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 (ip 10.222.0.48) !!! Nov 02 13:34:11.482141 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:11.482823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:11.487069 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b09738cf-aff0-4cc9-aad0-45cd989be97b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:11.488762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b09738cf-aff0-4cc9-aad0-45cd989be97b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:11.549794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b09738cf-aff0-4cc9-aad0-45cd989be97b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:11.557960 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b09738cf-aff0-4cc9-aad0-45cd989be97b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1266 microversion: 2.1 time: 0.080608 Nov 02 13:34:11.559423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4086/7860] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:11 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:12.585773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6f86757d-ea88-4bca-b3bd-db64c091dcd2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:12.585773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6f86757d-ea88-4bca-b3bd-db64c091dcd2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:12.641762 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6f86757d-ea88-4bca-b3bd-db64c091dcd2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:12.649437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6f86757d-ea88-4bca-b3bd-db64c091dcd2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1266 microversion: 2.1 time: 0.071487 Nov 02 13:34:12.650036 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3775/7861] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:12 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:13.673576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:13.674277 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:13.682574 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.683104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.683561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.684855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.684855 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.685167 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.755420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:13.764416 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f4537105-8ae6-4a41-bef8-10a57e8a763d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1318 microversion: 2.1 time: 0.095123 Nov 02 13:34:13.765060 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4087/7862] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:13 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:14.787997 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.788661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:14.796214 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:14.796715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:14.797593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:14.798609 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:14.799106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:14.799601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:14.999447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:15.007825 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9810567a-dbda-4ac6-994f-0aa51ec5553c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.223681 Nov 02 13:34:15.008417 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3776/7863] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:15.861769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ddede6-278a-4eb9-a493-635122963253", "tag": "9ef15199-0020-4a57-ab9c-a6d0e9b5d37d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:15.873330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:15.873829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:15.874295 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:15.885736 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] Creating event network-changed:9ef15199-0020-4a57-ab9c-a6d0e9b5d37d for instance 19ddede6-278a-4eb9-a493-635122963253 on n-h2-855649-4 Nov 02 13:34:15.891415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-abd9ff6c-ddb0-4981-9cfd-159958e70038 req-c72b51aa-6b0a-4dfd-a5c7-5f9871eaee77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033817 Nov 02 13:34:15.891748 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4088/7864] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:16.033786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:16.034420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:16.042574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:16.043344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:16.044126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:16.045010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:16.045485 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:16.045931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:16.267512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:16.276447 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbd7b574-126f-435a-b71f-2e077ed0d16a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.247753 Nov 02 13:34:16.277060 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3777/7865] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:16 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:17.302149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:17.303464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:17.309873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.310377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.310832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.311584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.312056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.312501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.448504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:17.456388 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03ef3fa2-348c-4b43-9e55-ec73094b3093 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.159390 Nov 02 13:34:17.456982 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4089/7866] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:17 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:18.480630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:18.481250 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:18.483936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:18.488713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.489194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.497028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.497028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.497028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.497028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.628732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:18.637143 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-48b8476b-63cb-4bac-af6f-c7bfab81372f tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.160444 Nov 02 13:34:18.637989 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3778/7867] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:18 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:19.660430 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:19.661254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:19.668495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.669018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.669468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.670177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.670644 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.671120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.808457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:19.816518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-96537595-88be-4e6f-9215-213effb60744 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.160054 Nov 02 13:34:19.817102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4090/7868] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:19 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:20.840633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:20.841295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:20.848615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.849600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.850039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.850774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.851228 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.851671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.993573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:21.001365 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4989ffbe-0aea-4049-9520-aab1db22c845 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.164696 Nov 02 13:34:21.001943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3779/7869] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:20 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:21.645345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ddede6-278a-4eb9-a493-635122963253", "name": "network-vif-plugged", "status": "completed", "tag": "9ef15199-0020-4a57-ab9c-a6d0e9b5d37d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:21.655929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:21.656475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:21.656927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:21.669056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] Creating event network-vif-plugged:9ef15199-0020-4a57-ab9c-a6d0e9b5d37d for instance 19ddede6-278a-4eb9-a493-635122963253 on n-h2-855649-4 Nov 02 13:34:21.674410 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-94a823f2-f42a-423f-9415-af1974937be9 req-6fe03aff-6869-419d-a346-4630d23dcae3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Nov 02 13:34:21.675126 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4091/7870] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:22.025974 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:22.026574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:22.028469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:22.035747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.036237 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.037301 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.038058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.038513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.038965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.195806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:22.204406 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b3c58c00-2d46-4b02-b965-7aabe0f04d6c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.182429 Nov 02 13:34:22.205029 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3780/7871] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:22 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:23.229890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:23.230534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:23.237115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.237622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.238081 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:23.238803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.239315 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.240341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:23.385828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:23.394179 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f2d9b10-f18f-4db2-95b9-66a355a2341c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1391 microversion: 2.1 time: 0.170162 Nov 02 13:34:23.394784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4092/7872] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:23 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:24.421188 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:24.422230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:24.425246 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:24.436695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.441629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.441629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.441629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.441629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.441629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.585951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:24.594348 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-93967515-2238-4acd-a1f4-7b0fa82b25f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1562 microversion: 2.1 time: 0.180291 Nov 02 13:34:24.594935 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3781/7873] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:24 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1562 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:24.618196 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:24.618832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:24.620858 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:24.626736 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.633626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.633626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.633626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.633626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.633626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.768456 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:24.777379 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-07748dd5-dd83-4ec6-ae68-dbce23bd9838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1562 microversion: 2.1 time: 0.163699 Nov 02 13:34:24.777963 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4093/7874] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:24 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:26.866848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:26.867532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:26.875469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.876556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.876556 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.877161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.877744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.878263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.960121 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ddede6-278a-4eb9-a493-635122963253", "tag": "9ef15199-0020-4a57-ab9c-a6d0e9b5d37d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.975943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.975943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.975943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.989250 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] Creating event network-changed:9ef15199-0020-4a57-ab9c-a6d0e9b5d37d for instance 19ddede6-278a-4eb9-a493-635122963253 on n-h2-855649-4 Nov 02 13:34:26.995913 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-72596861-7597-409c-a1b4-ad4ec8f9cd60 req-11fe34a0-f168-46f0-aee7-e456e268403e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126512 Nov 02 13:34:26.997057 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4094/7875] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:34:27.062540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:27.071330 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-34ec3f06-aad7-47c3-bc19-da540b9a62ac tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1562 microversion: 2.1 time: 0.209247 Nov 02 13:34:27.071936 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3782/7876] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:34:26 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1562 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:04.424180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=20 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:04.424988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=36 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:04.429351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:04.432210 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:04.439093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.442752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.442752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:04.442752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.442752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.442752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:04.495784 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d4968b0-7e13-4bc5-80b2-f081f2a2fa84 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action" status: 200 len: 24573 microversion: 2.1 time: 0.073460 Nov 02 13:35:04.496549 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4095/7877] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:35:04 2022] POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:35:43.452270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=9 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:43.453040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=44 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:43.457678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:43.460110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:43.466323 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.466817 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.467298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.468051 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.468504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.469573 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.677357 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-64e5c062-6c4c-465b-a2df-40d1ac02a583 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action" status: 202 len: 0 microversion: 2.1 time: 0.226909 Nov 02 13:35:43.678902 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3783/7878] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:35:43 2022] POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:35:43.687001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:43.688317 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:43.691316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:43.696876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.697398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.697854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.698572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.699078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.699523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.842136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:43.850270 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-edb46042-243d-4c8f-80d4-c5799c8d5d5a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1672 microversion: 2.1 time: 0.167642 Nov 02 13:35:43.851081 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4096/7879] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:43 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:44.876919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:44.877629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:44.884072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:44.884536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:44.884990 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:44.885697 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:44.886434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:44.886871 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:45.162923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:45.170869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94a76441-003b-40d2-8d26-dbdefc9c1638 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.299274 Nov 02 13:35:45.171479 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3784/7880] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:44 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:46.194680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:46.195404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:46.202509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:46.203056 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:46.204033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:46.204750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:46.205224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:46.205666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:46.343532 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:46.353293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ab0d569-fd32-4e96-bc84-44346736f127 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.162040 Nov 02 13:35:46.353293 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4097/7881] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:46 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:47.376187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:47.378718 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:47.385898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.386653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.387133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.387884 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.388490 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.388929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.523431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:47.531369 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4815df8-6691-4b51-aa55-d0af324b7cf5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.159428 Nov 02 13:35:47.532496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3785/7882] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:47 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:48.556368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:48.556940 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:48.564722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:48.565248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:48.565712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:48.566450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:48.566922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:48.567393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:48.707089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:48.715351 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-80a793c1-78eb-4ec6-918b-045a614aa090 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.162971 Nov 02 13:35:48.715952 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4098/7883] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:48 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:49.738543 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.739204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:49.746522 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:49.747793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:49.748253 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.749348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:49.749819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:49.750252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.888401 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:49.896687 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9dfc014-fc3c-4e7a-a7d8-6d9d6f40ed7b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.162210 Nov 02 13:35:49.897272 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3786/7884] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:50.920801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:50.921446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:50.928322 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.928822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.929281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:50.930002 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.930464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.930908 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:51.075557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:51.084111 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a6248ec2-a192-4f0d-991a-34ce053eb1a7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.167240 Nov 02 13:35:51.084699 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4099/7885] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:50 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:52.107488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:52.108179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:52.117269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.117752 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.118192 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:52.118899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.119383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.119819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:52.264259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:52.272822 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4461467c-8cbe-41a5-b713-f228441f7416 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.169385 Nov 02 13:35:52.273401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3787/7886] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:52 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:53.297407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:53.297958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:53.306391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:53.306890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:53.307372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:53.308085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:53.308552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:53.308991 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:53.443165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:53.450942 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-03826903-8ddc-4a7e-9f30-3ce4492ac112 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.157554 Nov 02 13:35:53.451538 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4100/7887] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:53 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:54.474649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.475276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:54.482691 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.483222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.483672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.484385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.484849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.485318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.621542 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:54.629775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42349076-0413-4604-95e3-7ad79f408162 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1677 microversion: 2.1 time: 0.159602 Nov 02 13:35:54.630367 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3788/7888] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:55.654688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:55.655342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:55.662773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.663332 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.663776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:55.664493 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.664960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.665395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:55.799275 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:55.807875 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-005da701-1687-4e6d-aff8-8c211f21e1a1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1680 microversion: 2.1 time: 0.157444 Nov 02 13:35:55.808480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4101/7889] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:35:55 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:32.052626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:32.054938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:32.057356 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:32.058042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:32.062992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:32.063498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:32.063938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.064637 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:32.065091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:32.066110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.129720 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-96fc79d1-58fe-46dc-94d4-3a839e67e514 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action" status: 200 len: 69087 microversion: 2.1 time: 0.081646 Nov 02 13:36:32.130551 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3789/7890] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:36:32 2022] POST /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253/action => generated 69087 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:36:55.866709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:55.868171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:55.869205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:55.877519 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:55.879813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=40 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:55.882852 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:55.883801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:55.887376 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:55.888185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:55.888679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:55.889158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:55.918692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:36:55.952647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ddede6-278a-4eb9-a493-635122963253", "tag": "9ef15199-0020-4a57-ab9c-a6d0e9b5d37d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:55.970177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:55.970862 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:55.971527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:55.984240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] Creating event network-changed:9ef15199-0020-4a57-ab9c-a6d0e9b5d37d for instance 19ddede6-278a-4eb9-a493-635122963253 on n-h2-855649-4 Nov 02 13:36:55.990766 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-8b942a33-4c23-438c-9263-8f6e017cdb66 req-389f7bef-eea5-4f35-8ae3-9830f2f31355 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126234 Nov 02 13:36:55.991688 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3790/7891] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:56.321470 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7a084cd7-38a8-4e10-8c27-0c4cfc6fb392 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 204 len: 0 microversion: 2.1 time: 0.459979 Nov 02 13:36:56.324263 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4102/7892] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:36:55 2022] DELETE /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:36:56.331809 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:56.332523 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:56.339590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:56.347908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:56.347908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:56.347908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:56.347908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:56.347908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:56.512429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:56.520587 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7a5252d4-7d9e-4d2c-a129-3c4795c0d157 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1686 microversion: 2.1 time: 0.193554 Nov 02 13:36:56.521178 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3791/7893] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:36:56 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:57.546848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:57.547690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:57.555952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:57.556423 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:57.557096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:57.558144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:57.558662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:57.559174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:57.718040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:57.728193 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e2147c71-fc25-4b32-ac14-3d90691c88e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1686 microversion: 2.1 time: 0.185655 Nov 02 13:36:57.729005 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4103/7894] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:36:57 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:58.680822 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ddede6-278a-4eb9-a493-635122963253", "name": "network-vif-deleted", "tag": "9ef15199-0020-4a57-ab9c-a6d0e9b5d37d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:58.693713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:58.694198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:58.694685 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:58.707595 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] Creating event network-vif-deleted:9ef15199-0020-4a57-ab9c-a6d0e9b5d37d for instance 19ddede6-278a-4eb9-a493-635122963253 on n-h2-855649-4 Nov 02 13:36:58.713073 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d4ec3b6b-faf1-42cf-84ef-1a068ac982d9 req-49c5fc6d-e484-4569-984a-40bf36ae5d03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036582 Nov 02 13:36:58.713690 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3792/7895] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:58.754704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:58.755472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:58.762472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:58.763119 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:58.763694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:58.764434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:58.764913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:58.765362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:58.847104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:58.855574 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ebf4095e-9197-44f8-a293-c6ee24561f79 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 200 len: 1501 microversion: 2.1 time: 0.105910 Nov 02 13:36:58.856176 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4104/7896] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:36:58 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 1501 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:59.882121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:59.882820 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 19ddede6-278a-4eb9-a493-635122963253] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:59.889805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:59.890351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:59.890741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:59.891594 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:59.892054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:59.892494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:59.907078 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] HTTP exception thrown: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Request method failure captured: Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 HTTP/1.1 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYnGCmhHHeEa5edewNdrBm-Ml4j7CZ86tsInqrZ_02u7_P7i_Acx9w9HRvapQYEGgZs7XqBYOlAD2OjI4BkR8X3eMhrfJHDF0lqL8Y48-giABr1iX9X33FkgZjTf2Cx6BHGl6JdAUiWBidvFWi8eOQH-t3jYaEwhtJTWJvTf6t0Vp3qs Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc1a0a3d0dd24bdead6edbede9d003d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7563337be85c4779beff3350ad1e1f23 Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '19ddede6-278a-4eb9-a493-635122963253'} Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:36:59.908763 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Returning 404 to user: Instance 19ddede6-278a-4eb9-a493-635122963253 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3c7d7016-ae20-4eda-a9d6-731c81dd322d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253" status: 404 len: 111 microversion: 2.1 time: 0.034709 Nov 02 13:36:59.920978 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3793/7897] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:36:59 2022] GET /compute/v2.1/servers/19ddede6-278a-4eb9-a493-635122963253 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:37:04.030659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-16fdfb13-8a57-4d7c-91a0-0d38947d9d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '.version_select at 0x7ff1b3854550>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:04.161120 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-16fdfb13-8a57-4d7c-91a0-0d38947d9d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1937368720" status: 202 len: 0 microversion: 2.1 time: 0.134487 Nov 02 13:37:04.161739 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4105/7898] 10.222.0.48 () {58 vars in 1284 bytes} [Wed Nov 2 13:37:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1937368720 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:37:04.195272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c00418d8-5b2f-446d-8eb9-ae7780243650 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: .version_select at 0x7ff1b32a5700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-136855611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOzpVGx+GVrixltX6Nlw9QoFBU29aOvyMcVYVO4KElBk1z87wMfeqPfaN0wPLz+jaVyALP+2mwKp3sGLyL9WhHh6ro9ZIUtEVUMRp57D/91DZwVrd8VbSXAM1JlJi4bQQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:04.214362 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c00418d8-5b2f-446d-8eb9-ae7780243650 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:04.219600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-c00418d8-5b2f-446d-8eb9-ae7780243650 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:04.315025 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c00418d8-5b2f-446d-8eb9-ae7780243650 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.123966 Nov 02 13:37:04.315651 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3794/7899] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:37:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:13.472279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:13.477179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1182891360", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "53dbd3e1-0be4-4fa7-b91f-625810b75cbb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-136855611", "security_groups": [{"name": "tempest-secgroup-smoke-528674261"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:13.602022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] validate_networks() for [('53dbd3e1-0be4-4fa7-b91f-625810b75cbb', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:37:14.200873 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:37:14.201311 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:37:14.201856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:37:14.202288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:37:14.202719 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:37:14.212784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:14.213278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:14.213727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:14.214463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:14.214928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:14.215403 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:14.233891 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:14.239445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:14.252766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:37:14.255806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:37:14.371753 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [a86afada-22b6-4d03-adf6-147c3860d733] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:37:15.385460 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [a86afada-22b6-4d03-adf6-147c3860d733] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54778. Nov 02 13:37:15.391251 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8e4335e3-2083-4e62-80b3-1cd669a6946e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.920695 Nov 02 13:37:15.392239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4106/7900] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:37:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:37:15.402692 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=16 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:15.404611 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:15.405720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:15.410370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-91524a92-fa7a-4242-9796-955353a35c2d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:15.412327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-91524a92-fa7a-4242-9796-955353a35c2d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:15.490114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-91524a92-fa7a-4242-9796-955353a35c2d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:15.497675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-91524a92-fa7a-4242-9796-955353a35c2d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1266 microversion: 2.1 time: 0.096734 Nov 02 13:37:15.511040 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3795/7901] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:15 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:16.526913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35f1715e-853f-4783-8044-94a1135ffaf1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:16.527751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-35f1715e-853f-4783-8044-94a1135ffaf1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:16.591150 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-35f1715e-853f-4783-8044-94a1135ffaf1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:16.600163 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35f1715e-853f-4783-8044-94a1135ffaf1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1266 microversion: 2.1 time: 0.077351 Nov 02 13:37:16.600774 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4107/7902] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:16 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:17.624380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:17.625009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:17.633867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:17.634498 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:17.634893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:17.635892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:17.636360 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:17.636795 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:17.704306 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:17.712775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-76b352e5-a595-4be6-847b-37f75a6cebf8 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1318 microversion: 2.1 time: 0.093081 Nov 02 13:37:17.713592 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3796/7903] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:17 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:18.738179 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:18.738967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:18.746541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:18.747168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:18.747690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:18.748492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:18.749096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:18.749571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:18.935163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:18.946731 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9f9df981-9758-428c-8ccb-53fc553cba21 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.213726 Nov 02 13:37:18.947791 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4108/7904] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:18 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:19.978404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:19.979127 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:19.979634 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:19.988046 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.988641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.989343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:19.990545 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.990962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.991098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.991602 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.991766 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:19.992135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.004880 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] Creating event network-changed:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h1-855649-4 Nov 02 13:37:20.011208 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-88e9f34e-9089-43dc-a9b6-3fba4ca5ceb0 req-99727a25-61d9-4381-ba22-8f2d240d315e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038657 Nov 02 13:37:20.012222 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4109/7905] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:20.223263 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:20.231311 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-04710b81-cd3a-4dde-a581-c729d26410d5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.261297 Nov 02 13:37:20.231958 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3797/7906] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:19 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:21.255638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:21.256356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:21.262919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:21.263451 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:21.263907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:21.264624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:21.265095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:21.265539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:21.408781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:21.417661 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4137cd31-e68a-48e6-9256-ae4eeb743419 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.167101 Nov 02 13:37:21.418258 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4110/7907] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:21 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:22.441357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:22.441976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:22.448707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:22.449198 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:22.449720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:22.450367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:22.450799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:22.451259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:22.588505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:22.596466 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a3093c-be75-4d0f-9cc0-6e61c65b0817 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.159821 Nov 02 13:37:22.597118 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3798/7908] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:22 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:23.620326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:23.621024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:23.628039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:23.628547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:23.628999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:23.629721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:23.630185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:23.630627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:23.764685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:23.772753 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8c2c6356-db75-433e-b868-bd63392ef66c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.156455 Nov 02 13:37:23.773339 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4111/7909] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:23 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:24.796603 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:24.797277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:24.805379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:24.809830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:24.809830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:24.809830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:24.809830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:24.809830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:24.952970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:24.961492 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b534537c-3ee7-46eb-9bcc-2cfc4655050e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.168989 Nov 02 13:37:24.962087 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3799/7910] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:24 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:25.986333 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:25.987007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:25.989997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:25.991716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:25.996633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:25.997126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:25.997578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:25.998282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:25.998750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:25.999226 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:26.146729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:26.155878 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-94d26c01-438c-43f4-bfd1-ffa4b1c7087d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.173502 Nov 02 13:37:26.156468 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4112/7911] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:25 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:26.871466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "name": "network-vif-plugged", "status": "completed", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:26.882088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:26.882570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:26.887799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:26.895841 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] Creating event network-vif-plugged:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h1-855649-4 Nov 02 13:37:26.901117 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-2317b364-78bb-4561-a6a5-758b40df2115 req-68d47b86-e635-4bd5-898e-528850312735 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Nov 02 13:37:26.901712 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3800/7912] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:27.179427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:27.180062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:27.181888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=8 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:27.187712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.188220 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.188678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.189407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.189914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.191017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.329282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:27.337308 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-89235bc2-a39a-40fc-9d73-8803c96bde4c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1391 microversion: 2.1 time: 0.162253 Nov 02 13:37:27.337905 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4113/7913] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:27 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:28.373111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:28.514627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:28.523378 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2a0b0965-40c7-47c1-9306-a12b03569189 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1564 microversion: 2.1 time: 0.166897 Nov 02 13:37:28.523943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3801/7914] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:28 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:28.546054 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:28.546699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:28.553829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:28.554326 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:28.554780 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:28.555520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:28.556017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:28.556424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:28.692984 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:28.701025 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4918985e-f740-4202-b5ab-9eef9da477f3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1564 microversion: 2.1 time: 0.159346 Nov 02 13:37:28.701841 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4114/7915] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:28 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:31.130691 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:31.135452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:31.142095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:31.156359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:31.156575 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:31.156957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:31.157409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.157578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:31.157962 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.158906 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:31.160054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:31.161457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.170611 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] Creating event network-changed:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h1-855649-4 Nov 02 13:37:31.176537 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-cb61f4fe-7345-42ef-8dac-9602f47a2eb2 req-386e9f10-7261-4f86-938c-07951889ffd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049231 Nov 02 13:37:31.177501 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4115/7916] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:31.398621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:31.407048 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a8c3b295-12dd-4d70-b682-d07b513f4285 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1564 microversion: 2.1 time: 0.281785 Nov 02 13:37:31.407542 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3802/7917] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:31 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1564 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:52.702865 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:52.703638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=42 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:52.757000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:52.760185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:52.766237 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.766740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.767235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.767993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.768469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.768914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.821781 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40377027-954c-4591-bb03-ab7d4e0225cb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action" status: 200 len: 24562 microversion: 2.1 time: 0.121276 Nov 02 13:37:52.822423 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4116/7918] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:37:52 2022] POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action => generated 24562 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:37:59.266583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:59.268940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:59.271644 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:37:59.271795 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action (ip 10.222.0.48) !!! Nov 02 13:37:59.273153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:59.273841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:59.281069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.284787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.284787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.284787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.284787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.284787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.380709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:59.387473 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Old instance type m1.heat2, new instance type m1.heat {{(pid=127568) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 13:37:59.394738 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:37:59.394992 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:37:59.395482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:37:59.395891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:37:59.396312 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:37:59.616276 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f2f25dcd-88b4-45af-944c-f9af6720e4fd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action" status: 202 len: 0 microversion: 2.1 time: 0.353315 Nov 02 13:37:59.616991 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3803/7919] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:37:59 2022] POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:37:59.626082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:59.626883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:59.634765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.635308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.640252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.640252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.640252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.640252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.833330 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:59.841502 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ec1abb98-9e1d-46f3-90eb-caf994e46d92 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1692 microversion: 2.1 time: 0.219893 Nov 02 13:37:59.842195 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4117/7920] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:37:59 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1692 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:00.867488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:00.868118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:00.875315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.876126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.876575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:00.877318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.877835 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.878210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:01.025801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:01.034580 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4c889363-1a7d-42c3-a506-ff46201eb235 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1692 microversion: 2.1 time: 0.172656 Nov 02 13:38:01.035231 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3804/7921] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:00 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:02.060646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:02.061273 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:02.069035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.069536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.069989 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.070711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.071207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.071648 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.221061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:02.229934 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-98793923-3b95-49f0-bd8a-5ed07bf08733 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1692 microversion: 2.1 time: 0.173047 Nov 02 13:38:02.230493 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4118/7922] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:02 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:03.255451 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:03.256081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:03.263618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.264111 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.264587 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.265277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.265737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.266251 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.414592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:03.423292 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-639ec995-218d-4672-bd29-306cb9f3e89c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.171829 Nov 02 13:38:03.427062 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3805/7923] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:03 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:04.447511 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:04.448390 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:04.456294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.456854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.457327 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.458415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.458899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.459363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.619988 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:04.629054 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da206f34-bd3a-46c3-9b0e-826fdeeb50a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.185405 Nov 02 13:38:04.629648 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4119/7924] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:04 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:05.652800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:05.653458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:05.660731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.661226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.661674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.662387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.662854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.663321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.814667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:05.824724 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e93fd18f-ab65-4329-8aa0-53dfa47ee086 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.176094 Nov 02 13:38:05.825344 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3806/7925] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:05 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:06.850024 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:06.850627 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:06.857820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:06.858359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:06.858811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:06.859558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:06.860025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:06.860463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:07.013061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:07.021679 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42aaecc1-46aa-462a-ae8a-f65c8b1b4534 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.176117 Nov 02 13:38:07.022268 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4120/7926] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:06 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:08.045823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:08.046481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:08.055040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:08.055925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:08.056507 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:08.057422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:08.058173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:08.058653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:08.197622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:08.205760 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0e63f781-82f1-4739-ae3b-bbc0fbd77a80 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.163896 Nov 02 13:38:08.206365 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3807/7927] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:08 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:09.230012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:09.230640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:09.237934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:09.238457 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:09.238909 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:09.240192 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:09.240666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:09.241112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:09.394173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:09.402520 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c996ffc2-c084-42e8-878d-f0a8cdc9fdb0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.176479 Nov 02 13:38:09.403143 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4121/7928] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:09 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:10.426794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:10.427970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:10.435424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.440985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.440985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.440985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.440985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.440985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.605436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:10.613683 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-52d35257-e5f2-45ed-9b71-fbef7fdba4b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.191035 Nov 02 13:38:10.614280 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3808/7929] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:10 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:11.638408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:11.639065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:11.646701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.651674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.651674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.651674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.651674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.651674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.796329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:11.804995 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3c76bb00-ffbc-4886-ae61-1f4d08db20fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.170899 Nov 02 13:38:11.805590 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4122/7930] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:11 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:12.827804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:12.828457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:12.836090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.836581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.837027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:12.837744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.838207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.838643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:12.981079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:12.989244 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a31a19-b066-42d2-9ad9-ca86f2382995 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.165259 Nov 02 13:38:12.990433 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3809/7931] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:12 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:14.013597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:14.014414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:14.022272 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.022769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.023248 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.023963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.024435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.024875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.183496 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:14.192236 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bc167613-1eda-4850-a53e-77330c5a8909 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.182734 Nov 02 13:38:14.193541 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4123/7932] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:14 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:15.216342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:15.216958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:15.224840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.225339 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.225853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:15.226574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.227066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.227503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:15.390608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:15.400098 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3eea7a88-c1fe-464b-a636-cd42d8bd933b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.187451 Nov 02 13:38:15.400705 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3810/7933] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:15 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:16.423501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:16.424180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:16.431895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.432391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.432857 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.433579 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.434061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.434508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.577599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:16.585778 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-34bff9ca-2410-4823-9420-c2e45187a5f4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.166322 Nov 02 13:38:16.586429 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4124/7934] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:16 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:17.609396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:17.609960 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:17.617472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:17.617961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:17.618404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:17.619151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:17.619620 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:17.620048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:17.770410 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:17.778833 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d6e950ea-ca70-424c-b187-742fa2c3ac11 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.173355 Nov 02 13:38:17.779526 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3811/7935] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:17 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:18.802819 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:18.803468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:18.810626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.811171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.811631 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:18.812359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.812831 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.813280 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:18.961941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:18.970291 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5d88a396-ca6e-471e-8ac4-31afbe4a0a10 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.171394 Nov 02 13:38:18.970897 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4125/7936] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:18 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:19.994569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:19.995466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:20.002252 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:20.002748 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:20.003212 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:20.004100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:20.004558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:20.005115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:20.204742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:20.217679 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7b3069b5-b144-43c7-9b28-498221e3d452 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1697 microversion: 2.1 time: 0.227582 Nov 02 13:38:20.218277 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3812/7937] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:19 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1697 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:21.242492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:21.243773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:21.251207 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:21.251718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:21.252171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.252903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:21.253375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:21.253820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.418177 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:21.426957 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-afd9db10-c1b2-40fc-a4f1-4c052a5c458d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1696 microversion: 2.1 time: 0.188528 Nov 02 13:38:21.427459 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4126/7938] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:21 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:21.479154 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "name": "network-vif-unplugged", "status": "completed", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:21.489804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:21.490288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:21.490723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.504272 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Creating event network-vif-unplugged:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h2-855649-4 Nov 02 13:38:21.511238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] Instance e78fc418-f621-4fee-94f8-b6c729f003c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:38:21.522888 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-33478b49-b987-4588-bc99-b09190638ab8 req-31504c3a-6f5e-4c1f-b8b4-b33c70f1602b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049302 Nov 02 13:38:21.524078 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3813/7939] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:22.467520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:22.468570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:22.475849 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.476590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.476796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.477522 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.477990 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.478454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.646806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:22.655516 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7f2eef89-3089-4638-a954-4fbe3ee45c37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1696 microversion: 2.1 time: 0.193933 Nov 02 13:38:22.656115 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4127/7940] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:22 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:23.539724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:23.549521 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.550049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.550435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.562368 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Creating event network-changed:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h2-855649-4 Nov 02 13:38:23.567836 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] Instance e78fc418-f621-4fee-94f8-b6c729f003c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-855649-4', 'n-h2-855649-4'} {{(pid=127568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 13:38:23.578882 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-724187dc-ab01-48e9-bc48-f0d4a3a3be07 req-e40ee65a-170b-4ff9-9563-ec0ea2a258fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044211 Nov 02 13:38:23.579532 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3814/7941] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:38:23.679889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:23.688206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:23.688206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=27 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:23.688550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.688894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.689349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.690072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.690576 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.691040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.693952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=71 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:23.831274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:23.839660 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-43861b6a-7a25-4087-850b-e9e324c25a6e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1694 microversion: 2.1 time: 0.163936 Nov 02 13:38:23.840242 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4128/7942] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:23 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:24.864650 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:24.865374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:24.871793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:24.872282 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:24.872724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:24.873431 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:24.873895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:24.874327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:25.016833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:25.025259 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c9b5ded0-afaf-48dd-a950-d7b9003a4b37 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1694 microversion: 2.1 time: 0.165823 Nov 02 13:38:25.025844 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3815/7943] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:24 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:26.048843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:26.049470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:26.057748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:26.065563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:26.065563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:26.065563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:26.065563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:26.065563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:26.212601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:26.220979 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bfd59c81-2d87-4b71-96f7-986f19019a54 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1694 microversion: 2.1 time: 0.176394 Nov 02 13:38:26.221840 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4129/7944] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:26 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:27.245310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.245936 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.252886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.253377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.253829 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.254535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.255014 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.255455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.396466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:27.404431 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a0aa2377-a7e6-4f41-879b-01cdebec7bb6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1691 microversion: 2.1 time: 0.163787 Nov 02 13:38:27.405015 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3816/7945] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:27 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:27.427573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:27.428155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.435952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.436458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.436913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.437723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.438108 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.438554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.648540 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d19f3f9b-666f-4ed0-8fe6-f35c4cb277a6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action" status: 204 len: 0 microversion: 2.1 time: 0.224693 Nov 02 13:38:27.649823 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4130/7946] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:38:27 2022] POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:38:27.658169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.658787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.665626 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.666120 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.666558 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.667296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.667753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.668179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.817867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:27.826434 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-575fd1f0-6973-4890-9371-41067e3aceb5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1691 microversion: 2.1 time: 0.171978 Nov 02 13:38:27.826967 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3817/7947] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:27 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:27.850956 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.851726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.859712 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.869994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.869994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.869994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.869994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.869994 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:28.014485 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:28.022767 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c709484-d754-4d22-b2ad-956b2e8a223d tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1691 microversion: 2.1 time: 0.176175 Nov 02 13:38:28.023419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4131/7948] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:27 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:29.051547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:29.052789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:29.064607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.065457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.066248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:29.067541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.068384 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.069186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:29.224287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:29.232533 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:29.235961 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b7d4060-a638-4959-bdee-99350f0af9e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1691 microversion: 2.1 time: 0.192029 Nov 02 13:38:29.236553 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3818/7949] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:29 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:30.260076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:30.260706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:30.266876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.267424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.267889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.268617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.269090 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.269539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.408287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:30.417144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9dd1c3d8-35d1-4c4e-bf9f-d15e82a6ab85 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1683 microversion: 2.1 time: 0.161500 Nov 02 13:38:30.417738 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4132/7950] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:38:30 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:30.950850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "name": "network-vif-plugged", "status": "completed", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:30.955918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=39 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:30.961942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.962443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.962878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.974410 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] Creating event network-vif-plugged:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h2-855649-4 Nov 02 13:38:30.979927 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-f0de5a7b-bf37-4b7b-a05b-ea415dcd6aa4 req-375670da-ec52-41f8-8afe-7dcafe913456 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084810 Nov 02 13:38:30.980840 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3819/7951] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:02.646488 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:02.648823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:02.651254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=9 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:02.651958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:02.656846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:02.657350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:02.657804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:02.659112 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:02.659584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:02.663815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:02.713443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c0389487-3205-45b0-9571-ac70b612df31 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action" status: 200 len: 24578 microversion: 2.1 time: 0.070873 Nov 02 13:39:02.714275 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4133/7952] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:39:02 2022] POST /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6/action => generated 24578 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:39:26.382394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.384136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:26.395504 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:26.397678 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.398198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.399427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.400355 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.400775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.401222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.442941 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:26.483433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:26.498624 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.499567 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.500141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.514471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] Creating event network-changed:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h2-855649-4 Nov 02 13:39:26.521781 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c7dc1b28-ae9e-4c3c-8f01-df3ffef8a83c req-d6086ebe-e5e1-4149-85df-60038f9c2ebd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146622 Nov 02 13:39:26.522954 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3820/7953] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:26.791378 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-28558e33-39d9-485e-87fb-361fe5ca0a4a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 204 len: 0 microversion: 2.1 time: 0.415980 Nov 02 13:39:26.792194 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4134/7954] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:39:26 2022] DELETE /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:39:26.802033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.802805 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:26.809859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.810335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.810850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.811725 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.812076 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.812519 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.983961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:26.992732 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0aee2e2a-cf5e-4d80-9648-67402166bb63 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1689 microversion: 2.1 time: 0.195870 Nov 02 13:39:26.993380 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3821/7955] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:28.018624 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:28.024716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:28.027632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.028143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.028597 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.029308 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.029839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.030219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.188006 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:28.196286 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9298f2bd-0e42-4e3b-877d-e8d753262dbc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1689 microversion: 2.1 time: 0.182075 Nov 02 13:39:28.196892 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4135/7956] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:28 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:28.815599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78fc418-f621-4fee-94f8-b6c729f003c6", "name": "network-vif-deleted", "tag": "3cba638c-6b34-4408-9154-725ac4430ef0"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:28.825623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.826106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.826547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.839639 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] Creating event network-vif-deleted:3cba638c-6b34-4408-9154-725ac4430ef0 for instance e78fc418-f621-4fee-94f8-b6c729f003c6 on n-h2-855649-4 Nov 02 13:39:28.845569 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-70efb7fb-dfa9-4d95-bc38-c4aac65aeaa3 req-e19491b5-30b9-4d82-99d3-6a7c7e4b4a6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Nov 02 13:39:28.846118 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3822/7957] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:29.220976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:29.221721 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:29.231126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.232043 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.232986 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.233938 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.234435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.234883 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.275448 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.275954 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.276413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.276886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lazy-loading 'fault' on Instance uuid e78fc418-f621-4fee-94f8-b6c729f003c6 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:29.325791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:29.336387 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42b923a8-db8d-4586-b180-3c9fd3d74a14 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 200 len: 1356 microversion: 2.1 time: 0.118731 Nov 02 13:39:29.337190 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4136/7958] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:29 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:30.362256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.363011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: e78fc418-f621-4fee-94f8-b6c729f003c6] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.370274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.370775 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.371260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.371998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.372467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.372905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.388293 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] HTTP exception thrown: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Request method failure captured: Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 HTTP/1.1 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYnGCmhHHeEa5edewNdrBm-Ml4j7CZ86tsInqrZ_02u7_P7i_Acx9w9HRvapQYEGgZs7XqBYOlAD2OjI4BkR8X3eMhrfJHDF0lqL8Y48-giABr1iX9X33FkgZjTf2Cx6BHGl6JdAUiWBidvFWi8eOQH-t3jYaEwhtJTWJvTf6t0Vp3qs Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc1a0a3d0dd24bdead6edbede9d003d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 7563337be85c4779beff3350ad1e1f23 Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'e78fc418-f621-4fee-94f8-b6c729f003c6'} Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.390003 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Returning 404 to user: Instance e78fc418-f621-4fee-94f8-b6c729f003c6 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12c42c46-ae8e-4b33-9749-8eeb6fd775fe tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6" status: 404 len: 111 microversion: 2.1 time: 0.034499 Nov 02 13:39:30.398194 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3823/7959] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/e78fc418-f621-4fee-94f8-b6c729f003c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:34.419825 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-766530b1-9e18-4ea4-b1cd-1f8830020783 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '.version_select at 0x7ff1b267bdc0>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:34.424969 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-766530b1-9e18-4ea4-b1cd-1f8830020783 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:39:35.436583 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-766530b1-9e18-4ea4-b1cd-1f8830020783 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [8dd11e60-a814-44f3-93e5-e90a61110c9f] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55022. Nov 02 13:39:35.506274 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-766530b1-9e18-4ea4-b1cd-1f8830020783 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-136855611" status: 202 len: 0 microversion: 2.1 time: 1.090706 Nov 02 13:39:35.507076 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4137/7960] 10.222.0.48 () {58 vars in 1281 bytes} [Wed Nov 2 13:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-136855611 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:35.536712 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: .version_select at 0x7ff1b3fc6430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-472692916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRu64jDsV4zqr18rNiWGeel9fPScphzc7TLt82sT3cVXx5rduBJtP64YM/OH5fxsPE8MtM7hTP38005hMQ5X7Ta+F0SM0LaTPbyxTYGjFCqduPgczmyaECkoD5J8EeOQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:35.555275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:35.561458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:35.575236 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:39:36.583366 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55026. Nov 02 13:39:36.723616 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae3c9424-7998-48ec-ba56-687fa2926510 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.191064 Nov 02 13:39:36.724238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3824/7961] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:39:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:45.851263 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1553529310", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "26cfb268-cdeb-4158-a96c-8bbc422eb61b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-472692916", "security_groups": [{"name": "tempest-secgroup-smoke-1010731356"}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:45.870796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:45.871549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:46.048040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] validate_networks() for [('26cfb268-cdeb-4158-a96c-8bbc422eb61b', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:39:46.493151 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:39:46.493894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:39:46.494794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:39:46.495557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:39:46.496015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:39:46.505279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.505773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.506232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:46.506997 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.507486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.508189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:46.526959 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:46.532661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:46.552722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:39:46.556233 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:39:46.691849 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-66ccfdc0-54b7-4a26-8d2d-06601daa0a1e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844539 Nov 02 13:39:46.692709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4138/7962] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:39:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:39:46.702939 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=14 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:46.704616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:46.705578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:46.723309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0dc4de9e-cd62-40d9-99ea-38b24359130e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:46.739905 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0dc4de9e-cd62-40d9-99ea-38b24359130e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:46.801806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0dc4de9e-cd62-40d9-99ea-38b24359130e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:46.809453 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0dc4de9e-cd62-40d9-99ea-38b24359130e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1266 microversion: 2.1 time: 0.108834 Nov 02 13:39:46.812851 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3825/7963] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:46 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:47.840961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:47.841594 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:47.852745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:47.853247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:47.853696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.854417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:47.854886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:47.855358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.929010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:47.940717 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9167cb21-12ff-437b-acc7-832fcb6764a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1270 microversion: 2.1 time: 0.103555 Nov 02 13:39:47.941645 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4139/7964] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:47 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:48.966416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:48.967091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:48.978759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.979878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.979878 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.980432 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.980889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.981327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:49.048963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:49.057987 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7c3981a5-339d-4534-a06c-a51e4ece7b97 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1318 microversion: 2.1 time: 0.096203 Nov 02 13:39:49.058545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3826/7965] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:48 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:50.081892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:50.082538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:50.091365 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.091935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.092400 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.093191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.093673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.094118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.294328 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:50.312340 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0cfe5168-1c69-4f99-a3a5-8786349b17e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.233984 Nov 02 13:39:50.316473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4140/7966] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:50 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:51.123462 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107bf8ff-2a7e-40c1-9731-fc0cddb6f628", "tag": "ccdebd37-1e79-4416-b8e6-859e364d740a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:51.135756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:51.136239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:51.136671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:51.151905 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] Creating event network-changed:ccdebd37-1e79-4416-b8e6-859e364d740a for instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 on n-h1-855649-4 Nov 02 13:39:51.157349 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9ae0be61-d48a-4799-9d6c-69d33b63318f req-dfd94428-f64d-40eb-9541-1d1083dcb276 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039328 Nov 02 13:39:51.157981 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3827/7967] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:51.346163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:51.346840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:51.354844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:51.355287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:51.355760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:51.356514 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:51.356998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:51.357446 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:51.504427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:51.513747 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b88cec6d-b679-4cd0-9d25-cee6cb51ee03 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.171679 Nov 02 13:39:51.514353 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4141/7968] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:51 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:52.540027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:52.540839 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:52.548928 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.549482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.549929 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.550676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.551174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.551618 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.703269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:52.711355 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a9d88387-1573-4a80-b5c4-cb33fd7b99ab tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.176255 Nov 02 13:39:52.712493 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3828/7969] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:52 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:53.735905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:53.736534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:53.743463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.743964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.744417 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.745130 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.745697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.746100 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.889350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:53.897112 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3534438d-691e-445e-be6d-2a4ba10c13ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.165415 Nov 02 13:39:53.897693 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4142/7970] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:53 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:54.920798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:54.921366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:54.928269 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.928767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.929293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.929924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.930394 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.930834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.072867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:55.081149 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e290ad46-bdb2-4a1f-93f4-ceb39f89c9bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.164297 Nov 02 13:39:55.081749 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3829/7971] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:54 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:56.105524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:56.106208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:56.113995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.114503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.114967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.115751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.116227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.116675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.258606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:56.267448 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b5503fc3-66b4-4f57-a36e-52e4e630b0c7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.166670 Nov 02 13:39:56.268080 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4143/7972] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:56 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:57.294527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:57.295176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:57.302286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:57.302774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:57.303245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:57.303950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:57.304436 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:57.305151 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:57.450999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:57.459556 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-712d1b37-4e52-4975-8ed2-f8305897d706 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.169452 Nov 02 13:39:57.460301 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3830/7973] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:57 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:57.704541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107bf8ff-2a7e-40c1-9731-fc0cddb6f628", "name": "network-vif-plugged", "status": "completed", "tag": "ccdebd37-1e79-4416-b8e6-859e364d740a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:57.709808 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:57.710509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:57.716946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:57.718795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:57.718795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:57.729626 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] Creating event network-vif-plugged:ccdebd37-1e79-4416-b8e6-859e364d740a for instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 on n-h1-855649-4 Nov 02 13:39:57.734904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f1725954-e2c8-449f-bbe5-7039c64af9db req-7a0302cf-21c5-40f2-8aa0-d13ee6cc3a0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Nov 02 13:39:57.735754 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4144/7974] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:58.484419 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:58.485080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.492084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.492575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.493013 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.493755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.494389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.494680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.639164 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:58.646963 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bff79aa9-1461-4fe9-a331-a400fc4009b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1392 microversion: 2.1 time: 0.166597 Nov 02 13:39:58.647563 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3831/7975] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:58 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:59.672649 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.673347 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:59.680313 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.680810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.681257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.682623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.683115 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.683564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.831662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:59.840096 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a1b00a4-e908-411e-9e55-fd541e4f72f5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1563 microversion: 2.1 time: 0.173916 Nov 02 13:39:59.840709 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4145/7976] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:59 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:59.862622 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.863288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:59.865218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:59.870903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.871417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.871860 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.872553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.873008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.873435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:00.013460 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:00.021665 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-23300f57-2d15-4f67-89ca-0e8f857258ad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1563 microversion: 2.1 time: 0.162830 Nov 02 13:40:00.022369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3832/7977] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:39:59 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:02.395918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:02.396550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:02.401993 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107bf8ff-2a7e-40c1-9731-fc0cddb6f628", "tag": "ccdebd37-1e79-4416-b8e6-859e364d740a"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:02.404557 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.405062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.405708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.406433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.406906 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.407374 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.412910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.413671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.414378 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.434869 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] Creating event network-changed:ccdebd37-1e79-4416-b8e6-859e364d740a for instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 on n-h1-855649-4 Nov 02 13:40:02.445142 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-027d2c11-95b7-4499-89d6-bd82efbf893b req-4a3d9253-fc76-49d0-8969-c45550787064 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047009 Nov 02 13:40:02.446153 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3833/7978] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:02.566970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:02.581518 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8f9ea7f9-a9a2-40f7-abb6-2c107bd7d684 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1563 microversion: 2.1 time: 0.189261 Nov 02 13:40:02.586623 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4146/7979] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:02 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:23.866177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:23.868965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:23.872058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=20 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:23.872840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=40 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:23.878138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.878631 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.879098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.879814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.880272 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.880702 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.939226 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5999445e-eee7-499d-9650-9b3ed6739bad tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action" status: 200 len: 24520 microversion: 2.1 time: 0.077730 Nov 02 13:40:23.939951 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3834/7980] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:40:23 2022] POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action => generated 24520 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:40:30.309573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:30.311943 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:30.312640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=46 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:30.317799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.318278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.318728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.343194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Going to try to stop instance {{(pid=127567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:40:30.547359 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2662e210-b37d-4249-a8b0-fc2bd4d1e145 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action" status: 202 len: 0 microversion: 2.1 time: 0.241744 Nov 02 13:40:30.547904 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4147/7981] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:40:30 2022] POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:40:30.557539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:30.559366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:30.567482 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.568033 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.568433 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.569140 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.569683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.570035 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.715408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:30.723774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7941a5ab-84b7-46f4-b1d0-e17ccaf27919 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.170824 Nov 02 13:40:30.724369 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3835/7982] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:30 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:31.751538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:31.752257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:31.759035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.759675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.760144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.760853 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.761323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.761767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.894618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:31.902471 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-170c3c1f-b677-4fa9-875d-b6a3891bdcfb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.157342 Nov 02 13:40:31.903100 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4148/7983] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:31 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:32.927023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:32.927646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:32.934532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.935055 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.935509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.936213 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.936675 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.937113 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.069016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:33.077318 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-94d93e35-ea83-4f18-94f9-da5f8f64e1bc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.154317 Nov 02 13:40:33.077895 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3836/7984] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:32 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:34.100791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:34.101405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:34.109074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.109578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.110030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.110738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.111242 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.111680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.248009 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:34.255876 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-abc87df1-8e9f-4cfb-87dd-d5e128215d8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.158968 Nov 02 13:40:34.256621 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4149/7985] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:34 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:35.279403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:35.280023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:35.287186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:35.287680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:35.288137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:35.288853 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:35.289724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:35.289872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:35.428402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:35.437952 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-71caedc0-7f03-42b5-96df-3b99e7fec03b tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.162542 Nov 02 13:40:35.438546 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3837/7986] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:35 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:36.461095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:36.461718 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:36.468693 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:36.469185 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:36.469639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:36.470344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:36.470812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:36.471276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:36.603661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:36.611459 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8e9f2d6-2b23-4ac8-9f26-2ead40882ceb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.154305 Nov 02 13:40:36.612042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4150/7987] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:36 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:37.635676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:37.636299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:37.643857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:37.644354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:37.644802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:37.645515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:37.645976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:37.646412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:37.784396 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:37.792444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f67e0f6a-3325-4f03-8967-e996797d6f75 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.161020 Nov 02 13:40:37.793022 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3838/7988] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:37 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:38.815779 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:38.816437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:38.823513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:38.824144 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:38.824412 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:38.825126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:38.825598 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:38.826040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:38.965156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:38.973646 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c50d3428-6be6-4ae5-ad2e-619fa03c7d0e tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.161763 Nov 02 13:40:38.974687 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4151/7989] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:38 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:39.997425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:39.997985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:40.005724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:40.006225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:40.006773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:40.007791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:40.008261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:40.008699 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:40.145664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.153432 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39af3433-519b-4fcb-8935-a93073e582b0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1691 microversion: 2.1 time: 0.160095 Nov 02 13:40:40.154043 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3839/7990] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:39 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:41.179636 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:41.180286 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:41.187463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.187963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.188420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.189820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.190290 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.190738 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.328638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.336976 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-83dd4c49-cc60-47d6-bcb4-7f5dc4a55ffa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1668 microversion: 2.1 time: 0.161328 Nov 02 13:40:41.337552 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4152/7991] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:41 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:42.439527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:42.441811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:42.448745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.449226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.449665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.450370 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.450819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.451309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.508242 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d03376c-7fdb-4d60-b42f-4e93e32ef6b5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action" status: 200 len: 35355 microversion: 2.1 time: 0.073152 Nov 02 13:40:42.509113 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3840/7992] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:40:42 2022] POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action => generated 35355 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:40:42.521670 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:42.528645 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.529149 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.529606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.551542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Going to try to start instance {{(pid=127567) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:40:42.728999 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2f8bb510-9c8d-4890-b0c6-bd60eaaaa741 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action" status: 202 len: 0 microversion: 2.1 time: 0.211756 Nov 02 13:40:42.729615 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4153/7993] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:40:42 2022] POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:40:42.739310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:42.740026 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:42.747087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.747583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.748034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.748774 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.749238 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.749672 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.897150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.905120 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e155067e-0d3e-463e-8733-c09b6f4494a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1677 microversion: 2.1 time: 0.170712 Nov 02 13:40:42.905704 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3841/7994] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:42 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:43.931026 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:43.931755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:43.938157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.938662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.939235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:43.940041 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.940539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.941294 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:44.077284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.086018 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6f8641a4-3c66-4ee1-bfb0-566dbda1c37c tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1677 microversion: 2.1 time: 0.160503 Nov 02 13:40:44.086610 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4154/7995] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:43 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:45.109547 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:45.110147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:45.117902 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.118388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.118827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:45.119635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.120090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.120516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:45.341187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:45.349872 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5d8e440a-c91a-4042-b2da-7aaa05815e38 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1681 microversion: 2.1 time: 0.244228 Nov 02 13:40:45.350461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3842/7996] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:40:45 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.574608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:07.576798 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:07.579013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:07.579683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:07.584929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.585419 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.585863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.586564 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.587050 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.587489 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.640089 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e8fd6009-6cf1-484c-9549-5bcfe173d4fa tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action" status: 200 len: 59915 microversion: 2.1 time: 0.069575 Nov 02 13:41:07.640771 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4155/7997] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:41:07 2022] POST /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628/action => generated 59915 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:41:14.769468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:14.770038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:14.772846 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107bf8ff-2a7e-40c1-9731-fc0cddb6f628", "tag": "ccdebd37-1e79-4416-b8e6-859e364d740a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:14.775294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:14.776100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=50 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:14.779841 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.780336 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.780994 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.781720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.782180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.782619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.786175 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.786744 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.790737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.801816 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] Creating event network-changed:ccdebd37-1e79-4416-b8e6-859e364d740a for instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 on n-h1-855649-4 Nov 02 13:41:14.807087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d1cd273c-5011-4d0b-8a2b-8627ff9f6b22 req-2e4088c2-4358-4db8-90d5-4eec5f86bb48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039742 Nov 02 13:41:14.807783 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4156/7998] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:14.810967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:15.078016 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ae1f6c04-975e-43df-b734-2ab63f061012 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 204 len: 0 microversion: 2.1 time: 0.312304 Nov 02 13:41:15.078779 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3843/7999] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:41:14 2022] DELETE /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:15.091655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:15.092815 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:15.099983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.101319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.101786 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.102548 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.103042 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.103513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.252312 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.261491 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-dba98f74-b547-4bf5-a018-36c1d960a305 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1687 microversion: 2.1 time: 0.177423 Nov 02 13:41:15.262091 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4157/8000] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:15 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:16.289744 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:16.290459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:16.297440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.298221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.298668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.299417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.299883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.300318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.493335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:16.501234 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c6ca7214-9071-4598-86a5-61d498f018e9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1687 microversion: 2.1 time: 0.216555 Nov 02 13:41:16.501816 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3844/8001] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:16 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:17.044079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107bf8ff-2a7e-40c1-9731-fc0cddb6f628", "name": "network-vif-deleted", "tag": "ccdebd37-1e79-4416-b8e6-859e364d740a"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:17.055437 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.055929 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.056394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.067747 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] Creating event network-vif-deleted:ccdebd37-1e79-4416-b8e6-859e364d740a for instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 on n-h1-855649-4 Nov 02 13:41:17.073401 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c8a54fca-217a-41ad-978c-aeaef9cbb49e req-062f9784-4d3b-4d4a-a0fb-3b0546115809 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Nov 02 13:41:17.074006 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4158/8002] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:17.524589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:17.525218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:17.532337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.532876 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.533285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.534008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.534481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.534916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.568723 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.569108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.569557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.570016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lazy-loading 'fault' on Instance uuid 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:41:17.615985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:17.624591 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c027050d-06a3-4b74-a639-9ff20ce83a07 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 200 len: 1356 microversion: 2.1 time: 0.104072 Nov 02 13:41:17.625176 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3845/8003] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:17 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:18.649699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:18.650922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 107bf8ff-2a7e-40c1-9731-fc0cddb6f628] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:18.657140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.657629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.658076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.658776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.659269 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.659710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.675976 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] HTTP exception thrown: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Request method failure captured: Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 HTTP/1.1 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnGCmhHHeEa5edewNdrBm-Ml4j7CZ86tsInqrZ_02u7_P7i_Acx9w9HRvapQYEGgZs7XqBYOlAD2OjI4BkR8X3eMhrfJHDF0lqL8Y48-giABr1iX9X33FkgZjTf2Cx6BHGl6JdAUiWBidvFWi8eOQH-t3jYaEwhtJTWJvTf6t0Vp3qs Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc1a0a3d0dd24bdead6edbede9d003d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7563337be85c4779beff3350ad1e1f23 Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '107bf8ff-2a7e-40c1-9731-fc0cddb6f628'} Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:41:18.677606 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Returning 404 to user: Instance 107bf8ff-2a7e-40c1-9731-fc0cddb6f628 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a47e4af-0cb1-4b04-8440-764f333a6671 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628" status: 404 len: 111 microversion: 2.1 time: 0.034550 Nov 02 13:41:18.683232 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4159/8004] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:18 2022] GET /compute/v2.1/servers/107bf8ff-2a7e-40c1-9731-fc0cddb6f628 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:22.859715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d3c70cd-502f-4056-a19c-5d70816aefcd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '.version_select at 0x7ff1bba2c8b0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:22.938108 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d3c70cd-502f-4056-a19c-5d70816aefcd tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-472692916" status: 202 len: 0 microversion: 2.1 time: 0.082165 Nov 02 13:41:22.938732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3846/8005] 10.222.0.48 () {58 vars in 1281 bytes} [Wed Nov 2 13:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-472692916 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:22.971996 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-35e84104-21e2-4e9a-9802-39ef0984e095 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: .version_select at 0x7ff1b270fca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-682384624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMbl+7qFJtEThtsDr2Q+aS4xhMj+V7+AOUzw9fua/s/iqwHJyoRy/flEP8Ao7IhxIKxWGZ5qr5NId4Rg3O5sDTi00T8kdei0kO1Lf2YbhZwZk7EEjDxfYW0JBKt+ZaDbg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:22.989668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-35e84104-21e2-4e9a-9802-39ef0984e095 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:22.996985 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-35e84104-21e2-4e9a-9802-39ef0984e095 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:23.084625 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-35e84104-21e2-4e9a-9802-39ef0984e095 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.116847 Nov 02 13:41:23.085241 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4160/8006] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:41:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:31.896748 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:41:31.897349 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:41:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Nov 02 13:41:31.898442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:31.902764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1190188324", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "networks": [{"uuid": "6225e672-f73b-4ae0-95d5-972762c8fd16"}], "key_name": "tempest-TestNetworkAdvancedServerOps-682384624", "security_groups": [{"name": "tempest-secgroup-smoke-2057957922"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:32.030948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] validate_networks() for [('6225e672-f73b-4ae0-95d5-972762c8fd16', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:32.474117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:32.474647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:32.475260 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:32.475940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:32.476464 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:32.486434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.487297 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.487864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.488689 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.489247 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.489781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.515642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:32.521949 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Getting quotas for user 7563337be85c4779beff3350ad1e1f23 and project dc1a0a3d0dd24bdead6edbede9d003d1. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:32.536619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:32.539128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:32.686448 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3db14942-0918-4529-9db4-5c9b75184ca3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792169 Nov 02 13:41:32.687172 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3847/8007] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:41:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:41:32.699025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-246f76ef-c61d-4ab5-a9cd-10cd2ead5ca6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:32.700285 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-246f76ef-c61d-4ab5-a9cd-10cd2ead5ca6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:32.703143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=16 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:32.774889 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-246f76ef-c61d-4ab5-a9cd-10cd2ead5ca6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:32.782623 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-246f76ef-c61d-4ab5-a9cd-10cd2ead5ca6 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1266 microversion: 2.1 time: 0.087643 Nov 02 13:41:32.783620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4161/8008] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:32 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:33.808721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:33.817582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:33.839784 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.841244 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.841708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.843834 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.846866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.847404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.921512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:33.930652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e7258df2-8bd6-43a7-b160-1a4b18b4b2c0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1270 microversion: 2.1 time: 0.126974 Nov 02 13:41:33.931389 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3848/8009] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:33 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:34.954820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:34.955475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:34.963614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:34.964302 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:34.964760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:34.965683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:34.966886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:34.967314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.032740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:35.041872 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-786be767-7524-4af2-95b2-84b612ef0d29 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1326 microversion: 2.1 time: 0.091164 Nov 02 13:41:35.043606 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4162/8010] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:34 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:36.066695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.067311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:36.074599 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.075116 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.075564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.076278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.076739 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.077177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.232979 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:36.241076 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba9c47ba-56f2-462b-a772-6ca623ddb578 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.178493 Nov 02 13:41:36.243362 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3849/8011] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:36.650182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796866e8-d7ce-41d5-a677-7d59bfbfe960", "tag": "d01e8936-211b-4296-b566-7e424cfef0f2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:36.661839 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.662341 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.662788 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.675145 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] Creating event network-changed:d01e8936-211b-4296-b566-7e424cfef0f2 for instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 on n-h2-855649-4 Nov 02 13:41:36.680814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-e6476643-4078-4222-ae5e-73daf7f2101a req-3432a2ed-7238-4351-90cf-d04c1461171d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036850 Nov 02 13:41:36.682190 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4163/8012] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:37.264447 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.265073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.272420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.272911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.273358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.274069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.274532 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.274963 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.467715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:37.475709 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4d9911f2-9e7b-401b-8ce2-2922cf22dfe9 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.215228 Nov 02 13:41:37.476290 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3850/8013] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:38.501136 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.501810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:38.508467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.508973 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.509427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.510142 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.510616 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.511582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.643783 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:38.652171 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-042c5018-2529-4728-b3ce-e4eb87511967 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.155751 Nov 02 13:41:38.652747 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4164/8014] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:39.675194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:39.675823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:39.683430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.684354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.684859 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.685576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:39.686038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:39.686471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.828467 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:39.836279 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5bc8b3bd-21be-4325-87c2-11c64b2500b4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.165225 Nov 02 13:41:39.836857 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3851/8015] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:39 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:40.859922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.860500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.867377 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.867886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.868320 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.869028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.869490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.869927 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.003843 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:41.011898 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-40fc4c7c-c45f-4aed-a4fd-afb43549fde0 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.155950 Nov 02 13:41:41.012470 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4165/8016] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:40 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:42.034638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:42.035328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:42.042810 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.043341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.043793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.044510 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.044975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.045413 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.179528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:42.188059 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4b93b588-2665-4db2-9a3d-8755781566ef tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.157301 Nov 02 13:41:42.188713 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3852/8017] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:42 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.212362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.212978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:43.216046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:43.221020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.221524 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.221971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.222679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.223181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.223620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.357228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:43.365201 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-75983f51-ae94-4381-b7cd-88d88b5c9099 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.156745 Nov 02 13:41:43.365779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4166/8018] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.738077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796866e8-d7ce-41d5-a677-7d59bfbfe960", "name": "network-vif-plugged", "status": "completed", "tag": "d01e8936-211b-4296-b566-7e424cfef0f2"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:43.743255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:43.743944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=6 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:43.751366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.751850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.752288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.763810 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] Creating event network-vif-plugged:d01e8936-211b-4296-b566-7e424cfef0f2 for instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 on n-h2-855649-4 Nov 02 13:41:43.769799 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4d5d0379-b25a-4cab-9ec5-d41680e11ba5 req-d0ff7f7f-8354-461c-9414-4b8092dc1f78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Nov 02 13:41:43.770795 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3853/8019] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:44.388404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:44.389027 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:44.395859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.396352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.396806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.397506 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:44.397970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:44.398405 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:44.535963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.544084 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d487a403-9d01-4afb-8e36-498db367c4fb tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1392 microversion: 2.1 time: 0.159688 Nov 02 13:41:44.544664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4167/8020] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:44 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.568943 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.569671 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.572947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:45.579570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.580054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.580494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.581201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.581658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.582086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.726666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.735239 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec456078-9e8a-4ee2-8275-86545f5ab02a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1563 microversion: 2.1 time: 0.171129 Nov 02 13:41:45.735841 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3854/8021] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.758409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.758999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.761762 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:45.766614 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.767231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.767696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.768426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.768897 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.769343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.907899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.915782 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3de8933a-6060-45b8-9b48-bd3e1d56daa3 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1563 microversion: 2.1 time: 0.161673 Nov 02 13:41:45.916379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4168/8022] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.333289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796866e8-d7ce-41d5-a677-7d59bfbfe960", "tag": "d01e8936-211b-4296-b566-7e424cfef0f2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:48.334062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.334487 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.343255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.343755 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.344203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.344952 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.345381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.345534 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.345821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.345945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.346319 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.358770 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] Creating event network-changed:d01e8936-211b-4296-b566-7e424cfef0f2 for instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 on n-h2-855649-4 Nov 02 13:41:48.364428 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-5c716c24-9391-4ebd-a8b3-a0142e5581ac req-d750f94b-bce6-4ba9-8eee-8dd37ea7ec80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034901 Nov 02 13:41:48.365373 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4169/8023] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:48.583494 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:48.591634 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-da8d31fe-5b7a-414f-b3b1-23a21d601035 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1563 microversion: 2.1 time: 0.262424 Nov 02 13:41:48.592494 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3855/8024] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:23.946340 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:23.947156 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=40 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:23.952189 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:23.954501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:23.960765 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.961271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.961728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.962450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.962919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.963388 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.015412 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-14ae763b-57fc-42af-833c-7e21a4bb6073 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action" status: 200 len: 24572 microversion: 2.1 time: 0.070912 Nov 02 13:42:24.016075 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4170/8025] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:42:23 2022] POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:43:02.766342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:02.767149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=46 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:02.965923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:02.966471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.973243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.973732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.974178 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.974883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.975442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.975875 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.998866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lazy-loading 'flavor' on Instance uuid 796866e8-d7ce-41d5-a677-7d59bfbfe960 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:03.277038 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-490f6aaf-7b50-478e-81df-5321ce2598e5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action" status: 202 len: 0 microversion: 2.1 time: 0.512228 Nov 02 13:43:03.277776 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3856/8026] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:02 2022] POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:03.288381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.289033 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.290722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:03.291436 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=4 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:03.292404 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:43:03.292565 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:43:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 (ip 10.222.0.48) !!! Nov 02 13:43:03.301044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.301987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.301987 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.302685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.303191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.303628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.530182 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.538573 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74fb4825-d6e6-4d8e-8658-fde1aede4bce tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1690 microversion: 2.1 time: 0.256078 Nov 02 13:43:03.539173 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4171/8027] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.566361 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.567011 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.573270 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.573756 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.574204 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.574900 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.575387 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.575821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.710048 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.718055 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f5bf9dba-e4ca-4d8e-bdd8-eab040c485a4 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1690 microversion: 2.1 time: 0.157785 Nov 02 13:43:04.718631 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3857/8028] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:05.741662 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:05.742284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:05.749278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.749773 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.750219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.750923 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:05.751414 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:05.752364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:05.893621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:05.901728 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-5f4bc3df-f1a9-4d91-8f37-b4a41aa285dc tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1673 microversion: 2.1 time: 0.163931 Nov 02 13:43:05.902326 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4172/8029] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:06.998004 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:07.000318 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.008118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.008607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.009053 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.009749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.010209 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.010647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.064669 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-aa2b772e-00fe-494f-bb69-634f4de282f7 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action" status: 200 len: 38444 microversion: 2.1 time: 0.069982 Nov 02 13:43:07.065343 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3858/8030] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:06 2022] POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action => generated 38444 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:43:07.077236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:07.077771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.085465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.085967 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.086420 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.087163 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.087633 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.088073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.290361 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3a167ad3-0279-40a5-be77-e4c56b5ab8e1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action" status: 202 len: 0 microversion: 2.1 time: 0.216655 Nov 02 13:43:07.290950 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4173/8031] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:07 2022] POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:43:07.300366 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:07.301552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.308681 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.309276 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.309730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.310450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.310921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.311383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.487501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.495482 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ace8055d-8c22-4d59-9caa-d965e1f608a5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1679 microversion: 2.1 time: 0.199370 Nov 02 13:43:07.496068 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3859/8032] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:07 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:08.520830 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:08.521546 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:08.528763 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.529259 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.529710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.530415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.530878 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.531344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.672281 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:08.681680 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1a1fa699-d69d-493a-ab51-d19a1e364df5 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1679 microversion: 2.1 time: 0.165330 Nov 02 13:43:08.682263 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4174/8033] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:08 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:09.705131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:09.705753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:09.717742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.718277 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.718931 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.719480 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.719947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.720440 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.875293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.884123 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35e89856-9b81-45a7-b657-bbbb86b847b1 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1682 microversion: 2.1 time: 0.183001 Nov 02 13:43:09.884708 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3860/8034] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:09 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:09.980204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:09.982663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:09.991274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.991787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.992245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:09.992965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:09.993435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:09.993880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.045685 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29fa7beb-f5ce-42ff-b9df-f28c82af17e2 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action" status: 200 len: 38444 microversion: 2.1 time: 0.070501 Nov 02 13:43:10.046335 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4175/8035] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:43:09 2022] POST /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960/action => generated 38444 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:43:11.124838 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.135497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.144255 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.144759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.145210 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.145923 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.146686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.147355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.179179 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:11.201358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796866e8-d7ce-41d5-a677-7d59bfbfe960", "tag": "d01e8936-211b-4296-b566-7e424cfef0f2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:11.215737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.216247 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.216708 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.228805 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] Creating event network-changed:d01e8936-211b-4296-b566-7e424cfef0f2 for instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 on n-h2-855649-4 Nov 02 13:43:11.234115 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-2398417b-9b20-4067-87e2-f4758b83b480 req-5af91390-6006-493d-8c01-35265bfabf59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107082 Nov 02 13:43:11.235109 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4176/8036] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:11.489652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-98724dde-a3ea-45c8-b334-281df4e974ee tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 204 len: 0 microversion: 2.1 time: 0.368647 Nov 02 13:43:11.492085 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3861/8037] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:43:11 2022] DELETE /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:11.499768 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.500501 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.508541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.509093 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.509748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.516803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.516803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.516803 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.650888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:11.659862 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7043344d-ab01-4ef3-84a6-3dd1c5adc773 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1688 microversion: 2.1 time: 0.164325 Nov 02 13:43:11.660471 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4177/8038] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:12.685012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:12.685724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:12.695146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.695643 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.696091 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:12.696801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.697265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.697703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:12.906126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:12.915536 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-abcfe154-24fc-49ef-a011-f2d29c3c0a8a tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1688 microversion: 2.1 time: 0.234812 Nov 02 13:43:12.916143 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3862/8039] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:12 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:13.937061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796866e8-d7ce-41d5-a677-7d59bfbfe960", "name": "network-vif-deleted", "tag": "d01e8936-211b-4296-b566-7e424cfef0f2"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:13.941511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:13.942393 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:13.948143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.948453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.948596 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.949028 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.949149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.949651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.950351 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:13.950811 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:13.951278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.961575 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] Creating event network-vif-deleted:d01e8936-211b-4296-b566-7e424cfef0f2 for instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 on n-h2-855649-4 Nov 02 13:43:13.966897 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-7faf7b95-ac81-40ed-9140-2077319a2780 req-2b9b5cd7-9d78-44a6-bb11-077469f4272f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033563 Nov 02 13:43:13.968181 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4178/8040] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:14.018508 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7563337be85c4779beff3350ad1e1f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1a0a3d0dd24bdead6edbede9d003d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:14.026411 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ec2e210-887d-4fed-906d-43e274e2f486 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 200 len: 1501 microversion: 2.1 time: 0.090504 Nov 02 13:43:14.027250 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3863/8041] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:13 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 1501 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:15.051077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:15.051800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] [instance: 796866e8-d7ce-41d5-a677-7d59bfbfe960] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:15.058181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.058686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.059180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.059903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.060375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.060821 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.074293 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] HTTP exception thrown: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Request method failure captured: Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 HTTP/1.1 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnGCmhHHeEa5edewNdrBm-Ml4j7CZ86tsInqrZ_02u7_P7i_Acx9w9HRvapQYEGgZs7XqBYOlAD2OjI4BkR8X3eMhrfJHDF0lqL8Y48-giABr1iX9X33FkgZjTf2Cx6BHGl6JdAUiWBidvFWi8eOQH-t3jYaEwhtJTWJvTf6t0Vp3qs Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc1a0a3d0dd24bdead6edbede9d003d1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc1a0a3d0dd24bdead6edbede9d003d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: dc1a0a3d0dd24bdead6edbede9d003d1 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1356540568 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 7563337be85c4779beff3350ad1e1f23 Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1356540568-project Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': '796866e8-d7ce-41d5-a677-7d59bfbfe960'} Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:43:15.075978 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Returning 404 to user: Instance 796866e8-d7ce-41d5-a677-7d59bfbfe960 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf491416-fb31-41b4-a99c-9071803c3838 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960" status: 404 len: 111 microversion: 2.1 time: 0.031526 Nov 02 13:43:15.081695 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4179/8042] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:15 2022] GET /compute/v2.1/servers/796866e8-d7ce-41d5-a677-7d59bfbfe960 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:43:19.042036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1b36e83a-0a94-4e59-9fbf-d5e057ec2743 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] Calling method '.version_select at 0x7ff1b3d780d0>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:19.124236 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1b36e83a-0a94-4e59-9fbf-d5e057ec2743 tempest-TestNetworkAdvancedServerOps-1356540568 tempest-TestNetworkAdvancedServerOps-1356540568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-682384624" status: 202 len: 0 microversion: 2.1 time: 0.086113 Nov 02 13:43:19.124822 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3864/8043] 10.222.0.48 () {58 vars in 1281 bytes} [Wed Nov 2 13:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-682384624 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:34.827690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=18 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:34.840769 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:35.016970 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4d6ba970-c155-4e56-b357-a021c2bde71d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'create', calling method: .version_select at 0x7ff1b25f1940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1644961549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwn/9IUj8DoolK2uBX+EDxEqkgQCg8Ahej8ywhqHSNXbNiFpBbmrOF+fuhKI2KryCie5H4mRJDmqeHXhLdoObh9XS2UxBnBI6sxmhijC36x+Ziod5KGna9fL+GIggHyKg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:35.034264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4d6ba970-c155-4e56-b357-a021c2bde71d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for project 3a98de562bce47349656a4b64db5293d. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:35.041161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-4d6ba970-c155-4e56-b357-a021c2bde71d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for user 6a05d3fc822c4be882546434c19d374f and project 3a98de562bce47349656a4b64db5293d. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:35.182059 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4d6ba970-c155-4e56-b357-a021c2bde71d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.363497 Nov 02 13:43:35.182686 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4180/8044] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:43:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:37.887134 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:37.887921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:37.892195 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1105292719", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1644961549", "security_groups": [{"name": "tempest-secgroup-smoke-438944266"}], "networks": [{"uuid": "880ec782-4dd6-41c0-984b-ad6679471903"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:38.009851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] validate_networks() for [('880ec782-4dd6-41c0-984b-ad6679471903', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:38.527374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:38.528086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:38.528576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:38.528998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:38.529526 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:38.539400 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.539891 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.540333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.541294 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.541785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.542203 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.562040 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for project 3a98de562bce47349656a4b64db5293d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:38.568328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for user 6a05d3fc822c4be882546434c19d374f and project 3a98de562bce47349656a4b64db5293d. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:38.582131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:38.584644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:38.714365 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b716741c-f4be-40b7-b037-fde7ae56c163 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.829009 Nov 02 13:43:38.722217 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3865/8045] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:43:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:43:38.728771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-414df71c-d2d7-4c4f-bda4-33b5d30f5aab tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:38.730078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-414df71c-d2d7-4c4f-bda4-33b5d30f5aab tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:38.798084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-414df71c-d2d7-4c4f-bda4-33b5d30f5aab tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:38.806545 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-414df71c-d2d7-4c4f-bda4-33b5d30f5aab tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1247 microversion: 2.1 time: 0.082527 Nov 02 13:43:38.807192 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4181/8046] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:38 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:39.831773 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3bda5434-c54a-440b-940f-60698e525724 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:39.832429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3bda5434-c54a-440b-940f-60698e525724 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:39.891703 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3bda5434-c54a-440b-940f-60698e525724 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:39.899714 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3bda5434-c54a-440b-940f-60698e525724 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1247 microversion: 2.1 time: 0.073777 Nov 02 13:43:39.900314 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3866/8047] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:39 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:40.923492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:40.924730 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:40.932359 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.932828 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.933287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.933998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.934471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.934918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.000453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:41.008698 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d2b243ff-53f1-4d74-aab7-7af1a8aa7a46 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1299 microversion: 2.1 time: 0.089093 Nov 02 13:43:41.010150 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4182/8048] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:40 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:42.032458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:42.041415 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:42.043386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.043823 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.044450 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.045174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.045674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.046112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.212601 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:42.222071 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c02b9184-4534-4b3f-8831-9f6f02f4e6c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.193417 Nov 02 13:43:42.222705 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3867/8049] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:42 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:43.233859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:43.245651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.246146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.246285 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.246737 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.246857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.255786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.256296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.256733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.257446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.257903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.258338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.261424 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] Creating event network-changed:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h1-855649-4 Nov 02 13:43:43.266844 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-f26b350b-070a-440d-b9ac-a766a5df8aa1 req-96bf154c-a3b6-4386-a569-a764098a7f55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037048 Nov 02 13:43:43.267744 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4183/8050] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:43.401502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:43.410154 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b80dc785-3fe4-4cb3-b187-bc65d145f5a3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.167762 Nov 02 13:43:43.410669 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3868/8051] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:43 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:44.433925 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:44.434639 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:44.441928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.442368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.442814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.443555 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.444020 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.444454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.580525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.588362 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-37460b75-cdd4-4111-9807-2a4a73980d79 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.158771 Nov 02 13:43:44.588933 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4184/8052] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:44 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.612089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:45.612715 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:45.619732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.620223 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.620667 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.621372 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.621833 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.622265 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.761934 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.769808 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-acda63b2-0e3b-489c-9d48-1397a8836025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.162138 Nov 02 13:43:45.770372 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3869/8053] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:45 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:46.793469 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:46.794109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:46.801079 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.807165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.807165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.807165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.807165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.807165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.941863 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:46.949601 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74d224b6-d764-4334-b2b9-e777074260ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.160926 Nov 02 13:43:46.950178 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4185/8054] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:46 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:47.972444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:47.973063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:47.980087 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.980575 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.981016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:47.981711 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:47.982166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:47.982595 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.114764 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:48.122662 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-12ca5afb-4af6-4494-b279-771a18d6c1ad tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.154175 Nov 02 13:43:48.123275 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3870/8055] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:47 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:48.787571 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "name": "network-vif-plugged", "status": "completed", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:48.797107 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.797754 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.798052 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.802589 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:48.810198 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] Creating event network-vif-plugged:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h1-855649-4 Nov 02 13:43:48.816620 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-9a48bfb4-710b-4ed7-b9c0-315b1affd694 req-276c1df6-06fc-4209-83a1-8007989157fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087152 Nov 02 13:43:48.817248 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4186/8056] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:49.146726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:49.147334 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:49.149161 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:49.154856 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.158798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.158798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.158798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.158798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.158798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.296407 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:49.305102 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-bd061d65-3fb4-40aa-a3a3-2c332223a400 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1372 microversion: 2.1 time: 0.162322 Nov 02 13:43:49.305723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3871/8057] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:49 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:50.329538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.330264 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.336931 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.337503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.337961 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.338674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.339270 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.339716 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.476993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.485068 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-1e054ddb-6d7c-4a5c-b21a-a4afe25eaf78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1557 microversion: 2.1 time: 0.161150 Nov 02 13:43:50.485648 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4187/8058] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:50.508501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.509189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.510950 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:50.516633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.517117 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.517554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.518257 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.518708 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.519168 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.653638 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:50.662126 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-475d5d82-a424-4575-8af4-e340aaf96acd tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1557 microversion: 2.1 time: 0.157753 Nov 02 13:43:50.662741 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3872/8059] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:53.001105 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:53.012577 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.013078 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.013525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.025454 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] Creating event network-changed:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h1-855649-4 Nov 02 13:43:53.030347 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-6564d199-f7b8-435e-9d93-ee153a6b6fa7 req-410a8ed6-db47-44cb-8067-370861cfbb78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032966 Nov 02 13:43:53.031014 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4188/8060] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:48.263478 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:45:48.264118 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:48.264846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:48.265552 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:45:48.265697 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action (ip 10.222.0.48) !!! Nov 02 13:45:48.266849 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:45:48.267051 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action (ip 10.222.0.48) !!! Nov 02 13:45:48.272343 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:48.272893 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:48.281264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.283583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.283583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.283583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.283583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.284000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.313830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.objects.instance [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lazy-loading 'flavor' on Instance uuid 3e252773-3b17-4640-a153-5c616fdb6b79 {{(pid=127568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:45:48.964932 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-39426ca2-3345-40e9-9425-d86e866b5843 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action" status: 202 len: 0 microversion: 2.1 time: 0.703893 Nov 02 13:45:48.965628 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3873/8061] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:45:48 2022] POST /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:45:48.972281 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:45:48.973091 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:45:48.973706 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:48.974482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=30 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:48.975684 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:45:48.975833 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:45:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 (ip 10.222.0.48) !!! Nov 02 13:45:48.982257 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:48.982971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:48.992022 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.992520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.992966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.993676 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.994139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.994584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.135120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.143144 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b64003ba-b0e7-4f18-a843-abcb9802104b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.172691 Nov 02 13:45:49.143729 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4189/8062] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:48 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.169895 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.170753 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:50.177683 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.179367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.179367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.179367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.179802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.180236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.185827 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55658. Nov 02 13:45:50.324367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:50.332921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-63604e25-dfa0-42e9-9e8a-98fba71d8c65 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.169004 Nov 02 13:45:50.333517 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3874/8063] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:51.356160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:51.356784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:51.372590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.373094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.373553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.374279 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.374752 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.375231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.380779 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55664. Nov 02 13:45:51.384125 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55666. Nov 02 13:45:51.515134 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:51.522992 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4b103c45-3831-4821-9883-0ddda57f2b31 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.170808 Nov 02 13:45:51.523594 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4190/8064] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:51 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:52.547024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.547619 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:52.554919 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.555429 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.555870 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.556571 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.557027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.557458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.699421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.708347 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-13042eb6-cb25-4053-afe2-168a674c3ba7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.165347 Nov 02 13:45:52.708930 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3875/8065] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:53.742191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.742191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:53.742191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.742191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.742191 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.743181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.743181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.743482 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.881445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:53.889348 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9247aafb-ae78-4a5f-8068-ac2371a8c63e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.160688 Nov 02 13:45:53.889949 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4191/8066] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:54.912842 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.913463 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.920344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.920825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.921261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.921951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.922403 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.922827 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.055881 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:55.064024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d84806fb-763f-4b0a-8bd0-b028dd220b6c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.155082 Nov 02 13:45:55.064616 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3876/8067] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.088040 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.088661 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.095565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.096055 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.096503 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.097205 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.097674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.098122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.231748 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.239841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3036d169-44de-4366-a7da-f6ba411d685f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.156191 Nov 02 13:45:56.240430 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4192/8068] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:57.264054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.264746 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.272417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.272913 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.273358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.274066 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.274529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.274967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.410304 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:57.418830 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3ecb8a28-14f9-4da8-9099-eef99601a202 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.158993 Nov 02 13:45:57.419445 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3877/8069] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:57 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:58.443801 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:58.444424 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:58.451696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.452200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.452657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.453375 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.453848 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.454287 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.593426 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:58.602012 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6cee5ad-ec5c-4e87-b14c-6e27338f1f82 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.162325 Nov 02 13:45:58.602587 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4193/8070] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:58 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:59.625896 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.626536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.634535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.635038 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.635484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.636185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.636645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.637077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.775540 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:59.783646 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1720bc62-cb29-46b6-924b-d717990e7290 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1702 microversion: 2.1 time: 0.161698 Nov 02 13:45:59.784430 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3878/8071] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1702 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:00.807492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:00.808282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:00.815805 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.816381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.816895 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.817634 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.818623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.819097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.955334 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:00.963515 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f51985f5-81dd-40e3-b376-afd097eabeb1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1702 microversion: 2.1 time: 0.160172 Nov 02 13:46:00.964102 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4194/8072] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:00 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:01.987422 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.988058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.995249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.997649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.997649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.997649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.997649 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.998245 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.143582 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:02.152288 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fce1cb14-705e-4b7e-a2d7-a80ed337e338 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.169116 Nov 02 13:46:02.152980 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3879/8073] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:03.178088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:03.179389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:03.190795 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.191890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.192628 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.193498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.194229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.194903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.223921 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "name": "network-vif-plugged", "status": "completed", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:03.237355 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.238286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.239044 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.253199 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] Creating event network-vif-plugged:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h1-855649-4 Nov 02 13:46:03.260145 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-5301597a-4b7a-4d11-8dae-a2a143c4450f req-ed558e25-19ac-40ca-9737-592323bff1a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039951 Nov 02 13:46:03.265297 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3880/8074] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:03.387232 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:03.395303 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-72efcbfa-b74c-4f6d-8ae8-fce9e6095a16 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.222127 Nov 02 13:46:03.397798 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4195/8075] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:03 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:04.422395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.423513 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:04.431063 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.431941 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.432899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.434686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.435439 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.436103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.598385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:04.611532 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9c9ea151-f3ba-44a2-bafa-368d53e77f53 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.194119 Nov 02 13:46:04.620021 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3881/8076] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:05.640558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.641466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:05.648593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.649089 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.649539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.650245 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.650709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.651173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.820080 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:05.841162 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-3d55b3e8-537a-42ae-baad-bcb9abd19665 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.204526 Nov 02 13:46:05.842011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4196/8077] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:05 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:06.867865 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.868796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:06.876207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.876695 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.877128 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.878458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.878918 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.879580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:07.058340 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:07.070240 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3084fa1d-ffc7-4862-86d0-7d714a32cd80 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.206624 Nov 02 13:46:07.087319 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3882/8078] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:08.102316 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:08.103992 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:08.112957 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:08.113590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:08.114300 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:08.115838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:08.116587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:08.117408 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:08.264583 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:08.273242 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-63d9b144-1dae-47ac-ae10-15d90cf0f736 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.175245 Nov 02 13:46:08.273760 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4197/8079] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:08 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:09.305169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:09.305816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:09.313303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:09.313804 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:09.314254 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:09.314970 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:09.315469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:09.315901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:09.485054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:09.493304 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6ab548a9-ac74-4735-bc25-ee829202359c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.198543 Nov 02 13:46:09.494003 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3883/8080] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:09 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:10.517713 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:10.518338 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:10.525731 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:10.526235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:10.526688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:10.527439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:10.528160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:10.528563 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:10.690745 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:10.701221 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ee8c1e2f-eb70-4ad8-8245-e5eb6cbaf03d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.187294 Nov 02 13:46:10.702144 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4198/8081] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:10 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:11.726096 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:11.726734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:11.734155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:11.739825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:11.739825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:11.739825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:11.739825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:11.739825 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:11.879955 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:11.888059 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ba78c8e4-a267-4d1f-b773-e0e28637d247 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.166417 Nov 02 13:46:11.888449 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3884/8082] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:11 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:12.913389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:12.914209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:12.922919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:12.923658 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:12.924218 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:12.925260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:12.925976 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:12.926700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:13.070560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:13.078794 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0919b5c8-3a9c-4f93-9229-4bed4657a18e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1697 microversion: 2.1 time: 0.170673 Nov 02 13:46:13.079418 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4199/8083] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:12 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:14.102455 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:14.103115 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:14.110093 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:14.110590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:14.111132 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:14.111852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:14.112314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:14.112749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:14.255399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:14.264337 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a56ca65-0eec-4b2d-8f8a-6e2fa1b7838c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1679 microversion: 2.1 time: 0.165861 Nov 02 13:46:14.264978 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3885/8084] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:14 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:15.289221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:15.290383 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:15.297505 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:15.298096 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:15.298621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:15.299804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:15.300682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:15.301806 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:15.447353 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:15.455423 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2848d077-609e-4255-97a3-dde7cef03c94 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1679 microversion: 2.1 time: 0.170211 Nov 02 13:46:15.456207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4200/8085] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:15 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:16.479417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:16.480039 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:16.486927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.487382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.487821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.488512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.488964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.489388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.628951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:16.636921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b559db26-b0a7-4032-ae11-1bf13ef4385f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1682 microversion: 2.1 time: 0.162181 Nov 02 13:46:16.637496 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3886/8086] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:16 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:16.661001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:16.661621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:16.669200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.669702 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.670160 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.670871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:16.671369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:16.671812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:16.776652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:46:17.091913 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [a86afada-22b6-4d03-adf6-147c3860d733] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:46:17.207597 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "name": "network-vif-unplugged", "status": "completed", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:17.217727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:17.223271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:17.223271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:17.229502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_external_events [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] Unable to find a host for instance 3e252773-3b17-4640-a153-5c616fdb6b79. Dropping event network-vif-unplugged {{(pid=127568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:46:17.230395 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e7a50c6d-68d3-4581-8a32-a9e05b50c2ac req-ce9651ce-971f-45ea-9806-1104d25bad8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026876 Nov 02 13:46:17.230995 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3887/8087] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 13:46:18.098850 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [a86afada-22b6-4d03-adf6-147c3860d733] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55770. Nov 02 13:46:18.336135 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a24482ca-1fbe-40af-9cac-87f412ee731a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action" status: 202 len: 0 microversion: 2.1 time: 1.445178 Nov 02 13:46:18.336135 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4201/8088] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:46:16 2022] POST /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79/action => generated 0 bytes in 1446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-cb92e907-fae8-40bb-8b4b-918888571aaa tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1630 microversion: 2.1 time: 0.159879 Nov 02 13:46:18.340383 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3888/8089] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:18 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:19.293508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:19.294154 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:19.300091 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:19.304877 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:19.305373 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:19.305817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:19.306529 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:19.307085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:19.316208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:19.316208 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:19.438836 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:19.446578 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-732b288b-660b-4dc9-8437-2018ebe84122 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1630 microversion: 2.1 time: 0.157828 Nov 02 13:46:19.447707 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4202/8090] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:19 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1630 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:20.471060 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:20.471674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:20.473975 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:20.480350 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:20.480899 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:20.481386 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:20.482119 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:20.482668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:20.483153 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:20.621666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:20.630169 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-600ae54e-0f32-46d2-b30a-8573fdaded38 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1630 microversion: 2.1 time: 0.163778 Nov 02 13:46:20.630753 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3889/8091] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:20 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1630 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:21.655409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:21.656039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:21.662665 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.663206 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.663655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.664380 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:21.667143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:21.667143 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:21.804051 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:21.814181 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a990a4ca-ab7d-4997-91cd-69bd811c59af tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.164112 Nov 02 13:46:21.814787 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4203/8092] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:21 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:22.284332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:22.296268 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.296948 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.297555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.310392 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] Creating event network-changed:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h2-855649-4 Nov 02 13:46:22.315740 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-42a2447e-8269-4338-87a9-31c41e605a91 req-e3e5c8cd-02bc-470a-846d-a37d18e11a1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035183 Nov 02 13:46:22.316451 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3890/8093] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:22.838256 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:22.838880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:22.847183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.848249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.848699 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.849490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:22.849962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:22.850402 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:22.991729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:23.000954 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f833750c-bfd1-427b-8fcc-4b07e485334b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.166569 Nov 02 13:46:23.003041 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4204/8094] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:22 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:24.030780 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:24.031512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:24.037808 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.038296 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.038737 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.039488 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:24.039951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:24.040382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:24.200331 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:24.210024 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-42a2b17e-ff85-403c-ac30-f27bb3df147c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.184062 Nov 02 13:46:24.210578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3891/8095] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:24 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:25.234775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:25.235523 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:25.243072 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.243593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.244061 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:25.244791 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:25.245266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:25.245756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:25.398696 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:25.407572 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a36a2b23-2654-4a38-83fd-38007ea801f8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.177425 Nov 02 13:46:25.408424 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4205/8096] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:25 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:26.432275 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:26.433023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:26.440989 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:26.441606 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:26.442196 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.443077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:26.443581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:26.444098 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:26.605374 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:26.610732 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eded829e-d6c6-4f2d-9bea-5d8e891eebfc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.183011 Nov 02 13:46:26.611443 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3892/8097] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:26 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:27.637592 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:27.640254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:27.654172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.655018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.655811 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.657193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:27.658034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:27.659209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:27.968518 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:27.977458 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ac0fae45-046d-40bf-8743-a5e3c18d5659 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.345806 Nov 02 13:46:27.991851 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4206/8098] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:27 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:29.001661 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:29.002221 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:29.009357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.009851 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.010295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.011539 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:29.011999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:29.012424 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:29.192901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:29.202471 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-50598651-27f1-4b00-b8f4-4e96396a1146 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.204708 Nov 02 13:46:29.215578 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3893/8099] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:28 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:30.227394 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:30.228092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:30.236510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.237146 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.237673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.238535 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.239114 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.239568 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.453431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:30.466619 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-78fdd4b9-6635-4513-9181-262cbf0f8609 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.242928 Nov 02 13:46:30.468957 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4207/8100] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:30 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:31.496879 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:31.497481 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:31.504625 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.505108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.505548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.506235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:31.506767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:31.507159 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:31.725183 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:31.733353 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8ac0aee6-31c5-4d1e-a37d-95c7055ce4f7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.240921 Nov 02 13:46:31.733893 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3894/8101] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:31 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:32.757844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:32.758476 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:32.766010 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.766513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.766966 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.771349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.771349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.771349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.906274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:32.914088 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-26287b62-7450-4731-9a96-2d5a31372ba6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.160249 Nov 02 13:46:32.914673 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4208/8102] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:32 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:33.937676 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.938289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:33.945243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.945728 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.946173 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.946908 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.947388 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.947816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:34.082102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:34.090613 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-02187b6c-d6ce-44c0-a376-a07d579cf18b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.156377 Nov 02 13:46:34.091232 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3895/8103] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:35.114497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.115268 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:35.122824 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.123349 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.123804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.124539 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.125032 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.125473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.255729 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.263468 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-600a440d-e37e-485a-a89f-5833f8bc7912 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.152993 Nov 02 13:46:35.264042 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4209/8104] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:36.287380 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:36.287999 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:36.295564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.296058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.296501 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.297217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.297674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.298107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.430324 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:36.438831 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2d551f00-743d-4087-9968-826cba5a1b1d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.155463 Nov 02 13:46:36.439450 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3896/8105] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:36 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:37.462495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:37.463174 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:37.470673 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.471211 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.471663 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.472369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:37.472835 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:37.473271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.608188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.616128 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a0434b09-1b6a-4ced-a458-d3657386120b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.157552 Nov 02 13:46:37.616705 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4210/8106] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:37 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:38.639981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.640621 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.647536 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.648018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.648452 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.649148 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.649600 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.650020 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.793632 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.802116 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6b88853f-75a5-4044-bae5-c696c2909ff2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.166048 Nov 02 13:46:38.802701 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3897/8107] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:39.827968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:39.828794 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:39.836368 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.836964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.837352 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.838086 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.838559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.839025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.977502 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:39.986194 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fbc22c14-8aac-49db-a5cd-92eeba22951a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.162992 Nov 02 13:46:39.986791 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4211/8108] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:39 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:41.009957 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:41.010572 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:41.018086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.018502 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.018938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.019680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.020133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.020566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.167427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:41.175841 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ec7668d6-3edc-443d-9fec-216c24f6a6fe tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.169907 Nov 02 13:46:41.179696 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3898/8109] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:41 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:41.223067 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "name": "network-vif-plugged", "status": "completed", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:41.233572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.234062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.234509 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.246282 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] Creating event network-vif-plugged:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h2-855649-4 Nov 02 13:46:41.252081 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-36488c14-bd1e-477c-844c-32cf5989e61e req-ffbc96e6-006e-4ab4-b38d-20d6c6b68369 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Nov 02 13:46:41.253239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4212/8110] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:42.199684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:42.200302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:42.207217 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.207721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.208162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.208854 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:42.209311 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:42.209742 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.351430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.354912 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15100417-e627-4629-b771-51cf212228bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.159144 Nov 02 13:46:42.355522 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3899/8111] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:42 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:43.380171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.380886 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.387231 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.387750 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.388197 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.388899 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.389363 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.389800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.527471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:43.535786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a0ffd23-a97c-4121-8f01-f8f6058966bf tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1688 microversion: 2.1 time: 0.161061 Nov 02 13:46:43.536360 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4213/8112] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:44.560636 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.561166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.568635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.569123 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.569561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.570262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.570714 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.571167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.709593 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:44.717858 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3cf63535-ebc2-4b41-b949-550569cb1e3f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1675 microversion: 2.1 time: 0.162082 Nov 02 13:46:44.718447 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3900/8113] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:33.711692 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:33.712331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:33.715017 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=23 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:33.715697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=67 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:33.721785 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.722790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.722790 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.723483 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.723953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.724391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.753039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:33.793648 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:48:33.794924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=23 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:33.795745 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=68 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:33.796574 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:48:33.796719 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:48:33.853563 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:33.863104 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:33.863589 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:33.864025 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.877213 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] Creating event network-changed:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h2-855649-4 Nov 02 13:48:33.883414 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3c48dc73-1890-4b54-a088-a69fac77dd18 req-ab5a2fbd-be92-48b2-b1aa-b6961b080d74 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096216 Nov 02 13:48:33.884034 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3901/8114] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:48:34.130281 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-da547ec5-10b5-447d-9ef6-881e2e7dabac tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 204 len: 0 microversion: 2.1 time: 0.423808 Nov 02 13:48:34.133885 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4214/8115] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:48:33 2022] DELETE /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:34.146338 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:34.147090 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:34.153630 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.154207 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.154662 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.155427 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.155892 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.156335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.301045 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:34.309953 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-3d696712-c700-466f-83e6-baacd1835396 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.168334 Nov 02 13:48:34.310545 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3902/8116] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:34 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:35.382161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:35.384350 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:35.389238 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.389776 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.390240 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.390953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:35.391455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:35.391900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.532885 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.543022 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-202437ff-5f2b-492d-a62c-9459cf8ffa05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1681 microversion: 2.1 time: 0.211993 Nov 02 13:48:35.543734 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4215/8117] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:35 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:36.059645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e252773-3b17-4640-a153-5c616fdb6b79", "name": "network-vif-deleted", "tag": "da54c005-9136-4266-a738-51e74c9c2d65"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:36.070857 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.071821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.071821 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.084462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] Creating event network-vif-deleted:da54c005-9136-4266-a738-51e74c9c2d65 for instance 3e252773-3b17-4640-a153-5c616fdb6b79 on n-h2-855649-4 Nov 02 13:48:36.089414 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-bfafaafa-5129-44e6-a177-09eb660affc5 req-851c739d-c483-4e38-a42d-11687c0085e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Nov 02 13:48:36.090011 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3903/8118] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:48:36.568854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.569395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.576168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.576664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.577116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.577812 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.578278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.578720 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.614120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.614620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.615088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.615554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lazy-loading 'fault' on Instance uuid 3e252773-3b17-4640-a153-5c616fdb6b79 {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:36.657289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:36.665747 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d73e0bd1-927e-46ec-a690-8480575d39ec tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 200 len: 1337 microversion: 2.1 time: 0.100970 Nov 02 13:48:36.666319 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4216/8119] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:37.687279 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55968. Nov 02 13:48:37.691469 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.692182 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: 3e252773-3b17-4640-a153-5c616fdb6b79] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.698967 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.699807 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.700061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.700772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.701236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.701666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.715623 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] HTTP exception thrown: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Request method failure captured: Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 HTTP/1.1 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYnQAvYLicBmlhcaCcXL-USql3XfMefmq1H1hpKQzkTbTt6K-CAno2vFSSfSvVfGGxUHob_uMbOIosLUaQtBYlpBsQ6Ehrfpo3Q3jlARtM7kWQFE7e1pTMJVSU0m0UJV0tfQSyKZFk9in9OQ9_SV38ZVmMpLkSm3ekqSMc9Aj-J1QAF8 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 3a98de562bce47349656a4b64db5293d Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestShelveInstance-805925242 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a98de562bce47349656a4b64db5293d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a98de562bce47349656a4b64db5293d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a98de562bce47349656a4b64db5293d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a98de562bce47349656a4b64db5293d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestShelveInstance-805925242 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 3a98de562bce47349656a4b64db5293d Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestShelveInstance-805925242 Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestShelveInstance-805925242-project Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 6a05d3fc822c4be882546434c19d374f Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestShelveInstance-805925242-project Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': '3e252773-3b17-4640-a153-5c616fdb6b79'} Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:37.717484 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Returning 404 to user: Instance 3e252773-3b17-4640-a153-5c616fdb6b79 could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-65d24e8a-b1ef-41ff-ad4e-381dd6494e78 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79" status: 404 len: 111 microversion: 2.1 time: 0.033289 Nov 02 13:48:37.724732 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3904/8120] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/servers/3e252773-3b17-4640-a153-5c616fdb6b79 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:48:37.988379 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f7d0dc6b-dfea-4a92-8977-b856c4b1d025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '.version_select at 0x7ff1b04d9280>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:38.083633 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f7d0dc6b-dfea-4a92-8977-b856c4b1d025 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1644961549" status: 202 len: 0 microversion: 2.1 time: 0.099164 Nov 02 13:48:38.084261 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4217/8121] 10.222.0.48 () {58 vars in 1254 bytes} [Wed Nov 2 13:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1644961549 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:38.110930 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-098f8164-9881-46ce-9c0f-07a4fd64139b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'create', calling method: .version_select at 0x7ff1b334ec10>, body: {"keypair": {"name": "tempest-TestShelveInstance-284120859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOU/Q/JCAOJgRdYoIHuJMMjMVbcUBhR+VOf3l0BYkjLCSHkhr7jWIvcHVuHIvgh9MgA3UrJItNNEie67IzSsOUTlLdIeB3YqWoanTVdaUfEFSeXhQ+ufsJFk+AXm+mSYQ=="}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:38.126770 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-098f8164-9881-46ce-9c0f-07a4fd64139b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for project 3a98de562bce47349656a4b64db5293d. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:38.131971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-098f8164-9881-46ce-9c0f-07a4fd64139b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for user 6a05d3fc822c4be882546434c19d374f and project 3a98de562bce47349656a4b64db5293d. Resources: {'key_pairs'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:38.238222 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-098f8164-9881-46ce-9c0f-07a4fd64139b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.131108 Nov 02 13:48:38.238748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3905/8122] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:48:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:02.984288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:02.985070 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:02.989065 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1025744039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-284120859", "security_groups": [{"name": "tempest-secgroup-smoke-1917709633"}], "networks": [{"uuid": "880ec782-4dd6-41c0-984b-ad6679471903"}], "block_device_mapping_v2": [{"uuid": "f9cb6002-dcf9-4476-9014-1d9d8a697149", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:03.107582 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.network.neutron [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] validate_networks() for [('880ec782-4dd6-41c0-984b-ad6679471903', None, None, None, None, None)] {{(pid=127567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:03.584570 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Flavor limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:03.585012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Image limits 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:03.585534 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Flavor pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:03.585963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Image pref 0:0:0 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:03.586391 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.virt.hardware [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:03.596401 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.596905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.597361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.598116 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.599638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.599638 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.619526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for project 3a98de562bce47349656a4b64db5293d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:03.625449 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Getting quotas for user 6a05d3fc822c4be882546434c19d374f and project 3a98de562bce47349656a4b64db5293d. Resources: {'ram', 'instances', 'cores'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:03.686685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Going to run 1 instances... {{(pid=127567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:03.688968 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9cb6002-dcf9-4476-9014-1d9d8a697149',volume_size=None,volume_type=None)] {{(pid=127567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:04.199178 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74fa8402-b619-465c-be7a-54e6fa2a3373 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217106 Nov 02 13:49:04.199802 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4218/8123] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:49:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:49:04.209222 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=12 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:04.210019 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:04.210652 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:04.215552 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-7fba904c-bd59-4d8d-ad56-3715ab79de33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:04.216135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-7fba904c-bd59-4d8d-ad56-3715ab79de33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:04.270417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-7fba904c-bd59-4d8d-ad56-3715ab79de33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:04.277652 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-7fba904c-bd59-4d8d-ad56-3715ab79de33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1088 microversion: 2.1 time: 0.070229 Nov 02 13:49:04.279125 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3906/8124] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:04 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:05.303936 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-70c533c4-c5a9-4033-b2fd-6199426d141f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:05.304688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-70c533c4-c5a9-4033-b2fd-6199426d141f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:05.362804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-70c533c4-c5a9-4033-b2fd-6199426d141f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:05.370338 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-70c533c4-c5a9-4033-b2fd-6199426d141f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1088 microversion: 2.1 time: 0.070779 Nov 02 13:49:05.371769 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4219/8125] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:05 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:06.394747 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-db329610-8964-4384-999a-0ec55e873d75 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:06.395425 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-db329610-8964-4384-999a-0ec55e873d75 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:06.452883 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-db329610-8964-4384-999a-0ec55e873d75 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:06.462264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-db329610-8964-4384-999a-0ec55e873d75 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1088 microversion: 2.1 time: 0.071443 Nov 02 13:49:06.463223 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3907/8126] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:06 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:07.484796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a5072f6c-7b14-4e07-8889-7766f9cef907 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:07.485425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a5072f6c-7b14-4e07-8889-7766f9cef907 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:07.539958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a5072f6c-7b14-4e07-8889-7766f9cef907 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:07.547209 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a5072f6c-7b14-4e07-8889-7766f9cef907 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1088 microversion: 2.1 time: 0.066320 Nov 02 13:49:07.547850 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4220/8127] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:07 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:08.569548 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.570069 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.577869 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.578357 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.578802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.579592 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.580079 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.580516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.645925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.653815 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-46a11658-88ad-49c1-bf4e-864b5aa88e23 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1138 microversion: 2.1 time: 0.088432 Nov 02 13:49:08.660993 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3908/8128] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:09.678183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:09.678810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:09.686013 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.686516 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.686962 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.688325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.688789 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.689224 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.751611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.759561 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ce04bdba-842b-4b4b-9585-99c9dd339ca8 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1130 microversion: 2.1 time: 0.085138 Nov 02 13:49:09.760133 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4221/8129] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:09 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.783278 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.783932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.791230 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.791858 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.792303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.793009 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.793674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.794102 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.866727 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.875917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1d2b25ea-f4da-4e0f-8f77-186f8f2b988d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1204 microversion: 2.1 time: 0.097329 Nov 02 13:49:10.876509 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3909/8130] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:11.900771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.901404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:11.908561 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.909064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.909922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.910229 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.910701 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.911171 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.174239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:12.174239 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d12bed0-72db-4284-85a8-1c96af823129 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1272 microversion: 2.1 time: 0.263653 Nov 02 13:49:12.174239 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4222/8131] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:12.858141 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:12.869694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.869694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.869694 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.886475 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] Creating event network-changed:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h1-855649-4 Nov 02 13:49:12.893339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-9db6f876-1f9a-40d5-9780-c089382b13ad req-8ecd535a-4fae-48ea-b918-da17ca385908 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091227 Nov 02 13:49:12.894217 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3910/8132] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:13.188552 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:13.189188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:13.197023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.197023 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.197425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.198137 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:13.198599 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:13.199060 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.606964 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:13.702217 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.710901 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-833ca6bc-d0c8-4592-97ae-f56b34ef73eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1272 microversion: 2.1 time: 0.527009 Nov 02 13:49:13.711704 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4223/8133] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:13 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1272 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:14.734381 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:14.735137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.742560 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.743081 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.743530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.744243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.744709 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.745149 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.881976 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:14.889977 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-d9900abf-628e-4959-91fc-bd736ced6ad9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1272 microversion: 2.1 time: 0.159934 Nov 02 13:49:14.890576 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3911/8134] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:14 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:15.912817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.913445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.920243 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.920882 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.921180 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.921894 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.922372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.922814 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.060389 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.069437 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0ff8dfc1-6150-427c-8878-25263b9721b4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1272 microversion: 2.1 time: 0.160382 Nov 02 13:49:16.070287 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4224/8135] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:17.092391 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.093077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.100367 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=4 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:17.100844 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.104861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.104861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.104861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.104861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.104861 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.242226 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:17.251029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fe9fc726-4c2f-40ee-9722-3100eb9acacb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.162493 Nov 02 13:49:17.251633 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3912/8136] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:17 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:18.273871 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:18.274433 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:18.277106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=10 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:18.281995 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.282494 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.282948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.283681 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.284166 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.284606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.420919 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.429372 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4a3c9f7-55b7-47da-99b9-679ff373d84e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.159509 Nov 02 13:49:18.429944 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4225/8137] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:18 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:19.453459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.454185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:19.461305 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.461797 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.462243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.462947 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.463435 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.463867 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.598298 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.606344 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dbe90a95-657b-40d7-a28d-dca64c13d7ba tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.157544 Nov 02 13:49:19.606943 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3913/8138] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:19 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:20.630088 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.630758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:20.637756 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.638260 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.638722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.639471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.639947 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.640971 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.774094 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.781815 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0895f157-89d8-4322-8f15-e8c3b9bcaf67 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.155695 Nov 02 13:49:20.782379 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4226/8139] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:20 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:21.804664 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:21.805293 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:21.812646 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.813138 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.813629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.814332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.814788 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.815248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.954085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.961921 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b5136def-ddf3-4078-b09d-fcb190f4ad33 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.161323 Nov 02 13:49:21.962514 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3914/8140] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:21 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:22.985472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.986138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.992498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.993031 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.993495 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.994213 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.994686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.995169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.130851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:23.139058 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-f87da8b7-330e-4f78-9756-42988a8b278a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.158282 Nov 02 13:49:23.139640 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4227/8141] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:24.162968 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.168295 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.170598 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.171131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.171568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.172903 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.173358 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.173880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.311946 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:24.319898 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a67462f3-2100-4ee8-8f2f-567db893787f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.160734 Nov 02 13:49:24.320428 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3915/8142] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:25.343364 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:25.344181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:25.351122 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.351622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.352076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.352782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.353342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.353829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.490727 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.499131 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-173860ef-8c4b-459a-9045-e2dfd53f636b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.159828 Nov 02 13:49:25.499696 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4228/8143] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:25 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:26.315456 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "name": "network-vif-plugged", "status": "completed", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:26.325438 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.325924 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.326365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.337540 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] Creating event network-vif-plugged:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h1-855649-4 Nov 02 13:49:26.342852 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-c60cf2aa-618d-46d5-a415-d2bcbcb93149 req-1c15fe5a-fc74-47c2-8065-a3ac6061198a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082542 Nov 02 13:49:26.345794 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3916/8144] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:26.522655 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:26.523305 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:26.530021 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.530513 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.530960 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.532193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.532667 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.533106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.673168 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:26.680899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2da4e83a-e77b-454f-bc86-c11d8cb2ea40 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1260 microversion: 2.1 time: 0.162128 Nov 02 13:49:26.681480 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4229/8145] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.705194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.705915 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.713086 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.713576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.714024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.714733 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.715220 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.715654 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.854590 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.862492 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa7fc441-e27b-498c-a223-0a482bba46d9 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1444 microversion: 2.1 time: 0.162253 Nov 02 13:49:27.863122 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3917/8146] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:27.885431 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:27.886053 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:27.893565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.894062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.894508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.895252 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:27.895726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:27.896165 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.030467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.038899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-7d8efce0-78db-4aa2-9635-2773147deebc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1444 microversion: 2.1 time: 0.157351 Nov 02 13:49:28.039706 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4230/8147] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:49:27 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:30.202042 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:30.213385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.213866 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.214335 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.226339 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] Creating event network-changed:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h1-855649-4 Nov 02 13:49:30.231606 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-56a0f398-a317-4d00-b731-db98530bc4c2 req-8ad726fd-e420-46dd-a5fc-e0aa89c0aec8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033344 Nov 02 13:49:30.232241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3918/8148] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:56.687144 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:51:56.688281 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:51:56.688922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:56.689694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=62 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:56.690621 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:56.690769 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action (ip 10.222.0.48) !!! Nov 02 13:51:56.691940 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:56.692060 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action (ip 10.222.0.48) !!! Nov 02 13:51:56.693084 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:56.693186 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action (ip 10.222.0.48) !!! Nov 02 13:51:56.698323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:56.698879 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:56.711172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.711679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.712181 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.712866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.713336 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.713782 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.742186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.objects.instance [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lazy-loading 'flavor' on Instance uuid d54a540b-df3f-438e-917d-42d473e4784d {{(pid=127567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:51:57.044307 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-54bad70d-623d-4bb1-852b-f9f9f904fe1c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action" status: 202 len: 0 microversion: 2.1 time: 0.358665 Nov 02 13:51:57.044784 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4231/8149] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:51:56 2022] POST /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:57.053455 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:51:57.054263 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:51:57.054887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=30 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:57.055680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=54 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:57.056558 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:57.056686 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d (ip 10.222.0.48) !!! Nov 02 13:51:57.058913 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:57.059089 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d (ip 10.222.0.48) !!! Nov 02 13:51:57.060888 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:51:57.064951 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d (ip 10.222.0.48) !!! Nov 02 13:51:57.074509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.075261 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:57.087302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.087794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.088243 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.088944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.089405 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.089840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.320953 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:57.329620 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5955c1b1-f5e1-43d4-8a89-d55594391392 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.278469 Nov 02 13:51:57.330200 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3919/8150] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:58.361951 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:58.362674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:58.374086 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56334. Nov 02 13:51:58.376413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.376921 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.377378 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.378102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.378578 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.379037 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.379669 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56332. Nov 02 13:51:58.574339 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:58.583087 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e6a5565d-f50a-4597-ba22-943555485874 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.226858 Nov 02 13:51:58.583680 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4232/8151] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:58 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:59.606580 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:59.607156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:59.620881 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56346. Nov 02 13:51:59.621865 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56348. Nov 02 13:51:59.623794 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.624292 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.624717 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.625426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:59.625885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:59.626346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.761449 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:59.769996 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8fb50a1e-230f-444e-8e4b-0fd1b7fa3b25 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.167406 Nov 02 13:51:59.770574 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3920/8152] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:51:59 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:00.793725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:00.794351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:00.807222 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.807739 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.808227 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.808975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.809452 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.809903 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.946219 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:00.954335 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9a0f4383-0d19-4ad3-a826-921cbba5c6fc tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.164530 Nov 02 13:52:00.956284 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4233/8153] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:00 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:01.980133 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:01.980790 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:01.989803 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.990289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.990730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.991457 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.991912 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.992341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.128012 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:02.136887 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8a9b8b3f-2ba3-4560-bb6c-4425cd72a04f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.160657 Nov 02 13:52:02.137482 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3921/8154] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:01 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:03.160077 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:03.160710 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:03.167625 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.168129 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.168587 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.169306 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.169781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.170228 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.309097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:03.317587 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-a9166b34-b66c-4ee2-a7fa-107794711fd0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.161445 Nov 02 13:52:03.318247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4234/8155] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:03 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:04.342645 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:04.343961 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:04.351083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.351570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.352008 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.352732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:04.353184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:04.353608 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.488982 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:04.497267 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ca45c436-2c95-4161-ad1d-a7dec11b1b68 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.158556 Nov 02 13:52:04.498132 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3922/8156] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:04 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:05.525887 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.526551 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:05.534547 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.535087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.535559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.536303 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.536777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.537241 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.680694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.689067 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e5cce69f-cfa4-4626-a7bc-c125a19b8fd2 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.170621 Nov 02 13:52:05.689670 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4235/8157] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:06.713169 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:06.713701 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:06.720898 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.721389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.721826 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.722648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.723136 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.723566 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.868032 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:06.876733 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-278c7556-8273-4475-bc9c-a1ef9106d47d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.168182 Nov 02 13:52:06.877299 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3923/8158] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:06 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:07.899775 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:07.900411 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:07.907329 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.907832 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.908289 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:07.909001 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:07.909475 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:07.909917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:08.040606 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:08.048980 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af41d74f-e2ec-4b51-8735-221db7ecf7b6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.153126 Nov 02 13:52:08.049551 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4236/8159] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:07 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:09.071986 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:09.072700 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:09.080225 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.080710 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.081150 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.081846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:09.082303 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:09.082734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:09.216741 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:09.224688 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-35b2d2ca-7cee-42dd-9a6d-79c273c03f05 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.156709 Nov 02 13:52:09.225265 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3924/8160] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:09 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:10.249690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:10.250344 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:10.257804 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:10.258314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:10.258771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:10.259554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:10.260015 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:10.260461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:10.403796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:10.412317 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fb86b4e0-c327-4aa0-957c-4ef4eead3b2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.167020 Nov 02 13:52:10.412900 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4237/8161] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:10 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:11.435995 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:11.436535 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:11.444016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.444503 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.444944 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.445653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:11.446114 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:11.446544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:11.591713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:11.599658 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-6525dc3f-a58b-4093-91cc-1f3f99f2d9eb tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.167812 Nov 02 13:52:11.600238 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3925/8162] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:11 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:12.623913 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:12.624657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:12.631935 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.632445 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.632902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.633623 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.634102 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.634553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.749814 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "name": "network-vif-unplugged", "status": "completed", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:12.761155 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.761687 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.762121 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.771620 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:12.774015 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.compute.server_external_events [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] Unable to find a host for instance d54a540b-df3f-438e-917d-42d473e4784d. Dropping event network-vif-unplugged {{(pid=127568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:52:12.774917 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d692f977-3415-486c-ab32-bdf1e5218e03 req-45978c60-afbe-4ea5-a0a4-8a87826593a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030124 Nov 02 13:52:12.778794 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3926/8163] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 13:52:12.780324 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8ec20960-4b4b-468d-b846-bdabf4949be0 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1509 microversion: 2.1 time: 0.160578 Nov 02 13:52:12.780892 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4238/8164] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:12 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:12.803271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:12.806327 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:12.809877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.810373 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.810799 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.811525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:12.811985 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:12.812418 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:12.944146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 13:52:13.251886 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-f602e36d-ed46-4aeb-8af8-5eaf4865970d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "POST /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action" status: 202 len: 0 microversion: 2.1 time: 0.452455 Nov 02 13:52:13.252741 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3927/8165] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:52:12 2022] POST /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:52:13.261074 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:13.261974 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:13.277657 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.278239 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.278787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.279861 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:13.280590 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:13.281035 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:13.455910 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:13.464274 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-aa6d72ae-449d-40ee-a153-03c565158416 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1517 microversion: 2.1 time: 0.207135 Nov 02 13:52:13.464861 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4239/8166] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:13 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:14.488696 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:14.489348 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:14.495749 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:14.496239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:14.496674 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:14.497375 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:14.498088 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:14.498516 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:14.649426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:14.657584 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-c7311aa2-f0e4-4324-8835-273117f41bff tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1519 microversion: 2.1 time: 0.173669 Nov 02 13:52:14.658158 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3928/8167] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:14 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:15.681123 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:15.681755 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:15.688675 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.689201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.689651 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.690435 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:15.690907 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:15.691439 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:15.838271 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:15.847071 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fff7da31-515a-480d-8d10-b27e09b47f95 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1519 microversion: 2.1 time: 0.169836 Nov 02 13:52:15.847664 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4240/8168] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:15 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:16.871186 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:16.872146 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:16.879330 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.879925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.880442 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.881218 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.881877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.882707 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:17.030830 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:17.040029 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2f84a7ad-3864-4166-bff9-5ddda61f9fb6 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1519 microversion: 2.1 time: 0.172568 Nov 02 13:52:17.040630 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3929/8169] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:16 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:18.063567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:18.064139 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:18.071325 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.071826 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.072284 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.072993 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:18.073468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:18.073934 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:18.210057 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:18.218149 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2c2347d6-425d-496a-af6d-aa4ea2d75443 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1519 microversion: 2.1 time: 0.159141 Nov 02 13:52:18.218731 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4241/8170] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:18 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:19.242266 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:19.242894 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:19.250321 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.251459 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.251927 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.252614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:19.253103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:19.253541 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:19.392160 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:19.400221 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a5a30499-6e75-4664-9e1e-3526d500267c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1519 microversion: 2.1 time: 0.161899 Nov 02 13:52:19.400803 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3930/8171] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:19 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:20.424262 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:20.424928 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:20.431859 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.432362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.432816 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.433536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:20.434008 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:20.434454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:20.572844 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:20.580939 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c80d424f-9dc5-45bc-8348-aae1d0419fae tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.161246 Nov 02 13:52:20.581620 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4242/8172] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:20 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:21.565299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:21.576616 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.577106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.577554 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.589616 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] Creating event network-changed:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h2-855649-4 Nov 02 13:52:21.596629 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-4f463041-ef70-4f28-810a-8bf2e3010735 req-45af5ddc-b58d-4976-82c2-28c6ec087343 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Nov 02 13:52:21.597275 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3931/8173] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:21.604914 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:21.605646 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:21.612981 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.613500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.613955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.614687 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:21.615200 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:21.615688 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:21.758829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:21.767105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b2ac46d5-b831-4a15-a8ea-acc21acb3585 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.166191 Nov 02 13:52:21.767697 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4243/8174] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:21 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:22.792085 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:22.792792 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:22.799570 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.800056 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.800493 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.801187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:22.801641 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:22.802068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:22.939529 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:22.947389 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-277de243-38c7-4877-9b49-fbd1b28665c4 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.160410 Nov 02 13:52:22.947970 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3932/8175] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:22 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:23.971202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:23.971872 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:23.978479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.979005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.979468 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:23.980190 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:23.980664 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:23.981111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:24.116820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:24.125247 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-42238f29-e6cb-4599-9bcb-2530a9660e2f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.157973 Nov 02 13:52:24.125848 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4244/8176] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:23 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:25.149058 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:25.149684 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:25.156837 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.157322 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.157766 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.158499 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:25.158958 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:25.159408 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:25.298617 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:25.306856 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-89fb565d-8114-4154-a4e8-000618f020f3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.162101 Nov 02 13:52:25.307468 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3933/8177] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:25 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:26.330076 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:26.330700 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:26.337520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.338012 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.338461 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.339202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:26.339671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:26.340111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:26.358480 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:26.478387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:26.487056 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-994927aa-644d-4722-bb03-8fc86f227199 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.160781 Nov 02 13:52:26.487623 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4245/8178] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:26 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:27.510581 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:27.511235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:27.514024 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:27.518787 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.519314 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.519796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.521518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:27.521984 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:27.522420 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:27.525103 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:27.654028 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:27.661775 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1e5ada79-49eb-4d2d-a7e0-860685cada2b tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.155160 Nov 02 13:52:27.662355 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3934/8179] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:27 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:28.686198 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:28.686948 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:28.689087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=31 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:28.693892 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:28.694370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:28.694817 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:28.695554 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:28.696047 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:28.696508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:28.834135 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:28.842105 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0a262837-10f6-4de7-a9bc-45629de51a2d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.160116 Nov 02 13:52:28.842689 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4246/8180] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:28 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:29.866586 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:29.867236 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:29.874555 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.880998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.880998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:29.880998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:29.880998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:29.880998 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:30.023796 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:30.032525 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b871da7a-5212-4518-b39a-c8b2a5c5d06d tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.169884 Nov 02 13:52:30.033130 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3935/8181] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:29 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:31.056282 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:31.056918 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:31.064526 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.065030 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.065486 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.066201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:31.066705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:31.067188 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:31.212140 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:31.220687 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-ad5bf197-056f-4e02-adf6-912b78a4090e tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.168399 Nov 02 13:52:31.221273 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4247/8182] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:31 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:32.244544 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:32.245208 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:32.253089 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.253578 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.254023 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.254724 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.255287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.255680 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.387062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:32.394811 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-32d6145d-7ac8-414f-8ff3-9d730b1e138f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.154279 Nov 02 13:52:32.395429 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3936/8183] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:32 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:32.838499 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "name": "network-vif-plugged", "status": "completed", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:32.849204 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:32.849640 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:32.850098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:32.861678 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] Creating event network-vif-plugged:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h2-855649-4 Nov 02 13:52:32.867317 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b7e6cd18-a409-4ada-a835-2866f45e76df req-2a7bf43a-e067-49cf-abf6-5cb1b201e70c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Nov 02 13:52:32.867928 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4248/8184] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:33.419248 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:33.420054 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:33.427528 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.428016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.428461 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.429167 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:33.429629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:33.430062 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:33.561965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:33.569937 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8d23dc46-6172-49c5-bdef-87b66c197aa7 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1575 microversion: 2.1 time: 0.154728 Nov 02 13:52:33.570520 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3937/8185] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:33 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:34.594726 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:34.595473 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:34.602870 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.603415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.603876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.604626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.605104 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.605553 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.741820 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:34.750053 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8b9cfbd5-3460-48f8-b864-c1a602e1aa77 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1562 microversion: 2.1 time: 0.160414 Nov 02 13:52:34.750630 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4249/8186] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:52:34 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:23.378274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=7 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:23.379158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=23 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:23.380705 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=7 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:23.382186 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=22 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:23.385158 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:23.385668 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:23.395530 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.396288 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.396511 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.398034 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.398497 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.398938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.426354 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:54:23.511498 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:23.521147 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.521671 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.522668 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.534285 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] Creating event network-changed:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h2-855649-4 Nov 02 13:54:23.540583 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ee39989d-9d84-434e-9e2f-b3b8e9c3de46 req-6cfa29aa-698a-4701-adfd-8cc80397c113 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161512 Nov 02 13:54:23.545779 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4250/8187] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:23.773444 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-1f8ff181-0dfc-4b9d-a0d8-d0cf3f9b35c1 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 204 len: 0 microversion: 2.1 time: 0.396915 Nov 02 13:54:23.777543 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3938/8188] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 13:54:23 2022] DELETE /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:54:23.784421 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:23.786810 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:23.796455 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.797544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.798309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.799126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.799611 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.800297 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.937717 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:23.946766 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-0d668e88-fa8c-4fe3-a259-dff34e24120f tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.167135 Nov 02 13:54:23.947629 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4251/8189] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:23 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:24.971569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:24.972642 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:24.979782 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:24.980399 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:24.980938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:24.981726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:24.982434 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:24.983049 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:25.124512 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:25.135476 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-847ad627-e938-4206-8155-b81804ccdf2c tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1568 microversion: 2.1 time: 0.168788 Nov 02 13:54:25.136137 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3939/8190] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:24 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:25.997722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54a540b-df3f-438e-917d-42d473e4784d", "name": "network-vif-deleted", "tag": "dd710f91-b104-4d38-8fc3-9d1fe78b7754"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:26.008005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.008497 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.008945 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.020488 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] Creating event network-vif-deleted:dd710f91-b104-4d38-8fc3-9d1fe78b7754 for instance d54a540b-df3f-438e-917d-42d473e4784d on n-h2-855649-4 Nov 02 13:54:26.025814 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-c1e7771d-125d-4623-b06c-8476adefd73e req-1982bf16-77d9-4d64-802a-15ed6ae35fc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085979 Nov 02 13:54:26.026419 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4252/8191] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:26.158713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:26.160082 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:26.167003 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.167504 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.167942 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.168644 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.169095 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.169568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.235180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:26.244867 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-138b27f0-be30-4d38-bd25-74b3700d3916 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1219 microversion: 2.1 time: 0.089949 Nov 02 13:54:26.249798 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3940/8192] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:26 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:27.270454 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:27.271193 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:27.278823 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.279370 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.279837 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.280601 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.281082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.281541 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.350274 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:27.358595 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-4369be6b-090a-4a3a-b343-110609ce3222 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1219 microversion: 2.1 time: 0.093420 Nov 02 13:54:27.359207 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4253/8193] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:27 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:28.382627 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:28.383337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:28.390772 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:28.391443 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:28.392030 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.392840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:28.393299 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:28.393731 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.464983 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:28.474376 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-49efe586-7686-4bf4-8ac6-3c7df542329a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1219 microversion: 2.1 time: 0.096166 Nov 02 13:54:28.475523 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3941/8194] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:28 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:29.500425 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:29.501098 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:29.508111 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:29.508621 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:29.509082 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:29.509829 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:29.510309 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:29.510758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:29.575733 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:29.584848 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-177c6984-b383-4206-97cd-487962d1a5f5 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1219 microversion: 2.1 time: 0.087825 Nov 02 13:54:29.585460 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4254/8195] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:29 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:30.608249 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:30.608880 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:30.615904 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:30.616402 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:30.616847 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:30.617579 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:30.618036 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:30.618472 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:30.690666 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05d3fc822c4be882546434c19d374f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a98de562bce47349656a4b64db5293d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:30.698464 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-79c54abd-e7dd-4646-b75e-cecf2880e004 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 200 len: 1219 microversion: 2.1 time: 0.094364 Nov 02 13:54:30.703764 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3942/8196] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:30 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:31.723422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:31.723963 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] [instance: d54a540b-df3f-438e-917d-42d473e4784d] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:31.731450 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.731953 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.732404 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.733158 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.733626 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.734062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.751415 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] HTTP exception thrown: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Request method failure captured: Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d HTTP/1.1 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnQAvYLicBmlhcaCcXL-USql3XfMefmq1H1hpKQzkTbTt6K-CAno2vFSSfSvVfGGxUHob_uMbOIosLUaQtBYlpBsQ6Ehrfpo3Q3jlARtM7kWQFE7e1pTMJVSU0m0UJV0tfQSyKZFk9in9OQ9_SV38ZVmMpLkSm3ekqSMc9Aj-J1QAF8 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 3a98de562bce47349656a4b64db5293d Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestShelveInstance-805925242 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a98de562bce47349656a4b64db5293d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a98de562bce47349656a4b64db5293d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a98de562bce47349656a4b64db5293d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a98de562bce47349656a4b64db5293d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestShelveInstance-805925242 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 3a98de562bce47349656a4b64db5293d Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestShelveInstance-805925242 Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestShelveInstance-805925242-project Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 6a05d3fc822c4be882546434c19d374f Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestShelveInstance-805925242-project Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'd54a540b-df3f-438e-917d-42d473e4784d'} Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:31.753106 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Returning 404 to user: Instance d54a540b-df3f-438e-917d-42d473e4784d could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-8995e204-2489-4dcc-b6e5-dce44ba239c3 tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d" status: 404 len: 111 microversion: 2.1 time: 0.035356 Nov 02 13:54:31.756549 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4255/8197] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:31 2022] GET /compute/v2.1/servers/d54a540b-df3f-438e-917d-42d473e4784d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:31.972889 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-fa200372-6060-4ad4-9f11-f7ddf887092a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] Calling method '.version_select at 0x7ff1b28a0670>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:32.059813 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-fa200372-6060-4ad4-9f11-f7ddf887092a tempest-TestShelveInstance-805925242 tempest-TestShelveInstance-805925242-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-284120859" status: 202 len: 0 microversion: 2.1 time: 0.091105 Nov 02 13:54:32.060421 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3943/8198] 10.222.0.48 () {58 vars in 1251 bytes} [Wed Nov 2 13:54:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-284120859 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:54:55.060725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=12 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:55.069276 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=24 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:55.300704 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-50cec061-78db-42f4-bfa4-0fc30d04a43d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Action: 'create', calling method: .version_select at 0x7ff1b2791c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1410257303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnjSP2z+nuJialpD8LabKS/Re8WRsXm1zz5E1V6jcRvIei2b3joXnIqAEWkLFedyVOZL32Ji7EPqIACgQosWl7aMOmbyFDe4UBSGPshhosc52WEwEiLyQeRQUlYx3Ymg=="}} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:55.321464 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-50cec061-78db-42f4-bfa4-0fc30d04a43d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:55.328458 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.quota [None req-50cec061-78db-42f4-bfa4-0fc30d04a43d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for user 6241a30bc8fb41b785c7029b8ecb6fe6 and project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'key_pairs'} {{(pid=127567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:55.436940 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-50cec061-78db-42f4-bfa4-0fc30d04a43d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.386532 Nov 02 13:54:55.437813 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4256/8199] 10.222.0.48 () {60 vars in 1159 bytes} [Wed Nov 2 13:54:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:54:57.894365 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:57.895177 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:57.899264 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-190345079", "imageRef": "2f72b382-4911-4efc-9bb2-e22b0b29c043", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1410257303", "security_groups": [{"name": "tempest-secgroup-smoke-489387543"}], "networks": [{"uuid": "3160bf0c-2afe-41a0-9534-0561d35f5a72"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:58.014126 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] validate_networks() for [('3160bf0c-2afe-41a0-9534-0561d35f5a72', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:58.430166 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:58.430698 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:58.431302 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:58.432310 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:58.432732 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:58.444864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.445453 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.445969 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.446786 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.447332 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.447767 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.469328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:58.475108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for user 6241a30bc8fb41b785c7029b8ecb6fe6 and project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:58.489156 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:58.491629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f72b382-4911-4efc-9bb2-e22b0b29c043',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:58.607393 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:54:59.615726 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [e0ae6403-4d4d-4d75-8efb-b8529a3a981d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56690. Nov 02 13:54:59.621237 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-a00b599c-a9b4-4b25-ada2-54ffebebb867 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.728580 Nov 02 13:54:59.629049 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3944/8200] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:54:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:54:59.635787 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-6c530bc7-2756-474b-a980-66bed45320c6 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:59.637046 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-6c530bc7-2756-474b-a980-66bed45320c6 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:59.694038 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-6c530bc7-2756-474b-a980-66bed45320c6 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:59.703813 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-6c530bc7-2756-474b-a980-66bed45320c6 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1248 microversion: 2.1 time: 0.073543 Nov 02 13:54:59.704432 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4257/8201] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:54:59 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:00.729224 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-684e2bad-2c6a-4e1a-8d23-f1088f61f2bc tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:00.729850 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-684e2bad-2c6a-4e1a-8d23-f1088f61f2bc tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:00.790256 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-684e2bad-2c6a-4e1a-8d23-f1088f61f2bc tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.797544 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-684e2bad-2c6a-4e1a-8d23-f1088f61f2bc tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1248 microversion: 2.1 time: 0.073960 Nov 02 13:55:00.798117 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3945/8202] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:00 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:01.820875 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.821520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.830723 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.831544 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.832331 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.833288 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.834225 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.834851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.904472 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:01.912397 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-fdf8799c-8a5a-458f-8b44-b1ce887bc2b0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1300 microversion: 2.1 time: 0.095790 Nov 02 13:55:01.912966 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4258/8203] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:01 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:02.937569 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:02.938215 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:02.945273 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.945800 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.946471 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.947216 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:02.947678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:02.948106 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.012932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:03.021022 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-0bb06989-ba64-4ce7-bda7-3d807f0afa4f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1306 microversion: 2.1 time: 0.087752 Nov 02 13:55:03.021602 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3946/8204] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:02 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:04.043900 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:04.044540 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.051746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.052413 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.052902 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.053709 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.054462 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.054711 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.200202 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:04.211734 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.212289 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.216200 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.228424 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] Creating event network-changed:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 13:55:04.233895 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-a79432e6-f401-47ce-a0ca-a9de9b9c8899 req-f7e0f069-6502-40bc-9e94-2ebc418f5742 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038023 Nov 02 13:55:04.237387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.237579 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3947/8205] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:55:04.247355 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b17d7858-8eb2-4040-8dac-033358b379bf tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.207345 Nov 02 13:55:04.248478 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4259/8206] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:04 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.273518 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.274371 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.282940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.282940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.282940 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.283965 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.284527 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.285057 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.435341 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.443675 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b9ed163c-ffc4-40cc-92db-aaead41744fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.175625 Nov 02 13:55:05.444351 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3948/8207] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:06.467690 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.468407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:06.475950 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.476466 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.476933 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.477679 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.478178 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.478618 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.621958 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:06.630651 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-23628140-9775-44fd-bd1c-7e124a2d1ce5 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.167037 Nov 02 13:55:06.631290 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4260/8208] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:06 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:07.654720 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:07.655376 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:07.662235 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.662726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.663201 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.663916 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.664368 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.664801 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.808515 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.816462 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4db4a75c-52ea-4394-a741-bf1117e0c9ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.166221 Nov 02 13:55:07.817410 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3949/8209] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:07 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:08.840358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:08.840999 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:08.848064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.848573 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.849034 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.849758 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.850234 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.850685 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.991674 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.000643 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b996fc62-41c9-4ca1-9c62-f246d0260f67 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.164834 Nov 02 13:55:09.001251 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4261/8210] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:08 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:09.940996 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:09.999190 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "name": "network-vif-plugged", "status": "completed", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:10.008802 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.010517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.010517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.023946 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.024506 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] Creating event network-vif-plugged:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 13:55:10.024608 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:10.026447 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=6 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:10.029527 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-044b7df7-6c97-4530-8e08-a3cec00af07a req-d628fc89-26b7-4dce-9fd8-c0cde5af9937 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094976 Nov 02 13:55:10.030325 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3950/8211] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:10.034278 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.034781 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.035372 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.036095 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.036581 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.037029 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.264323 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.272151 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-156923cc-3d8f-4c0a-a432-4cb1a1d9ec3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.252439 Nov 02 13:55:10.272736 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4262/8212] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:11.292505 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:11.298287 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.300307 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:11.306706 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.307239 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.307686 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.308612 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.309078 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.309509 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.450781 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:11.458770 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-5355b1e1-744b-40db-9775-7365f82a6fc2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1373 microversion: 2.1 time: 0.167397 Nov 02 13:55:11.459385 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3951/8213] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:11 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:12.481972 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:12.482612 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:12.489760 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.490266 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.490725 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.491492 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.491952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.492398 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.627689 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:12.636044 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-05766dea-c694-4f85-a9c2-889485241171 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1559 microversion: 2.1 time: 0.158184 Nov 02 13:55:12.636657 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4263/8214] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:12 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:12.658193 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:12.658816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:12.665647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.666678 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.667162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.667864 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:12.668325 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:12.668758 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.800922 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:12.809390 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-372e66fd-762d-47f2-b1a2-79766fc3fc5c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1559 microversion: 2.1 time: 0.155108 Nov 02 13:55:12.809984 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3952/8215] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:55:12 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.921800 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:14.929386 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.930161 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.930684 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.945443 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] Creating event network-changed:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 13:55:14.952592 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-89dfb3f1-ed7c-4633-b302-4d005bf668dc req-98aa74a1-0fc2-49ab-a7fb-25a5749ceef1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039670 Nov 02 13:55:14.953247 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4264/8216] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:09.217604 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:57:09.218512 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 13:57:09.219107 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:09.219872 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=36 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:09.220832 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:57:09.220962 n-d-855649-4 devstack@n-api.service[127568]: Wed Nov 2 13:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2/action (ip 10.222.0.48) !!! Nov 02 13:57:09.226068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-557708590"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:09.228446 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:09.235635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:09.236124 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:09.237092 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:09.239291 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:09.240100 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:09.240818 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:09.808189 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-68cf8f86-d990-4569-a7d0-749b65c235df tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "POST /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2/action" status: 202 len: 0 microversion: 2.1 time: 0.592228 Nov 02 13:57:09.809128 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3953/8217] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:57:09 2022] POST /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 13:57:16.473533 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:57:16.475080 n-d-855649-4 devstack@n-api.service[127567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:57:16.476003 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:16.477686 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=38 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:16.478812 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:57:16.479214 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:57:16.482818 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:57:16.483299 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 13:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 13:57:16.497510 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "name": "network-vif-plugged", "status": "completed", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:16.513500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:16.514157 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:16.514622 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:16.526603 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] Creating event network-vif-plugged:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 13:57:16.532043 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d71dc9d1-364c-48c2-a616-c18eca4ee020 req-0fd9b1a9-a38e-4e34-9f57-8a63dff4a481 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063314 Nov 02 13:57:16.533011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4265/8218] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:26.514517 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:26.515342 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:26.521075 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-252060464", "imageRef": "b052e312-eebe-4dd5-a8a7-bdf57e7b7d85", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1410257303", "security_groups": [{"name": "tempest-secgroup-smoke-489387543"}], "networks": [{"uuid": "3160bf0c-2afe-41a0-9534-0561d35f5a72"}]}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:26.546312 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [96f7bff1-0609-4a8d-bed5-7cddac4501b4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56950. Nov 02 13:57:26.547093 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b23da22-451b-4431-8ae4-4ce8d9b86425] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56948. Nov 02 13:57:26.635328 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.network.neutron [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] validate_networks() for [('3160bf0c-2afe-41a0-9534-0561d35f5a72', None, None, None, None, None)] {{(pid=127568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:27.082476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Flavor limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:27.082907 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Image limits 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:27.083430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Flavor pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:27.083848 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Image pref 0:0:0 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:27.084258 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.virt.hardware [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:27.093147 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.093633 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.094068 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.094791 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.095274 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.096010 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.113798 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:27.119885 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.quota [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Getting quotas for user 6241a30bc8fb41b785c7029b8ecb6fe6 and project 56f2bbaf05e04fc0b99940c20b3d4868. Resources: {'ram', 'instances', 'cores'} {{(pid=127568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:27.132404 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Going to run 1 instances... {{(pid=127568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:27.135184 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b052e312-eebe-4dd5-a8a7-bdf57e7b7d85',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:27.269090 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-45284dc1-9eed-478f-ab8b-40bff6cc39a3 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756591 Nov 02 13:57:27.269769 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3954/8219] 10.222.0.48 () {60 vars in 1147 bytes} [Wed Nov 2 13:57:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:57:27.282202 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-922e0484-13da-45ff-b7f3-c55246b3e6c0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:27.282922 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-922e0484-13da-45ff-b7f3-c55246b3e6c0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:27.311004 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7124583-bf7d-4371-8dc9-99ad55637547] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56972. Nov 02 13:57:27.314938 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] [b297b9b2-a7a1-42f3-8116-911542b9dbe7] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56970. Nov 02 13:57:27.415975 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-922e0484-13da-45ff-b7f3-c55246b3e6c0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:27.422970 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-922e0484-13da-45ff-b7f3-c55246b3e6c0 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1248 microversion: 2.1 time: 0.145107 Nov 02 13:57:27.423661 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4266/8220] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:27 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1248 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:28.447629 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-b4c1bc54-be35-4a9f-9b58-aa5068570555 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:28.448206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-b4c1bc54-be35-4a9f-9b58-aa5068570555 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:28.504018 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-b4c1bc54-be35-4a9f-9b58-aa5068570555 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:28.511481 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-b4c1bc54-be35-4a9f-9b58-aa5068570555 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1248 microversion: 2.1 time: 0.069319 Nov 02 13:57:28.512056 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3955/8221] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:28 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1248 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:29.533952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:29.534595 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:29.542520 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.543044 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.543500 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.544212 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.544682 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.545126 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.612558 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.621158 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cfc431f4-25fb-4ee1-b037-776d069cd7f4 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1300 microversion: 2.1 time: 0.091172 Nov 02 13:57:29.621743 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4267/8222] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:29 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:30.495084 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "name": "network-vif-unplugged", "status": "completed", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:30.508162 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.508640 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.509271 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.521315 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] Creating event network-vif-unplugged:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 13:57:30.526634 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-dbe0aa3c-2c47-49ec-b741-7bf1d948adde req-290c3e58-21a9-4dcb-9b9b-c6498342b9e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036920 Nov 02 13:57:30.527287 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3956/8223] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:30.650138 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:30.651465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:30.661470 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.662345 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.663314 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.671173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.671173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.671173 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.935629 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:30.946423 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-e624e7ce-6629-4e22-a3ae-1159bff968eb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.300982 Nov 02 13:57:30.949082 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4268/8224] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:30 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:31.975550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:31.977143 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:31.986077 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.986938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.987635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.988690 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.989395 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.990320 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.155651 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:32.164437 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-2c22889b-d75b-4b6b-94f2-616b7b0c53db tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.193969 Nov 02 13:57:32.165045 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3957/8225] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:31 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:33.189854 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:33.190525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.198471 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.199007 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.199465 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.200194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.200666 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.201118 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.375018 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.383754 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-987bf661-a631-49c0-8af2-bd34b5c0fbea tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.197891 Nov 02 13:57:33.384349 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4269/8226] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:33 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:34.406815 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:34.407564 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:34.426713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.427309 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.427938 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.428665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.429130 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.429789 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.585819 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:34.593855 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e90af7a8-7985-4f4f-9ee4-0c18d12cd665 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.190830 Nov 02 13:57:34.594437 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3958/8227] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:34 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:35.620025 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:35.620888 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:35.629536 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.630235 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.630955 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.631683 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.632183 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.632714 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.800427 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:35.813904 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-2d5b9fe5-2b35-4168-bb9f-edf98bef402c tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.197377 Nov 02 13:57:35.818878 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4270/8228] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:35 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:36.834383 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.886793 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.998615 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.006624 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-4e174b29-886f-487c-b72b-3e25e24e520b tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.176220 Nov 02 13:57:37.007401 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3959/8229] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:36 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:38.030221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:38.030880 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:38.033680 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell0:SELECT=2 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:38.038559 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.039109 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.039567 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.040283 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.040751 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.041201 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.192358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:38.201605 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-af67f91f-bbc2-4e11-9bad-53afb3728096 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.175237 Nov 02 13:57:38.202227 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4271/8230] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:38 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:39.226174 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:39.226779 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:39.228806 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:39.230426 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell0:SELECT=8 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:39.235416 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.238971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.238971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.238971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.238971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.238971 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.376382 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:39.384329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-147c5ec1-d5c6-48fe-90aa-73aad157bfdb tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.162701 Nov 02 13:57:39.384905 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3960/8231] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:39 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:40.407838 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:40.408467 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:40.415652 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.416155 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.416613 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.417360 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.417867 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.418310 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.552000 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:40.560568 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c1cd599e-c611-4931-b555-25ef0713bc72 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.156649 Nov 02 13:57:40.561164 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4272/8232] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:40 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:41.474333 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:41.484981 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.485364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.485910 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.498111 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] Creating event network-changed:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 13:57:41.503622 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-3eaf2771-2ed7-4c6e-8ceb-59d9d1e195d2 req-957e15de-a2d1-4106-90ae-97f158dab440 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033386 Nov 02 13:57:41.505637 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3961/8233] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:41.583221 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:41.584396 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:41.591249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.591784 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.592236 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.592949 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.593415 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.593851 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.734799 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.743210 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-810bb70e-5416-41c3-b016-7ec29363eb89 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.163678 Nov 02 13:57:41.743842 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4273/8234] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:41 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:42.767846 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:42.768557 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:42.775385 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.775877 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.776317 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.777016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.777476 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.777911 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.914561 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.922631 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-9035160d-92d1-4c45-8db5-7529e5942346 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.160027 Nov 02 13:57:42.923241 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3962/8235] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:42 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:43.946866 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:43.947521 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:43.954407 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.954904 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.955387 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.956097 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.956565 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.957005 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.088085 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.095899 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-bf15d1f7-8f88-4d34-a44f-a9ad50008ad9 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.153662 Nov 02 13:57:44.096473 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4274/8236] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:43 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:45.118849 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:45.119576 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:45.126417 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.126901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.127377 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.128080 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.128614 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.128972 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.266816 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:45.275198 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-e76a08ea-4a88-483d-898a-35b559cdbd3e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.160530 Nov 02 13:57:45.275794 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3963/8237] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:45 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.298409 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.299092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.306562 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.307084 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.307538 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.308254 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.308722 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.309162 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.444062 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.455925 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-74775e3a-c46b-4e67-876d-a9118d71df73 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.161432 Nov 02 13:57:46.456546 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4275/8238] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:47.478110 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:47.478726 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:47.485546 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.486027 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.486466 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.487194 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.487648 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.488072 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.624583 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.632647 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8e8b3181-77da-4503-9dd8-e0087d555b49 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.158294 Nov 02 13:57:47.633831 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3964/8239] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:47 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:48.221767 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "name": "network-vif-plugged", "status": "completed", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:48.232813 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.233343 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.233796 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.245944 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] Creating event network-vif-plugged:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 13:57:48.251083 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d4989897-a746-4b57-9cca-f02a2b8bed4e req-84fd801c-56f8-42cb-86c9-e832f85b50f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Nov 02 13:57:48.251693 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4276/8240] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:48.656337 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.656964 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.664574 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.665061 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.665506 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.666206 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.666665 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.667189 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.799444 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.807264 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-403bed99-9796-4c67-b2b0-4377d1f94e28 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1373 microversion: 2.1 time: 0.154731 Nov 02 13:57:48.807867 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3965/8241] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:49.832593 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:49.833369 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.840351 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.845463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.845463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.845463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.845463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.845463 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.985856 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.993969 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-111fecfd-6095-44e9-943d-7930fdda3b4d tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1558 microversion: 2.1 time: 0.166757 Nov 02 13:57:49.994550 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4277/8242] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:49 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:50.016759 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.017389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.025176 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.025721 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.026197 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.026932 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.027421 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.027852 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.475886 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:50.483884 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-15ee4a47-9738-4232-9de3-719b53730c36 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1558 microversion: 2.1 time: 0.471423 Nov 02 13:57:50.484461 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3966/8243] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 13:57:50 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1558 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:52.553917 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:52.565249 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.571632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.571632 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.577706 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] Creating event network-changed:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 13:57:52.583786 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-b013b177-064c-490d-9ba9-baaa67c3f0c2 req-13ef57ad-00fb-4aea-af84-2bf8e23a5f35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033338 Nov 02 13:57:52.584416 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4278/8244] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 13:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:52.834346 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:52.835185 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=60 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:52.840259 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1685962831"}} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:52.842607 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:52.849635 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.850131 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.850584 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:52.851430 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:52.851925 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:52.852364 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:53.270273 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-dfdb2690-3ae8-44ff-ae36-09f4438893ec tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "POST /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f/action" status: 202 len: 0 microversion: 2.1 time: 0.437806 Nov 02 13:59:53.271022 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3967/8245] 10.222.0.48 () {60 vars in 1278 bytes} [Wed Nov 2 13:59:52 2022] POST /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 14:00:00.792362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_api:SELECT=30 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:00.792362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG dbcounter [-] [127567] Writing DB stats nova_cell1:SELECT=66 {{(pid=127567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:00.792362 n-d-855649-4 devstack@n-api.service[127567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:00:00.792362 n-d-855649-4 devstack@n-api.service[127567]: Wed Nov 2 14:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Nov 02 14:00:00.792362 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "name": "network-vif-plugged", "status": "completed", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:00.793255 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:00.793746 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:00.794187 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:00.806049 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] Creating event network-vif-plugged:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 14:00:00.812310 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-ca2f7681-e57b-459d-acd9-4ca567bcaef8 req-db192008-c50e-4674-81e2-f0cbcb1bfefa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041775 Nov 02 14:00:00.812982 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4279/8246] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:15.269073 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_api:SELECT=2 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:15.269855 n-d-855649-4 devstack@n-api.service[127568]: DEBUG dbcounter [-] [127568] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:15.274653 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:15.275412 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.284349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.284349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.284349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.284349 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.284840 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.285553 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.324545 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Going to try to terminate instance {{(pid=127568) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:15.384342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:15.394965 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.395572 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.396087 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.409750 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.compute.server_external_events [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] Creating event network-changed:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 14:00:15.415661 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [req-d6492835-9ced-4be6-8c1a-6fd0d2c44d32 req-e9f9035c-b36e-4dd9-b0c0-b70947b5343c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131968 Nov 02 14:00:15.416567 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4280/8247] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:15.808204 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-8369502f-3ebc-4c4e-9adb-2fc20b8123bd tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 204 len: 0 microversion: 2.1 time: 0.540928 Nov 02 14:00:15.809518 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3968/8248] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:15 2022] DELETE /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:15.819694 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:15.820422 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.826890 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.827434 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.827881 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.828619 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.829092 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.829537 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.973039 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:15.981606 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-c6ce0632-a1f1-410b-8c53-23b731987ca7 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1564 microversion: 2.1 time: 0.167133 Nov 02 14:00:15.982381 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4281/8249] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:15 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.831112 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:16.842137 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.842713 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.843279 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.857329 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] Creating event network-vif-unplugged:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 14:00:16.863383 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-cb7524e4-1a7f-4dbe-b832-22d80824afd5 req-ec919bc2-ab90-4e15-bdbe-00ce3399ee8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087366 Nov 02 14:00:16.864086 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3969/8250] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:17.006617 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:17.007393 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:17.014381 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.014876 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.015358 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.016073 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.016542 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.016983 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.156809 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:17.165492 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-9fe261ff-31b6-4895-beb4-b4948d1d41fa tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1564 microversion: 2.1 time: 0.163012 Nov 02 14:00:17.166134 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4282/8251] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:17 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:18.116730 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13211ea-0a53-4f64-bd9b-a6258d6b0f8f", "name": "network-vif-deleted", "tag": "4fe597cf-5708-4829-bd6a-c2c48a35a1de"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:18.126657 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.127180 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.127623 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.139842 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] Creating event network-vif-deleted:4fe597cf-5708-4829-bd6a-c2c48a35a1de for instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f on n-h2-855649-4 Nov 02 14:00:18.144774 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-02bb0f76-1f92-4147-87f9-5a8b523e2541 req-f653cf72-d936-4b49-ae26-86d0691ab600 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Nov 02 14:00:18.145377 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3970/8252] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:00:18.188777 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:18.189474 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:18.197840 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.198361 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.198822 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.199584 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.200064 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.200508 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.266342 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:18.274480 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-b4292ec8-cfac-4dbd-b7cf-15ef306d3fd2 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 200 len: 1497 microversion: 2.1 time: 0.089691 Nov 02 14:00:18.275011 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4283/8253] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:18 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 1497 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:19.300315 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:19.301389 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: c13211ea-0a53-4f64-bd9b-a6258d6b0f8f] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:19.307458 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.307951 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.308397 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.309108 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.309568 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.310006 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.324196 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.wsgi [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] HTTP exception thrown: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Request method failure captured: Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: request: GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f HTTP/1.1 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Accept: application/json Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Accept-Encoding: identity Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Connection: close Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Content-Length: 0 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Content-Type: application/json Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Host: 10.222.0.48 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: Openstack-System-Scope: None Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Auth-Token: gAAAAABjYnaoMRjXx6YfAa2BrAytpvt-x3E-tSfEsKe3ImKO5QxGvhXjvh5S3tQC8UHdvr5AHoGssDFxjSVtzUoiPyA2cC2JJJouATMIboVSWODgzmmngG6BibQApI-PnH-9Djo3n4Jmo9qxxC9NpDr8DdLyx9blWgLZRTPWHZwtAPq3_ia8CIo Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Id: None Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Domain-Name: None Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Identity-Status: Confirmed Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Is-Admin-Project: True Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Id: default Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Domain-Name: Default Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Id: 56f2bbaf05e04fc0b99940c20b3d4868 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Project-Name: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Role: reader,member Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Roles: reader,member Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f2bbaf05e04fc0b99940c20b3d4868", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Id: 56f2bbaf05e04fc0b99940c20b3d4868 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-Tenant-Name: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-User: tempest-TestSnapshotPattern-234166743-project Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Id: default Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-User-Domain-Name: Default Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-User-Id: 6241a30bc8fb41b785c7029b8ecb6fe6 Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: X-User-Name: tempest-TestSnapshotPattern-234166743-project Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: method: > Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: exception: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: action_args: {'id': 'c13211ea-0a53-4f64-bd9b-a6258d6b0f8f'} Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:19.325887 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: ERROR nova.api.openstack.wsgi Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Returning 404 to user: Instance c13211ea-0a53-4f64-bd9b-a6258d6b0f8f could not be found. {{(pid=127568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-ecb9604e-0c3f-4678-b5fa-454b0bcd251a tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f" status: 404 len: 111 microversion: 2.1 time: 0.032386 Nov 02 14:00:19.330647 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3971/8254] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:19 2022] GET /compute/v2.1/servers/c13211ea-0a53-4f64-bd9b-a6258d6b0f8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:22.067209 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:22.067905 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:22.073286 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:22.075525 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.076172 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.076732 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.077560 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.078321 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.079356 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.087187 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.087785 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.088379 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.102951 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] Creating event network-changed:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 14:00:22.108975 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-d9c6d08b-258c-48b8-a6c3-2a9f7374d765 req-afc142e9-6f65-4cd8-a5ea-be819f65a72d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040712 Nov 02 14:00:22.109169 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Going to try to terminate instance {{(pid=127567) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:22.109774 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3972/8255] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:00:22.424841 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-d17fb943-055e-4e12-8f08-7bf48703063e tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 204 len: 0 microversion: 2.1 time: 0.361615 Nov 02 14:00:22.425632 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4284/8256] 10.222.0.48 () {58 vars in 1239 bytes} [Wed Nov 2 14:00:22 2022] DELETE /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:22.436525 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:22.437344 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.compute.api [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127568) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:22.444550 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.445135 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.445658 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.447262 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:22.447831 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:22.448359 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:22.602000 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.policy [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127568) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:22.610147 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-eb462a7f-0c99-4b16-883e-c498be3d3cce tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1683 microversion: 2.1 time: 0.179037 Nov 02 14:00:22.610748 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3973/8257] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:22 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:23.634697 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:23.635453 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:23.643635 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.644490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.645395 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.646550 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.647194 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.647771 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.717740 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.policy [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6241a30bc8fb41b785c7029b8ecb6fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f2bbaf05e04fc0b99940c20b3d4868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127567) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:23.725083 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2", "name": "network-vif-deleted", "tag": "16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d"}]} {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:23.727304 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-cc1a5d4d-84ac-4921-b8b5-c01290f34d35 tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 200 len: 1498 microversion: 2.1 time: 0.097014 Nov 02 14:00:23.727992 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4285/8258] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:23 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 1498 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:23.735956 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:23.736468 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:23.736901 n-d-855649-4 devstack@n-api.service[127568]: DEBUG oslo_concurrency.lockutils [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:23.750400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.compute.server_external_events [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] Creating event network-vif-deleted:16564b3e-f15e-4e2d-8ec8-f85f8c8e4a7d for instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 on n-h1-855649-4 Nov 02 14:00:23.756400 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [req-e681d52b-cac9-402b-a766-7f49f1b4b664 req-d469238a-e9a1-4e85-b899-6b63bc8df7f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095904 Nov 02 14:00:23.757169 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3974/8259] 10.222.0.48 () {64 vars in 1317 bytes} [Wed Nov 2 14:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:24.751845 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '>' {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:24.752479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.compute.api [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [instance: b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2] Fetching instance by UUID {{(pid=127567) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:24.761490 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:24.761998 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:24.762659 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:24.763952 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Acquiring lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:24.764479 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:24.765440 n-d-855649-4 devstack@n-api.service[127567]: DEBUG oslo_concurrency.lockutils [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Lock "6188fd48-dbf5-4478-9768-9058e0ca7da6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:24.779664 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.wsgi [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] HTTP exception thrown: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Request method failure captured: Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: request: GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 HTTP/1.1 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Accept: application/json Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Accept-Encoding: identity Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Connection: close Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Content-Length: 0 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Content-Type: application/json Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Host: 10.222.0.48 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: Openstack-System-Scope: None Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Auth-Token: gAAAAABjYnaoMRjXx6YfAa2BrAytpvt-x3E-tSfEsKe3ImKO5QxGvhXjvh5S3tQC8UHdvr5AHoGssDFxjSVtzUoiPyA2cC2JJJouATMIboVSWODgzmmngG6BibQApI-PnH-9Djo3n4Jmo9qxxC9NpDr8DdLyx9blWgLZRTPWHZwtAPq3_ia8CIo Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Id: None Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Domain-Name: None Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Identity-Status: Confirmed Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Is-Admin-Project: True Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Id: default Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Domain-Name: Default Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Id: 56f2bbaf05e04fc0b99940c20b3d4868 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Project-Name: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Role: reader,member Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Roles: reader,member Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f2bbaf05e04fc0b99940c20b3d4868", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f2bbaf05e04fc0b99940c20b3d4868"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}] Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Id: 56f2bbaf05e04fc0b99940c20b3d4868 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-Tenant-Name: tempest-TestSnapshotPattern-234166743 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-User: tempest-TestSnapshotPattern-234166743-project Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Id: default Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-User-Domain-Name: Default Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-User-Id: 6241a30bc8fb41b785c7029b8ecb6fe6 Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: X-User-Name: tempest-TestSnapshotPattern-234166743-project Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: method: > Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: exception: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: action_args: {'id': 'b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2'} Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: {{(pid=127567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:24.781728 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: ERROR nova.api.openstack.wsgi Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: DEBUG nova.api.openstack.wsgi [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Returning 404 to user: Instance b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 could not be found. {{(pid=127567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: INFO nova.api.openstack.requestlog [None req-29c872e9-6083-4a0c-8d1a-71a1481da89f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2" status: 404 len: 111 microversion: 2.1 time: 0.035372 Nov 02 14:00:24.786120 n-d-855649-4 devstack@n-api.service[127567]: [pid: 127567|app: 0|req: 4286/8260] 10.222.0.48 () {58 vars in 1236 bytes} [Wed Nov 2 14:00:24 2022] GET /compute/v2.1/servers/b2294aea-fcd8-4a51-a1c9-4fe76fdc11e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:25.028016 n-d-855649-4 devstack@n-api.service[127568]: DEBUG nova.api.openstack.wsgi [None req-01bf04a9-f96d-4a44-bf54-f3c4ce18156f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] Calling method '.version_select at 0x7ff1b2179040>' {{(pid=127568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:25.032770 n-d-855649-4 devstack@n-api.service[127568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01bf04a9-f96d-4a44-bf54-f3c4ce18156f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [35410c4b-2984-45e0-83e3-fe9321837394] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:00:26.038867 n-d-855649-4 devstack@n-api.service[127568]: INFO oslo.messaging._drivers.impl_rabbit [None req-01bf04a9-f96d-4a44-bf54-f3c4ce18156f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] [35410c4b-2984-45e0-83e3-fe9321837394] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57402. Nov 02 14:00:26.125126 n-d-855649-4 devstack@n-api.service[127568]: INFO nova.api.openstack.requestlog [None req-01bf04a9-f96d-4a44-bf54-f3c4ce18156f tempest-TestSnapshotPattern-234166743 tempest-TestSnapshotPattern-234166743-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1410257303" status: 202 len: 0 microversion: 2.1 time: 1.102448 Nov 02 14:00:26.125723 n-d-855649-4 devstack@n-api.service[127568]: [pid: 127568|app: 0|req: 3975/8261] 10.222.0.48 () {58 vars in 1257 bytes} [Wed Nov 2 14:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1410257303 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)